Repeated crawls / snapshots

14 datasets whose data is: repeated crawls / snapshots. Computed from the tables of each dataset's ECHO Data Package.

14 datasets.

YouTube SFU Crawls 2007-2008 (Collection) Limited

Repeated crawls of YouTube made in 2007 and 2008 by Xu Cheng, Cameron Dale and Jiangchuan Liu of Simon Fraser University, as published on the data page of the university's Network Systems Group. There are 94 breadth-first crawls of YouTube's lists of related videos, 35 started between 22 February and 18 May 2007 and 59 between 27 March and 28 July 2008. Each starts from a set of seed videos and follows each video's list of related videos down to depth 3 (to depth 4 in the first crawl, to depth 2 in 2007-0302). The package holds one record for each video a crawl visited (8,490,464 records; uploader, age, category, length, number of views, average rating, number of ratings and number of comments) and one directed link for each entry in a visited video's list of related videos (129,437,347 links, with the position in the list as rank), all marked with the crawl they come from. It also holds 28 update crawls (4,623,189 records with the views, rating, number of ratings and number of comments of videos already seen; 7 in 2007 and 21 in 2008), the video file sizes and bitrates measured in three further crawls (552,647 records), and a table that describes each of the 126 crawls from its log.

8.5M records2008

Fedivertex: mastodon federation Analyzed

The Mastodon federation graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 5 February 2025 and 15 July 2025. In the upstream documentation this is a federation graph: if two instances know each other they are connected, and the graph corresponds to the undirected communication graph between instances. The package holds 424,844,278 links, each with the snapshot it was seen in, and 166,411 instance records (8,953 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `statuses`, `languages`, `registration_enabled`). A snapshot lists between 6,477 and 7,302 instances and between 16,001,803 and 18,845,951 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Mastodon federation series only.

9K records9K nodes16.1M edges2026

Fedivertex: mastodon active_user Analyzed

The Mastodon active-user graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 5 February 2025 and 15 July 2025. In the upstream documentation this is an active-user graph: for each instance the 10,000 most recently active users are considered; for each of them, the accounts they follow are listed and 1 is added to the edge from X to Y, where X is the instance of the user and Y the instance of the followed account, so the weight of the edge from X to Y encodes how much of the content seen on X is generated on Y; the graph is directed and contains self-loops. The package holds 12,811,937 links, each with the snapshot it was seen in, and 160,468 instance records (8,135 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `statuses`, `languages`, `registration_enabled`). A snapshot lists between 6,185 and 7,142 instances and between 490,701 and 560,299 links. Edge weights are whole numbers from 1 to 548,292 (15,034 distinct values). Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Mastodon active-user series only.

8.1K records8.1K nodes647.8K edges2026

Fedivertex: peertube follow Analyzed

The PeerTube follow graph of the Fediverse as crawled by the Fedivertex project: 62 snapshots taken between 3 February 2025 and 13 April 2026. In the upstream documentation this is a follow graph: an instance X can follow an instance Y to let its users see all the videos posted on Y; the graph is directed, with edges of weight 1 for following. The package holds 1,038,682 links, each with the snapshot it was seen in, and 64,677 instance records (2,356 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`totalUsers`, `totalDailyActiveUsers`, `totalWeeklyActiveUsers`, `totalMonthlyActiveUsers`, `totalLocalVideos`, `totalVideos`, `totalLocalPlaylists`, `totalVideoComments`, `totalLocalVideoComments`, `totalLocalVideoViews`, `serverVersion`, `totalInstanceFollowers`, `totalPeertubeInstanceFollowers`, `totalInstanceFollowing`, `totalPeertubeInstanceFollowing`, `categories`, `languages`, `error`). A snapshot lists between 836 and 1,756 instances and between 10,067 and 49,104 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the PeerTube follow series only.

2.4K records2.4K nodes88.6K edges2026

Fedivertex: misskey federation Analyzed

The Misskey federation graph of the Fediverse as crawled by the Fedivertex project: 60 snapshots taken between 3 February 2025 and 13 April 2026. In the upstream documentation this is a federation graph: if two instances know each other they are connected, and the graph corresponds to the undirected communication graph between instances. The package holds 10,357,631 links, each with the snapshot it was seen in, and 53,129 instance records (1,765 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`users_count`, `posts_count`, `languages`, `description_language`, `error`). A snapshot lists between 814 and 1,116 instances and between 145,105 and 243,373 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Misskey federation series only.

1.8K records1.8K nodes360.3K edges2026

Fedivertex: misskey active_user Analyzed

The Misskey active-user graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 3 February 2025 and 15 July 2025. In the upstream documentation this is an active-user graph: for each instance the 10,000 most recently active users are considered; for each of them, the accounts they follow are listed and 1 is added to the edge from X to Y, where X is the instance of the user and Y the instance of the followed account, so the weight of the edge from X to Y encodes how much of the content seen on X is generated on Y; the graph is directed and contains self-loops. The package holds 274,652 links, each with the snapshot it was seen in, and 21,425 instance records (1,274 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`users_count`, `posts_count`, `languages`, `description_language`). A snapshot lists between 841 and 982 instances and between 9,999 and 12,894 links. Edge weights are whole numbers from 1 to 872,529 (2,619 distinct values). Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Misskey active-user series only.

1.3K records1.3K nodes19.5K edges2026

Fedivertex: pleroma federation Analyzed

The Pleroma federation graph of the Fediverse as crawled by the Fedivertex project: 61 snapshots taken between 3 February 2025 and 13 April 2026. In the upstream documentation this is a federation graph: if two instances know each other they are connected, and the graph corresponds to the undirected communication graph between instances. The package holds 7,531,914 links, each with the snapshot it was seen in, and 34,579 instance records (1,170 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `statuses`, `languages`, `registration_enabled`, `error`). A snapshot lists between 445 and 755 instances and between 77,681 and 181,907 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Pleroma federation series only.

1.2K records1.2K nodes185.9K edges2026

Fedivertex: pleroma active_user Analyzed

The Pleroma active-user graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 3 February 2025 and 15 July 2025. In the upstream documentation this is an active-user graph: for each instance the 10,000 most recently active users are considered; for each of them, the accounts they follow are listed and 1 is added to the edge from X to Y, where X is the instance of the user and Y the instance of the followed account, so the weight of the edge from X to Y encodes how much of the content seen on X is generated on Y; the graph is directed and contains self-loops. The package holds 30,207 links, each with the snapshot it was seen in, and 14,538 instance records (821 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `statuses`, `languages`, `registration_enabled`). A snapshot lists between 540 and 709 instances and between 1,161 and 1,365 links. Edge weights are whole numbers from 1 to 14,259 (209 distinct values). Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Pleroma active-user series only.

821 records821 nodes1.8K edges2026

Fedivertex: lemmy federation Analyzed

The Lemmy federation graph of the Fediverse as crawled by the Fedivertex project: 62 snapshots taken between 3 February 2025 and 13 April 2026. In the upstream documentation this is a federation graph: if two instances know each other they are connected, and the graph corresponds to the undirected communication graph between instances. The package holds 5,633,796 links, each with the snapshot it was seen in, and 22,651 instance records (779 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `posts`, `comments`, `communities`, `users_active_day`, `users_active_week`, `users_active_month`, `users_active_half_year`, `captcha_enabled`, `require_email_verification`, `description_language`, `error`). A snapshot lists between 290 and 442 instances and between 53,985 and 141,277 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Lemmy federation series only.

779 records779 nodes166.1K edges2026

Fedivertex: lemmy federation_with_blocks Analyzed

The Lemmy federation-with-blocks graph of the Fediverse as crawled by the Fedivertex project: 62 snapshots taken between 3 February 2025 and 13 April 2026. In the upstream documentation this is a federation graph completed with negative edges when instance X blocks instance Y; the graph is directed. The package holds 5,641,052 links, each with the snapshot it was seen in, and 22,621 instance records (779 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `posts`, `comments`, `communities`, `users_active_day`, `users_active_week`, `users_active_month`, `users_active_half_year`, `captcha_enabled`, `require_email_verification`, `description_language`, `error`). A snapshot lists between 291 and 439 instances and between 54,200 and 141,669 links. Edge weights are +1 (5,620,855 links) or -1 (20,197 links, the blocks), and the `sign` column repeats them as integers. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Lemmy federation-with-blocks series only.

779 records779 nodes289.5K edges2026

Fedivertex: friendica federation Analyzed

The Friendica federation graph of the Fediverse as crawled by the Fedivertex project: 59 snapshots taken between 3 February 2025 and 14 April 2026. In the upstream documentation this is a federation graph: if two instances know each other they are connected, and the graph corresponds to the undirected communication graph between instances. The package holds 2,158,557 links, each with the snapshot it was seen in, and 14,926 instance records (594 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `statuses`, `registration_enabled`, `error`). A snapshot lists between 214 and 364 instances and between 29,852 and 67,199 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Friendica federation series only.

594 records594 nodes70.8K edges2026

Fedivertex: lemmy cross_instance Analyzed

The Lemmy cross-instance graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 3 February 2025 and 14 July 2025. In the upstream documentation this is a cross-instance graph: two instances are connected as soon as there exists a pair of users who published a message in the same thread, possibly on a third instance; an undirected graph, less sparse than the intra-instance graph. The package holds 99,867 links, each with the snapshot it was seen in, and 9,878 instance records (557 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `posts`, `comments`, `communities`, `users_active_day`, `users_active_week`, `users_active_month`, `users_active_half_year`, `captcha_enabled`, `require_email_verification`, `description_language`). A snapshot lists between 362 and 439 instances and between 3,244 and 5,246 links. Edge weights are whole numbers from 1 to 1,719 (470 distinct values). Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared undirected. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Lemmy cross-instance series only.

557 records557 nodes4.7K edges2026

Fedivertex: lemmy intra_instance Analyzed

The Lemmy intra-instance graph of the Fediverse as crawled by the Fedivertex project: 24 snapshots taken between 3 February 2025 and 14 July 2025. In the upstream documentation this is an intra-instance graph: instance X is linked to instance Y if a user of X has published a message on instance Y; the graph is directed and very sparse. The package holds 24,692 links, each with the snapshot it was seen in, and 9,878 instance records (557 distinct instances; one record per instance per snapshot) with the attributes upstream recorded (`version`, `users`, `posts`, `comments`, `communities`, `users_active_day`, `users_active_week`, `users_active_month`, `users_active_half_year`, `captcha_enabled`, `require_email_verification`, `description_language`). A snapshot lists between 362 and 439 instances and between 797 and 1,133 links. Edge weights are whole numbers from 1 to 86,402 (1,102 distinct values). Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. The graph is declared directed. Fedivertex covers 13 such graph series (seven Fediverse software systems and several kinds of relation); this package is the Lemmy intra-instance series only.

557 records557 nodes2.4K edges2026

Fedivertex: bookwyrm federation Analyzed

The federation network of BookWyrm, the federated social network for reading and reviewing books, as crawled by the Fedivertex project: 62 snapshots of the network taken between 3 February 2025 and 13 April 2026. In the upstream documentation, two instances (servers) are connected in a federation graph if they know each other, and the graph is the undirected communication graph between instances. The package holds 171,615 links, each with the snapshot it was seen in, and 4,313 instance records (151 distinct instances; one record per instance per snapshot) with the software version, whether registration was enabled and, in 49 of the snapshots, the language of the instance's description. A snapshot lists between 55 and 103 instances and between 1,949 and 4,435 links. Every link has weight 1. Instance names are written with "[DOT]" in place of each dot, exactly as upstream published them. Fedivertex covers 13 such graphs (seven Fediverse software systems and several kinds of relation); this package is the BookWyrm federation graph only.

151 records151 nodes5K edges2026