The Register® — Biting the hand that feeds IT

Feeds

Internet Archive serves up 1.4 million BitTorrent downloads

Nearly a petabyte of public domain data

Regcast training : Hyper-V 3.0, VM high availability and disaster recovery

The Internet Archive, a non-profit online library dedicated to the permanent preservation of information in digital form, has made nearly a petabyte of materials available via the controversial BitTorrent peer-to-peer file sharing protocol.

For the project's launch on Tuesday, founder Brewster Kahle announced that the Internet Archive was hosting more than a million torrents, the small files that point to data accessible by BitTorrent clients. The collection has grown since then, and now comprises nearly 1.5 million torrents.

The majority of those torrents – more than one million – point to digitized books, while the others point to audio and video files.

Although BitTorrent has become a popular method of distributing large file collections, such as Linux distributions, historically it has more often been associated with illicit sharing of copyrighted content. According to the Internet Archive, however, all of the material available in its BitTorrent collection is in the public domain.

"The Archive is helping people to understand that BitTorrent isn't just for ephemeral or dodgy items that disappear from view in a short time," John Gilmore, founder of the Electronic Frontier Foundation, said in the announcement. "BitTorrent is a great way to get and share large files that are permanently available from libraries like the Internet Archive."

Unlike many BitTorrent sites, such as the Pirate Bay, which only host torrent files but not the actual digital content they point to, the Internet Archive is also hosting all of the original content for which it makes torrents available.

That means BitTorrent is now the fastest way to download files from the Internet Archive, Kahle says, because the distributed nature of the BitTorrent protocol allows clients to download data from two of the Archive's servers at once, housed in two separate data centers.

Kahle says the peer-to-peer protocol should also make downloads more reliable from locations with slower connectivity to the Archive's servers, including outside the United States. ®

Cloud storage: Lower cost and increase uptime

Sensible decision

It's no use spending lots and lots of money on http and ftp distribution. Bittorrent is so much quicker and faster for the user than the usual solution, at least for files where the download takes longer than a minute or so.

16
0

Re: Sensible decision

...not to mention that you're cross-downloading from other torrent users so there's a couple of quid saved on bandwidth for the host of the downloads.

12
0

A visit in the offing?

How long before The Internet Archive gets a visit from an armed tactical response group a la Mr Kim Dotcom?

12
1

More from The Register

Thanks, NSA: Amazon sales of Orwell's 1984 rise 9,500%
Citizens of Oceania bone up on the new reality
 breaking news
BBC lied to Parliament about doomed £100m IT monster, thunder MPs
Axed DMI ballooned and burst while watchdogs sang Kumbaya
Microsoft to open Windows Stores inside 600 Best Buy locations
Product showcases 'must be seen to be believed'
 breaking news
Author Iain (M) Banks falls to cancer at 59
Misses the release of his final work
 breaking news
What did the Lehman Brothers implosion look like to a techie?
Insider tells all about the Gnab Gib at Lehmans
It's official: 'tweet' an English word – not just in the avian sense
If the Oxford English Dictionary says it is so, then it is so
 breaking news
The only Waze is Google: Ad giant tipped to gobble map app 'for $1.3bn'
Pac-Man-satnav-ish upstart in bidding war with Apple, Facebook
 breaking news
1-in-10 e-tomes 'are self-published'... most are 'rubbish' says book ed
Publishing man scoffs at go-it-alone writers, ursines still fouling in forests
 breaking news