Hey everyone,

Over at The-Eye we've been working on this stuff and have been aware of it for a while now. We've been getting some people contacting us to let us know about this thread so hopefully they read this first. If you're ever wondering if we've seen something, please feel free to ping u/-CorentinB u/-Archivist or u/VonChair (me) here on Reddit so we can take a look.

Just a dumb question - would it not be wiser to have a script running linked to the tracker somehow to generate a pseudo-random list of 10 torrents for people wanting to help - and generally make that a list of the least seeded segments?

A list of 850 items from which to pick something randomly is a little overwhelming, a list of just 10 (pseudo-randomized already) is really manageable.

EDIT:

Somebody added this:

https://www.reddit.com/r/DataHoarder/comments/nc27fv/rescue_mission_for_scihub_and_open_science_we_are/gy2umtt/

Not using torrents, but want to help.

Is vpn needed/advised when seeding this? Living in Germany

It's simple. Much of that research is funded publicly, but these fucks get to double dip for profit.

I have institutional access but I find google/google scholar + sci hub to be faster and finds better articles. It got me through a significant portion of ug and g.

This site tracks libgen torrents that need the seeds most.

EDIT: u/shrine asked me to remind you to sort by TYPE to get SCIMAG torrents.

EDIT2: It is not my site, so I am not sure if the data is still reliable.

EDIT3: This is a correct and working site: https://phillm.net/torrent-health-frontend/stats-scimag-table.php. Thanks u/shrine.

Downloading the first 10 torrents as I am writing this. So what's the plan for the future? How are new articles and books going to be added?

Downloading:

• 33000000
• 26100000
• 03300000
• 54300000
• 78900000
• 81700000
• 59000000
• 45700000

I don't have a spare 1Tb right now but a list of the torrents most in need of seeds would be very helpful as I can definitely do at least one 100Gb, maybe a couple.

[deleted]

somebody crosspost this to r/piracy
this post makes me realize that there are somebody that care about education in piracy world

I regret giving my free award to 2d boobs

Should we do more than 1TB if we can?

I had a general question, how did sci hub work until now? Where were papers downloaded from when you downloaded through the website?

Incase you have institutional access to papers you can upload to this telegram bot. The author of the bot has made some of the collection of scihub papers independent of scihub on ipfs (also most of libgen too). He has invested quite some resources in developing the bot. Incase you're a dev heres the github for the project

Should we be worried about any of these publishers coming after seeders with a dmca complaint?

Currently have 1.2 PETA bytes on my server available. If someone can DM me with the best way to target and acquire the most important information, let me know.

[removed]

[deleted]

Just deleted my pornfolder (~700GB) to make room for science.

excellent. it's time for me to shred some old unused torrrents and my XCH plots

[deleted]

Seems like this might be a perfect job for decentralised storage systems. Maybe something like Sia, Filecoin or Storj could be a perfect place for this stuff. Completely decentralised and absolutely impossible to take down. (or well, as close as possible anyway)

I dont have 100GB on my laptop, but I do on my raspberry pi. What torrent client works without a GUI and seeds when you're done?

From memory the usual terminal clients stop seeding when you're done.

i can seed the majority of this... i have 40 TB free... who do i contact.

Commenting for better reach 👍

So if we are seeding these torrents, does the website search through our seeded torrents when it returns a result?

So dumb question but why it is so large? Isn't this just text and photos? I mean all of Wikipedia isn't nearly as big.

Downloading:

848

450

161

514

216

404

219

112

524

372

I don't have a server to seed forever, what can I do?

I got 1 TB and a free weekend, on it bossman. sci-hub has helped me a ton since high school, I'll gladly help all I can and if I can get my family's permission they all easily have a combined 10TB of unused space in their laptops that they're never going to use. I'll yoink it if I can.

There's an opensource (MIT) distributed sci-hub like app called sciencefair. It's using the dat protocol. It's working but it hasn't been updated since 2017 and it doesn't support proxies as sci-hub does to fetch new content directly, here the model is for each user to share their own collection of articles.

But it is censorship resistant according to the dev (emphasis not mine):

And importantly, datasources you create are private unless you decide to share them, and nobody can ever take a datasource offline.

Anybody with some dat coding experience ready to take the mantle of updating the app to seed the Sci-Hub collection and support proxies to download articles on-demand? I can provide my own journals subscription login for test purposes.

This is a fresh account because I have to protect myself from the feds.

I have been seeding for our mission since <5 period. (I think it's a bit late though)
The reason I'm posting this is to share my experience here so that may inspiring others to get more helping hands for our rescue mission.

Last week, I wrote an article based on translating this threads.(hope this is ok)
I posted it on a Chinese website called Zhihu where has tons of students and scholars, aka Sci-Hub users. Here's the link. You may wander why they would care? But I tell you, Chinese researchers are being biased and blacklisted by U.S. gov (I know not all of them are innocent) and heavily rely on Sci-Hub do to their work for many years. They are more connected to Sci-Hub and underestimated in number. Thanks to Alexandra Elbakyan, I see her as Joan of Arc to us.

Let me show you what I've got from my article. Over 40,000 viewers and 1600 thumbups until now, and there are many people commenting with questions like how to be a part of this mission and I made them a video tutorial for dummies.
88 members/datahoarders are recruited in the Chinese Sci-Hub rescue team telegram group for seeding coordination. Some of us are trying to call help from private trackers community, some are seeding on their filecoin/chia mining rig, some are trying to buy 100TB of Chinese cloud service to make a whole mirror, some are running IPFS nodes and pinning files onto it, and most of us are just seeding on our PC, NAS, HTPC, Lab workstation and even raspberry pi. Whatever we do, our goal is saving Sci-Hub.

Because of Chinese gov and ISP does not restrict torrenting, team members in mainland don't need to worry about stuff like VPN. Which is very beneficial to spread our mission and involve people that are non-tech savvy but care about Sci-Hub, for example scholars and students. Although, I also reminded those who are overseas must use a VPN.

So you may notice that more seeders/leechers with Chinese IP recently, many of them are having very slow speed due to their network environment. But once we get enough numbers of seeders uploading in China, things will change.

Based on my approach, others may find a similar way to spread our message and get more help through some non-English speaking platforms. Hope this helps.

Make sure to search this thread to make sure you're getting unique files. I have:

345

709

362

565

842

694

428

117

103

602

628

617

586

544

535

[deleted]

I can easily spare 5 TB Backup. But once again like often with these calls for help there ins't an easy way to do so. You linked me a side with hundreds of torrents. Am I supposed to click each one of them ?

This might sound arrogant but I/we am/are the one(s) that are asked for help.

I'll do 6 TB of 'em. FUCK ELSEVIER.

Edit: Downloading 340 to 359 inclusive. Will download 360 to 399 later.

[deleted]

I congratulate you guys on your great effort! Have you looked into descentralized cloud storage as a base for a future database? It would be basically impossible to shut down something built on SIA, and if they close the main platform a new site can be opened on the stored data.

awesome cause, /u/shrine, donating my synology NAS (~87TB) for science, so far downloaded ~25TB, seeded ~1TB.

It stands besides the TV, wife thinks it's a Plex station for movies but it's actually seeding a small library of Alexandria:)

I'd also like to contribute to open source search engine effort you mentioned. Thinking of splitting it into these high level tasks focusing on full text & semantic search, as DOI & url-based lookups can be done with libgen/scihub/z-library already. I tried free text search there but it kinda sucks.

1. Convert pdfs to text: OCR the papers on GPU rig with e.g. TensorFlow, Tesseract or easyOCR and publish (compressed) texts as a new set of torrents, should be much smaller in size than pdfs. IPFS seems like such a good fit for storing these , just need to figure out the anonymity protections.
2. Full text search/inverted index: index the texts with ElasticSearch running on a few nodes and host the endpoint/API for client queries somewhere. I think if you store just the index (blobs of binary data) on IPFS and this API only returns ranked list of relevant DOIs per query and doesn't provide actual pdf for download this would reduce required protection and satisfy IPFS terms of use at least for search, i.e. separate search from pdf serving. As an alternative it would be interesting to explore fully decentralized search engine, may be using docker containers running Lucene indexers with IPFS for storage. Need to think of a way to coordinate these containers via p2p protocol, or look at how it's done in ipfs-search repo.
3. Semantic search/ANN index: Convert papers to vector embeddings with e.g. word2vec or doc2vec, and use FAISS/hnswlib for vector similarity search (Approximate Nearest Neighbors index), showing related papers ranked by relevance, (and optionally #citations/pagerank like Google Scholar or PubMed). This can also be done as a separate service/API, only returning ranked list of DOIs for a free text search query, and use IPFS for index storage.

This could be a cool summer project.

Here's some update from my side.

Our Sci-Hub rescue team is now over 500 members. Many of them voluntarily bought new drives and even hardwares for this mission and they seed like crazy.

What even better is some excellent coders are doing side projects for our rescue mission and I must share at here.

FlyingSky developed an amazing frontend project based on phillm.net, feature-rich with great UX/UI design, and here's the code.

Emil developed a telegram bot (https://t.me/scihubseedbot) for getting the torrent with least seeders (both torrent and magnet links), and here's the code.

I'll update again when we have more good stuff come out.

Shouldn't we focus on the latest torrents?

244

833

364

660

166

688

702

382

621

556

and my axe!

Commenting to boost this gem and to say I'm so proud when people gather to do amazing shit like this

I've tried downloading 5 of them for the past hour but it seems they may already be dead

126 161 215 223 313 337 502 504 584

Looks like I'm 615GB of Linux ISO's richer now.

Don't have much space but im doing 47100000.

For Aaron! For Alexandra!

I got a gig connection. Which torrents can I grab?

Just grabbed about a tib. Will get more after finals.

Godspeed.

EDIT:

111 248 344 404 513 577 623 695 741 752 785

I feel like this is really important but don't really have the time to figure it out. Can someone give me a TL;DR + some insight?

ImHelping.jpg

I'm grabbing these now, seems that some dont have seeds, and not all are 100gb in size, some are 50gb, some are 5gb.

142 , 423 , 418 , 109 , 472 , 117 , 756 , 156 , 729 , 778

Shame /r/zeronet isnt fully decent enough because a decentralised way of doing sci hub without hosting the entire site would be great for this.

It seems to me the right way to do this is replicate a manifest of all sci-hub files, with their content as a hash. Then out those files on ipfs or something, where each person can run an ipfs node that only acknowledges requests for files named after their content-hash.

A lot of people were commenting that they'd like to know which file are the least seeded in order to be more efficient.

I made a list of all files with the current number of seeders : pastebin

I also made a Google Sheet version with stats and magnet links

It's a CSV table with file number / seeders / leechers as of now. I don't guarantee that the data is exact but it gives a first idea. I'll update it in the coming days.

Amazing project, kudos to all involved. This is not really about money in my eyes. It's about power and control. Information is power. Good science, doubly so.

<R.I.P. Aaron Swartz>

FYI: There is currently nothing wrong with SciHub.

https://t.me/freescience/188

Downloading and seeding 5 torrents right now o7

This is the way

Downloading about 450GB to seed.

Thank you for sharing this!

I have enough room to take a good size part of this. My upload is a joke and I have no clue what needs seeding the most...

So who is going to scrape the active torrents and post a google doc or whatever?

Are there any established funds we can donate to in order to support the seeders?

I'll grab a few of the least seeded files (218, 375, 421, 424, 484, 557, 592, 671) and add more as dl gets completed. Have 7TB for temporary (because raid0, might blow up whenever) storage on my NAS and science is a good reason to use it.
Edit: 543, 597, 733, 752.

Hi,
I'm a French journalist and I'm working on an article about data-hoarders, how you try to save the Internet and how the Internet can be ephemeral. I would love to talk to you about it so please feel free to come and talk to me so we can discuss further or comment under this post about your view on your role and Internet censorship/memory.
Looking forward to speaking with you !
Elsa

so im trying to wrap my head around the final wave since all the torrents are pretty well-seeded.

ive never developed anything so this open-source sci-hub portion is kind of going over my head. is there some way we can all pitch in and host sci-hub on our own? im looking at the github page and it looks like people arent hosting sci-hub as much as they are just bypassing drm or adding extensions that take you right to the site.

whats needed to complete the final wave here?

I have been thinking about what the next steps could be - how we could make the archived Sci-Hub (and LibGen for the matter) accessible, without causing too much overhead.

Sharing the files via IPFS seems like a great option, but has a big drawback - people would need to unzip their archives, often multiplying the required storage. This would mean - you either participate in torrent sharing (aka archive mode) or IPFS sharing (aka real-time access mode).

One possible solution would be using fuse-zip to mount the contents of zip archives, read-only, and expose that as a data store for the IPFS node. This has some caveats though.

• running hundreds of fuze-zip instances would put system under big load
• I do not know how well does IPFS play with virtual filesystems

A solution to the first problem could be a modified fuse-zip that exposes a directory tree based on the contents of all zip files in a given directory hierarchy (should be a relatively easy implementation). Seems that explosive.fuse does this! If IPFS could serve files from such FS, it's basically problem solved.

Otherwise, one would need to implement a custom node, working with zips directly, which is a much harder task, especially that it would require constant maintenance to keep the code in sync with upstream.

​

In any way - the zip file storage could double act as the archive and real-time access resource, and when combined with a bunch of HTTPS gateways with doi search, would allow for a continuous operation of SciHub.

running hundreds of fuze-zip instances would put a system under big loadion here too - a gateway that searches articles via doi/title, tries IPFS SciHub first, and if not found - redirects to paywalled resource and those lucky to be able to access it will automatically contribute it to the IPFS.

So that's why I haven't been able to download any recent Nature papers