If someone was to acquire a few hundred gigs of books and feed them to something like paperless-ngx, would it work as a sort of google of books? Are there any software projects better suited for doing thisand understand synonyms and perhaps some context? I guess AI search but guided for the intermediate user.
Google is so bad lately. Basically every result is official sponsored corporate biased BS. It would be nice to be able to instantly query a bunch of ebooks.
Yes. This exactly.
https://phys.org/news/2010-11-million-dollar-verdict-music-piracy-case.html
In all fairness, meta should be assessed a fee of 250k per EACH pirated work.
This would amount to forfeiting all assets to doge.
Anna’s Archive: Mirror our database, help us preserve Humanity’s knowledge
Facebook: I’ll just torrent what I need, see yaa
These big tech monopolies are a curse to humanity…
Facebook: I’ll just
torrent what I needburden your underfunded project and volunteers with over 81 TB of bandwidth costs without contributing anything in return, see yaaFTFY
Rules for thee, not for me
Do it, Judge. Protect the wealthy and say it’s not piracy. Do it.
It’s not piracy. For corporations. For you and me believe it or not, straight to jail!
Just make an llc, now its legal again.
I’d almost like to think an LLC would be enough, but I suspect that only works if you also have a billion in VC funding and political connections.
Oh for sure, since the law is basically toilet paper for billionaires at this point.
Please! Think of the shareholders, we must protect them!
They’ll be fined 100k
And they’ll ham up how punished and sorry they are, and how thankful they are for the judge handing down “fair and impartial” justice.
But did they keep a good ratio though?
1000% guarantee those mf’s had their upload choked to 20kbps
Nah they used a leeching client. No upload at all.
Gotta have some upload just for the protocol traffic tho.
I would assume that the requests sent from the torrent client to download data are not factored into the Upload amount for the torrent. When they mean no upload, it would be that none of the data in the files they downloaded were shared with anyone else, making them a piece of shit leecher.
In copyright protection terms the ratio shouldn’t matter. They should pay for all the lost profits from pirating everything they’ve downloaded. Every time someone pirated it should be counted. And every time someone uses the AI trained on the data.
They can become the corporate Jesus of the interwebs, having paid for our sins.
Technically, copyright infringement is committed by the entity making and sending the copy, not the entity receiving it. Leeching could indeed remove liability.
I’m not sure if the courts have cared about that nuance when persecuting the ‘small fish,’ but I bet they would in this ‘big fish’ case.
If the receiving entity then ingests all that copyrighted material into its AI, and the AI sends it piece at a time to other receiving entities, that should be the AI infringing on everything it is copying to make its answers.
Yes, yes it should. But that’s a different act than the one being discussed here.
I agree. Still doesn’t hurt to bring it up on appropriate tangents.
Asking the real questions.
What is Anna’s Archive?
It’s a popular search engine that works with shadow libraries like Sci-Hub or Library Genesis. Shadow libraries are hosts to copies of works of literature and science. Their legal status is murky at best but it’s incredibly impractical to persecute those accessing them.
So it’s like thepiratebay or 1337x.to but for books?
Also I think you mean prosecuting, not persecuting.
TPB and 1337x are torrents, whereas Anna’s Archive typically uses direct downloads. So it’s more akin to the old CoolROMs back before the massive takedown purges.
Anna’s Archive does offer torrents, but it’s not for individual files. Their torrents are more like database backups, with thousands of books each. In fact, people will download and seed them to help increase AA’s resilience. Since they aren’t super useful for individual files, very few people use them as such. But clearly, Meta just used them to feed into an LLM, because they didn’t care about the content of the files as long as they were properly written. It was less “looking for your favorite fantasy book” and more “looking to grab every fantasy book ever written.”
Also I think you mean prosecuting, not persecuting.
Nowadays, I’m not so sure anymore.
Those are torrents, Annas Archive is typically used for direct downloads.
Thanks. It’s confusing because everyone is talking about torrents. It’s in the title even, but I didn’t read the article.
Well i think you can also torrent off of there too. There are massive backup files on their home page that they are basically begging people to download and seed… So maybe it’s that?
Meta has open sourced every single one of their llms. They essentially gave birth to the whole open llm scene.
If they start losing all these lawsuits, the whole scene dies and all those nifty models and their fine-tunes get removed from huggingface, to be repackaged and sold to us with a subscription fee. All the other domestic open source players will close down.
The copyright crew aren’t the good guys here, even if it’s spearheaded by Sarah Silverman and Meta has traditionally played the part of the villain.
Where is the source content then
If the existence of open source LLMs hinges on the benevolence of one of the few most cancerous tech companies in the world, maybe they’re not really worth it?
This isn’t about “heroes” and “villains”. Facebook has been and has stayed the “villain”, they’ve done something colossally illegal that any mere mortal would be sued to death for (by an another “villainous” instance, the media system that has made piracy a necessity in the first place), and they’re hoping to get away with it simply on technicalities and by having more money for better lawyers. Rules are rules, if you don’t like them maybe Facebook should try to change them (and not just for themselves, but for the rest of us too)?
Meta stole from everyone, including those that struggle to make ends meet, so it doesn’t matter that they gave you back some of it. Any moral qualms should evaporate when you consider that they did it to create shareholder value and the rest is philanthropy (aka pretend tax). As a socialist I believe that man is owed for his work and you can’t take from him even though technology makes it so easy.
As a socialist I believe intellectual property is a falsehood and technological advancement should be for the public good. Open source LLMs are for the public good.
Given the options between having open source LLMs and the US Govt banning non-corpo non-proprietary LLMs and giving a free pass to people like Musk and Altman and Zucc to monopolize, I happily pick the former.
You’re delusional if you think they will pay anyone, the only way zucc will pay is with a guillotine.
Corpos will make inter-platform deals that’ll simply make all online data licensable for the right price and enrich each other so you can’t avoid it while still actually being a career creative, but price out academic researchers and the public sector so that all fruits of it stay behind closed R&D doors and be free of ethics etc.
Continuing in your role as a useful idiot, you’ll also most likely also foot the bill for it via subsidies from your taxes to “develop the AI sector” in some anti-China dick measuring contest by the US.
You will then be sold this data back via proprietary chat bots via a monthly subscription and you better pay up because once it gets really good, it will become mandatory to use for just about any job, leaving you with no choice.
Or you can support FOSS LLMs.
You’re confusing self entitlement to stuff with the left.
Lolwut? Public good is self-entitlement? Go read a fucking book. Communists are not pro-copyright, especially not when it only benefits the giant corpos.
Another day, another entitled artoid larping as progressive blocked.
That must have touched a sensitive spot lol.
Lieber Genosse, der Hype um Affirming Incompetence (AI) ist der dieser Zeit die höchste Ausdruck der Entfremdung der Menschen von sich selbst, Zeugnis des Begehrens nach und Voraussetzung also der weitergehenden Fetischisierung seines Zugriffs auf Welt. Wie jedoch Bernard Stiegler so schön bemerkte: Kein Savoir-vivre ohne Savoir-faire! Dies seien die unabdingbaren Bedingungen für die Befreiung der Menschheit aus den sich selbst angelegten Ketten zur Errichtung einer geschwisterlichen Ordnung!
(now have fun w/ an LLM’s attempt of “advancement”!)
Calling property labor, doesn’t make you a socialist.
You’re confusing libleft with left.
Don’t give me that slop. No one except the biggest names are getting a dime out it once OpenAI buys up all the data and kills off their competition. It’s also highly transformative, which used to be perfectly legal.
Copyright laws have been turned into a joke, only protecting big money and their interests.
Nope. Get fucked
“Meta downloaded millions of pirated books from LibGen through the bit torrent protocol using a platform called LibTorrent. Internally, Meta acknowledged that using this protocol was legally problematic,” the third amended complaint noted.
Just want to make clear that Libtorrent is just the torrent application they were using, while the Libgen torrents are easily accessible on the libgen site, not through a separate “platform” called Libtorrent.
I wish people like us could help with these complaints, because then they might actually get the details more accurate to reality.
https://libgen.is/repository_torrent/
The amended complaint makes it sound like Libtorrent is a private tracker website when its just the application they were using on the publicly available torrents.
People are putting an S on the end of words like ‘traffic’ and ‘email’. They will never understand the semantics of that correction.
Meta Horizons
Totes yeet, yo.
Given the extent it should be considered criminal so $250k per offense and the higher ups who authorized the torrenting should get conspiracy charges at a minimum.
But this is America so they’ll probably pay a small amount, for Meta, and a light slap on the wrist with a finger wagging.
you are being optimistic, it’s likely going to be considered “fair use” and then be business as usual. Meta themselves have claimed that they aren’t filing to dismiss because they believe they are on the legal side, due to the fact they aren’t distributing the pirated content, only using it for training which is currently a massive grey area that hasen’t been ruled as non-fair use
$250k per offence is literally nothing to meta.
Average ebook size: 2.5 MB or so.
Meta downloaded 81 TB, or 81,000,000 MB.
81,000,000 / 2.5 = Approx 30 million books.
30,000,000 books * $250,000 per offence = $7.5 trillion
(are you sure you’re from programming.dev?)
$250k * [every book in existence] is literally nothing?
Remember, “offense” doesn’t mean “per torrent,” it means “per copyrighted work infringed.”
Each time someone uses their LLM it should be considered a violation.
People are using these things millions of times a day in aggregate. That adds up fast. $250k multiplied by millions suddenly isn’t so cheap.
Damn leeches
