- cross-posted to:
- technology@beehaw.org
- cross-posted to:
- technology@beehaw.org
Artificial intelligence labs are in a new arms race to buy up millions of rare books, slicing them open, scanning the pages and pulping the remains — sparking concerns that the last remaining copies of out-of-print texts are being destroyed on an industrial scale.
ISBNdb notes that “print books from the pre-LLM era are structurally guaranteed to be free of this contamination”.
“Millions of the most valuable books have never been digitised. They exist only in physical form, scattered across library shelves, used bookstores, and out-of-print catalogues. We get them to you at scale.”
You must log in or # to comment.
These companies need quantity over quality. They’re gonna buy the cheapest books in bulk they can.
Contrary to what some might think. I’m not taking a stance for AI. I’m just pointing out, no one cared about these books 1 month ago. No one wanted to buy them. No one wanted to read them. That’s why they’ve been sitting on a shelf in a warehouse collecting dust.
They’re not valuable in any sense of the word. They’re only “rare” in the sense that they sold so poorly, there was no point in printing more.
This is such a silly thing to glue on the hate-train. “They’re destroying books no one wanted to read!” Oh no… anyway
Popular doesnt always mean good. Unpopular doesnt always mean bad. There are countless little poetry books that only circulated through clubs. Texts circulated through writing groups that contain works of authors before they were famous.there are rare books you’ve never heard of that a collector would pay thousands for because they are one of the few people who know its value. Old folios that crossed oceans as the libraries behind them burned in petty wars that sat in attics for generations before the family found it only to send it up wholesale in an estate auction.
The point is that these assholes buy it all up by the truck load and process it indiscriminately. All to avoid copyright, and to feed their environment destroying hallucination machine.
Yeah, small community literature is extremely valuable to historians of such communities.
“It was the best of times, it was the blurst of times?” Stupid AI!
“We must destroy this precious archive of humanity so our competitors can’t also scan it”
Literally
1984Fahrenheit 451You have got to be fucking kidding me
You people have no idea how much I want AI banned all across everything. I don’t care about anything at this point. These people are EVIL EVIL EVIL EVIL. Pure breed CRIMINALS
Fucking 90% of the books I read are “rare”
“Oh, but there’s SOME benefits to having AI”, says some person on the internet that had it shoved down their throat by their boss. No. Fuck you. Fuuuuuuck you all the way.
Fucking 90% of the books I read are “rare”
That’s sort of the joke. These aren’t treasured first editions. They’re not shredding the Guttenburg Bible. These are single prints sitting in warehouses and abandoned libraries or dumps that nobody has read or carried about in decades. They’re rare because they never got a second edition.
And the process of digitizing the book means disassembling it. So the copy (that nobody wanted) is destroyed as a result.
The article is pure clickbait. These books aren’t valuable, save that they were produced pre-AI. That’s why you can get them in bulk on the cheap.
They are buying up used books at rates that push up the cost of used books. That is enough to piss off people legitimately.
We also are fully aware they are not careful. Yes, they will occasionally shred the last few examples of a book that might have otherwise become useful in the future, and there’s no indication that they are archivists. They will eventually destroy or loose this training data and the book contents will be gone to future generations.
They are buying up used books at rates that push up the cost of used books.
Used books are practically free to begin with. Libraries will often give away whole storage containers of books that they don’t want anymore. Bookstores will sell books for pennies on the wholesale market.
Half-Price offers Books By The Yard to be used entirely for decorative purposes. $50 for 40-60 books, largely organized by color and binding style.
a book that might have otherwise become useful in the future
We have vastly overproduced the physical reading material relative to consumer reading habits. We have vastly overproduced certain genres and subject matter material. We have overproduced individual volumes. These books are not useful in any material sense. No more than the clothes we overproduce or the snacks we overproduce or the automobiles and electronics we overproduce.
We are swimming in trash. We produce mountains of it. We fill ravines with it. Stop treating hording as a virtue.
What’s the point of destroying books after scanning them instead of reselling them apart from *hurr durr we are evil*?
Easier to scan if you cut the binding off, and it costs money to re-bind a book you purchased for 10 cents as part of a lot.
Do make sure that knowledge is only available through their model and otherwise lost to humanity.
Same with bombarding small websites until they give up and pull the plug.
Everything is fucked
Have you ever tried scanning a book? It’s a huge PITA.
They just cut the binding off so they can be run through a document feeder.
I mean have you tried donating books? They just dump them into a storage room with thousands of other books donated that nobody wants.
To avoid competitors also scanning the book to get some kind of edge.
Copyright. They mustn’t make a copy. There is legal precedent that confirms it’s okay to transform the copy you bought into digital format. The Internet Archive relies a lot on that. I think they actually litigated it in the first place. So that’s why the copyright heads are going so absolutely apeshit. If no one’s charging you rent for using some data, then it’s “unethical”.
The Internet Archive absolutely does not destroy books. They scan them the hard way with the binding still intact.
Cause to easily scan them they remove the binding and rebinding is more work %han destroyibg so the point is capitalism
To keep their competitors from buying them and scanning them.
That seems to be the most likely reason. Bastards.
Sorry, but I did an oopsie. I watched the video linked, they destroy the books to scan them. It’s really sad. Though I’m sure they would destroy them anyway.
I assumed the process destroyed the book but keeping the contents from the competitors would definitely be seen as a business goal.
They’re pissing in the well so their competitors can’t access the same information.
Fair use loophole, they claim they convert one physical book into one digital with no illicit copies, while also supporting the delusion of AI being an equivalent to a human reader. It is weird on so many levels but no one of noticeable weight asked them wtf.
That is not required by law. It is just easier to cut the bindings off. The other way is slow: https://archive.org/details/eliza-digitizing-book_202107
Does anyone remember circa 2014 that radical jihadists in the middle east were destroying ancient and medieval artifacts, including stone heads? And I remember here in the liberal west we thought that was awful.
This is not the only thing that makes me think of that. Also Trump’s recent calls to reduce the size of US national parks and open them up to oil and uranium mining exploitation.
Yeah we remember. Because that’s a literal fucking warcrime. You’re not allowed to destroy historical sites.
While I agree that destroying books is bad - even common ones - it’s also not technically illegal. If I want to burn a first edition of whatever book worth thousands of dollars… I’m legally allowed to do that.
I can also see the benefit of having a digital version of a rare book that can be enjoyed by thousands as opposed to sitting on a shelf. But yeah, definitely hold companies accountable for destroying them. There has to be a better way to do that work and still have a useable book afterwards.
If they were archiving digital versions so they could be read by thousands in the future, this would be a totally different conversation.
They don’t even need to be as selfless as the internet archive - just follow Googles lead and allow people to search and view selections the archive, with automatic opening of the archive when you are confident copyright is expired. Even a closed archive owned by a third party with a dead mans switch to open it in the future when the business model is done would be something.
The point of bookburning is that it would only be accessible to AI, bringing forth it’s monopoly on said first edition. No one would upload it to IA in the process. It is deleting one source of knowledge out of existence.
I don’t trust AI companies to not alter the texts of those books if there’s something in them that does not align with their worldview.
So any book added to the online archive(s) by these companies is suspect.Theyre actually destroying the book to be legal according to the article.
That is the justification and not the reason. Its faster and cheaper to cut the bindings, and they would have to store the books while they are using the digital copies to comply with copyright.
Random bulk rate books aren’t artifacts. The vast majority of them probably have a copy in Anna’s Archive.
If they did have a copy in Anna’s Archive, why the fuck would AI companies find physical copies, buy them, rip them apart, scan them, and then digitize them before destroying them?
Remember, you don’t get the digital copy. It’s only used to train their models.
Absolutely. Every AI company has Anna’s Archive in their training data already. They want to differentiate their models by having more training data than their competitors. There are way more books out there that have never been scanned than those that have.
Then they aren’t rare books necessarily.
The use of the word “rare” implies that they are not bought in bulk…
Rare doesn’t necessarily mean culturally valuable. How many of these rare books are actually just old instruction manuals, travel guides, training materials, phone books, and dictionaries?
The issue with that is that we don’t yet know what is culturally valuable or not.
Just because we don’t see a need for the specific book now, doesn’t mean it won’t change tomorrow.
Which appears to be backed up by nothing.
Why are you so intent on riding big corpo cock? Do you think daddy Altman is going to praise you, call you his good girl?
You don’t actually need to play devil’s advocate, you know.
What is a rare book, exactly? Why can’t the publishers just print more if there is demand for them?
Keep in mind that books often become culturally important decades after their print run, sometimes when the copyright is ambiguous.
And also keep in mind there are technically, an insane number of “rare” books out there, but important rare books might only be important to people without the money to pay for another printing.
I could almost forgive this prrocess if they were /also/ archiving these books (leven if limited ike Google books does), but they won’t, because they are so focussed on staying ahead of compeditors based on the “knowledge” in their training data.
Maybe theyre from publishers that have since folded, and the original plates or print-copies are lost in some storage yard, or a tip face.
Im assuming for pre digital era books, they don’t have the equipment (printing plate) anymore. But yes, presumably anybody could just print the scans with a modern printer?
Yes… If they were archiving their scans. Which isn’t happening.
It depends on why the books is rare, some books are rare because they are not popular while other because they were banned. For example I know a novel were the English translation is easily available, but the original language is rare because it was banned in the original language in multiple countries. Don’t forget collecter artbooks that were never digitised.
I have this great book about all the glassware in use in 1940s chemistry.
As someone whose entire library is focused on the history of science: what’s the citation?
Lots of them are uninteresting and useless to 99.99% of people IIRC (examples I saw in a French article a few months ago was very precise history of some random villages in Spain or something similarly ultra specific)
When destroying books, we don’t actually know what will be important in the future. That’s why archivists spend so much time archiving mineutia without trying to curate. Those are different jobs and you can’t curate for the future.
That’s fucking evil.
That’s absolutely disgusting. At this rate, governments should really be stepping in and stopping all this.
According to the article, they are doing this to comply with copyright.
they are doing this to maliciously comply with copyright
Exactly, they don’t comply with any other law that might inconvenience them.
The whole point of post-enlightenment government is to serve the public good. But then it gets captured by capitalist interests (as Karl Marx explains in Das Kapital) at which point the government serves capital.
Issue is, the AI accelerationist cult has planned out every scenario, and they have a very good plan to amaze politicians. That’s why the bubble haven’t burst yet.
Destroying the an endangered book feels like it should be criminal no?
As much as I think this behaviour is fucked up, once they buy the books it’s legally property of the company. And it can be destroyed without consequence since it’s legally property of the company.
Good way to prepare for rewriting history to their liking. Shredding/destroying the books should be illegal in this regard.
Yeah, part of me thinks this is part of why they are desperate for these LLMs to take off.
Get everyone to trust it, then just manipulate it to saw whatever fascist lies they want as truth. Look at how Elon gets all pissy everytime Grok starts going to the left on its ideas.
The reason they are doing it this way is because it is illegal to not destroy the books if they ingest them. Skirting copyright laws.
To be fair, we don’t know what books those are, anyone can publish anything as a book these days. It doesn’t have to be good or even true. For example, Jordan Peterson shits out some books, and I personally would not mind if all copies were shredded and forgotten.
I really hope the AI bubble pops soon and takes at least some of these stupid companies with it. They’ve been operating at a GIANT loss for years at this point, how much longer will this go on?
Be careful, because we will all pay the price when the bubble pops. It won’t be just the CEOs paying the bill, it will be governments and people.
Depends on how much power the financiers have to fabricate capital from debt. In modern economics that’s not necessarily a limitation. I do hope it will be tho.
The way I see the situation is that every single AI company can clearly see the massive wall they are speeding ever faster towards, they see it and can also see that it is a massive wall, thick and sturdy.
There is however one thing that keeps them pushing the accelerator down hard against the floor, the delusion that they alone is smart enough to find the prefect weakpoint where they can smash through to the promised land of massive promises, while everyone else is just flattened against the wall.
It is extreme narcissism combined with yes men powering this shit.
i think they are just making sure they arnt holding the bag. thats why i keep seing new AI startups popping up.
“the delusion that they alone is smart enough”
are*
It very weird when an otherwise logical comment has such a dumb error.
Nevermind that when this bubble pops, the US govt will give them all the money they need from our taxes.
Nah, just Musk. The US Government will bail out Grok and let the others fail.
Investors are starting to notice that it’s all smoke and mirrors in terms of the profits. I am reasonably sure it will pop this year. I will be utterly shocked if it doesn’t pop by the end of next year. It’s just so comically and obviously unsustainable.
This is gonna go down as the biggest Ponzi scheme of all time, I swear.
I dunno, the GameStop Bros are still waiting for MOASS. So I’d say the wealthy have more ways to keep the plates spinning than we wish they did.
Corps don’t have to register to people anymore. Just as an example of how corrupt and well stocked these plate spinning rich bastards are
At least GameStop is profitable though.
I like the plate spinning analogy. I think these guys have SO much money that they do have a few tricks up their sleeve to keep investors going.
I think once they land a few enterprise level fish hard, it will keep the plates spinning a good bit longer.
This makes me tear up a bit. All those lost books…
“Book burning, you say?”
