The horizon is not so far as we can see, but as far as we can imagine

The Potential AI Lockdown Of Knowledge

In the old days knowledge was gated primarily by work: it was almost all available in books, but you had to find the books, read the books and (hopefully) understand them.

Most knowledge was not illegal. A good example is the “Anarchist’s Cookbook”, which includes recipes for explosives. I used to own a copy, though I never made any explosives. But if you wanted better knowledge, just go to a university library (most of which allowed anyone to walk in and read the books, though not necessarily to borrow then) and learn. This was true for poisons, weapon information, guides on how to pick locks, etc, etc… There was very little knowledge you couldn’t find out, IF you were willing to do the work.

What we’re seeing with AI is restrictions on what knowledge AI will provide. For example non-institutional biology researchers have complained that some models won’t help with that: it’s too dangerous. Ask for poison info and you can get it, but it requires very careful wording of the query: no hint of wanting to use the poisons. An author might get thru by saying it’s for a novel. Anything illegal can have the knowledge frozen as well: want to research con-men or burglary or hacking? Might get thru, might not.

As time goes by it’s reasonable to expect these blocks to evolve and become harder to get around. This may seem like a good thing, I guess, but if I want to research poisons, I don’t think the government or private companies should tell me I can’t.

Now this might be OK, IF we weren’t losing the books. There are reliable accounts of AI companies buying books en-masse, then destroying them. Outside of AI, as people move more and more online, books sell less and entire warehouses are being destroyed because it doesn’t make financial sense to keep them. Universities have mostly become “closed” and you get access unless you’re a student or maybe an alumni, and they certainly track what you read (so if it’s a book someone could misinterpret, read it in the library, don’t check it out.)

The old knowledge is going away. The new knowledge is much easier to get, but also much easier to restrict.

Books were beautiful: once they existed, once you had them, they were always there. We’ve all noticed that even leaving aside AI the internet is not “forever”, sites disappear all the time, the Internet Archive and other similar sites are under constant attack, and what you read can and is easily tracked both by government and private enterprise. The life of your mind is no longer private, what you know from online can be stitched together by anyone with enough power who cares to bother, and indeed, there are pre-crime initiatives by people like Thiel, in which dossiers are kept, soon on everyone, and evaluated to see if you’re a threat.

The future looks like a place with easy knowledge, unless the powerful don’t want you to have it, in which case it will be far harder to find than it was before AI or before the internet.

Big Brother knows best, after all.

What I write here is for the benefit of everyone, but alas, I live in capitalism and I, and the site, take money to keep running. If you value the writing here and can, please subscribe or donate.

Previous

Joy In Twilight

Next

Joe Biden’s Three Genocides in Four Years: Ukraine Part 4

18 Comments

  1. Purple Library Guy

    “Universities have mostly become “closed” and you get access unless you’re a student or maybe an alumni, and they certainly track what you read”

    Um, no, we don’t. Speaking as a university library person who works in the “Loans” department, that’s a nope, both in policy and reality. The software is specifically designed not to keep the information of what people have checked out in the past, precisely because certain US agencies sometimes ask libraries about that and so university libraries have wanted as a feature the ability to say “Sorry, we don’t know”. I suppose it’s possible someone’s hacking us and scraping all the checkout information in real time, but that wouldn’t be the UNIVERSITY tracking what you read.

  2. Brian M

    The future looks like a place with easy narrative.

    Facts? Knowledge? Wisdom? Perhaps not so much.

  3. Watt4Bob

    I have inside knowledge of a university in Canada that is busy destroying their libraries at the behest of/advice of high-priced consultants.

    They paid these guys $10M to help them with their finances I suppose, and they have convinced the school that all those books are a needless expense considering the material is available in digital form.

    So this university started warehousing their books, in cardboard boxes, sorted, I kid you not, by size.

    When you want a book that the library has, but is not on the shelves, you must fill out a request form to have it retrieved from the warehouse. This takes up to 2 weeks.

    A person I know well requested some books, and when he and the staff-person opened the box, along with the book he requested, they found a misplaced book that he recognized as rare, and important, and belonging to a 5 volume set. My informant explained to the staff-member that this book should be reunited with the rest of the rare set.

    The staff-person explained they were not actually a librarian, the ‘rules’ preclude her from moving the book, and that the best she could do was put a red adhesive tag on the book which would alert the next ‘real’ librarian that opens the box that the book was mis-placed.

    My friend told me that he had looked into the ‘consultants’ that were paid the $10M, and that they had left behind a significant number of schools that went broke following their advice.

  4. Jan Wiklund

    I would like to see some of the “reliable accounts of AI companies buying books en-masse, then destroying them”. After all, they should be published!

  5. Ian Welsh

    Search engines are you friend, guy who said that Nate didn’t have enough links when he had like 50.

    Plug this in to the search engine of your choice: “ai companies buying and destroying books”

  6. Feral Finster

    IIRC, the version of The Anarchist’s Cookbook that I read contained a caveat that there was nothing in that book concerning weapons, explosives, drugs, methods, etc. that the radical left and radical right didn’t already know. All the Cookbook did was make that knowledge more available.

    For that matter, what made The Prince so revolutionary was that Machiavelli spelled out in black and white what rulers had already long known and lived by, even if they told themselves something different. The Prince said the quiet part out loud.

  7. mistah charley, ph.d.

    Tom Murphy’s diagnosis of ‘metastatic modernity’ seems very plausible to me, and while “university” and “library” are pre-modern-techno-industrial concepts, the “great simplification” that global society seems likely to go through (using the term favoured by the Institute for the Study of Energy and our Future) may not spare many university libraries. Internet-using apes? Typing apes? Talking apes? Seven generations from now, one wonders how many of each – university libraries, internet users, people that can type, people that can talk – will remain. Fewer than now, probably – but one never knows when something surprising might happen.

  8. mago

    The Anarchist’s Cookbook, ha ha quite the screed. I knew someone whose brother used information from said cookbook to send a car load of explosives careening down a mountainside into an expensive ski town.

    In my early college years I worked in the university library, and we were all bibliophiles. Throughout my adult life I got a library card wherever I lived and made good use of it. I loved browsing the stacks. Guess I’m a member of a dying breed. Alas, the digital age confers dinosaur status upon me.

  9. Carborundum

    Realistically, anything that is thinly circulated enough that an AI firm purchasing a copy, scanning and destroying it (my understanding is that generally the destruction is because they de-spine the book to make the scanning easier to automate) wasn’t really accessible in any case. I have several antique books related to my academic field that were produced in very small publishing runs on the order of a few hundred copies (most are numbered). Sure, destroying one of these measurably reduces the population of the title, but they were only ever accessible to the vast majority of readers through good academic libraries. The objectionable thing here is that we’re not fucking savages and we just don’t destroy books.

    In my opinion, the centroid of concern here is twofold. First, running everything through an AI model significantly dumbs everything down – much less detail and heterogeneity. Second, not doing the work of data retrieval and assembly means there’s reduced opportunity to understand how the knowledge is really structured. Together, these factors significantly exacerbate the decades long crisis of epistemology that we’re living in. The modern motto appears to be only electronically available sources matter, if an interpretation has face validity, run with it, and if it’s viral, it must be true.

    As a technical note, pretty much any university library system – at least in Canada – will offer some form of research readership access. It will cost because there are real costs associated with running academic libraries, but does not require that one be an affiliated academic.

  10. Jan Wiklund

    Thanks, Ian. I checked at https://www.npr.org/2026/08/19/nx-s1-5936438/why-tech-companies-are-buying-up-tons-of-rare-old-books-to-train-their-ai-models (the others were open only to subscribers) and it seemed that Anthropic buys one copy of each book to scan them. And the scanning is easier if you cut up the book.

    One copy of each doesn’t seem such a big deal? And if that was the only copy that existed it shouldn’t be for sale, should it? Or perhaps NPR has missed something?

  11. Flaser

    People are fighting back, in various ways:
    https://annas-archive.gl/blog/how-to-run-a-shadow-library.html

    …then there’s library genesis and sci-hub.

    Yes, knowledge will be lost, but beyond fighting to change laws (hard when the elites don’t care) we can also actively resist.

  12. Purple Library Guy

    Jan Wiklund: “And if that was the only copy that existed it shouldn’t be for sale, should it?”

    No. No it shouldn’t. But this is capitalism. “Everything’s for sale” is one of the core mottos. The system that makes it so such books are for sale, is the same system that makes it OK to then destroy them once bought. As Marx said, “All that is solid melts into air, all that is holy is profaned”. So far I see little sign of Marx’s corollary, “and man is at last compelled to face with sober senses his real conditions of life, and his relations with his kind.”

  13. bruce wilder

    The University of Michigan let Google scan 4.7 million books twenty years ago without destroying any books. As far as I know, all the scanned volumes returned to the shelves. The insistence that books have to be destroyed seems to me to a pretense.

    AI search, as publicly available for free, is of very poor quality as far as discovering quality sources and arguments is concerned. These vast troves of scanned book text don’t seem to inform the answers to queries I make. The sources cited, usually uncritically, are preponderantly on-line pdf’s and webpages.

    I am not the person, who can articulate this well, but I suspect the whole system can be subverted by seeding even anonymous webpages with confident assertions, poisoning the shared knowledge base. As Brian M observed, narrative uber alles, but worse than that. If people lose the habits of critical thinking—things as simple as the instinct to check the sums or reconcile dates and sequence—superficial assertion will displace analysis.

  14. spud

    Curiosity is an innate human trait, and many people have a natural desire to explore and engage with their environment, often leading them to work with their hands. This hands-on approach can enhance learning and creativity, as it allows individuals to actively experiment and discover new things.
    CliffsNotes University of Pennsylvania
    The Nature of Curiosity

    Curiosity is an innate human trait that drives individuals to explore and engage with their surroundings. This natural desire to learn and discover is fundamental to human development and creativity.
    Hands-On Learning

    Many people express their curiosity through hands-on activities. Engaging with materials and experimenting physically can enhance understanding and foster creativity. This approach allows individuals to:

    Actively experiment
    Discover new concepts
    Develop practical skills

    Benefits of Curiosity

    Curiosity not only promotes personal growth but also supports learning in various contexts. Here are some key benefits:
    Benefit Description
    Enhanced Learning Curiosity encourages deeper engagement with subjects, leading to better retention of information.
    Creativity A curious mindset fosters innovative thinking and problem-solving abilities.
    Resilience Curious individuals are more adaptable and view challenges as opportunities for learning.

    To nurture curiosity, it is essential to create environments that stimulate exploration. Here are some strategies:

    Provide Opportunities: Allow individuals to engage in hands-on projects.
    Encourage Questions: Foster an atmosphere where asking questions is welcomed.
    Model Curiosity: Demonstrate a curious attitude in everyday situations.

    By recognizing and supporting the natural curiosity in people, especially through hands-on experiences, we can enhance learning and creativity across various fields.
    CliffsNotes University of Pennsylvania
    ————–
    the oligarchs have been trying to smash the printing presses since it inception. so far they have failed every time, because we evolved to be curious. and no amount of eugenic pseudo science can rectify this.

    A belief in “superior DNA” is a core tenet of eugenics, which falsely claims that complex human traits like intelligence or morality are inherited in a simple, predictable way and that society can be improved by promoting reproduction among those deemed “fit” while discouraging or preventing it among others. Eugenics historically led to harmful policies such as involuntary sterilization and institutionalization of marginalized groups.
    Nature National Human Genome Research Institute
    Understanding the Concept of “Superior DNA”
    Definition of Superior DNA

    The belief in “superior DNA” is a fundamental aspect of eugenics, a discredited theory that suggests certain individuals or groups possess genetic traits that make them inherently better than others. This ideology falsely assumes that complex human characteristics, such as intelligence and morality, can be inherited in a straightforward and predictable manner.

    Origins: The term “eugenics” was coined by Francis Galton in the late 19th century. He proposed that society could be improved by encouraging reproduction among those he deemed “fit” while discouraging it among those considered “unfit.”

    Eugenics Movement: This belief gained traction in the early 20th century, leading to harmful practices such as:
    Involuntary sterilization of individuals deemed unfit.
    Institutionalization of marginalized groups.

    Misconceptions About Genetics

    Eugenics is based on several misconceptions:

    Oversimplification of Inheritance: It inaccurately claims that complex traits are controlled by single genes, ignoring the multifactorial nature of most human characteristics.
    Racial and Class Superiority: The movement often promoted the idea that certain races or social classes were superior, leading to discrimination and social injustice.

    The legacy of eugenics continues to affect discussions around genetics today. It serves as a cautionary tale about the misuse of genetic science to justify discrimination and marginalization. Understanding these historical contexts is crucial in addressing contemporary issues related to genetic research and ethics.
    Nature National Human Genome Research Institute

  15. j

    99 copies of a book in the world,
    99 copies of a book.
    OpenAI takes one down,
    shreds it and scans,
    98 copies of the book in the world.

    98 copies of a book in the world,
    98 copies of a book.
    Anthropic takes one down,
    shreds it and scans,
    97 copies of the book in the world.

    97 copies of a book in the world,
    97 copies of a book.
    Whoever takes one down,
    shreds it and scans,
    96 copies of the book in the world.

  16. spud

    this is what happens when capitalists drive out government R&D and regulation

    https://www.youtube.com/watch?v=KmZDcyxJaWg
    Musk’s Boring Company Is Even Dumber Than You Think

    https://www.youtube.com/watch?v=l__XCYY79jk

    Tesla’s Robotaxi Network Is Failing Hard

    https://www.youtube.com/watch?v=2VMiVJrU8Fw
    OpenAI Is Becoming More Dangerous As Its Business Fails
    its a dead man walking:)

    https://www.youtube.com/watch?v=il0ulOZNF1k
    Autonomous Delivery Robots, Silicon Valley’s Latest Flop

  17. spud

    free market economics: lets pretend its real, then build on it from there. we will prefund ideas because we have merit, regardless if its real, legal or ever work!

    https://www.youtube.com/watch?v=57-OZSXGcxA

    Stanford’s Fraud Pipeline

    “CORRECTION: DNA was NOT discovered at Stanford. The double helix structure was first characterized by Watson and Crick at Cambridge University in 1953. However Stanford researchers won 3 Nobel Prizes for DNA research in 1959, 1980 and 2006 for the synthesis o DNA, the creation of recombinant DNA and DNA transcription.”

  18. Flaser

    @Bruce Wilder
    The reason AI companies shred books is quite asinine: copyright.

    See, scanning a book non-destructively creates a 2nd copy and that’s a big no no. AI companies may have purchased a copy, but not the license to duplicate. However, in their infinite “wisdom”, US courts have decreed that if scanning is destructive, then only one copy remains and thus the sacred cow would remain untouched.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Powered by WordPress & Theme by Anders Norén