Amazon’s Secret Project to Train AI

Amazon, the e-commerce giant that started off selling books, is now involved in a rather disturbing practice. According to a recent report by 404 Media, Amazon is buying tons of rare books, cutting off their spines, and scanning them for AI training.

The report claims that Amazon is using a facility in Las Vegas, known as VGT3, to process these rare books. The facility is identified by a symbol of a dinosaur holding a book in its claws.

Amazon has released a statement in response to the report, stating that it ‘purchases books through commercial channels to improve the products and services customers use.’ However, the true extent of Amazon’s involvement in this project remains unclear.

The Need for Rare Texts in AI Training

Companies like Amazon need unfathomably large amounts of text to train their Large Language Models (LLMs). These models have already ingested what they can from the internet, but rare books offer a new source of coveted training data.

Rare books are especially valuable since there’s no chance that anything published before 2022 was written by an LLM. When LLMs train on AI-generated text, they risk ‘model collapse,’ which can occur when the quality of an LLM’s outputs degrade after ingesting too much AI-generated text.

In other words, rare books are a treasure trove of untapped knowledge that can help LLMs learn and improve. By scanning these books, Amazon is essentially creating a massive library of text that can be used to train its AI models.

The Ethics of Scanning Rare Books

The practice of scanning rare books raises several ethical concerns. For one, it involves the destruction of these rare books, which can be irreplaceable and hold significant cultural or historical value.

Furthermore, the process of scanning these books may not be entirely accurate, leading to potential errors or inaccuracies in the AI training data.

While Amazon’s statement claims that the company is purchasing books through commercial channels, it remains unclear whether the company is obtaining these books through legitimate means or exploiting loopholes in the market.

The Future of AI Training

The use of rare books in AI training is a growing trend in the tech industry. As LLMs continue to play a crucial role in various applications, the need for high-quality training data will only continue to grow.

However, the ethics of scanning rare books raise important questions about the future of AI training. Will companies like Amazon prioritize the preservation of cultural and historical artifacts, or will they continue to prioritize the pursuit of AI dominance?

Only time will tell, but one thing is certain: the world of AI training is about to get a whole lot more interesting.

Amazon’s involvement in this project is a reminder of the complex and often disturbing nature of AI development. As we continue to push the boundaries of what is possible with AI, we must also consider the consequences of our actions and the impact they have on our world.

In the end, it is up to us to decide whether the benefits of AI outweigh the costs. But one thing is certain: the future of AI training is about to get a whole lot more complicated.