Skip to main content

artificial intelligence collapse risks

AI training of AI in LLMs may result in model collapse, researchers suggest

AI training of AI in LLM
A study published in Nature warns that using AI-generated datasets to train subsequent machine learning models may lead to model collapse, polluting their outputs. The research indicates that, after a few generations, original content is supplanted by unrelated gibberish, underscoring the necessity of reliable data for AI training.

Generative AI tools, including Large Language Models (LLMs), have gained widespread popularity, primarily being trained on human-generated inputs. However, as these AI models become more prevalent on the internet, there is a risk of computer-generated content being used to train other AI models, or even themselves, in a recursive manner.

Ilia Shumailov and his team have developed mathematical models to illustrate the phenomenon of model collapse in AI systems. Their research shows that AI models may disregard certain outputs, such as infrequent lines of text in training data, leading to self-training on a limited subset of the dataset.

Shumailov and his team examined the responses of AI models to training datasets primarily generated by artificial intelligence. Their findings reveal that using AI-generated data leads to a degradation in learning capabilities over successive generations, culminating in model collapse.

The majority of recursively trained language models analyzed showed a pattern of generating repetitive phrases. As an example, when medieval architecture text was used as the initial input, the ninth generation's output consisted of a list of jackrabbits.

According to the authors, model collapse is an inevitable result of using training datasets produced by earlier generations of AI models. They suggest that successful training with AI-generated data is possible if stringent data filtering measures are implemented.

Simultaneously, firms leveraging human-produced content for AI training could develop models that outperform those of their rivals.

Further detail: In the paper 'AI Models Collapse When Trained on Recursively Generated Data,' Ilia Shumailov et al., Nature, 2024.

Source: 

Labels:

Comments

Post a Comment

Popular posts from this blog

NASA chile scientists comet 3i atlas nickel mystery

NASA and Chilean Scientists Study 3I/ATLAS, A Comet That Breaks the Rules Interstellar visitors are rare guests in our Solar System , but when they appear they often rewrite the rules of astronomy. Such is the case with 3I/ATLAS , a fast-moving object that has left scientists puzzled with its bizarre behaviour. Recent findings from NASA and Chilean researchers reveal that this comet-like body is expelling an unusual plume of nickel — without the iron that typically accompanies it. The discovery challenges conventional wisdom about how comets form and evolve, sparking both excitement and controversy across the scientific community. A Cosmic Outsider: What Is 3I/ATLAS? The object 3I/ATLAS —the third known interstellar traveler after "Oumuamua (2017) and 2I/Borisov (2019) —was first detected in July 2025 by the ATLAS telescope network , which scans he skies for potentially hazardous objects. Earlier images from Chile's Vera C. Rubin Observatory had unknowingly captured it, but ...
Post a Comment
Read more

bermuda triangle rogue waves mystery solved

Bermuda Triangle Mystery: Scientist Claims Rogue Waves May Explain Vanishing Ships and Aircraft for decades, the Bermuda Triangle has captured the world's imagination, often described as a supernatural hotspot where ships vanish and aircraft disappear without a trace. From ghostly ships adrift to unexplained plane crashes, this stretch of ocean between Bermuda, Puerto Rico and Florida remains one of the most infamous maritime mysteries. But now, Dr. Simon Boxall, an oceanographer at the University of Southampton , suggests the answer may not be extraterrestrial at all. Instead, he argues that the truth lies in rogue waves — giant, unpredictable surges of water capable of swallowing even the largest ships within minutes. The Bermuda Triangle: A Legacy of Fear and Fascination The Bermuda Triangle has inspired decades of speculation , with theories ranging from UFO abductions to interdimensional rifts. Popular culture, documentaries and countless books have kept the legend alive, of...
Post a Comment
Read more

nist breakthrough particle number concentration formula

NIST Researchers Introduce Breakthrough Formula for Particle Number Concentration Understanding the number of particles in a sample is a fundamental task across multiple scientific fields — from nanotechnology to food science. Scientists use a measure called Particle Number Concentration (PNC) to determine how many particles exist in a given volume, much like counting marbles in a jar. Recently, researchers at the National Institute of Standards and Technology (NIST) have developed a novel formula that calculates particle concentrations with unprecedented accuracy. Their work, published in Analytical Chemistry , could significantly improve precision in drug delivery, nanoplastic assessment and monitoring food additives. Related reading on Nanotechnology advancements: AI systems for real-time flood detection . What is Particle Number Concentration (PNC)? Defining PNC Particle Number Concentration indicates the total count of particles within a specific volume of gas or liquid,...
Post a Comment
Read more