Skip to main content

Reliability issues in large language models explored

Researchers Examine Accuracy and Transparency of Leading AI Chatbots: A Closer Look

Introduction to the Study

Performance of a selection of GPT and LLaMA models

Researchers from the Universitat Politecnica de Valencia in Spain have discovered that as Large Language Models expand size and complexity, they are less inclined to acknowledge their lack of knowledge to users.

Study: Examining AI Chatbots

The researchers, in their Nature study, assessed the newest versions of three popular AI chatbots, examining their response accuracy and users' effectiveness in recognizing incorrect information.

Increased Reliance on LLMs

As LLMs gain widespread adoption, users have increasingly relied on them for tasks like writing essays, composing poems or songs, solving mathematical problems, and more, Consequently, accuracy has become a growing concern.

Study Objective: Evaluating AI Accuracy

In this new study, the researchers sought to determine whether popular LLMs improve in accuracy with each update and how they respond when they provide incorrect answers.

AI Chatbots Assessed: BLOOM, LLaMA and GPT

In order to assess the accuracy of three leading LLMs--BLOOM, LLaMA and GPT---the researchers presented them with thousands of questions and compared the answers to those generated by earlier versions in response to the same prompts.

Diverse Themes Tested

The researchers also diversified the themes, encompassing math, science, anagrams, and geography, while evaluating the LLMs' capabilities to generate text or execute tasks like list ordering. Each question was initially assigned a level of difficulty.

Key Findings: Accuracy and Transparency

The researchers discovered that accuracy generally improved with each new iteration of the chatbots. However, they observed that as question difficulty increased, accuracy declined, as anticipated.

Transparency Decreases with Size

Interestingly, they noted that as LLMs became larger and more advanced, they tended to be less transparent about their ability to provide correct answers.

Behavioral Shift in AI Chatbots

In previous iterations, most LLMs would inform users that they were unable to find answers or required additional information. However, in the latest versions, these models are more inclined to make guesses, resulting in a greater number of responses, both accurate and inaccurate.

Reliability Concerns

The researchers also found that all LLMs occasionally generated incorrect answers, even to straightforward questions, indicating their continued lack of reliability.

User Study: Evaluating Incorrect Answers

The research team subsequently requested volunteers to evaluate the answers from the initial phase of the study, determining their correctness. They discovered that most participants struggled to identify the incorrect responses.

Source 

Labels:

Comments

Post a Comment

Popular posts from this blog

NASA chile scientists comet 3i atlas nickel mystery

NASA and Chilean Scientists Study 3I/ATLAS, A Comet That Breaks the Rules Interstellar visitors are rare guests in our Solar System , but when they appear they often rewrite the rules of astronomy. Such is the case with 3I/ATLAS , a fast-moving object that has left scientists puzzled with its bizarre behaviour. Recent findings from NASA and Chilean researchers reveal that this comet-like body is expelling an unusual plume of nickel — without the iron that typically accompanies it. The discovery challenges conventional wisdom about how comets form and evolve, sparking both excitement and controversy across the scientific community. A Cosmic Outsider: What Is 3I/ATLAS? The object 3I/ATLAS —the third known interstellar traveler after "Oumuamua (2017) and 2I/Borisov (2019) —was first detected in July 2025 by the ATLAS telescope network , which scans he skies for potentially hazardous objects. Earlier images from Chile's Vera C. Rubin Observatory had unknowingly captured it, but ...
Post a Comment
Read more

bermuda triangle rogue waves mystery solved

Bermuda Triangle Mystery: Scientist Claims Rogue Waves May Explain Vanishing Ships and Aircraft for decades, the Bermuda Triangle has captured the world's imagination, often described as a supernatural hotspot where ships vanish and aircraft disappear without a trace. From ghostly ships adrift to unexplained plane crashes, this stretch of ocean between Bermuda, Puerto Rico and Florida remains one of the most infamous maritime mysteries. But now, Dr. Simon Boxall, an oceanographer at the University of Southampton , suggests the answer may not be extraterrestrial at all. Instead, he argues that the truth lies in rogue waves — giant, unpredictable surges of water capable of swallowing even the largest ships within minutes. The Bermuda Triangle: A Legacy of Fear and Fascination The Bermuda Triangle has inspired decades of speculation , with theories ranging from UFO abductions to interdimensional rifts. Popular culture, documentaries and countless books have kept the legend alive, of...
Post a Comment
Read more

nist breakthrough particle number concentration formula

NIST Researchers Introduce Breakthrough Formula for Particle Number Concentration Understanding the number of particles in a sample is a fundamental task across multiple scientific fields — from nanotechnology to food science. Scientists use a measure called Particle Number Concentration (PNC) to determine how many particles exist in a given volume, much like counting marbles in a jar. Recently, researchers at the National Institute of Standards and Technology (NIST) have developed a novel formula that calculates particle concentrations with unprecedented accuracy. Their work, published in Analytical Chemistry , could significantly improve precision in drug delivery, nanoplastic assessment and monitoring food additives. Related reading on Nanotechnology advancements: AI systems for real-time flood detection . What is Particle Number Concentration (PNC)? Defining PNC Particle Number Concentration indicates the total count of particles within a specific volume of gas or liquid,...
Post a Comment
Read more