Skip to main content

Mozilla adviser's views on AI industry influence

Mozilla adviser's views on AI industry influence

In the AI sector, 'scaling up' has become a popular term as technology firms strive to enhance their AI capabilities by leveraging increasingly vast internet data sets.
Mozilla's Abeba Birhane, an AI expert, has long criticized the values and practices of her field, highlighting the potential global impact of its influence.
Her recent research indicates that the expansion of online data for training popular AI image-generation tools disproportionately produces racist outputs, particularly targeting Black men.
Birhane serves as a senior adviser on AI accountability at the Mozilla Foundation, the nonprofit organization behind the Firefox web browser. Originating from Ethiopia and residing in Ireland, she also holds the position of adjunct assistant professor at Trinity College Dublin.
Her discussion with The Associated Press has been shortened and clarified for conciseness.
Q: Could you share how your journey in the AI field began?
A: My academic background is in cognitive science, which doesn't typically have its own dedicated department. At my institution, cognitive science was housed within the computer science department. I found myself in a lab surrounded by machine learning researchers. While they were conducting impressive work, I noticed a lack of focus on the data itself. This struck me as both amusing and fascinating because I believe data is critical to the success of any model. I found it odd that there was little attention paid to questions like, 'What comprises my dataset?' This curiosity led me to this field, and I eventually began conducting audits of large-scale datasets.
Q: Could you elaborate on your research concerning the ethical principles underlying artificial intelligence?
A: There are diverse perspectives on machine learning's nature. While AI practitioners often view it as a purely mathematical and neutral field, social scientists argue that, like any technology, it reflects the values of its developers. To investigate this, we conducted a comprehensive analysis of the top hundred influential machine learning papers to rigorously understand the field's core concerns.
Q: One of the core values identified was the emphasis on scaling up.
A: Scale is often regarded as the ultimate benchmark for success, with prominent researchers from leading firms such as DeepMind, Google and Meta asserting that increasing scale mitigates noise and balances inconsistencies. The premise is that as datasets expand, they should stabilize, approximating a normal distribution or aligning more closely with the actual truth.
Q: Your research has investigated the negative implications of scaling up. What are some of the adverse effects identified?
A: Our research indicates that as datasets are scaled, so too does the prevalence of harmful content such as hate speech and toxicity. Specifically, we observed a significant increase in hateful content when datasets were expanded form 400 million to 2 billion entries. This finding challenges the notion that scaling datasets simply balances out biases and inaccuracies. Additionally, our analysis revealed a disproportionate allocation of suspicious or criminal labels to darker-skinned individuals, particularly women.
Q: How hopeful are you about the AI field embracing the modifications you have recommended?
A: The impact of these outputs is not confined to mathematical and technical aspects; they also play a crucial role in shaping societal norms and influences. Our recommendations advocate for the incorporation of values like justice, fairness and privacy into AI systems. Nevertheless, I am profoundly skeptical that the industry will embrace these suggestions. The industry's track record shows a tendency to overlook societal concerns unless compelled by legal requirements or substantial public pressure that could damage their reputation.

Comments

Popular posts from this blog

fractal universe cosmic structure mandelbrot

Is the Universe a Fractal? Unraveling the Patterns of Nature The Cosmic Debate: Is the Universe a Fractal? For decades, cosmologists have debated whether the universe's large-scale structure exhibits fractal characteristics — appearing identical across scales. The answer is nuanced: not entirely, but in certain res pects, yes. It's a com plex matter. The Vast Universe and Its Hierarchical Structure Our universe is incredibly vast, com prising a p proximately 2 trillion galaxies. These galaxies are not distributed randomly but are organized into hierarchical structures. Small grou ps ty pically consist of u p to a dozen galaxies. Larger clusters contain thousands, while immense su perclusters extend for millions of light-years, forming intricate cosmic  patterns. Is this where the story comes to an end? Benoit Mandelbrot and the Introduction of Fractals During the mid-20th century, Benoit Mandelbrot introduced fractals to a wider audience . While he did not invent the conce pt —...

Quantum neural algorithms for creating illusions

Quantum Neural Networks and Optical Illusions: A New Era for AI? Introduction At first glance, optical illusions, quantum mechanics, and neural networks may appear unrelated. However, my recent research in APL Machine Learning Leverages "quantum tunneling" to create a neural network that perceives optical illusions similarly to humans. Neural Network Performance The neural network I developed successfully replicated human perception of the Necker cube and Rubin's vase illusions, surpassing the performance of several larger, conventional neural networks in computer vision tasks. This study may offer new perspectives on the potential for AI systems to approximate human cognitive processes. Why Focus on Optical Illusions? Understanding Visual Perception O ptical illusions mani pulate our visual  perce ption,  presenting scenarios that may or may not align with reality. Investigating these illusions  provides valuable understanding of brain function and dysfunction, inc...

Theory Quantum Mechanics Gravity Fifth Dimension

Quantum Theory vs Relativity: A Classical Five-Dimensional Approach to Unifying Physics Quantum mechanics and Albert Einstein's general theory of relativity stand as two towering achievements of modern science. Each has proven remarkably successful within its own territory: quantum theory governs the behaviour of particles and atoms , while general relativity explains gravity and the very fabric of space and time . Yet, after decades of intense research, physicists still lack a convincing framework that unites these two pillars into a single, coherent description of the universe . Related science coverage : Physics and cosmology updates Why Quantum Mechanics and Gravity Remain Unreconciled Most mainstream attempts assume that gravity itself must be treated as a quantum phenomenon . The late physicist Richard Feynman famously warned that accepting quantum mechanics without quantizing gravity would leave physics in serious difficulty. However, quantum theory carries unresolved ...