Nov 6th 2023

We built a ‘brain’ from tiny silver wires. It learns in real time, more efficiently than computer-based AI

 

The world is infatuated with artificial intelligence (AI), and for good reason. AI systems can process vast quantities of data in a seemingly superhuman way.

However, current AI systems rely on computers running complex algorithms based on artificial neural networks. These use huge amounts of energy, and use even more energy if you are trying to work with data that changes in real time.

We are working on a completely new approach to “machine intelligence”. Instead of using artificial neural network software, we have developed a physical neural network in hardware that operates much more efficiently.

Our neural networks, made from silver nanowires, can learn on the fly to recognise handwritten numbers and memorise strings of digits. Our results are published in a new paper in Nature Communications, conducted with colleagues from the University of Sydney and the University of California, Los Angeles.

A random network of tiny wires

Using nanotechnology, we made networks of silver nanowires about one thousandth the width of a human hair. These nanowires naturally form a random network, much like the pile of sticks in a game of pick-up sticks.

The nanowires’ network structure looks a lot like the network of neurons in our brains. Our research is part of a field called neuromorphic computing, which aims to emulate the brain-like functionality of neurons and synapses in hardware.

A microscope photo showing a messy web of thin grey lines against a black background.
Each nanowire is around one thousandth the width of a human hair, and together they form a random network that behaves much like the web of neurons in our brains. Zhu et al. / Nature Communications

Our nanowire networks display brain-like behaviours in response to electrical signals. External electrical signals cause changes in how electricity is transmitted at the points where nanowires intersect, which is similar to how biological synapses work.

There can be tens of thousands of synapse-like intersections in a typical nanowire network, which means the network can efficiently process and transmit information carried by electrical signals.

Learning and adapting in real time

In our study, we show that because nanowire networks can respond to signals that change in time, they can be used for online machine learning.

In conventional machine learning, data is fed into the system and processed in batches. In the online learning approach, we can introduce data to the system as a continuous stream in time.

With each new piece of data, the system learns and adapts in real time. It demonstrates “on the fly” learning, which we humans are good at but current AI systems are not.

The online learning approach enabled by our nanowire network is more efficient than conventional batch-based learning in AI applications.

In batch learning, a significant amount of memory is needed to process large datasets, and the system often needs to go through the same data multiple times to learn. This not only demands high computational resources but also consumes more energy overall.

Our online approach requires less memory as data is processed continuously. Moreover, our network learns from each data sample only once, significantly reducing energy use and making the process highly efficient.

Recognising and remembering numbers

We tested the nanowire network with a benchmark image recognition task using the MNIST dataset of handwritten digits.

The greyscale pixel values in the images were converted to electrical signals and fed into the network. After each digit sample, the network learned and refined its ability to recognise the patterns, displaying real-time learning.

A grid of handwritten digits
The nanowire network learned to recognise handwritten numbers, a common benchmark for machine learning systems. NIST / Wikimedia, CC BY-SA

Using the same learning method, we also tested the nanowire network with a memory task involving patterns of digits, much like the process of remembering a phone number. The network demonstrated an ability to remember previous digits in the pattern.

Overall, these tasks demonstrate the network’s potential for emulating brain-like learning and memory. Our work has so far only scratched the surface of what neuromorphic nanowire networks can do.

 

Zdenka Kuncic, Professor of Physics, University of Sydney and Ruomin Zhu, PhD student, University of Sydney

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Browse articles by author

More Essays

Jan 28th 2024
EXTRACT: "Health disparity is a powerful weapon in the savage class warfare otherwise known as neoliberalism. (In 2020, the RAND Corporation did a study of the transfer of wealth over the last several decades from the working-class and the middle-class to the top one percent. Their estimate is a staggering $47 trillion – that is how much the “upward redistribution of income” cost American workers between 1975 and 2018.) Neoliberalism is a brutal form of labor suppression, which uses health as a means of maintaining and reproducing a condition in which wealth is constantly being redistributed upwards, and the middle-class is kept in a constant state of fear of sinking into the ranks of the poor. Medical expenses are the leading cause of bankruptcies in America – and that’s according to the American Bankruptcy Institute. The ballooning costs of healthcare serve to maintain a system marked by morally unacceptable health inequity and injustice."
Jan 28th 2024
EXTRACT. "But living longer has also come at a price. We’re now seeing higher rates of chronic and degenerative diseases – with heart disease consistently topping the list. So while we’re fascinated by what may help us live longer, maybe we should be more interested in being healthier for longer. Improving our “healthy life expectancy” remains a global challenge. Interestingly, certain locations around the world have been discovered where there are a high proportion of centenarians who display remarkable physical and mental health. The AKEA study of Sardinia, Italy, as example, identified a “blue zone” (named because it was marked with blue pen),....."
Jan 4th 2024
EXTRACT: ""Tresors en Noir et Blanc" presents 180 prints from the collection of the Musee des Beaux-Arts de la Ville de Paris, also known as the Petit Palais.  The basis of the museum's print collection is 20,000 engravings amassed by a 19th-century collector, Eugene Dutuit, " ----- "This wonderful exhibition, the tip of a great iceberg, serves to emphasize how unfortunate it is that the tens of thousands of prints owned by the Petit Palais are almost never seen by more than a handful of scholars who visit them by appointment.  Nor is the Petit Palais the only offender in this regard,....."
Jan 4th 2024
EXTRACTS: "And that is the clue to Manet’s work. He paints painting, regardless of his subject: he paints the medium itself, it as if he is constantly reminding us that this is a painting," ..........."This is a new conception of painterly truth at play here, a new fidelity to truth. Manet is the Kant of painting because he initiates a similar kind of “Copernican revolution” – we do not see the world as it is but as we are. " -------- " Among the most remarkable but unfamiliar of Manet’s work on display are those depicting the bloody aftermath of the Paris Commune of 1871.There is no question regarding Manet’s condemnation of the Versailles government’s actions following the defeat of the Commune, when some 25,000 Parisians were gunned down, including women and children."
Dec 27th 2023
EXTRACT: "Think of our brain like a map. When we’re young, we explore all corners of this map, sending out connections in every direction to make sense of our environment. Before long, we figure out basic truths – such as how to secure food, or where we live – and the neurological paths that make up these connections strengthen. Over time, a network emerges that reflects our unique experiences. Regions we re-visit often will develop established paths, whereas under-used connections will fade away. ---- Conditions such as addiction, chronic depression and post-traumatic stress disorder (PTSD) are characterised by processes such as repetitive negative thinking or rumination, where patients focus on negative thoughts in a counterproductive way. Unfortunately, these strengthen brain connections that perpetuate the unfavourable mental state."
Dec 14th 2023
EXTRACT: "While no one was looking, France has become a melting pot of European peoples. Its neighbors have traditionally been welcomed, and France progressively turned them into French boys and girls in the next generation."
Dec 4th 2023
EXTRACTS: "Being rich is essentially about having more stuff in general, including bigger houses." "..... if SUVs had not become widely adopted largely as a status symbol for the global middle classes, emissions from transport would have fallen by 30% over the past ten years. For the largest class of SUVs, six of the ten areas of the UK registering the most sales were affluent London boroughs like Kensington and Chelsea."
Nov 11th 2023
EXTRACT: "By using these “biomarkers”, researchers have discovered that when a person’s biological age surpasses their chronological age, it often signifies accelerated cell ageing and a higher susceptibility to age-related diseases." ----- "Imagine two 60-year-olds enrolled in our study. One had a biological age of 65, the other 60. The one with the more accelerated biological age had a 20% higher risk of dementia and a 40% higher risk of stroke."
Nov 6th 2023
EXTRACT: "We are working on a completely new approach to 'machine intelligence'. Instead of using ..... software, we have developed .... hardware that operates much more efficiently."
Nov 6th 2023
EXTRACTS: "When people think of foods related to type 2 diabetes, they often think of sugar (even though the evidence for that is still not clear). Now, a new study from the US points the finger at salt." ...... ".... this type of study, called an observational study, cannot prove that one thing causes another, only that one thing is related to another. (There could be other factors at play.) So it is not appropriate to say removing the saltshaker 'can help prevent'." ..... "Normal salt intake in countries like the UK is about 8g or two teaspoons a day. But about three-quarters of this comes from processed foods. Most of the rest is added during cooking with very little added at the table."
Oct 26th 2023

 

In 1904, Emile Bernard visited Paul Cezanne in Aix.  He wrote of a conversation at dinner:

Sep 11th 2023
EXTRACT: "Many people have dipped their toe into the lazy gardener’s life through “no mow May” – a national campaign to encourage people not to mow their lawns until the end of May. But you could opt to extend this practice until much later in the summer for even greater benefits. Allowing your grass to grow longer, and interspersing it with pollen-rich flowers, can benefit many insects – especially bees. Research finds that reducing mowing in urban and suburban environments has a positive effect on the amount and diversity of insects. Your untamed lawn won’t only benefit insects. It will also encourage more birds, such as goldfinches, to use your garden to feed on the seeds of common wildflower species such as dandelions."
Aug 30th 2023
EXTRACT: "Eliot remarked that Shakespeare's greatness not only grew as the writer aged, but that his development became more apparent to the reader as he himself aged: 'No reader of Shakespeare... can fail to recognize, increasingly as he himself grows up, the gradual ripening of Shakespeare's mind.' "
Aug 25th 2023
EXTRACTS: "I moved here 15 years ago from London because it was so safe. Bordeaux was then known as La Belle au Bois Dormant (The Sleeping Beauty). It's the wine capital of France and the site of beautiful 18th century architecture arrayed along the Garonne river." ---- "What’s new is that today lawlessness is spreading into the more comfortable neighborhoods. The favorite technique is to defraud elderly retirees by dressing up as policemen, waterworks inspectors or gas meter readers. False badges including a photo ID are easy to fabricate on a computer printer. Once inside, they scoop up most anything shiny as they tip-toe through the house."
Aug 20th 2023
EXTRACT: "The 1953 coup d'etat in Iran ushered in a period of exploitation and oppression that has continued – despite a subsequent revolution that led to huge changes – for 70 years. Each year on August 19, the anniversary of the coup, millions of Iranians ask themselves what would have happened if the US and UK had not conspired all those years ago to overthrow Iran’s democratically elected leader."
Aug 18th 2023
EXTRACT: "Edmundo Bacci: Energy and Light, curated by Chiara Bertola, and currently on view at the Peggy Guggenheim Collection in Venice, is the first retrospective of the artist in several decades. Bacci was a native of Venice, a city with a long and illustrious history of painting, going back to Giorgione and Titian, Veronese and Tiepolo. As a painter, he was thoroughly immersed in this great past – as an artist he was determined to transform and remake that tradition in the face of modernity and its vicissitudes, what he called “the expressive crisis of our time.” That he has slipped into obscurity affords us, at the very least, an opportunity to see Bacci’s work essentially for the first time, without the burden of over-determined interpretations or categories."
Aug 12th 2023
EXTRACT: "Is Oppenheimer a movie for our time, reminding us of the tensions, dangers and conflicts of the old Cold War while a new one threatens to break out? The film certainly chimes with today’s big power conflicts (the US and China), renewed concern about nuclear weapons (Russia’s threats over Ukraine), and current ideological tensions between democratic and autocratic systems. But the Cold War did not just rest on the threat of the bomb. Behind the scientists and generals were many other players, among them the economists, who clashed just as vigorously in their views about how to run postwar economies."
Aug 5th 2023
EXTRACT: "I have a modest claim to make: we need Bruno today more than ever. This is because he represents an intellectual antidote to the prevailing ideology of today which tells us that we are doomed to finitude, which comes down politically to the assertion that there is no alternative to the reign of global capitalism. Of course, Bruno did not know about capitalism, globalization or neoliberalism. What he did know however is that humanity is infinite. That we are limited only by our own narrowness of vision."
Jul 26th 2023
EXTRACT: "We studied 55,000 people’s dietary data and linked what they ate or drank to five key measures: greenhouse gas emissions, land use, water use, water pollution and biodiversity loss. Our results are now published in Nature Food. We found that vegans have just 30% of the dietary environmental impact of high-meat eaters. The dietary data came from a major study into cancer and nutrition that has been tracking the same people (about 57,000 in total across the UK) for more than two decades."
Jul 26th 2023
EXTRACT: "Art historians have never understood economics, and as a result they believe they can ignore markets: in their view, the production of art can be treated in isolation from its sale.  This is of course disastrously wrong.  But their ignorance has led to a neglect of the economic history of art. "