Nov 6th 2023

We built a ‘brain’ from tiny silver wires. It learns in real time, more efficiently than computer-based AI

 

The world is infatuated with artificial intelligence (AI), and for good reason. AI systems can process vast quantities of data in a seemingly superhuman way.

However, current AI systems rely on computers running complex algorithms based on artificial neural networks. These use huge amounts of energy, and use even more energy if you are trying to work with data that changes in real time.

We are working on a completely new approach to “machine intelligence”. Instead of using artificial neural network software, we have developed a physical neural network in hardware that operates much more efficiently.

Our neural networks, made from silver nanowires, can learn on the fly to recognise handwritten numbers and memorise strings of digits. Our results are published in a new paper in Nature Communications, conducted with colleagues from the University of Sydney and the University of California, Los Angeles.

A random network of tiny wires

Using nanotechnology, we made networks of silver nanowires about one thousandth the width of a human hair. These nanowires naturally form a random network, much like the pile of sticks in a game of pick-up sticks.

The nanowires’ network structure looks a lot like the network of neurons in our brains. Our research is part of a field called neuromorphic computing, which aims to emulate the brain-like functionality of neurons and synapses in hardware.

A microscope photo showing a messy web of thin grey lines against a black background.
Each nanowire is around one thousandth the width of a human hair, and together they form a random network that behaves much like the web of neurons in our brains. Zhu et al. / Nature Communications

Our nanowire networks display brain-like behaviours in response to electrical signals. External electrical signals cause changes in how electricity is transmitted at the points where nanowires intersect, which is similar to how biological synapses work.

There can be tens of thousands of synapse-like intersections in a typical nanowire network, which means the network can efficiently process and transmit information carried by electrical signals.

Learning and adapting in real time

In our study, we show that because nanowire networks can respond to signals that change in time, they can be used for online machine learning.

In conventional machine learning, data is fed into the system and processed in batches. In the online learning approach, we can introduce data to the system as a continuous stream in time.

With each new piece of data, the system learns and adapts in real time. It demonstrates “on the fly” learning, which we humans are good at but current AI systems are not.

The online learning approach enabled by our nanowire network is more efficient than conventional batch-based learning in AI applications.

In batch learning, a significant amount of memory is needed to process large datasets, and the system often needs to go through the same data multiple times to learn. This not only demands high computational resources but also consumes more energy overall.

Our online approach requires less memory as data is processed continuously. Moreover, our network learns from each data sample only once, significantly reducing energy use and making the process highly efficient.

Recognising and remembering numbers

We tested the nanowire network with a benchmark image recognition task using the MNIST dataset of handwritten digits.

The greyscale pixel values in the images were converted to electrical signals and fed into the network. After each digit sample, the network learned and refined its ability to recognise the patterns, displaying real-time learning.

A grid of handwritten digits
The nanowire network learned to recognise handwritten numbers, a common benchmark for machine learning systems. NIST / Wikimedia, CC BY-SA

Using the same learning method, we also tested the nanowire network with a memory task involving patterns of digits, much like the process of remembering a phone number. The network demonstrated an ability to remember previous digits in the pattern.

Overall, these tasks demonstrate the network’s potential for emulating brain-like learning and memory. Our work has so far only scratched the surface of what neuromorphic nanowire networks can do.

 

Zdenka Kuncic, Professor of Physics, University of Sydney and Ruomin Zhu, PhD student, University of Sydney

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Browse articles by author

More Essays

Nov 28th 2024
EXTRACT: "Researchers analysed data from two major prostate cancer prevention trials, linking them with Medicare health records to track outcomes for over 29,000 participants. Among these, nearly 4,000 men were diagnosed with prostate cancer. Of this group, 655 underwent surgery to remove the prostate (prostatectomy), 1,056 received radiotherapy, and 2,235 did not receive treatment."
Nov 17th 2024
EXTRACT: "The weight-loss jab Wegovy made its debut on June 4 2021. It was the first new weight-loss drug to be approved by the US Food and Drug Administration since 2014. There has been a lot of excitement since the launch. Not only is the drug extremely effective (people lose about 15% of their body weight in a year), it also appears to have many benefits beyond just weight loss. It’s worth noting that the drug (generic name: semaglutide) was first used to treat diabetes, and indeed is still a blockbuster diabetes drug. So that’s two benefits already. Let’s look at some of the other potential benefits. Here are eight (and the list isn’t exhaustive)."
Oct 11th 2024
EXTRACTS: "Between 1939 and 1945, around 10% of concentration camp guards were women, yet these Aufseherinnen (overseers) as they were known, barely feature in Holocaust history or literature." ------ "One little Aufseherin, twenty years old, who had so little knowledge that she said 'excuse me' when walking in front of a prisoner, and who was visibly frightened by the first round of brutality she saw, needed exactly four days to adjust her tone and procedures, although it was totally new to her." ----- " 'The most frightening news brought about by the Holocaust and by what we learned of its perpetrators was not the likelihood that ‘this’ could be done to us, but the idea that we could do it.' ---- The true horror of genocide is found in the similarity between us and the perpetrators, not in the difference."
Oct 9th 2024
EXTRACT: "In 1928, Walt Disney's fledgling animation studio lost most of its staff to a rival company, his two latest cartoons had not found a buyer, and he had had to sell his car to meet payroll.  Disney's innovative response changed his industry, and American popular culture."
Sep 26th 2024
EXTRACT: "When it comes to economic policy, Carter is sometimes blamed for excessive regulation, government spending, and runaway inflation. His successor, Ronald Reagan, is often credited with ending the era of “big government.” But the conventional narrative fails to acknowledge that it was Carter who launched the deregulatory push that bore fruit during the Reagan years."
Sep 26th 2024
EXTRACT: "Buffett's status as the Oracle of Omaha stemmed from his ability to develop the wisdom and judgment that transformed him from a good conceptual investor into an exceptional experimental one."
Sep 26th 2024
EXTRACT: "Last year, a social-media trend featured women asking men how often they thought about the Roman Empire. The answer, it seemed, was “very”: many men claimed that the ancient empire crossed their minds weekly or even daily. That did not surprise Mike Duncan, the host of the popular 'History of Rome' podcast, and probably not Tom Holland, who has written multiple bestselling books on the topic. Mary Beard certainly understands the popular fascination, too. Her study of ancient Rome – together with her unpretentious style and brash charisma – has made her what one observer called 'a national treasure, and easily the world’s most famous classicist.' ” ----- "Beard challenges this mythology of whiteness, arguing in her 2016 book SPQR: A History of Ancient Rome that the story of the Roman Empire, which was necessarily ethnically diverse, is 'the history of people of color'. In fact, the book concludes with Emperor Caracalla’s grant of citizenship to all the empire’s subjects. The old Roman aristocracy lost its privileges, because it had not shared them."
Sep 22nd 2024
EXTRACTS: "Since the golden age of Athenian democracy, freedom of speech has been viewed as a defining feature of open societies, even as it remains under constant attack. The Athenians believed that the proper functioning of government depended on free and honest exchange of ideas, no matter how controversial or unpopular. In ancient Rome, by contrast, only senators enjoyed anything resembling free speech – and even then, as the statesman Marcus Tullius Cicero learned the hard way, speaking out could have deadly consequences." ----- "In our hyper-connected world, where mobile phones outnumber people and most of the global population has internet access, the decline of traditional news outlets has deepened our dependence on social media. As opaque algorithms shape the news we consume and our perception of reality, the corporations and oligarchs controlling these platforms pose a growing threat to free speech. Although they claim to be its ultimate defenders, their business model, by amplifying disinformation and identity-based grievances for profit, renounces the responsibility that sustains it."
Jul 27th 2024
EXTRACT: "Some conservative intellectuals think the west has already adopted Christianity-lite. Many point to the book Dominion: The Making of the Western Mind (2019), by historian Tom Holland. Holland argues that despite declining religious belief, Christian ideas remain central to western civilisation. He views liberalism – our dominant political philosophy – as secularised Christianity. For him, core western ideas, like universal human rights, equality and dignity, stem from Christianity."
Jul 26th 2024
EXTRACTS: "We often hear about the importance of the human microbiome – the vast collection of bacteria and fungi that live on and inside us – when it comes to our health. But there’s another, equally important part of this microbial community that remains far less known: the virome." ----- "Viruses are the most abundant biological entities on Earth, with an estimated 10³¹ viral particles globally and about 10¹³ in each human being." ----- "Understanding the virome could revolutionise medicine and public health."
Jul 16th 2024
EXTRACTS: "Trump joins tens of thousands of Americans treated for non-fatal gunshot wounds each year. Such experiences can shatter people’s assumptions that they are living in a safe, understandable and controllable world, leaving them feeling unworthy, unsafe and unsure. As a result, survivors of non-fatal gun violence face increased risks of depression, anxiety, substance use and post-traumatic stress disorder (PTSD). PTSD can feel overwhelming." ---- ".... some trauma survivors experience post-traumatic growth. They may develop greater empathy, stronger relationships, deeper spirituality and find new meaning in life. After being shot in 1981, the then president Ronald Reagan’s trauma seemed to deepen his sense of empathy and humility. He felt God had spared him for a reason, spurring him to reduce nuclear tensions with the Soviet Union."
Jul 15th 2024
EXTRACTS: "Artificial sweeteners such as sucralose are not metabolised by the human body so they are excreted – this is what makes them low-calorie sugar alternatives. And that’s where the environmental problem begins. Current wastewater treatment plants are unable to remove these sugar mimics, meaning they end up in our environment – in our water, rivers and soil." --- "Forever chemicals are increasingly present in our streams, rivers and oceans – most notably per- and polyfluoroalkyl substances (PFAS) that don’t degrade. PFAS are synthetic chemicals found in many consumer products, including skincare products, cosmetics and waterproof clothing. PFAS can remain in the human body for many years, and some present significant risks to our health – potentially causing liver damage, thyroid disease, obesity, infertility and cancer."
Jul 3rd 2024
EXTRACTS: "Psychologist, James Hillman had concerns about what I like to call the 'loneliness-as-pathology' "---- "....Hillman went on to argue...: 'If loneliness is an archetypal sense built into us all from the very beginning, then, to be alive is also to be lonely. Loneliness, therefore, will come and go as it chooses in the course of a lifetime, quite apart from our efforts to deny or avoid this reality.' "
Jul 3rd 2024
EXTRACT: "How can we be at least 15 times richer than our pre-industrial Agrarian Age predecessors, and yet so unhappy? One explanation is that we are not wired for it: nothing in our heritage or evolutionary past prepared us to deal with a society of more than 150 people. To operate our increasingly complex technologies and advance our prosperity, we somehow must coordinate among more than eight billion people."
Jun 25th 2024
EXTRACTS: "What’s interesting about the entire Russia-North Korea showy display of camaraderie is China’s response: silence. China has misgivings about how things are unfolding, which reports suggest prompted Chinese president Xi Jinping’s call to Putin to call off the latter’s visit to Pyongyang. Obviously, Putin didn’t heed Xi’s request." ----- "The Sino-Korean animosity dates back centuries and took shape when Korea was a vassal state of imperial China. Unfortunately, this animosity extended to modern times when Mao Zedong decided to station Chinese troops in North Korea even after the conclusion of the Korean war, and when Beijing did not aid Pyongyang in its nuclear ambitions. It didn’t help either that the founding leader of North Korea, Kim Il-sung, was suspected of espionage and was nearly executed by the Chinese Communist party in the 1930s."
Jun 19th 2024
EXTRACT: "Ultra-processed foods (such as packaged snacks, sugary drinks, instant noodles and ready-to-eat meals) often contain emulsifiers, microparticles (such as titanium dioxide), thickeners, stabilisers, flavours and colourants. While research on humans is limited, studies on mice have shown that these ingredients alter the gut microbiome (the community of microorganisms living in the intestines) in several ways. These many microbiome changes can in turn affect the way the immune system functions."
Jun 9th 2024
EXTRACT: "Alzheimer’s disease can be split in two subgroups, familial and sporadic. Only 5% of patients with Alzheimer’s are familial, inherited, and 95% of Alzheimer’s patients are sporadic, due to environmental, lifestyle and genetic risk factors. Consequently, the most effective tactic for tackling Alzheimer’s is preventative and living a healthy lifestyle. This has led researchers to study risk factors associated with Alzheimer’s."
Mar 8th 2024
EXTRACT: "This study suggests that around 10% of people diagnosed with dementia may instead have underlying silent liver disease with HE causing or contributing to the symptoms – an important diagnosis to make as HE is treatable."
Jan 28th 2024
EXTRACT: "Health disparity is a powerful weapon in the savage class warfare otherwise known as neoliberalism. (In 2020, the RAND Corporation did a study of the transfer of wealth over the last several decades from the working-class and the middle-class to the top one percent. Their estimate is a staggering $47 trillion – that is how much the “upward redistribution of income” cost American workers between 1975 and 2018.) Neoliberalism is a brutal form of labor suppression, which uses health as a means of maintaining and reproducing a condition in which wealth is constantly being redistributed upwards, and the middle-class is kept in a constant state of fear of sinking into the ranks of the poor. Medical expenses are the leading cause of bankruptcies in America – and that’s according to the American Bankruptcy Institute. The ballooning costs of healthcare serve to maintain a system marked by morally unacceptable health inequity and injustice."
Jan 28th 2024
EXTRACT. "But living longer has also come at a price. We’re now seeing higher rates of chronic and degenerative diseases – with heart disease consistently topping the list. So while we’re fascinated by what may help us live longer, maybe we should be more interested in being healthier for longer. Improving our “healthy life expectancy” remains a global challenge. Interestingly, certain locations around the world have been discovered where there are a high proportion of centenarians who display remarkable physical and mental health. The AKEA study of Sardinia, Italy, as example, identified a “blue zone” (named because it was marked with blue pen),....."