MIT Researchers Enable Flexible ML Models Through Brain Dynamics


November 15, 2022

By Rachel Gordon, MIT News Service

Recently MIT researchers built “liquid” neural networks, inspired by the brains of small species: a class of flexible, robust machine learning models that learn on the job and can adapt to changing conditions, for real-world safety-critical tasks, like driving and flying. 

The flexibility of these “liquid” neural nets meant boosting the bloodline to our connected world: better decision-making for many tasks involving time-series data, such as brain and heart monitoring, weather, and stock prices. But these models become computationally expensive as their number of neurons and synapses increase and require clunky computer programs to solve their underlying, complicated math. But all of this math, similar to many physical phenomena, becomes harder to solve with size, meaning computing lots of small steps to arrive at a solution. 

Now, the same team of scientists discovered a way to alleviate this bottleneck by solving the differential equation behind the interaction of two neurons through synapses (there hasn’t been a known solution since 1907) to unlock a new type of fast and efficient artificial intelligence algorithms. These modes have the same characteristics of liquid neural nets – flexible, causal, robust, and explainable – but are orders of magnitude faster and scalable. 

You could use this type of neural net for any task that involves getting insight into data over time, as they’re compact and adaptable even after training – while many traditional models are fixed. 

The models outperformed state-of-the-art counterparts on a slew of tasks, with considerably higher speed-ups and performance in recognizing human activities from motion sensors, modeling physical dynamics of a simulated walker robot, and event-based sequential image processing. On a mortality-based prediction task, for example, the models were 220 times faster on a sampling of eight thousand patients. 

“The new machine learning models we call ‘CfC’s’ replace the differential equation defining the computation of the neuron with a closed form approximation, preserving the beautiful properties of liquid networks without the need for numerical integration. CfC models are causal, compact, explainable, and efficient to train and predict. They open the way to trustworthy machine learning for safety-critical applications,” says MIT professor and CSAIL Director Daniela Rus. 

Keeping things liquid 

Differential equations enable us to compute the state of the world or phenomena as it evolves, but not all the way through time – just step-by-step. To model natural phenomena through time and understand previous and future behavior, like human activity recognition or a robot’s path, for example, the team reached into a bag of mathematical tricks to find just the ticket: a “closed form” solution that models the entire description of a whole system, in a single compute step. 

With their models, dubbed a “closed-form Continuous-time” (CfC) neural network, you can compute this equation at any time in the future, and at any time in the past. Not only that, but the speed of computation is much faster because you don’t need to solve this differential equation step-by-step. 

Imagine if you have an end-to-end neural network that receives driving input from a camera mounted on a car. The network is trained to generate outputs, like the car’s steering angle. In 2020, the team solved this by using liquid neural networks with 19 nodes, so 19 neurons plus a small perception module could drive a car. A differential equation describes each node of that system. With the closed-form solution, if you replace it inside this network, it would give you the exact behavior, as it’s a good approximation of the actual dynamics of the system. They can thus solve the problem with an even lower number of neurons, which means it would be faster and less computationally expensive. 

These models can receive inputs as time series (events that happened in time), which could be used for classification, controlling a car, moving a humanoid robot, or financial and medical forecasting. With all of these various modes, it can also increase accuracy, robustness, and performance, and, importantly, computation speed – which sometimes comes as a trade-off. 

Solving this equation has far-reaching implications for advancing research in both natural and artificial intelligence systems. “When we have a closed-form description of neurons and synapses’ communication, we can build computational models of brains with billions of cells, a capability that is not possible today due to the high computational complexity of neuroscience models. The closed-form equation could facilitate such grand-level simulations and therefore opens new avenues of research for us to understand intelligence,” says Ramin. 

Moreover, there is early evidence of Liquid CfC models in learning tasks in one environment from visual inputs, and transferring their learned skills to an entirely new environment without additional training. This is called out-of-distribution generalization, which is one of the most fundamental open challenges of artificial intelligence research.  

“Neural network systems based on differential equations are tough to solve and scale to, say, millions and billions of parameters. Getting that description of how neurons interact with each other, not just the threshold, but solving the physical dynamics between cells enables us to build up larger-scale neural networks,” says MIT CSAIL research scientist Ramin Hasani. “This framework can help solve more complex machine learning tasks – enabling better representation learning – and should be the basic building blocks of any future embedded intelligence system.”

“Recent neural network architectures, such as neural ODEs and liquid neural networks, have hidden layers composed of specific dynamical systems representing infinite latent states instead of explicit stacks of layers,” says Dr. Sildomar Monteiro, AI & Machine Learning Group Lead at Aurora Flight Sciences, A Boeing Company, who was not involved in this paper. “These implicitly-defined models have shown state-of-the-art performance while requiring far fewer parameters than conventional architectures. However, their practical adoption has been limited due to the high computational cost required for training and inference.” He adds that this paper “shows a significant improvement in the computation efficiency for this class of neural networks … [and] has the potential to enable a broader range of practical applications relevant to safety-critical commercial and defense systems.”

Hasani and Mathias Lechner, Postdoctoral Associate at MIT CSAIL wrote the paper supervised by MIT Professor and CSAIL Director Daniela Rus, alongside MIT CSAIL Postdoc Alexander Amini, Lucas Liebenwein (former PhD student), MIT CSAIL PhD student Aaron Ray, Max Tschaikowski, Associate Professor in Computer Science at Aalborg University, Denmark, and Gerald Teschl, Professor at the Faculty of Mathematics of University of Vienna. It will be published today in Nature Machine Intelligence. This research was partially sponsored by the United States Air Force Research Laboratory and the United States Air Force Artificial Intelligence Accelerator. 

To view the code respository, click here.

Robotics World News

  • Seed Group and Ryberg Partner to Bring AI-Assisted Disinfection Technology to the Middle East

    Seed Group and Ryberg Partner to Bring AI-Assisted Disinfection Technology to the Middle East

    Netherlands-based Ryberg combines the latest in computer vision, robotics, and infection prevention-technologies to deliver intelligence and efficiency in disinfection. Ryberg has developed Disinfection Robots, which are self-driving disinfection machines. Ryberg’s patented Disinfection Engine makes intelligent disinfection decisions, allowing the robots to disinfect spaces for up to 6 hours—to bring a layer of defense in the… Read More…

  • Wind River and Airbus Collaborate on Certification of Automatic Air-to-Air Refueling (A3R)

    Wind River and Airbus Collaborate on Certification of Automatic Air-to-Air Refueling (A3R)

    Wind River, a global leader in delivering software for mission-critical intelligent systems, announced it has worked with Airbus to support the A330 Multi-Role Tanker Transport (MRTT) aircraft for automatic air-to-air refueling (A3R). The MRTT aircraft is the world’s first tanker to be certified for automatic air-to-air refueling boom operations in daylight. Airbus uses VxWorks 653 for the A330 MRTT… Read More…

Products for Robots & Cobots

  • Jabil, OSRAM, Artilux Develop Next-Generation 3D Camera Prototype

    Jabil, OSRAM, Artilux Develop Next-Generation 3D Camera Prototype

    Manufacturing solutions provider Jabil has announced that its optical design center in Jena, Germany, is currently demonstrating a prototype of a next-generation 3D camera with the ability to operate in both indoor and outdoor environments up to a range of 20 meters. The prototype was the result of a combination of proprietary technologies from Jabil,… Read More…

  • Product Profile: IDS CMOS Sensor IMX273

    Product Profile: IDS CMOS Sensor IMX273

    What is it? IDS cameras can be found in automotive, packaging, printing, and robotics industries, as well as in medical technology, traffic monitoring, security, kiosk systems, and logistics contexts.  The global shutter CMOS sensor IMX273 in the Sony Pregius series offers high image quality, high sensitivity and wide dynamic range. With a resolution of 1.58… Read More…