If the order of your data is important for understanding it, then the LMU is for you.
The LMU provides the best possible compression and representation of information over time, allowing you to get state-of-the-art results with smaller networks and less training.
About Legendre Memory Units
The LMU has been recognized by DeepMind and others as the first state space neural network. It is proven to be not just better, but optimal, for solving time series problems. This allows us to bring down power demands and energy costs while remaining highly accurate, even with less data and smaller models. In fact, the LMU has proven so successful that we developed a TSP Chip specially built to run it for even greater efficiency gains.
With the LMU, we are bringing a wide range of features, from full speech recognition to advanced signal processing, to the edge. See our case studies on how this has already been done for keyword spotting in hospitals and smart garments monitoring heart rates.
The first published paper on LMUs — our state-of-the-art algorithm, and a new kind of neural network
LMU-based keyword spotting achieves state-of-the-art accuracy and low parameter counts
LMUs outperform transformers on language modeling, with better data efficiency and improved scaling