AI-based sound synthesizer: Introduction to Neurorack

Abstract:

<aside> 💡 The Neurorack is the first ever AI-based real-time synthesizer, which comes in many formats and more specifically in the Eurorack format. The current prototype relies on the Jetson Nano and the Eurorack hardware and software have been developed by our team: Philippe Esling, Martin Vert and myself. The goal of this project is to design the next generation of music instrument, providing a new tool for musician while enhancing the user's creativity. It proposes a novel approach to think and compose music. We deeply think that AI can be used to achieve this quest.

We designed our instrument so that it follows several aspects that we found crucial:

• Musical: the generative model we choose is particularly interesting as it produces sounds that are impossible to synthesize without using samples.
• Controllable: the interface was relevantly chosen, being handy and easy to manipulate.
• Real-time: the hardware behaves as traditional instrument and is as reactive.
• Stand alone: it is playable without any computer.

One of the biggest advantage of our module is that it can interact with other synthesizer. Following the classical conventions of modular synthesizers, our instrument can be controlled using CVs (control voltages) or gates.

</aside>

Resources**:**