In 2022, DataMind were accepted onto the final round of Creative Informatics’ Resident Entrepreneur programme, proposing to use the £12,000 grant to support their five-strong core team in developing a groundbreaking new AI plug-in, the Combobulator.
Using AI-models trained by Stability AI servers on the audio from world-class music producers (such as Tipper, Max Cooper, and Mr. Bill) with their explicit permission, the Combobulator transforms a live audio signal to sound like the selected music producer’s unique style. Whilst this programming an AI to “hallucinate” an interpretation of an audio signal itself already represents a completely new paradigm for creative sound design, the plugin comes with many modular controls that will be familiar to synthesizer users.
During the development of the Combobulator MVP, DataMind came to understand how innovative their online marketplace for ethically-sourced neural networks, which will create a new economic opportunity for artists in the AI space. By curating the world’s finest collection of neural networks and establishing a global marketplace for AI-generative implementations of their work, DataMind Audio is providing a new income stream for music producers to earn royalties, addressing the financial insecurity faced by artists This represents a significant market innovation and initial sharing of the product suggest it will garner positive attention in the music software industry.
Furthermore, the idea of a neural network marketplace, where trained networks can be sold based on specific artist datasets, has broader implications beyond sound design. This concept could potentially be applied to other forms of media in various creative industries. As the technology rapidly expands and accelerates, DataMind aim to actively participate in the conversation surrounding its applications in all creative industries.
Participating in the Resident Entrepreneur programme has helped DataMind’s team develop as researchers, audio specialists, artists, and community members. Internally, they have adopted a rolling work plan and a private Discord server to help streamline production. This approach allows them to easily track each other’s progress and make updates in real-time, saving time and effort in coordinating tasks and ensuring everyone is on the same page. Mentorship was provided by Tinderbox Orchestra’s Luci Holland, whose guidance and expertise in the UK music industry proved to be an invaluable resource, providing astute insights which have helped position DataMind for success, and which is continuing on an ongoing basis. DataMind have produced two working plugins, both of which are in Alpha testing at the time of writing.
“Our experience with Creative Informatics has been invaluable. From the kickoff meeting with other grant winners and the CI team, we were inspired by the collective creativity and innovation within the community. Nicola’s advice and support have been instrumental in navigating the Catalyst Grant Application process, and we are grateful to have her as our mentor. It feels like we have a reliable support system in place.” Ben Cantil
Whilst their primary focus continues to be on further developing the Combobulator, in particular enhancing its security measures to ensure the protection of IP, user data, and prevent any potential security / piracy risks, the team are also working on the Refractalizer, which employs granular synthesis techniques combined with AI neural audio synthesis and represents another exciting avenue to expand the company’s portfolio of cutting-edge audio plugins, and provides a unique tool for music producers to explore innovative sound design possibilities.
In addition to the production of these tools, this project has also helped the company increase their knowledge and awareness of ethical considerations in this emerging field of AI creativity. Working with AI technologies raises ethical considerations around data privacy and ownership of generated content, and DataMind have striven to ask the hard questions and find their place to rise to them. The project has deepened the team’s awareness and understanding of AI ethical issues and helped them craft ethical policies for the company’s use of artist content for data training. DataMind are committed to paying out royalties of 50% of the sales price of each model, after the initial expense of training the model (£800-£1000) has been paid. On a wider scale, they hope to become a model company for generating ethical training data, working with artists in the AI music space to become the UK’s premier ethically-sourced AI neural audio software company.
In the coming months, they intend to explore further opportunities in funding, marketing, research, and development to achieve these aims. On 9 November 2022, DataMind Audio Ltd was registered as a limited company, and the Combobulator is planned for a public launch in January 2024. Whilst the instrument is now more dynamic and expressive than initially imagined, and additional features, such as model blending and side-chain functionalities, have been identified, further work on resolving inconsistencies in sound quality and processing power usage of models is being undertaken before its full unveiling.
Since their participation in Resident Entrepreneurs, the company has been successful in gaining a further £5,000 of R&D funding through Creative Informatics’ Creative AI Music & Audio Pilot Project to retrain the Combobulator using an improved version of the current algorithm to enable the tool to scale more quickly and efficiently, and reduce the likelihood of it being swamped by larger scale competitors. They have also recently been awarded £50,000 by Innovate UK to train a number of Model Reliability Engineers, who will specialise in training the tool’s neural networks in close collaboration with the artists whose styles they will be applying, and with ethical considerations at their forefront.
