OpenAI is actively developing an innovative artificial intelligence tool that will allow users to create music based on text descriptions and audio recordings. The new product is aimed at applications in video and vocal accompaniment, providing users with the ability to generate musical backgrounds for videos or create accompaniment for vocal compositions.
This is reported by Finway
Collaboration with Juilliard School and Data Preparation
To enhance the quality of the future tool, OpenAI has established a collaboration with students from one of the world’s most prestigious music academies — Juilliard School. Future musicians are helping the company annotate scores, allowing the model to better understand the structure and compositional features of musical works.
“The tool will enable users to add music to existing videos or, for example, a guitar accompaniment to a vocal track.”
The Music AI Market and Competition
Although OpenAI already has experience in sound generation, the company has recently focused primarily on the development of speech synthesis models. The launch of the new product could be a significant step in the company’s return to developing music AI solutions. Currently, the release date and format of the future tool remain uncertain, and it is still unknown whether the service will be a standalone product or integrated into the already known platforms ChatGPT or the video model Sora.
In the artificial intelligence music market, players such as Google and the startup Suno are already active. In particular, Suno has integrated its model into Microsoft Copilot, highlighting the competition in the field of generating music from text. According to experts, if OpenAI successfully combines text and audio models, it could create a tool capable of posing serious competition to leading music AI platforms and significantly expand the ecosystem of products at the intersection of creativity and technology.
It was previously reported that OpenAI is also considering the possibility of creating artificial intelligence for the banking sector.