AI-Generated Sound Effects: ElevenLabs’ Game-Changing Tech

ElevenLabs, the startup that made waves last year with its groundbreaking AI-driven Text to Speech platform, is back with another game-changing innovation: Text to Sound. This new AI audio model can generate a wide array of audio elements—from sound effects and short instrumental tracks to soundscapes and character voices—all from a simple text prompt.

The technology, now available to all users, represents a significant leap forward in AI-generated audio. In a demo video, ElevenLabs showcases the tool’s versatility, with every sound being AI-generated based on text descriptions. This advancement follows their successful launch of the first truly emotive, human-like Text-to-speech platform a year ago.

Text to Sound is designed with creators in mind. Film and television studios, video game developers, and social media content creators can now produce rich, immersive soundscapes quickly and affordably at scale. The tool’s ease of use is striking: users log in, describe the desired sound, click generate, and choose from the best results.

To make this expansion into sound effects possible, ElevenLabs partnered with Shutterstock, a global creative platform known for its ethically sourced content. Using Shutterstock’s extensive audio library of licensed tracks, ElevenLabs fine-tuned its model to create a versatile tool for modern creators.

Aimee Egan, Shutterstock’s Chief Enterprise Officer, expressed excitement about the partnership, stating, “ We’re excited to be partnering with ElevenLabs to fuel yet another significant innovation in AI, Text to Sound Effects, with our ethically-sourced data. The combined power of our rich and immersive library of tracks and this cutting-edge audio technology has enabled the creation of a true market first.”

How it works?

1. Login and head to Sound Effects.
2. Describe the sound you need.
3. Click generate.
4. Review samples and download the best results.

Check out ElevenLab’s Text to Sound here. Also, do check out our article on the best AI audio tools in 2024.