Someone Just Made Claude AI Talk Directly to VST Plugins in Real Time: Watch
A new video making the rounds online shows Claude AI communicating directly with VST plugins inside a DAW.
The system translates simple text commands into real-time parameter changes, effectively letting the AI control synths and effects as you produce.
In the demo, the creator(@inkie.beatbox) asks Claude to create a “crunchy” sound. The AI immediately tweaks compressor curves, thresholds, and dynamics settings. In another video, he requests parallel compression, and the plugin updates automatically. Instead of jumping instantly, he tells the AI to apply changes slowly so he can hear each adjustment in real time.
He also shared another video showing how simple text prompts can generate sounds inside Serum 2. By asking for an “8-bit pluck,” Claude created a matching patch within seconds. When prompted to design a neuro bass sound, the AI quickly built a complex preset in that style.
So far, every example features FabFilter and Serum plugins. This could likely mean the setup currently works through detailed parameter mapping or plugin control layers. The creator hasn’t made the technology public yet and is currently testing out the features of what he built.
Even in this early form, the innovation is striking. Producers could shape sounds, build processing chains, and fine-tune mixes using natural language instead of manual tweaking. It lowers technical barriers while speeding up workflows. Just a few years ago, creators were experimenting with building VST plugins using AI tools, and now we are seeing real-time plugin control inside DAWs. AI is clearly moving into music production at a rapid pace.
This could also mean, producers have to be less dependent on preset packs. For decades, preset packs from third party developers have shaped a lot of the tunes as we hear them today. If the technology further improves this could possibly bypass the demand for such products.
Check out the technology for yourself down below:
Sonarworks SoundID VoiceAI Giveaway
Sign up for a chance to win SoundID VoiceAI + Expansion Pack