From the source
Add music and sound effects to any video in ElevenCreative Elevate any video you upload to ElevenCreative by generating sound effects alongside a soundtrack with Instant Soundtracks.
The new update to ElevenCreative, launched today, allows you to upload a video, and the model scores it with original music, then analyzes the footage for sound effect cues, and generates sound effects aligned to those timestamps.
These generated effects are automatically placed on the timeline to match the video.
The model watches the video for moments that call for an effect and places each one at the right timestamp, for example, a whoosh timed to the logo at the end of an ad.
Today’s update also brings better timing for short-form content, as well as more accurate mood switching across scenes.
You can now also use your video's existing audio as a reference for the new score.
The model can analyze the audio — its genre, crescendos, beats per minute, or instrumentation, for example — and use it to shape the new score.
…
