OpenAI may be reducing its efforts in the video generation market with the closing your Sora applicationbut ByteDance confirmed on Thursday that its new audio and video model, Dreamina Seed 2.0is now being implemented on your publishing platform, cap cut.
ByteDance says the model allows creators to compose, edit and sync video and audio content using prompts, images or reference videos.
The gradual rollout will begin with CapCut users in Brazil, Indonesia, Malaysia, Mexico, Philippines, Thailand and Vietnam, with more markets added over time.
The news of the launch on CapCut follows a recent report that said the The global launch of the model would be stopped.while working to address intellectual property issues that attracted hollywood reviews on alleged copyright infringement. That probably explains the limited number of markets where the model is currently available within CapCut.
In China, the model is available to users of ByteDance’s Jianying app.
The video generation model works without reference images, even if the creator only uses a few words to describe the scene he has in mind, ByteDance says in its advertisement. CapCut is also good at rendering realistic textures, motion, and lighting in a variety of perspectives and visual angles, which the company says could be used to edit, enhance, or correct the creator’s own footage.
Another use case would be to allow creators to test potential ideas based on concepts or initial sketches before filming the actual video.
Additionally, Dreamina Seedance 2.0 can be used for a wide range of content, including cooking recipes, fitness tutorials, business or product summaries, and videos with content focused on motion or action, where AI video models have historically faced challenges, the company explains.
At launch, the model supports clips up to 15 seconds long in six aspect ratios.
In CapCut, the model will be implemented in different areas, including editing functions such as AI Video and generation tools such as Video Studio. It will also come to ByteDance’s AI generation platform, Dreamina, and its marketing platform, Pippit.
Given its ability to create realistic content, ByteDance says it has added security restrictions, so the model will not have the ability to make videos from images or videos containing real faces. CapCut will also block the use of unauthorized generation of intellectual property. (However, if the restrictions worked correctly, the model would already be available in the United States. More adjustments are likely still being made.)
Content produced by Dreamina Seedance 2.0 will also include an invisible watermark, which will help identify content created with the model when shared outside the platform, ByteDance added. This could help with things like takedown requests from rights holders in case the model allowed copyrighted content to pass through.
ByteDance says it will partner with experts and creative communities as the model is implemented to iterate and improve the model’s capabilities.
