Stability AI has released a new AI model-stable virtual camera, which the company claims to convert 2D images into “immersive” videos with realistic depth and perspective.
Virtual cameras are often used in digital film production and 3D animation to capture and navigate scenes in real time. Stable Stability Attempts to add generator AI to the mixture to provide greater control and customizability. Blog Posts.
A stable virtual camera will generate a “new view” of the scene from one or more images (32 in total) at the user-specified camera angle. The model can generate videos that propagate along the “dynamic” camera path, including presets such as “spiral”, “Dolly Zoom”, “Move”, and “Pan”.
The current iteration of the stable virtual camera (study preview) can generate videos in a plaza (1:1), portrait (9:16) and landscape (16:9) aspect ratio up to 1,000 frames. Stability warning that the model may produce lower quality results in some cases, especially images with humans, animals, or “dynamic textures” (e.g., textures of water).
Stability notes in the blog post: “Highly ambiguous scenes, complex camera paths that intersect objects or surfaces, and irregularly shaped objects can cause flickering artifacts.”
Stable virtual cameras can be studied under non-commercial licenses. This model can be downloaded from the AI Dev platform hug.
Stability, the troubled company behind popular image generation models Stable diffusion,,,,, New cash was raised last year As investors including Eric Schhmidt and Napster founder Sean Parker, trying to turn things around. Stable co-founder and former CEO Emad Mostaque reportedly made the employees resign, partnerships with Canva, and focus on the company’s prospects.
Over the past few months, Stability has hired a new CEO to appoint Titanic director James Cameron to the board, and Several new image generation models have been released. In early March, the company Work with chip maker arms Bringing an AI model that can generate audio, including sound effects to mobile devices running the arm chip.
