Gemini App: Turn Photos into Videos with New AI Feature

Google’s gemini App Gains Powerful ‘Ingredients to Video’ Feature, Expanding AI Video Creation

Google is considerably enhancing its gemini app with the rollout of Ingredients to Video, a new feature leveraging Veo 3 that allows users to generate videos guided by reference photos. The update, initially launched in Google’s dedicated AI filmmaking tool Flow, is now available to subscribers of Google AI Plus, google AI Pro, and Google AI Ultra plans, begining today.

The rise of AI video creation is rapidly transforming industries, from advertising to social media, and Google is positioning itself as a key player. The company recently introduced the Veo 3.1 video-generation model to Gemini users, boasting improved realism, richer audio, and greater narrative control. “Ingredients to Video” builds on this foundation, offering a more intuitive and precise method for video creation.

Did you know? – Google’s Imagen, another AI model, can generate the reference images used in “Ingredients to Video,” creating a fully AI-powered video creation workflow.

Announced alongside the Veo 3.1 release on October 15,the feature enables users to upload reference images that directly influence the generated video’s characters,objects,and overall style. According to a company release, this capability streamlines the video generation process by reducing the need for lengthy and detailed text-based prompts. Users can even utilize images generated with Google’s Imagen AI to further refine their vision.

The impact of “Ingredients to Video” extends to several key areas of video production:

• Character Consistency: Ensuring a character maintains the same appearance throughout different scenes.
• style Transfer: Applying specific textures, lighting, or artistic styles from a reference image to the entire video.
• World-Building: Creating videos where objects and scenes align with a user’s pre-defined aesthetic or environment.

Pro tip: – For best results, use high-quality, well-lit reference images. Clear visuals help Veo 3.1 accurately interpret yoru desired video style and content.

In a related update, Google is now displaying the specific video generation model – in this case, Veo 3.1 – being used within the Gemini Tools menu, providing users with greater transparency.

Despite these advancements, Veo 3 in Gemini still faces limitations when compared to competitors like OpenAI’s Sora. One analyst noted that Gemini and Veo 3 currently employ stricter content guardrails, refusing to generate certain types of content.

Why: Google is enhancing its Gemini app to compete in the rapidly growing AI video creation market and provide users with more intuitive and powerful tools.
Who: The feature is available to subscribers of Google AI Plus, Google AI Pro, and Google AI ultra plans. Google is positioning itself as a key player, while OpenAI’s Sora is a competitor.
What: The “Ingredients to Video” feature allows users to generate videos guided by reference photos, leveraging Veo 3 and Veo 3.1. The rollout of Veo 3.1 in the Gemini app is underway.
How did it end?: while the feature is rolling out, Gemini and Veo 3 still have stricter content guardrails than competitors like OpenAI’s Sora, limiting the types of videos they can generate. The rollout to all paid users is expected next week.