- AI Valley
- Posts
- 🐶 Google unveils V2A
🐶 Google unveils V2A
PLUS: Runway launches new model Gen-3
Together with
Howdy, happy Wednesday, AI family 🐶
Are you able to catch up with all of the updates in the AI space?? 😱
In today’s edition:
✨ Runway launches new model Gen-3 Alpha
🔉 Google Deepmind generates audio for silent videos
🔍️ + new AI Tools, Resources, and other news
Reading time: 4 minutes.
"We’re racing with the machines, not against them." — Charles Petzold
🤖 Main AI Updates
Runway launched Gen-3 Alpha, its latest AI model for generating video clips from text descriptions and still images.
It's like every week is Christmas again. First Luma Labs’ Dream Machine, then Kuaishou's Kling, and now it’s Runway Gen-3 (AI videos are flying to the moon.)
Why Gen-3 is different:
The model can handle complex scene changes and a wide range of cinematic choices. The model has been trained with highly descriptive, temporally dense captions/texts.
However, what stands out immediately is the photorealism—especially with human faces, gestures, and emotions (this is close to OpenAI’s Sora)
Runway partnered with entertainment and media organizations to create custom versions of Gen-3 for more stylistically controlled and consistent characters, targeting specific artistic and narrative requirements.
Here are 10 examples of Gen-3 - take a look 👀
Why does it matter?
As competition in AI video generation heats up, Runway's Gen-3 Alpha empowers artists and filmmakers to create high-quality, controllable videos with ease, pushing the boundaries of storytelling and creative possibilities.
No, robots aren’t replacing us tomorrow: But yes, understanding AI and how to put it to work is essential to staying competitive.
Luckily, you do not have to spend months online or drop $$$ on expensive classes. Brilliant helps you master AI with gamified bite-sized lessons in minutes a day, whenever, wherever.
Their first-principles approach helps you master any concept easily.
Progress through lessons and challenges tailored to your level. Designed for ages 13 to 113.
Join 10 million people around the world and start your 30-day free trial today. Plus, AI Valley readers get a special 20% off a premium annual subscription.
Sound is a critical part of making a good video.
This is why, despite the realism of the output from tools like Google's Veo, OpenAI's Sora, and Runway's Gen-3 Alpha, the videos often feel lifeless.
Google Deepmind's latest AI model hopes to fill this void by generating synchronized soundtracks for your video. It's pretty wild.
Google's V2A (video-to-audio) technology generates musical score, sound effects, and voice over dialogue that 'matches the characters and tone of a video'.
To enhance audio quality and enable more specific sound generation, DeepMind trained the model on additional data, like AI-generated sound annotations and dialogue transcripts.
Why does it matter?
The technology could help revive and enhance historical footage, silent films, and other archival material. However, generative AI tools like V2A also threaten to disrupt the film and TV industry, potentially eliminating jobs without strong labor protections.
Here are 4 examples - turn your sound on.
*Indicates a sponsored link
🤔 Our take
Full feature-length film AI studio is almost here!
Synthetic character generation? Solved
Temporal Consistent Animation? Solved
Voice cloning? Solved
Image to video? Solved
Text to video? Solved
Lip Sync? Solved
Video to audio? Solved
Text to audio(music generation)? Solved
PS: take it with a grain of salt. Quack, Quack
🤌 Quick Tech/AI updates
Clone is building low-cost, biomimetic, and intelligent androids, trained to perform all the common labor for daily life. These next 5 years are going to change everything.
Former head of NSA joins OpenAI board. Nakasone will participate in the board's safety and security committee for critical decisions on OpenAI projects.
LinkedIn introduces new AI tools. The aim is to streamline job searches, write cover letters, personalize learning, and more.
Google is redesigning its search engine — and it’s AI all the way down. “What we see with generative AI is that Google can do more of the searching for you,” says Liz Reid, Google’s head of search.
Perplexity now displays weather, currency conversion, and simple math directly through cards. This move aims to keep users from going to Google for such results.
TikTok introduces gen AI avatars of creators and stock actors for ads. "Custom Avatars" allow creators to scale their likeness for multilingual avatars and brand collaborations, while brands can use pre-built "Stock Avatars" to add a human touch.
OpenAI CEO Sam Altman is considering restructuring OpenAI into a for-profit benefit corporation, a move that could lead to an eventual IPO and allow Altman to take a stake in the company.
Google is rolling out a new option called “Listen to this page” that can read a webpage out loud to you from within the Android Chrome browser. It’s just like a podcast.
Apparate Labs introduced PROTEUS, a low-latency foundation model for generating highly realistic and expressive humans.
🔗 Useful AI Links
Trending Tools
PlugBear - Integrate your custom GPTs/Claude into Slack/Discord/Teams/Zendesk/HubSpot in 10 minutes. No coding is required.
Wallpaper Al - A high-resolution wallpaper generator that uses AI to create wallpapers for smartphone or desktop.
Humanize AI Text - Transform AI writing to be more human-like.
Summit - The AI life coach for your biggest goals.
Drip - AI-powered introspections & journaling.
AI Findings/Resources
When will singularity happen? 1700 expert opinions of AGI
What is intelligent life?
Will we run out of data to train AI models soon?
Contents you might like
1/ This is the future of robotics
2/ 26k people watching fake livestream
✌️ AI Valley Picks
Business
"F*ck You" Money - The definition of "Fuck You" Money in my mind.
How an entire generation learned more about money, economics, & business from a game called "RUNESCAPE" than they did from 12 years in school
The most simple framework for free and hot startup/business idea.
Productivity
Sources of Advantage.
Which one you'd love to see on this list? |
That’s all for today
Thanks for reading. See you next time! Uff uff 🐶
💡 Help me get better and suggest new ideas at [email protected] or @heyBarsee
👍️ Like what you see? Subscribe Now
Reach 85K+ Readers
Acquire new customers and drive revenue by partnering with us
Sponsor AI Valley and reach over 85,000+ entrepreneurs, founders, software engineers, investors, etc.
If you’re interested in sponsoring us, email [email protected] with the subject “AI Valley Ads”.
What'd you think of today's edition? |
We appreciate your continued support! We'll catch you in the next edition 👋
Written and edited by Barsee and Jet.