AI Character Acting and Relighting Is Crazy Good

Published 2024-07-09
I've got some amazing breakthroughs in AI character acting and creative relighting to share with you today. From advancements in AI lip-syncing to the exciting possibilities of relighting your images, there's a lot to explore. Let’s dive in!

* Thank you to Antti Karppinen (@postphotography.xyz) since I kind of cribbed a frame from his video for the thumbnail!!

What’s Inside?

AI Character Acting: Discover the latest in AI-driven character expressions with Live Portrait

Creative Relighting: Explore the new creative relighting feature that's transforming how we enhance images. 🌟💡

Hands-On Demonstrations: See real-time examples and learn how to use these new tools effectively. 🎬✨

Pro Tips: Get the best out of Live Portrait and creative relighting with our expert tips and tricks. 🛠️💡

Highlights:
00:00 - Introduction to AI Character Acting
00:33 - Lip Syncing Advancements and Live Portrait
01:03 - New Approach to AI Character Expression
02:31- Limitations and Workarounds
03:10 - How LivePortrait Works
03:55- LivePortrait Walkthrough Tutorial
5:43 - The Craziest Thing You'll see Today
07:17- Introduction to Creative Image Relighting
09:08- Limitations on Magnific Relighting
9:35 - Free Alternatives
10:18 - Krea's other amazing feature - Video Upscaling!


LINKS
LivePortrait: huggingface.co/spaces/KwaiVGI/LivePortrait
Magnific.AI: magnific.ai/
Krea.AI: www.krea.ai/home

All Comments (21)
  • @thronosstudios
    This is basically like facial motion capture for 3D characters but with basically already "rendered" images. Super interesting
  • @aquato33
    I see a future with a ton of horrible content generated by technicians claiming it to be animation or film or story telling and it's just crap. Fortunately this will last about 6 months to a year before people get sick of watching garbage and lose interest.
  • @owenlarson07366
    So we’ll eventually be able to remake entire movies with characters and scenes from different films. Basically complete style transfer, voices included. Weird.
  • @LouisGedo
    Definitely not blown away by either tech but I love the people who are bringing us ever closer to blown away results 👍 👍 👍
  • @IwatoHyena
    I find it astonishing how just two years ago, I was writing code to coax an AI model into producing what I called 'trippy,' distorted fever dream visuals. Witnessing its evolution since then is both awe-inspiring and unsettling hahah. I find myself repeating the matra, "I can't wait to see where it will be in a year"
  • @noobicorn_gamer
    Basically a “lite” version of Hollywood mocap feature can be available for the public to use soon. Will greatly help with my current ongoing projects. Neat!
  • @suzevidz
    I get so excited when I see that you've uploaded a new video. I always learn something cool and new.
  • @shadyendeavor
    crap, now I may need to rethink my current project/video I'm working on. Thanks a lot, Tim! But seriously, the Live Portrait stuff looks really good. As so many times before, it looks like it could make other options irrelevant.
  • @DVAted
    Thanks for all of your constant, up to date, thorough videos! Props
  • @dylan_curious
    I see so many TikTok’s where people have to label the character that they’re pretending to be with text to make the joke work. It’s gonna be so different when you can actually make it feel like the video is filmed in real life with those people, but use different facial expressions and voices. Great video as always.
  • @azhuransmx126
    We are looking at the mind of the machines and using that mind to take out the thoughts of our own minds because our brains doesn't come with a display integrated.
  • How different is Magnific Relight from Magnific Style Transfer? They seem very similar in my brain...
  • Soooo, can you even get a landscape layout you can use in an AI video?
  • @phwilk
    This is incredible. I have normally kept a hard stance in not using AI because as a creative designer, it feels like losing control of creativity. But, just the other day, I softened my stance. I have a project that will require multiple speaking parts. I don't have a large budget for hiring voice actors. So, I stumbled upon text-to-speech and text-to-speech AI generation that blew my mind. I was able to alter the delivery of the voice over based off of my own vocal audio; and it worked for Male and female voices. My work pipeline instantly expanded! But now this! The mocap translation is incredible. I could find a use for this without surrendering everything to AI.
  • @capitannegro100
    This would've been perfect for that movie with Kevin Spacey they re-shot
  • bruh i play in amateur movies as an actor, its being really bruh years for artist who dont want direct stuff and more doing it like to draw, write or acting rather typing prompts.