How Synthetic Media will change Hollywood? with AI, Digital Humans, Voice Cloning + Synthesia Demo

hey i'm sander and today i'm really excited to explore with you the possibilities of synthetic no you're not sandra i don't think you're going to be exploring any opportunities here yeah well i look like you i can speak like you and i can probably even write better than you so maybe just let me take this one no you're not going to be taking this one i'm going to be taking this one but maybe next time okay but don't forget to like this video and subscribe yeah all of this that you just saw was fully completely computer generated the visual and the audio and the voice as well i'm really excited to explore with you synthetic media and when when i say synthetic media when people first come to think about is actually deep fakes and those are those videos that we've seen on social media like this one when there's so many haters i really don't care because their data has made me rich beyond my wildest dreams or this one that was a president obama we're entering an era in which our enemies can make it look like anyone is saying anything at any point in time even if they would never say those things but actually synthetic media is any media that's created by computers or modified by computers so actually the media that we see around us the for example playing around with instagram filters or tick-tock filters all of those things are synthetic media because they're manipulated or they're creating or modified using the help of computers so when you turn into a cat or you turn your mask on that's actually synthetic media as well and then there's also this high-end synthetic media that the big movie producers use you know for making those masks tracking people's faces and those very complex models in mapping those out and making them sound and look real in movies and there's a great development that's happening there there this is also synthetic media through this digital domain example here so there's these two categories of the consumer side where you know we play around with the filters you can use the time machine filter or snapchat that i've used here when i turn myself older or younger or they're those big high-end movie productions where these professionally made used hours and months of work and millions of dollars to make this happen but now using those tools those tools are getting more and more accessible we see the consumer ease of use coming to professional tools and professional tools becoming more and more available to consumers and we see this middle presumer class coming up from companies like synthesia or rephrase or windsor that we're going to see later on and we're moving this general phase from digital to everything driven by ai we already did that in music where we moved from analog instruments to digital instruments so now most of the music being produced beats voices pitch corrections all done by ai using computers same thing happened in written press from writing sending facts to sending emails to now most of the emails being generated by computers using the titles and the content and they're mostly automatically even sent out and the same thing is happening now in the video world where no need there for cameras no need for microphones lights or crews and we can just generate all of that content we can produce content on our computers and i'm going to show you how i did the intro bit as well but why now and why video first of all why video 68 of consumers prefer watching videos instead of reading articles or looking infographics or ebooks that's why youtube is the second largest search engine and the top three most popular apps for gen z are all video apps snapchat twitch and tick tock and that consumer traffic by the end of this year will be 82 video it's also important for business because it increases the click-through rate increases the exposure in google search as they include 62 of videos in google search results and people who have video on their website they spend actually longer on the website two minutes long the next day so here's an example everyone's got a personal video just for them hey sebastian how are you doing hey david how are you doing hey michael how are you doing and they just had to reply using computer generated personalized email is actually having business impact as you saw before peel a company was making phone cases used this is an example with 10 000 of their customers the ones who got the personalized video from their ceo thanking them from their purchase and the ones who didn't and the ones who did get that personalized video calling out their name and thanking them for the purchase were 87 more likely to buy from them again so it's a significant business driver in getting more revenue and having a more personalized connection synthesia themselves also reports that they're getting higher engagement when they're using video one of their clients and their massive cost savings in video production by using synthetic media production platforms and what why now why we're just now getting those tools accessible to everybody number one thing is that google machine learning for word accuracy surpassed human level accuracy in 2017 just four years ago the same thing is now happening with the production of voices so google wavenet is 92 human speech quality and being able to do that in 80 plus different languages and variants so you can produce 20 seconds of audio in just one second of production and this truly shows that we're passing the turning test during test which means that whether computer processes the audio or human process the audio we don't hear the difference and i think we're hitting that infection point now with some of the demos that we've seen from google and also what else is happening is that image classification themselves and the visual side is getting better we passed human accuracy in 2015 and it is just getting better we can use the machine learning to see people's emotions recognize their faces and all the other attributes to then create engines to create people's faces this is an unreal engine meta humans example to see how you can use their platform to generate all kinds of different faces or you can use platforms like this person doesn't exist dot com to generate as many fake faces as you want but what are the benefits what is the reason of using these kinds of technologies number one it's democratization you're giving that ability to create videos to everybody so you don't need a camera it's accessible to everybody it's much lower cost because you don't need to invest in that equipment it's much more simpler you don't know how to operate all of these platforms so let's go into each one of them how the content creation now drives scale how it's much more personal how it helps you reach more people by knowing or being able to share your content in more languages number one is scale through automation you know if somebody purchases something on your website you can then trigger it automatically through zapier to go through for example someone like synthesia or windsor to trigger that personalized email to go to the customers to drive the customer love that we already saw for them coming back to you the second thing is speed you know for me to record a 10 minute video takes 10 minutes for ai to generate 10 minutes video just 30 seconds so it's very very fast it accelerates your production pipeline and in order to create a digital version of my voice for example i used dscript in the first iteration the first video that you saw so i had to read 30 minutes of audio to the computer to then generate my voice custom voice model in synthesia it cost thousand dollars to create the custom avatar of yourself and for that i needed to do five takes of three minute video and then i'll have a avatar that i can use indefinitely across all of my videos so how did it actually look like or how do those tools work because we talk about simplicity right this is an example of a dscript where you can just type in the word so you can take existing script or existing video and then it automatically generates your voice which you can then just export to be used across all of your distribution channels or you can use that voice of video voice recording to then put against your video so here's what i'm going to do within synthesia and their interface i'm showing how i created the intro video first of all if you go to their platform there are so many options out there it's like a true creation platform so you can use their existing templates or you can import your own powerpoints to build your own templates and you can then also choose background for example in this case i'm using the same background that i'm using for these videos to make it look very similar you can size the avatar you can add your text you can add your graphics you can add music you can add different elements into the video and then you can also change the person in the video then in order to generate the voice you can use their own voice generation platform which is really good actually even better than my voice model and you can choose that in 55 different languages in this case i'm using the audio file that i generated already in dscript as i want it to sound like me using my own voice custom voice and that's it once you hit generate you just wait a couple of minutes and the video is going to be ready what you already saw in the intro bit so we're moving from this investing 20 or hundreds of thousands of dollars to analog equipment to now being recently just able to couple of thousands to start being your filmmaking career by now just you know paying 30 dollars and synthesia platform and being able to create videos just using your computer with no need for cameras lights or microphones here's an example of how it also makes it very personal messi a famous football player here you can use your you can just by entering some triggers like your name your friend's name and where you want to see the game together with your friend you can automatically generate videos that sound completely as it's coming from messi and your friends won't notice the difference this is unbelievable how good it is hey stefan what's up my friend sander has invited us to watch the game online i hope i can make it if i can't be there enjoy the game ah and don't forget to bring the snacks ciao it's unreal how good it is and i'm always amazed when i see examples like that it can also help you reach a lot more people in addition to being personal you can also reach more people by having it available in many more languages synthesia for example supports more than 50 languages here's an example of how it can be very powerful in one of the campaigns that synthesia did malaria isn't just any disease it's the deadliest disease there's ever been existed [Music] so imagine the reach that you can drive by able being able to speak everybody's language around the world if you want to check out more examples and how all the other big companies that you see here are using their tools go to synthesis website which i've linked down below in this video but what are the other use cases that synthetic media allows us to do which we were not able to do before a good example of that is the movement of v tubers you know where you can actually rather than you being in the video you can have a virtual character or your avatar being in the video and here's an example of one set up from code miko whose channel is also linked below my facial cam goes right here okay and it's an iphone x and um so this is basically it i have new fingers on these are the gloves see that but thumbs up uh whatever this is peace sign three four five and this is incredible how much you can do with that you can create the whole virtual space not just the character within that space and of course it's much more accessible while this setup still costs like ten thousand dollars for her you can use emojis and animojis to animate yourself by just using your phone these days by using the avatars this is also sparked the start of virtual influencers a company called brood which is in la has created little mikwela who has got more than 3 million followers on instagram by actually being completely virtual it's also allowed ai companions to come around us and it's not just you know being able to chat with them or talk to them in a chat environment and then reacting it on the screen but also you can pick them out and actually place them within your space as a completely augmented reality experience where you can have a virtual friend a companion that you can talk to anytime that always listens to you it also sparked the start of digital humans by unique for example where they create digital humans but they also have created some that you can already interact with so you can go on the website and have a conversation with einstein it's also used widely much more like closer example in learning and development in different companies you know to drive down the cost and make their content much more accessible and much more engaging it's also used much in corporate communications you know where you just need to get a message across the whole company or things that move or change constantly you can have those videos automatically generated or you can just use it you know for your own fun we all know reface app where you have a ton of templates where you can replace your face in any of the videos just to make them look you know [Music] [Applause] you know those are just fun examples but what are the risks by using those videos and or those technologies across all of your video outputs and the use cases that we talked about number one certainly is ethics while the tools are very powerful it's important to keep people first always and synthesia is part of this content authenticity initiative and i think whenever you're talking about these tools and make sure that those companies have those ethics and principles in place you can only use the avatars with the person's permission and they're not going to be shared publicly unless obviously people choose to do that so ethics are key for those companies who have access to those technologies but i think what is even more important than ethics for these companies is education and public knowledge you know we all got used to seeing costumes and then they're centuries old from the sixth century before christ when we know that so the person behind the costume is not the same person that they're acting out to be we're now used to that on tick tock and instagram filters you know we know that's not real we know that's actually generated by a computer or lenses when somebody makes them look younger older or has different effects in them you know we got used to that in emails you know when 1970s when emails started the first emails were sent 99 of them were written by humans while in 2000 we're used to that receiving the 99 of emails that we get are actually generated by computers using the name and the personalization and the titles and everything else that goes with an email so i think education is key and while you know those cheaper tools are very accessible to everybody they still don't look as good even the prosumer good consumer tools that don't look as good as something that we go and see in the movies because they take much longer time and much more effort so there's really good defects that you see out there actually somebody has to pay their time and energy to make those happen there's usually somebody somebody's interest behind that but i think public knowledge is really the key while public knowledge is key i think it's going to be less and less easy to distinguish them even with a higher awareness that those kinds of videos are out there and i think fingerprinting is such a key area that needs to happen whether on a device level or an application level where those videos are produced and then with that while we have the fingerprint who's the original author of that video that's always attached and embedded into the file we should have tools for consumers to then find out who's the owner you know like in music i hear a good song i want to know who was the singer who was the writer same way in youtube when you see a video that's using music you could go out and validate you know who who is the actual owner and who should claim the revenue from that video so those tools already already existing music they need to happen also for video what does the future look like for video i'm really excited about this part we're moving from this idea that somebody looks like you can act like you but in the future can also think like you and i think this is a super powerful development when somebody looks like you know we can make anybody say anything to use their likeness and here's an example of digital domain in charlatan in the dhg group we've been doing a lot of research a lot of research on how to create digital humans digital creatures digital characters there really isn't any real way just to turn one person into somebody else that technology just doesn't exist we're not able to sort of take somebody's face and immediately just suddenly transform it into my face and there are truly that technology does not exist never seen that of course it exists and it's actually live now the second thing to make things act like you and me this gives us an ability to make things come alive and a great example is the google lambda where they make paper airplanes and planet pluto so you can converse with them they have the knowledge of a pluto and paper airplane from the world from the web and so that you can now start having conversation with them listen to a conversation the team had with pluto a few days ago i'm so curious about you i sense your excitement ask me anything tell me what i would see if i visited you would get to see a massive canyon some frozen icebergs geysers and some craters it sounds beautiful i assure you it is worth the trip however you need to bring your coat because it gets really cold i'll keep that in mind hey i was wondering have you ever had any visitors and i think this is powerful if you now put the likeness together with act like so he takes the knowledge someone's likeness how they look and how they sound and then put that together with the knowledge you get to autonomous digital humans and this is another example of what digital domain is working at where they've created doug as somebody you can converse with without necessarily knowing what they're going to say because they're fully driven by their own ai in their looks in their sound in their knowledge would you like to introduce yourself hello everyone i'm an autonomous digital human digital replica of dub robl digital domain has been on the forefront of visual effects for over two decades these effects take thousands of hours and hundreds of skilled artists but things have changed and things have truly changed so imagine even in my case like creating a youtube video without writing or filming or you could just ask me hey can you tell me more about synthetic media and then it automatically generates a video for you so even today i can use a writer such as openai gbt3 to write the script for sound i can use dscript to then make it sound like me or someone like respect or tool that was used in the recent mandalorian series from star wars and for camera and editing you could use synthesia you know a platform that brings it all together where you can add effects and text and then make it actually come out and sound really good so just maybe we are very soon of course it's going to take time getting to a place where you can start making hollywood films with a laptop which is the vision for synthesia company and the ceo as well so thank you very much for watching yes i hope you thank you from me as well and just one more thing please let me know down in the comments if you'd like me to create a video that is entirely not created by sander but ai i'll ask gpt3 to write it descript to do the audio and synthesia to film it thanks and hope to see you next time

Channel: Sander Saar

Views: 50,099

Keywords: synthetic media, ai videos, digital humans, voice cloning, synthetic video, how synthetic media will change hollywood, artificial intelligence, ai video, artificial intelligence video, ai filmmaking, ai in film, ai media, virtual identity, vtubers, virtual influencers, ai companion, virtual avatars, synthesia, descript, overdub, windsor, synthesia.io, windsor.io, digital domain, unreal engine, unity

Id: qlBrh60bGlY

Length: 19min 6sec (1146 seconds)

Published: Thu Sep 16 2021