AI Enhance Speech Tool In Premiere Pro

so here it is the comprehensive test breakdown review whatever you want to call it of the enhanced speech tool in Premier Pro so I decided to go to a few different locations to test how good it is at recovering poorly recorded audio and I also decided to test it with a podcast because there are differences in how the enhanced speech Works based on the format of audio recorded so let's just get right into it all right so revving the engine now and this is what it sounds like I don't think there's much of a difference is there there's a lot of sounds going on right now all right so revving the engine now and this is what it sounds like I don't think there's much of a difference is there it's a lot of sounds going on right now God I love AI it's kind of scary though so it's not often that you're going to be sitting on a car that's revving its engine but I wanted to test the enhanced speech to the extreme so honestly not bad it sounds a little roboy and as we go through this you'll see if this continues on the other Clips or not but first example not bad reing the engine now and this is what it sounds like re your get be now and just put it Southway so this was the audio from the camera that was further away from me and as you can tell it did not pick up really anything I said it made me sound stupid so this is the first important takeaway and I've used the enhanced speech on some other Clips to figure this out if your audio is at about the same level of DB as your background noise then the enhanced speech really struggles to make your voice sound better this is because the enhanced speech works by recreating a different version of your voice with AI so if it's hearing a bunch of noise in the background on the same level as your voice then it's going to struggle and let's see another example of that where it just really does not pick it up until the end of the clip wait that start so yeah you can only really hear it at the end and this is because this is when the generator shut off so now I know those were some pretty extreme examples so I also wanted to test it in more of a daily application let's say a daily Vlog so once again I wanted to push it to the limits so I actually did this while I was on a skateboard but let's see how it sounds if you want to Vlog and you're on a skateboard and this is how it sounds if you want to Vlog and you're on a skateboard and this is how it sounds so as you can see in these clips when the enhanced speech is at 100% it still sounds like an AI but when we drop it down to 75% let's see how that sounds if you want to Vlog and you're on a skateboard and this is how it sounds so it sounds a little bit less like a robot obviously it's still taking your voice and making a new representation of it but when you leave some of the background audio in there it just makes it seem a little more natural and a little bit less forced so yeah not bad all right there's a generator right next to me let's see how it sounds I'm talking I'm saying things there's no way this works it's cool there's a generator right next to me let's see how it sounds I'm talking I'm saying things laugh there's no way this works cool so one key thing that I want to note here is the laugh it's almost like the AI tries to make the laugh into words and I've tried this on many other clips and it just does really seem to struggle with laughing which brings me on to the next and the final example that I have for you which is podcasting now I've worked on the postproduction for a few podcasts myself and I've had to deal with overlapping audio laughing which I just mentioned and these are two big issues that you see when trying to use enhanced speech for a podcast so first let me just show you an example of using it on a regular podcast in this first clip there's a plane flying by so let's listen to that yeah I think that uh I I remember those days I mean cuz it did extend through to middle school I don't remember exactly the dollar to store days yeah I think that I I remember those days I mean cuz I did extend through to middle school I don't remember exactly the dollar to store days and in the second clip there are a bunch of kids playing in the background I don't hate kids but kind of annoying to listen to so let's see how that sounds but really what are the tools that I can help equip you with but really what are the tools that I can help equip you with so it does a pretty good job if you turn it up to 100 then it gets rid of all of the kids playing in the background now the only thing that happens when you turn it up to 100 is it just sounds like a robot I've only had like a few where it doesn't sound completely like a robot and that's usually if I'm talking into a mic like this one right here but in that case your audio should probably already be good enough to where you can just fix it with other tools and don't really need to use enhanced speech granted it is nice that you can just click a clip come over to dialogue and then hit enhance and within seconds it makes your audio better but in my opinion it's still not great and it has a little bit of a ways to go before I would be using it consistently and I didn't show you it here but the AI sort of struggles to pick up who's talking at which point and so if someone's ending their speech they might get cut off early and the AI will just start with this next speech or vice versa and the person who's starting their first sentence just gets cut off at the beginning so it sounds really weird it really can't make out what's being said which I don't expect it to if it's on one track like that's really tough to figure out but that's besides the point hopefully this test and breakdown of the enhanced speech tool helped you out and let me know if you've tried it down below in the comments if you've had any better luck with it maybe I just haven't tested it out enough yet but who knows if you enjoyed make sure to like And subscribe and I'll see you in the next one

Channel: Gavin Herman

Views: 3,254

Keywords: gavin, adobe premiere, premiere pro, How to Use Enhance Speech in Premiere Pro 2023 (Make Your Voice Sound CINEMATIC), https://www.youtube.com/watch?v=zg_tKslIZS0, enhance speech, enhanced speech, https://www.youtube.com/watch?v=h4nCOoe3xo4, 5 Ai Tools that have saved me 100+ hours, https://www.youtube.com/watch?v=ykYobtBputk, Enhanced Speech in Adobe Premiere Pro NOW LIVE! | Adobe Video, Exploring Text-Based Editing & Enhance Speech (beta) - Premiere Pro 2023 Update

Id: VXNIJ30IYCw

Length: 5min 23sec (323 seconds)

Published: Sat Feb 24 2024