Convert Voice into Music with this New AI Tool!

hello everybody and welcome back to the Matt vidpro AI YouTube channel I have a pretty exciting one for you guys today we're going to be trying out speech to music so essentially I'm going to take my voice here and make some vocal notes with it and that will actually be converted into an instrument that you can hear and it sounds like it's really playing now I spoke about this technology in a recent AI news video and you guys seriously wanted to see the full thing in action first of all let's take a peek at that demo that drove everyone so crazy in my original AI news video so here is that original Twitter post voice to music we launched a feature that allows you to sing and turn your notes into any instrument you want pretty cool to see AI giving humans the ability to do things they could just never do before and I mean that really is kind of what AI is all about [Music] [Music] it's pretty Flawless right off the bat I think we can all agree again we're testing it out today so we'll have to see how good it truly is but man right off the bat really impressive so that's guitar right there the next one [Music] electric guitar again just as impressive as the regular guitar next up this was seriously impressive to [Music] me [Music] so you can see that was a duduk we have some percussion here next up we take an instrument and turn it into another [Music] one impressive stuff man some more at the end here so yeah I think you guys can get the idea here why everyone wanted me to test this thing out so bad I mean it's just really darn exciting a lot of people were also wondering you know the video that we just saw makes it look like it works in real time unfortunately no the AI doesn't actually run in real time although one day it probably will let's check out the website that actually is able to do all of this this right here is musicy meet your AI music assistant is their tagline here on the website use AI to create music with your voice and leverage the latest in AI technology to supercharge your music this is an AI site that I just hadn't heard of before I don't know they have a lot more than just what we are going to be focusing on today so I might have to come back to this one at some point so when you log in with an account you can can get access to this instrumentals section but I'm really focused on this speech to music type deal upload your vocals or an instrument track and convert it to one of our AI instruments you can actually record right in browser which is obviously what I'm going to be doing today but you can upload audio files with a 20 megabyte file limit which really isn't too big but that could be a full song they actually have more instruments than I originally thought obviously you know the guitars that we saw but we also have violin break beats saxophone cinematic music some good options in here really solid let's just start off with the basic acoustic guitar I think we can all agree and we will record some basic vocal instrument like noises from my [Music] mouth [Music] listen I never said I had a musical ear for some reason the vocals is set to the instrument that I picked so let's listen to [Music] that so obviously that's not as good as the demo that we listened to earlier but it's probably because I've never used this tool before it still wasn't half bad honestly it was still very mindblowing it's clear that the way I was extenuating my voice doesn't really match well with the acoustic [Music] guitar [Music] all right so for that one I'm going to do the duduk from the video that we saw I hope that this converts a little bit [Music] better you it seems like one of those things you kind of have to tweak we're also only on the standard quality here we're not in the master quality all right guys just for this video I upgraded to a more Premium plan let's take a listen to the master [Music] quality trying the electric guitar out [Music] that was definitely a lot better than the previous ones and I think I have to up my pitch a little bit just because of the pitch of my voice that could be what this setting really is for all right we got a banjo got to try that one out [Music] that's pretty crazy that one worked well I got to say it definitely sounds like a banjo although it's got like a weird twang to it because of the way that I'm speaking into this I really want to try this cinematic like what could that even [Music] be got to say the generation time with the paid plan is a lot [Music] faster I have no idea what instrument that is supposed to be but that one didn't work at all let's apply that one to uh this instrument sure a [Music] Shai that one worked honestly better than the Cinematic let's go ahead and try the violin [Music] I knew that would kind of work I'm I'm happy with that I'm pleasantly surprised actually okay let's actually try some of the percussion out so this one I'm going to point the mic at my desk I'm going to do tapping and just Beats that one actually works really well like you could do some real like Bongo beats with that thing this little piece of plastic worked pretty good though I'm I'm happy with that [Music] result I'm putting this on the uh perk by the [Music] way not good let's try to convert an acoustic guitar into an electric [Music] one I have a feeling this is going to work out pretty [Music] well definitely not perfect but a lot better than me using my voice again that could just be the fault of my voice not really being well suited for this specific application and also me just not knowing how to reproduce instruments with my voice let's convert that to banjo [Music] now [Music] yeah that one sounds a little bit AI you know what I'm saying can we convert it to [Music] saxophone came through a little bit there not too bad got a little bit JBL at the end they have General brass instruments as [Music] well what was that at the end overall this is definitely something that's going to take a little bit of fine-tuning to get perfect some people's voices might be better attenuated for this than others and likely I could see a future where this is huge and this is used often but I suspect that the model might have to be fine-tuned on your specific voice to work super well it might be the thing we're struggling with here it is pretty impressive though and for instrument conversion I have no doubt in my mind that this could actually work really well again they have a few other things here that I will have to check out apparently they have straight text to music generation let's take a listen to their text to music [Music] [Music] okay it didn't really follow my prompt too well but the generation itself was not half bad I got to say I don't know if this is a model that they have developed in house or if they're using some open source stuff I'd have to look into it a little bit more but if you want a full video exploring the rest of Music F's AI capabilities please let me know down in the comments below we got parody vocals as well which is pretty crazy I mean we got Eric Cartman SpongeBob Plankton I'm sure you've heard some of these before but this is all pretty interesting is it only singing or can it just do like a straight SpongeBob for me voice conversion thanks for watching And subscribe to Matt VI Pro okay as far as AI SpongeBobs go that ain't half bad again this could be another video checking out the rest of this stuff thank you so much for tuning in and diving into this stuff with me I hope you enjoyed it as much as I did this is definitely very interesting I don't think it works great on my voice or I'm just really bad at making instrument sounds with my voice this is one you'll have to test out for yourself and let me know down in the comments if it works well for you their plans are reasonably priced I'd say and you do get five generation for completely free so if you make anything cool please post it to my Discord server we would love to see it on there thanks so much for watching I'm at vidpro Ai and see you in the next one goodbye

Channel: MattVidPro AI

Views: 28,542

Keywords: mattvidpro, mattvidpro ai, ai news, ai tools, ai song, ai music, ai voice to instrument, ai voice to music

Id: 53uIlyMaL3o

Length: 14min 39sec (879 seconds)

Published: Tue Nov 28 2023