Turning BASS into violin (using AI)

[Music] this video is brought to you by skillshare okay so i saw this andrew huang video recently where he turns the sound of his voice into the sound of violin using ai okay dang andrew's using a tool that was developed by magenta which is google's ai and music research division they were the ones that were responsible for that ai corral doodle thing they have tons of really interesting projects but the one that andrew is using is something called tone transfer which can transform the timbre or the tone of one audio recording or instrument into the timbre of another one a completely synthesized one the best way that i can understand it is that they're using machine learning that has been trained on the sounds of violins or saxophones or different timbres and then combining that machine learning with traditional understanding of synthesizer technology additive synthesis subtractive synthesis filters oscillators etc so basically the way that this works is you can go to their web widget thing that they developed and just record yourself talking or singing or doing anything like that i'm just talking right now and then you click done i'm just talking right now let's transform that into from doing anything like that i'm just talking right now and then you click done improvisational jazz trumpet baby i'm sure you can make some spicy memes this way i wonder what steamed ham sounds like through the ai well seymour i made it despite your directions ah superintendent chalmers welcome i hope you're prepared for an unforgettable engine all right so clearly there's meme potential here but i want to see if there's actually some practical potential can i turn the sound of my bass into one of these ai sounds and can i actually make some music with it so so i got this drum loop happening and actually one thing that i like to do is put the snares like a little bit ahead it creates a kind of a cool feeling especially when the high hats are like laid back a little bit more aggressive sort of sound being on top of the beat like that add some keys [Music] that sounds like some music to study and relax too that will soon change let me grab my bass okay that sounds like a bass line now let's run it through the ai and see what happens [Music] i really like that bending thing that happens right there that kind of reminds me of my friend zach zinger and his shakuhachi doesn't sound like an actual concert flute it's kind of cool though that like took all of 10 seconds to change the bass line into you know an ai flute what about violin [Music] let's download that let's download a couple of these so i think my strategy is to kind of take these four versions of the ai thing and then pick out the best usable bits and like create this weavable texture around my baseline weavable woven woven that's the right word that slide down sounds a little wonky in the flute it sounds pretty cool in the violin so that sounds a little bit more natural to me [Music] okay that's usable you get some somewhat realistic sounds out of that and all i was doing was just chopping up my bass line and moving it around what if i took a bass solo what would that sound like [Music] ah stupid all right let's hear how that sounds with the ai [Music] sounds okay uh i think the flute might sound a little bit better [Music] sounds kind of drunk actually when i start playing like the jazz lines like the like that stuff that's when some of these um models kind of fail like maybe too much portamento between each one of the notes but that's okay this is the original training data for the flute this isn't the violin the violin was trained on [Music] bach again sounds like uh one of the bach violin sonatas it seems like ai is being trained on a lot of bach which i think is cool i mean there's the ba ai doodle but you know there is other music besides bach believe it or not i mean box is great i don't want to knock ba at all this is interesting because bach is being trained into like the very fabric of machine learning now i don't necessarily disagree with that decision if you have to pick one composer from the common practice of european music but it's an interesting thing to consider anyway to do this twice because i had to break up the base solo recording so let's listen to the second half of the bass solo that lick right there i call that the mary spender i stole that from mary spender [Music] let's see how the ai deals with that because it's a very fast sort of articulation almost this is how the saxophone fairs that's kind of fun actually i'm gonna download all of these and then i'm gonna combine them again like i did with that first baseline maybe we pick and choose what we like in this solo and then craft something like that i like the end that tail of the trumpet right here that sounds cool like the way that that note decays that's pretty cool somehow captures the breath sound of a tenor sax i do like the vibrato though that's kind of cool though definitely has like a stefan grappelli vibe if it's in the violin even like widens up at the end [Music] did a pretty good job of that capturing the merry spender special [Music] why don't we just create a track or just like the best just like fade in between them [Music] that definitely sounds general midi don't like that [Music] that sounds a little better don't mind that the way the slides are working on the violin i think sound the most natural just because violin is a fretless instrument seems like the trumpet's pretty good at getting like the distinct notes when it's like a jazz line so that's nice so this is the comp take i just comp some of the elements that i liked from all four it might sound a little ridiculous but we're just having some fun right now [Music] so so i'm not sure if this is the most musical thing but i think the super cool thing that's happening with magenta and the team at google who are doing all these experiments with music and ai is that it shows the possibilities and things are advancing very very quickly this idea of changing instruments into one another i think is super cool it can't really be done in real time yet but if this differential digital signal processing ever found its way into like a vst or a plug-in or some kind of synthesizer for a digital audio workstation i think musicians would go kind of crazy with it there's some really cool possibilities and honestly i'm just kind of messing around here i'm sure if i spend a little bit more time with it i would come up with something and some kind of a workflow that would make more sense and even be like super musical potentially maybe now in ableton live you can already do audio to midi so i can just right click and say convert melody to numity track it doesn't have nearly the same degree of nuance as this ai did took ableton about 10 seconds to spit out this midi and then it took the ai about 10 seconds to spit out this kind of uh ai transformation of the same audio things like that's pretty subtle and pretty tricky even the best midi pickups won't be able to pick that sort of thing up very well and it did a pretty good job of grabbing that and you can see in the midi ableton did a terrible job so the potential is huge i think it's super cool i'm gonna work on getting this mix uh feeling and sounding good right now you can listen to the final mix on bandcamp it's available for free uh it's also going to be playing during the ad read for this video which is brought to you by skillshare sick sponsors skillshare is an online learning community for creative and curious people with thousands of classes to choose from one of the classes in particular that i recommend is learn how to mix music with grammy nominated producer young guru it's a great condensed approach to learning things about mixing including a great section on compression which can always be confusing if you're just starting out this is our threshold this is telling us when the signal is going to be affected by the compressor you can take classes like this or other things like photography and design and illustration and if you're interested in joining skillshare and learning more about these things the first 1000 people to click the link in the description will get a free trial of skillshare premium membership after that skillshare is less than 10 a month with an annual subscription anyway guys thank you so much for watching if you have any ideas on how you might use this tone transfer technology that just was released let me know in the comments section because it's kind of ridiculous but like any ridiculous thing that's kind of janky musicians and artists will eventually figure out how to use it it's pretty cool i think uh yeah until next time everybody

Channel: Adam Neely

Views: 268,016

Rating: 4.9698491 out of 5

Keywords: adam, neely, jazz, fusion, bass, guitar, lesson, theory, music

Id: cIX4y22NWWc

Length: 11min 46sec (706 seconds)

Published: Tue Oct 20 2020

Reddit Comments

[u/TKameli]

Dude, pretty much every Adam Neely video has the lick. That's pretty low effort.

[u/redditrais]

It's an Adam Neely video, this should be expected lol