Robot Piano Catches Fire Playing Rush E (World’s Hardest Song)

this is a talking piano and it's so cool [Music] and his name is chopsticks so in addition to talking he could play simple songs like that but also like really complicated songs [Music] so today not only will we talk about the science behind making a piano speak human but later he's gonna play the drums for us and sing for us not yet chopsticks remember for my videos that song usually comes a little bit later [Music] anyways then he's gonna attempt to play the world's most complicated digital piano song from sheet music boss rush e there's a reason this song has never been played with an actual real-life piano so i've legitimately got a couple fire extinguishers on hand in case the whole thing goes up in flames [Music] but before we get to any of that we need to first understand the really cool engineering behind how pianos even work because if you look at the guts of this modified see-through piano for something that was invented by an italian dude 300 years ago you can see it's pretty complicated in fact if you zoom in and just isolate on a single key this is what's happening every time you push down on the white part now if you're thinking like an engineer you know the best design is always the one that gets the job done in the most simple way possible and when i first saw this no offense to bartolome christofori the inventor of the piano it just seemed overly complicated i mean the first piano i ever played was pretty dang simple like why can't you just have a class one lever where when i push down here there's a full crimp in the middle and it hits the string here well it turns out there's two problems with that right off the bat the first is that the hammer remains in contact with the string when you hold the key down that means the string isn't free to wiggle and vibrate which is how the sound is created like with this guitar it sounds great until you touch the strings and now because it can't vibrate you don't hear anything in fact you can see that's exactly the problem with this toy piano the second problem is this is an upright piano so the strings must be vertical to fit but that's an easy enough fix if we shift them here and add an extra hinge point however you'll notice we're still damping the string and as you can see the piano should continue making sound even if i'm holding the key down so how do we do that well bartolomeo got real clever and added a little extra hardware here so now when you press the key this jack flings the hammer forward so it hits the string but then the jack gets its foot caught which moves it out of the way so the hammer can move back and not dampen the string fun fact most people think pianos are considered string instruments but this hammer-like action is why they're actually classified as percussion [Music] okay so now if i press the key down it will continue to make noise but wait if i let my finger go the sound should stop so something is damping that string but if you look in our current build you can see if i let the key go there's nothing to stop the string from just continuing to vibrate and make sound to solve this bartolomeo added an extra pivot point and some more hardware so now you see this damper rests on the string and keeps it quiet until you press the key down then the hammer strikes then it's free to vibrate and create noise all the way up to the moment the key is released and finally if i want to play note really quickly and repeatedly like this i need the hammer to be close to the string and not way back here like this so by adding this backstop it keeps the hammer close after each hit in case i need to quickly hit it again so there you have it apologies to my fellow engineer bartolomeo it turns out it's only as complicated as it needs to be and no more it's also sort of simplistically beautiful that all that functionality is from only one input every time you press a single key now chopsticks here is a special case not only because he's see-through but because he can play himself and it is true pianos that play themselves have been around for over 100 years but there's an important difference here an old player piano works by scrolling through a paper sheet like this and when it encounters a hole it passes air through which plays the key so all the keys are played at full force and the timing isn't very precise whereas chopsticks here is a modern version that uses a solenoid to actuate the key we place the solenoids right here so when the rod extends it's no different than someone actually pressing the key you can see them all lined up along here but with solenoids not only do you get your timing down to fractions of a second but you have 127 different levels of increasing force to press a piano key which means you can make perfect recreations of a human player so here's my friend andrew from the youtube channel sheet music boss playing a simple c shanty and then recording it as a midi and then chopsticks uses that midi to play it back perfectly only since he's not limited to a mere 10 human fingers the songs can get more complicated [Music] but he can do even better than that because those 88 precision solenoids allow him to make crude reproductions of entire bands see if he can pick out the singer's actual voice in this classical piece of music history [Music] and so now that we know at least partially what he's capable of before we attempt rushi let's quickly discuss how we actually make chopsticks speak and sing chopsticks that's better and to do that i'm gonna pass it over to my buddy grant from the youtube channel three blue one brown for a simple explanation the signals from speech can be visualized with a waveform which you might think of as telling you the air pressure next to a microphone as a function of time if you zoom in on a little window of it you might notice it looks like a rhythmic repeating pattern as it happens one of the most delightful facts from math tells us that for pretty much any signal you can express it as a sum of pure sine waves which in the context of sounds correspond to pure pitches higher frequency sine waves giving you higher pitches if you want to perfectly reconstruct the original signal this often requires adding a very large number of pure sine waves each with a different height now a favorite tool in signal processing is something called a fourier transform which you can think of as telling you the heights of each one of these sine waves as a function of the frequency you're dealing with so for a piano project if you take this fourier transform and you just consider the peaks it's a way of giving you the most important notes to be played to recreate the sound if you add just a handful of these dominant frequencies you'll get a signal which is almost but not quite the original signal and if we do this process across many different little windows of our full signal it's a way of telling us what notes should be played at what time and with what level of intensity and if you do it right you can get something that sounds like this hey chopsticks repeat after me now i do have to come clean and admit that i am cheating a little bit by putting the words chopsticks is speaking up on the screen as humans eighty percent of the information our brains gather about our surroundings comes from our sense of sight and so as our dominant sense our brain really leans on our eyes even when processing what we hear if you don't believe me here's two tests you can do right now number one go back and re-watch any part of this video where chopsticks is speaking only this time close your eyes and see how much harder it is to understand him and number two maybe you've heard this audio clip from some random 80s toy saying the word green needle now compare that to this other clip that says brainstorm [Music] only as you might have guessed those are the exact same audio clip which is bonkers because those two words don't even have the same number of syllables for proof i'll repeat it twice more only this time you can randomly pick a word to look at each time [Music] alright and so now for the big finale in a world's first exclusive i present an actual piano attempting to play the world's hardest piano song rush e [Music] of course buddy good luck [Music] do [Music] [Music] oh [Music] the biggest problem with me making a youtube video to try and teach you something is that it's just not very interactive which is why i'm pleased to say my friends at brilliant.org who just so happen to be supporting this video have solved this issue and if you don't know brilliant is a problem-solving website and app that has over 60 courses including topics in math science and computer science but their real special sauce is all about making the content interactive which is way more effective at building your intuition my favorite one so far is their scientific thinking course where instead of memorizing specific formulas that interactivity builds intuition about general principles you see in the everyday world around you and it works great on both desktop and mobile so instead of picking up your phone and mindlessly scrolling a news feed that leaves you feeling sad with brilliant you get this addictive experience which leaves you feeling stoked by unlocking the hidden principles that govern our amazing world so if you want to grow your brain and support my channel at the same time go to brilliant.org markrover or use the link in the video description to sign up for free because the first 2000 people get 20 off their annual membership so thanks to brilliant for making learning fun thanks to chopsticks for not catching fire and burning my place down and of course thanks to you for watching

Channel: Mark Rober

Views: 12,178,650

Keywords:

Id: uBEL3YVzMwk

Length: 11min 34sec (694 seconds)

Published: Sat Mar 19 2022

Reddit Comments

[u/[deleted]]

6:28 (tau time) for 3b1b's explaination

[u/Friek555]

Aaah, I want to watch everything that 3b1b makes but I don't want to watch anything by Mark Rober, what do I do???

[u/fuckballs9001]

Wait.... why do I see Rush E?