Effective Remote Teaching with intention and creativity - Computer Stuff They Didn't Teach You #16

this is gonna be fun hey friends i'm scott hanselman and i'm here with dr david kellerman he's a senior lecturer at the university of new south wales and i get that right that's right scott thank you very much for having me i thought that i had the coolest use of leds in an office and i have been once again one-upped by you this is a beautiful space that you've put together here thank you very much yes this is my home office i also co-own this with my six-year-old so um luckily for me he's got a great collection of lego and other things that actually work pretty well in space that's lovely i also have a collection of lego it's a library and the children just show up and they check it out like a book and then they leave so in the interest of the topic of computer stuff that they didn't teach you in school which is the kind of the theme of my youtube channel i i like to talk about different things now i'm a programmer you are not a programmer what is your specialty what is your phd yeah so i'm like a knuckle dragging mechanical engineer which is funny because a lot of people don't really fully get what mechanical engineers are but we're just people who turn the world into mathematics and then use it to model it and predict the future so it's a very generic discipline it's not to do with cars or engines it's just to do with mechanics which could be magnetism or thermodynamics or it could be light or stress and strain or defamation or modelling of machines and systems and processes so i'm a mechanical engineer by trade i did a phd in computational mechanics and computational mechanics is the field where we take a material and we model the way that it responds to force or defamation we turn it into maths and then we create complex computer software that is able to simulate what's going to happen great example is a bridge we don't build a bridge roll a truck and see whether it falls down we want to model it before we ever start building it and so we completely simulate everything now that we manufacture and create in computers and we test first whether it's strong enough before we start making it and this is the field of computational interesting so my 14 soon to be 15 year old just started a high school physics i think it'd be form 1 physics where he just started out and he's always impressed with the idea that physics in his mind predicts the future he takes the little car he puts it on the ramp they calculate it and it says it'll take this many seconds to go down and it go and it and it's like and it did what it said it would do and he thinks that's amazing are you saying that you can like say that this bridge will stand or this iphone won't bend when the and then it happens in reality so the simulations really do reflect reality because the numbers work yep yeah and for the viewers i recommend if you're in youtube now you know open another tab and search for crash worthiness analysis and you're going to see something mind-blowing which is that when we design a new car we virtually crash the computer the the car on the computer into a wall every crumple the airbag going off the person hitting the airbag and then they do the and cap tests two years later when the car is actually in production and you put the images side by side and it is absolutely mind-boggling every crease in the metal everything it's it's perfection and it's mind-blowing so that's computational mechanics that's what we do okay so the goal of my youtube is to teach people and the goal of younow as a remote lecturer i assume that you all are doing a lot of your things remote on teams is to teach people but i have felt very constrained by this square you know i'm limited to the pixels that i can put in here you know so i i try different camera angles and i try different different things i've tried it in different talks that i've given as well you do similar things yeah i do and you know we could rewind the clock back to march when that's when our university went in you know the whole of australia basically went into lockdown because of covert 19. and i had an upcoming class that i was going to teach my classes of three to 500 students and i had a few weeks prep time so a year before that may 2019 i presented at build and i was talking about bot framework for teams in the in the talk that i gave and build came around and i thought i want to see what microsoft do because that was one of the first big conferences out of the gate that had to rapidly switch to online and i thought i want to see what these clever folks did and that's how i got to know how you are because you did a keynote called every programmer is welcome and you made a really nice scene and it was very i'm sure you probably look at it now and go it was pretty basic but it was the idea of of using all of that real estate of of having a more you know humanistic kind of experience not just powerpoint karaoke or his little box in the corner and so it got me to thinking about how i could do teaching better once i started and you know like you said we're stuck in this box all the time and you know for people watching you've probably got a zoom call or two today and you'll have these meetings and people will be talking like this and what they're actually doing is they're gesturing down here but you can't see any of that and you lose that and then then they do this thing where they share a powerpoint and they talk over the top of it but they can't do the simplest thing like point at something and so we do this weird awkward jiggling of the mouse over different parts of the screen it's awesome if i wanted to show you something on my screen right like i would be yeah i've got this lovely high definition camera people compliment me on my camera but as soon as i go like this yeah well you can't well how can i how do i get this here i just want to if you were standing there you feel like you're standing there your head is the right size can't you see that it's very frustrating don't even start on paper exactly yeah exactly and so so the first thing i did was i showed an email to my friends over at surface and i said could you send me one of these surfaces it's good to have players it is good to have friends and i thought what i want to be able to do is i want to be able to point to stuff on the screen physically and then flip over to screen sharing and of course teams is really great teams is ahead of zoom and and other things in that you can join the meeting as one person from multiple devices and it won't switch the mic on for everyone and it won't broadcast your own voice back at you which is a really tricky thing and so i thought okay well i could join from this device and i can set a hanselmann style scene and how do i do that okay so you put power toys on and you've got fancy zones and you want powerpoint to fill up part of the screen so that you can still have your camera and other things composed but something funny happens with powerpoint is when you make it open to that box you can't ink on it anymore you won't do annotations so this this started me on my whole problem solving where i built this system we can we can demo it now so yeah i'll walk over here and yeah you're doing that i want to give context to people hang on so we're in a team call now and i can pick you up and i can move you around because i'm compositing this but now if i go over here now look how how are you in two places at once what's happening here yeah actually i'm in three places at once because i've got another computer here and i'm using this computer for chat and you know chat might not be meaningful for people who are watching this right now because the chat's between me and scott but actually i think our chat is really important so i can do magic like that and i just docked the chat and i put a bit of a thanksgiving turkey so happy thanksgiving to everyone in the us and now what i have is i've got my scene here i've got my onenote i can have my powerpoint you know over here in full in full screen oops sorry i can do the right one okay i've got my powerpoint and because it's full screen i can do all of my ink annotations and i can go between scene here okay maybe we're talking about the hover bridge maybe we're going to turn it into a 3d model do a morph effect let's do some maths okay we jump over here and we're going to do some hardcore mathematics at this point where i'm going to start writing that's pretty good right like you can read what i'm writing here i can mostly read it i mean i can zoom in a little bit yeah i can pretty much see that yeah it's not too bad but as i'm talking here maybe actually what i want to do is i want a screen share oh so now i'm writing it and you've got a really good close feed of exactly what i'm doing and that's now i want to do a worked example and so you see i've got a link here i'm going to jump over i see to my onenote now it's going to take me to the the same example that i'm going to solve and now what i'm going to do is i'm going to start solving this problem with digital ink right and if you notice now you're looking at my back it's like spitballing the professor in the classroom so i'm going to do another bit of magic and hey now i'm on a different camera so i'm looking at the camera i'm doing digital inking up here you know maybe i'm i use some ink to shape here i'm going to draw a rectangle all right we're going to highlight that okay we've got a new beam that we're drawing and to my left down here i'm watching the meeting and you can write something in the chat i'm gonna write hey over here and you see that the hey that i just wrote is there in the chat and so i'm watching my students so my student scott has said cool and scott might say hey well you know you're calculating this being but where does the maximum deflection occur so i'll go yeah great question scott it actually doesn't occur where the load is applied it occurs right here where the gradient of the beam is zero and so then we go off and we do a whole calculation and we go through a whole bunch of maths maths maths maths and then we get here and i say isn't that interesting we actually that even though the load is here that the max deflection is here wow and so then this is what i love about layering digital and physical is i can put an actual beam in front of it and i can say look when we apply the force here the deflection occurs further over and we are compositing layers of physical digital physical and digital on one another and our communication is getting better and better so this is the whole kind of principle we get to the end of the lecture and i say that's it thanks everyone i'll see you next week and then boom you're outside of the lecture theatre and so you can see i can do all of this kind of magic almost as if i've got a producer but i don't i've got a remote in my left hand a lot of people are using stream deck but you've got a wire you've got a usb cable to press those little buttons i just got a logitech remote and i just set all of the keys to switch between the scenes in xsplit as hotkeys and you can remap them and do whatever you want so i just kind of click a button and i'm just talking and i'm producing and i'm switching scene between different things like this and it's become second nature to me now while i have these classes interesting now for folks that are watching this they may know a bit notice a bit of an audio leg that's because of the way i have been able to composite this into into obs so that's certainly not your fault i just want to make sure that folks know that if you're out of sync just a tiny little bit it's because i am pulling a team's meeting out compositing this into obs and bringing it back into youtube as well i'll try to fix that a little bit in post you're off by about 100 milliseconds but that's not how it works it's very live this is live and crisp and you're basically a a tv producer and it's very organic yeah it doesn't feel like there's a lot of friction here no it's not and you know you you did a uh podcast recently it's on your youtube channel and it's about being intentional right and what i love is that i sit at my desk and i work and then i get up to have a meeting or a class and i'm being intentional here i'm in a i'm in a different space and this space where i can gesture and talk and control my screen is completely around that function i move between different places depending on what i'm doing during the day in my home office and this is it's making me feel more focused it's much more natural you know in the office we all get up from our desk and we walk over to a meeting room and we have a meeting and then the meeting ends and we get up and we walk back to our desk and it's very intentional and we've lost all of that with work from home we just sit on this one chair all day eating our lunch having a meeting being productive we don't move from that space recently i added the lavalier mic that you have as well and even though i've got a headphones on right now being able to simply move around your personal space and still be heard it's a surprising a surprising gift i think a webcam with a wider a wider lens as a gift as well and you've got both that that tight shot right now and then the wider lens as well one of the things yeah and you know the the camera i'm using here by the way is a sigma fp this is a full frame uh camera that when you plug usb in it pretends that it's a webcam and one of the amazing things that this camera can do is it can you can see my face is well resolved and the screen is well resolved and then i can switch completely to a very dark scene like this and we've still got a really good match between these and this is called dynamic range and it's one thing that this camera does really well that most webcams don't do that is so interesting in fact one of the things let me take my headphones on and show you something one of the things that i've been struggling with for a while alexa turn off the office beam is i picked up a samsung art frame which looks great over here in oh yeah in this darkness because it is very very dim but once i turn the picture on it becomes so bright that it fights with things so having a camera that can be presented in such a way that you can see a screen and not have to mess with the contrast and the brightness is really really challenging yeah and you know another thing that i did actually is i don't have it turned on now but these phillips lights are all sinks to this screen and so when i change this scene from something light to dark the room light as well changes and it helps keep a really nice contrast balance okay so i'm going to stop i'll stop screen sharing this i can show you one other thing quickly while i'm here is um i'm going to jump over again here i'm actually i'm i'm joining this meeting three times with teams but this is another thing i do which is augmented reality this is our lab space and this is in teams this is in sharepoint spaces and my students couldn't come to the lab anymore and so we're talking about beam deflection and stuff and so we just we took a 3d bubble shot of our laboratory and then the assignment which is in sharepoint it's actually a sharepoint document right here and then we used azure connect and we digitized the rig here which is a it's a momentum rig right and then we animated it using ubiquity and now the students can actually take the measurements of the momentum of this rig in an augmented reality space so instead of just sitting there passively watching a video they're immersed in the lab space and they're taking the actual measurements from a 3d digitization of the actual experimental rig and so it's interesting right how we can bring the students back into the physical space even though they can't be on campus you're in teams right there what are you inside of are you in a web vr uh link no no this is sharepoint spaces this is native this is it's in private preview i worked with the sharepoint spaces but literally this is a sharepoint page and it's stored in the team site oh my goodness and so if you go into sharepoint spaces you go into options and you'll be able to enable this thing called sharepoint spaces and you can just bring in your 3d objects that you have straight into that sharepoint space it's pretty wow let's uh let's sit down and talk about yeah let's talk about the the intentionality of this and also i think that it's possible that one could look at this who's made it what 15 20 minutes into our little chat here and they could start being dismissive they could say well he's got a doctorate you know he's a fancy he must be a fancy computer person but you said before this is you're not a programmer you're enthusiastic about technology how do we bridge that gap how do you make it seem like this is possible for an eighth grade english teacher and not just a a you know a mechanical engineer yeah and i well i think this is where engineering comes in because engineering is about taking the art of the possible and democratizing it about turning it into something that everybody can use you know we we pick up our phones and we have all of this technology and gps and amazing stuff in our pockets we get in our cars we have all of this incredible technology it's the job of the engineer to improve the quality of life of humanity by taking complex systems and turning them into scalable things now i think you can take systems like this and build them all in to teams or zoom or google me or whatever you want and just have buttons you know you you wiggle your mouse and you get a couple of controls like right now we can change who we're spotlighting or whatever we can just compose these different scenes so i think that we can come a long way there is also hardware i mean this surface hub is an expensive piece of equipment indeed but i actually spoke to the folks at microsoft and i said do you know what it costs to give your employees an office for one year and and the guy said to me actually i know the number it's nine thousand dollars per year to get a little bit it's a little cubicle to give you a cubicle i'm like what does this cost and he's like nine thousand dollars so one year amortization you you if you've got employees working from home we don't think let's set up our employees at home with equipment it's gonna make them more productive it's healthy for me to stand up it's good practice for me to break my routine we don't think about this it's funny that you mentioned that because i'm on a personal machine right now there's a big discussion about you know a lot of us were told in in march grab your laptops and run and you know a lot of people are running on personal machines they're underpowered but there's so many opportunities like you have a a 9 000 touch screen but i've got a small dual screen touch screen but the amount of the amount of machination it would require me to get this here to there like i'd like to be able to just go oh hey let me just join click hey watch and i can start scribbling with my you know my little stylus or whatever i don't need i could use an ipad i could use an android tablet that like that microsoft whiteboard i think tries to to accomplish that as well so you're imagining a world where what you just showed us which you put together with a lot of lego pieces a lot of technology lego pieces would become a use case that everyone would be able to do plug in a webcam and camera one camera two absolutely i mean i i'm looking at a 28-inch monitor right now i've got a phone that's got teams on it i'm imagining i hit join from teams i make this my camera and i point it so it's looking at me and the screen and now i'm pointing at you and this this happened with technology we've already got on our desk um and have you found that the students that you work with are far more engaged than just sitting in a giant grid of people and screen sharing yeah they love it there's this really amazing thing where i gave my students an activity so i said okay here's a mechanism i want you to draw the free body diagram that's an engineering thing right where you remove it from its environment and you replace the environment with forces and if you've got a piece of paper scribble it down in front of you solve the free body diagram take a photo post it to the team's chat and so then i'm standing on my big computer here and i just tap the different images in the chat and i'm standing in front of them and i'm able to point and talk about the students attempts now we're on the other side of the world literally i've got students in mongolia italy the us everywhere in the world at the moment and they've gone from watching the live stream of me and scribbling a drawing in front of them to seeing me pointing to their drawing a moment later giving a critical assessment of it and it's like magic because now what we did was we brought every student to the front of the class and that's the moment where we realized this is better than a lecture theater because it's easier to get 500 people to the front of the classroom in digital space than it is to walk down the corridor of a big lecture theatre it is easier to get 500 people to the front of the class in a virtual environment that is really thoughtful i think you also point out that the use case where the camera is next to the chat line meaning i want to get a picture in there quickly has been prioritized by teams which then allows them to do that and of course we're teams to be like office lens and recognize the square d skew it clean it up and then send it even better turn it into a pdf there's one better i i noticed that my my children who have now been in zoom school or team school now for a number of months one of them said i feel like all we do anymore is copy web links around like he's constantly making a link and sending a link and copying a link and he and he's starting to learn like i don't feel like we should have taught children about pdfs at this age i feel like that's a thing we should you inflict pdfs upon someone you don't actually teach them to the children but yeah those use cases can be hidden in the example you gave no one's thinking about jpeg or h-i-e-c or whatever they're just saying hey hey look at this doc click and then it's up on the screen and you're marking it up and so what we're talking about is friction there is so much friction surrounding this educational delivery at the moment and that friction is blocking our ability to communicate easily so i'm talking about all of these things here that are increasing my bandwidth of communication you know digital ink is is a way of communicating it's easier to draw a diagram of something than to explain it more space the ability to point at things the ability to change camera it's all about more bandwidth and less friction and that this is what we need to do to move forward with our ability to communicate in digital space indeed i've seen professors take cds or i'll take i'll just wipe off my messy phone here and hold it up and see how i'm reflecting downward and you can see my hand they'll take mirrors or makeup mirrors or cds and reflect them to make a kind of airsats overhead projector that feels like a thing that we should make a 3d printed very inexpensive two dollar one dollar thing that snaps on a webcam and suddenly i can i can scribble or i even have a a very inexpensive gooseneck lamp and i gaffer taped a webcam to it but if i want to change cameras i have to go device settings pick the camera it's just enough friction that i would do it well i would do it you would do it but i think we'd come up with an automated way to do it but an average teacher i think it's asking a lot they're trying to teach not exactly click on things yeah and so this is where to me the frontier of 2020 and the next decade is about what we can do with integrated systems so if you look at 2010 to 2020 that decade of technology was the age of the killer app there's an app that does everything now but all of these apps are separated and they can only do what is possible within the sandbox of the data they have and so now we move forward and we start saying well what's possible when you integrate different systems this is why i'm really interested in teams so you know we can take video for example you go okay well there are students there and you're talking and you're communicating what about students who are re-watching the video after how do we start looking at this video as being something more than a monolithic object like a vhs tape that you put in the box and hit play how do we start thinking about this as a really rich asset of information and so you know this this comes back to communication again we're in teams we're in the chat a student asks a question like hey does anybody know what this is and they didn't watch the lecture that week now my team's meeting that i had is recorded in stream on office 365 and machine learning generates a transcript of that and that transcript is a file that's time indexed against every sentence we can take the question that the student asked we can get a bot to search that question with natural language processing against the transcript of the video and then we can the bot can answer the student straight away and go i think the answer to your question might be in this week's lecture at 53 minutes and 22 seconds and then you've got a task module that pops up with the time indexed video going straight to the lecture so we we can start integrating all of these different elements i built that by the way and it's in my bot um we can bring all of these different elements together and mash up things whether they're synchronous or asynchronous or whether they happen via chat or video or today or a week ago and it's really fascinating this i think this is the frontier of the next decade now when you said i i did that you wrote that doesn't that make you a programmer because we introduced you not a programmer no i didn't wrote i didn't write it my developers built it ah okay so you conceived of it the lego pieces were available you specked it out and then some of your your interns your teaching assistant your developers made that for you well actually they were friends of mine at a company in sydney called antares solutions so i work with them i i get them to build my crazy ideas and i know just enough about programming to know what's possible and what isn't possible i that's actually an interesting thing and one of the things that is the theme of both my youtube and also what i try to teach people is that it's not about the the keywords the functions the the little details it's about the you know this ought to work i should be able to plug that thing into that thing and if we look back at the beginning of this conversation where you showed us how you took x split i'm using obs you took your digital ink you took your screen that was the mind of someone who says you know this plug really ought to plug into that way and you're trying well that doesn't fit and that well hang on maybe that will fit you know this logitech remote control i should be able to push buttons and that that should make that thing and then you find a non-fragile way to do it you've prototyped an integrated system and now it's on someone to productize it and make it a really important system and it's an interesting thing about engineering you know because when you come in as a first year mechanical engineering student we start teaching you from around the year 1600 like newton the principia and we can't actually get anywhere near to today in a four-year engineering degree we get about from the 1600s to about the 1800s maybe in a four-year engineering degree and so really what an engineering degree is about is understanding the world and realizing that you can learn it right you can figure it out you you imagine what's possible and not possible and you start learning how to go and teach yourself or find the resources that you need to move forward and so that's kind of my position with programming which is i know enough to figure out what's possible and then i try and find out whether the tools exist or not that is er very cool i think that's why we get along because i feel the same way like when i went to school i learned how to program in the 90s and none of those programming languages exist anymore except for c but i know how to i know how to learn the thing i learned in school was how to learn more and how to how to push the limits of what's possible that's really cool well thanks a lot for chatting with me today thank you scott it was an absolute pleasure all right go ahead and go out there and google for dr david kellerman you can see lots of great demos and interviews with him about some of the fun things that he's doing to push the limits with teams and he and i may just team up next year and try to cause some trouble and do some damage uh with some of these products we've got plans all right uh smash that bell subscribe to my youtube channel and we'll see you later

Channel: Scott Hanselman

Views: 18,234

Keywords:

Id: 2LaTamAIinc

Length: 32min 8sec (1928 seconds)

Published: Tue Nov 24 2020