Advanced Online Assessments with Google Forms

hello and welcome to today's webinar advanced online assessments with Google Forms this session is part of a series of free webinars offered every week or two by the stark portage area computer consortium or spark for short SPARC is an information technology center in Northeast Ohio where we support about 30 school districts however this webinar is open to everyone and we'd like to welcome all the people who have joined us live today or are watching the recording in the future my name is Eric Kurtz and I am a technology integration specialist here at SPARC and I will be your presenter for this session today I'm joined by Anthony lucky my coworker he'll be monitoring the QA doc which we'll be talking about here in just a moment all of the information for today's session can be found at tiny dot CC slash spark two one three I'd encourage you to go to that site if you've not already done so if you're watching this live you're probably already there but otherwise again tiny dot CC / s parc c - 1 3 and i'm actually gonna go there right now myself so i can show you what is available there and tell you what i'll even zoom in just a little bit on that page so it's a little bit easier to see excellent that link will take you out to our technology integration website where you'll find all the resources for this session today including the live stream which will become the recorded video after the session you'll also find any help guides slideshows other videos related to this session in the resources section there's also a live session chat we've got a google document linked in here that if you give a click on that it'll open up a doc that you can type in any questions comments ideas feedback that you have and that's what Anthony is going to be monitoring during the session so that's a great way for you to be involved and give some feedback during this particular session would definitely encourage you to do that below there is a session evaluation we all always love to get your feedback it helps us improve our our webinars and other professional development so please after the session give a click on that and you'll find a real short four or five question evaluation and at the very bottom of that page is a link to a Google Form quiz to take about this session and if you take that quiz and complete it ivor better correct you will earn a certificate of attendance for one contact hour that'll be generated as a PDF and emailed straight to you after you complete that quiz so it's a great way to earn some contact hours for your professional development now while we're on the website I do want to point out real quick just a couple of other quick things at the top we do have a few links at the top of the page including a PD schedule which will show you other upcoming webinars so certainly be sure to go there and check out and see what else we have in the works there's a link at the top for the recorded trainings which shows you our past webinars we're building up quite a good collection of those you can go back through any of those and watch those at your leisure we also have a link at the top to our newsletter sparklines you can come here and sign up for our newsletter and date on all of the upcoming webinars and other professional development opportunities that we provide it comes out maybe every three or four weeks so you won't get it a whole lot but it'll definitely give you the information you need to stay in the loop and finally there's a link here to contact us so if you'd like to get in touch with with me or Anthony there we are with our emails and other ways to contact us fantastic all right well back to the presentation all right so for our ARA web our webinar today our session agenda is going to be as follows we're going to start off with a very forum jury review and I do say it's gonna be brief because this is not an introductory session this is meant to be an advanced session but we're gonna lay some real quick groundwork on Google Forms and then after that we're gonna spend the remainder of our time talking about 10 advanced tips for using Google Forms for assessments now those 10 tips are going to be as follows we're going to talk about adding mathematical expressions to a quiz we're going to talk about adding a reading passage to a quiz we'll cover password protecting a quiz adding questions with more than one possible right answer including ranges of acceptable answers for math problems forcing case sensitive answers turning off the quiz at a certain date and time providing helpful feedback for questions providing individualized feedback for students and Auto grading the assessment so that's gonna be what we're gonna be focusing on that's ten items in an hour so we'll see this mean we'll see if we can fit this one in in an hour if it goes a little long that's okay but we'll do our best to get through all ten of those during our time here today as far as prerequisites for this webinar you should have a Gmail or a Google Apps account so that you can go ahead and create a forum as well of course that means you'll need access to Google Docs or Google Drive I should say so that you can go there and create your Google Form for this session though it would really be helpful to have a basic understanding of Google Forms because this is an advanced session we actually already ran an earlier webinar a couple of weeks back maybe a month or so ago which was an introduction to creating online assessments with Google Forms if you have not yet seen that one and if you are very new to Google Forms or haven't done much with it I would definitely encourage you to catch that webinar that's a tiny dot CC slash spark to10 and that'll get you totally up to speed on how to create forms and different types the questions and sending it out to students and using flubaroo to grade it all of that is a basic introductory level information whereas what we're gonna be doing is assuming that you're already there and pretty much is hitting the ground running from that point on all right so as I mentioned I was gonna do like we said a very brief Google Forms review just to set the stage so we will start with that real quick and then move on to the ten advanced techniques so Google Forms is a tool from Google that allows you to create forms and surveys and quizzes and such it is free and easy to use it allows you to insert nine different types of questions you can also insert images and videos and be anonymous or you can have it collect the usernames of the people that fill out the forms typically if you're doing this for quizzes the way this works is you'll create the quiz and Google Forms you'll share that link out with others those people will then follow that link to open up the form they'll complete that quiz online as they do all of their responses will get collected together into a spreadsheet and then once all those answers are in the spreadsheet you can use a great add-on called flubaroo to grade those responses so that's pretty much what we did in session one we covered that whole entire process in great detail so again please refer back to that if you need to catch up on that in preparation for this session here today but today we're gonna go ahead and get on with the session whoops sorry about that click the link to open up the page try that again we'll get on with the session as we're gonna dive into advanced techniques for online assessments with Google Forms remember all of the session resources help guides etc can be found at I need CC slash spark two one three now again to save time today I feel like I'm on a cooking show you know I've already prepared some of the ingredients that's kind of how it works here today so what I've done is I've already created a quiz now I'm gonna I'm gonna zoom and again on this just a bit just to make it easier for you guys to be able to see this so I already created a beginning of a quiz it's not entirely done but I've got some things already pre-loaded in here just so that we can save as much time as possible as we get going through here today so what you'll see is I have made a very simple quiz called sample quiz - advanced to techniques and if I scroll down a little bit I've got a few questions not much I've got a question about what is your name what is your email address so you can tell right away I am not automatically collecting anybody's email addresses you're I'm actually not even using my apps or education account I'm just using my standard Gmail account here at the moment so that's not even an option but anyway I'm asking for their name I'm asking for the email address and then after that I've got a few questions now these questions are ones that we're going to be using as we're learning about some advanced techniques today now question 1 2 & 3 we're gonna come back to we've got to kind of cycle around to them there's a few more things well do but as you can see question 1 is asking for a president who came from Ohio for those of you that know Ohio you know we've got a bunch of presidents from here and so this is going to be a good example of creating a question where there's more than one possible right answer again we will come back to that the second one on geometry is asking for the circumference of a circle and this is going to be a good example for allowing answers in mathematics that have a range of possible correct answers and again we'll come back to that and then the third one down is a geography question talking about what is the capital of Ohio but that spelling and capitalization counts this is going to be a good example we're going to use to talk about case sensitivity so we're not skipping over these just be aware they're already in there we will have to come back around to them just in a bit when it's the appropriate time to address those all right so with all of that said let's go ahead and get started so here we go um number one all right so the first thing the first advanced two technique that I want to talk about when it comes to creating online assessments with Google Forms is adding mathematical expressions now I used to be a math teacher I taught seventh seventh and eighth grade in math for seven years and so I've always got a soft spot for math teachers and the things that we go through and one of the things that you hear a lot of times with forms is the forms are great I love that's fantastic for quizzes but what about math what about equations what about things like that where I'm trying to put in you know a graph or some mathematical notation there's no easy way to do that in Google Forms and you are correct under normal conditions there's not there's no equation editor just built into Google Forms well the nice thing is there is an add-on now called gene math that can help you with this this add-on allows you to create math expressions and graphs and such and then it inserts them into the form as an image so that's what we're going to do for our first one today is I'm going to show you how gee math works for math teachers to put mathematical expressions into a quiz so here we are back in the quiz we've created and if I go up to my add-ons you'll see I've already installed G math now if you have not messed with add-ons before we've got lots of webinars that have talked about those go back and check those out as well but the main gist is if you go to add-ons and you go to get add-ons it'll give you a list of all these available add-ons that you can install and all you have to do is hover your mouse above one and click the free button to install it now I've already done that for G math that's the particular one that we're going to use right now so what I'm going to do is I'm going to go up to add-ons i'ma go down to gene math reforms and then I'm going to choose from that create math expressions and when I click on that what it does is it pops up this panel over here on the side and this panel allows me to be able to come in here and create a mathematical expression using all of these different symbols and pre-made expressions that I can pull in and manipulate however I need now I'm not gonna do anything too crazy I'm gonna keep this pretty basic so I'm gonna start here by clearing out what's already in here now you'll see that what you've got is a spot where it has the code this is the latex code that's actually creating the expression I'm gonna take that out so we can just kind of start from scratch you can see how this works and below it'll be the preview of what's gonna get inserted now here's my plan really simple guys I'm just gonna do a question where we simplify a fractional expression so nothing too fancy but because it's got a fraction in it that's the thing that sometimes hard for example to put into a form so I'm gonna scroll on down and I've got to find something that looks like a fraction and there we go a over B I can find that and if I click on a over B it goes ahead and inserts it up here into my latex window for the preview and also for the code now it puts a over beam and that's not what I want I don't want the or B instead I want to do something like for plus and maybe I'll do 2 times 6 now I could use 2 X 6 use extra times but we know that usually that's not what you use in math we try to use the dots so if I come down let me see here's a times let me click on that to add that in excellent and I'll edit the a and the B there and I'll make it two times six so we'll do two and we'll make the V a six excellent and then on the bottom it's being divided by B at the moment but let's divide by three minus one excellent so there we go I've created this mathematical expression by by choosing the things that were available at the bottom and then editing them at the top if I'm happy with that all I need to do now is click the insert button and go ahead and click insert link and what's gonna happen is gee math is gonna take that and it's going to insert it into my form over here now when it inserts it it's gonna drop it down at the bottom so I've already got these questions I have to scroll down to find it now that I'm done I can I can close out of that Erie here so I'll close out of my add-on panel if I scroll down you'll now see what it's done is it's added two things it added the picture so right there if you click on it that's an image that's the expression and then it added a question to go along with it and remember that's how it works we talked about that in our first class on using Google Forms for assessments images and questions are two separate items they actually are not connected to each other so for the question I actually need to put in the question itself so I'm gonna go ahead and do that right here for the question when I'm gonna paste this in see how fast I can type actually pre did all of this but I'm trying to save us some time here today guys and I'm gonna go ahead and make this a multiple choice question and I'm gonna throw in our answers there so we'll give them 2 8 9 and 18 we'll make that a required question we'll hit done and because I said simplify the expression shown below I'm gonna need to drag this up above the image Dada there we go so there you go there's trick number 1 using G math to insert a mathematical expression into a quiz all right that took five minutes I think we're doing okay okay keep on moving here all right next one step two or a technique to adding a reading passage to a Google Form now this one actually came up at a training that I did a few months ago we were talking about forms and somebody said I'd like to to add a reading passage but I don't know a good way to do it because you know it's big it's long where do you actually put it how do you get that in there now there's no one perfect way to do this I can probably give you three different options here and if we have time I maybe I'll show you all three of them but the one that I'm suggesting that I think is probably one of the easiest is just to use the section break option Google Forms allows you to insert a lot of things including section breaks and when you insert a section break you can include a header and a description with it and you know what a section break might be a really good item to use if you want to insert a passage of text for students to read so we're gonna try that we're gonna pop back over to our quiz again and this time we're gonna go down below our math problem and we're gonna go to the add item button and we're gonna click the little down arrow there and instead of adding a particular question at the moment we're gonna add a section header okay so I'm going to click on section header under the add item section and when I do that link it's gonna go ahead and add this in where I get a header title and a description now what I'm gonna do for my header title is I'm gonna put in some text that tells the student that question five deals with the reading passage below now I'm just doing one question and for the sake of time but it could be like questions five through eight to deal with this passage you know that would certainly make sense now I need the passage so I'm gonna go ahead and copy and paste the passage in here and just something I whipped up earlier I think I've got a good ring to it it was the best of times it was the worst of times that sound good Anthony okay yeah we'll go with that so anyway I've got a little excerpt from Tale of Two Cities obviously and I went ahead and threw that in for my description to go along with the header text so basically by doing this I'm creating a section in my quiz that has the header and then the body of the text that I want the students to read and when I hit done that just sits all on its own now it's not really connected to any particular question but it gives you a good spot to be able to insert something like that so now that I've got that thrown in as a section header needy and insert my question below that so I could go down to my little down arrow for add item whoops got to click on the right spot there Eric and I'll say I want to add a multiple choice question and so I'll go ahead and throw in my question which will be question number five asking them what technique is being used above and then I'll throw in my possible answers here which is compare/contrast alliteration and metaphor I'll make that required and hit done and there you go now I've got a reading passage as a section header and below there I have a question on that now there are other ways you could do this for example if you had a reading passage in a book or and somehow printed out already on paper or you could scan it and turn it into an image and then you could add that as an image to your quiz now I mean I'll show you real quick certainly we don't have to do this approach but I could go to add item choose to add an image go to upload and I think on my desktop I've got a folder where I put a sample same sample quote in there there we go so I could upload and here it is hit done and let's shrink that up a bit it's kind of big doesn't need to be quite so large maybe Center it so I could instead scan in a reading passage and upload it as an image so instead of doing a section header I could do that I think the section header is a little easier you don't have to go through the scanning and uploading process but you could do that and I'm gonna go by I'm gonna delete it I won't really do that and then the other option is you could just put a link out to a reading passage so instead of doing the section header I could have done something like this in the help text of the question I could have pasted in a reading passage link hit done and you'll see that that would then create a link that the students could click on that would jump them out to a passage now obviously there's dangers here and that once they get out onto the Internet maybe then they're going to start searching or googling things and so maybe you don't want them leaving the quiz but you certainly could to do that again I won't really do that for this example here just want to let you know there are other options you could go with alright so there you go guys that is number two all right next advanced technique password protecting a quiz let's say you want students to take a quiz but you don't want them to take it until a certain time well typically our answer to that is go ahead and create the quiz and then either don't give them the link until the very last moment or go up into the top menu here and click on responses and then click on accepting responses to toggle that off and what that does is that turns the forum off and so once it's been turned off then if anybody tries to go take the forum they just get an error message saying sorry this is no longer accepting responses then you go into responses and you click the not accepting responses to toggle it back on and now tada it's alive again usually that's what our approach has been in the past so you've got a you know create the quiz ahead of time and either somehow withhold the link from the students or you need to turn it off and then turn it back on when it's time for them to take it and that's all fine there really is nothing wrong with that that certainly is fine but it's just one more thing you've got to juggle it's another thing you've got to make sure the last minute that you're turning it on turning it off you know holding on to the link to the last minute all that kind of stuff instead one possible option would be to use a password protection scheme which uses data validation and we're gonna explain how this works and we'll actually go through the whole thing show you the whole process but the gist of it is you're gonna add another question to your quiz and this question is gonna be the very first question on the quiz and the questions just going to be what's the password and for a student to move on to the rest of the quiz to even see the rest of know the correct password and we're going to use data validation to make that happen so here's the idea you can create the quiz you can put the link out there anybody can click on it it's wide open just ready for them to get to it but they can't actually take the quiz until you give them the password that you could very easily state to the class face-to-face the password is and give them whatever the password is and that way you're sure that the students are in fact taking the quiz with you in the room in a proctored setting and they're not accessing it any other time any other way so how does that work all right well let's go ahead and do it so like I said what we need to do is we need to start by creating another question okay so we'll go to the bottom here we'll go to add item and we're just going to add a text question and the text question is gonna be very simple it's just going to say we copy and paste this over it's just gonna say enter the password provided by your teacher to take this quiz but instead moment get required of course but instead of it just being a text box that they can just type in like if we had done just like I regular text box instead of it just being a regular text box we're gonna go to the Advanced Settings below there now if you click on Advanced Settings whoops try that again Eric if I click on Advanced Settings underneath there you'll see that I have an option to use something called data validation so if I go ahead and click on data validation what it does is I can specify what the student puts in the box that it must match some criteria so I could say what they type in must be a number or what they type in must be text or what they type in must be a regular expression we see this a lot of times with like if I chose text I could say what they type in must be text and it must be a valid email address for example or it must contain certain words or whatever I can also do number it must be a number and it must fit within these categories here so this is a nice way to make sure that what students are putting in is what you're expecting them to put in well one of the options here is regular expression that's a little bit more powerful tool so if I choose data validation and I choose regular expression what I can say is that what they type in has to match a certain pattern if it doesn't match this pattern I'm sorry you can't move on you can't go past this question because you have not been able to match the pattern well what I'm going to do is I'm just going to go ahead and put in a pattern of password now obviously you wouldn't use password you would use a more sophisticated you know word there and it is case sensitive just by default so whatever you put in there upper case it does make a difference and then if the student gets it wrong I do have the option here to put in custom error text so I could say that is not correct please try again but the point is by doing this I'm now saying to take this quiz whatever you type in here it must match the word password and if it doesn't match that you can't move on so I'll go ahead and hit done in this question though needs to be the first question of the quiz so now that I've created it I'm gonna grab it and drag it up up up up up above keep going up keep going up keep going up alright and did I make it to the top almost excellent now it's at the very top loquiz well that's good but not good enough because right now there's nothing really between that question and the rest so even though they can't submit the quiz without having the right pass where they would actually see the rest of the the rest of the test well that's not what we want what we want to do is we want to insert a page break between the password and the rest of the quiz so that after they put in the right password then they can move past the page break so I'm going to go ahead and I'm going to insert a page break and I can do this at the top I can do this at the bottom under the add item I'll just do it I'm at the top already I'll do that up there insert page break and because I was already at the top it dropped it right in underneath password now guys a page break though you could move around so if you added to the bottom no probably up to the top - not a problem at all for the page break I'll just put in a title that says begin quiz and I'll hit done and that's pretty much it - so now what you'll see is I've a password question at the beginning followed by a page break and then the rest of the quiz begins now like I said the page break itself can be moved around so if I click and drag the page break I can move it up I can move it down so if it wasn't where it needed to be you could move it until it's right where it's supposed to be underneath of the password item there so get that below password there we go there we go excellent all right now that gives you now that control so when a student goes to ten we'll see this in a moment we'll view the live form here in just a moment you'll see what it looks like so now what's going to happen is when we go to the live form will have to answer the password before we can move on to the rest of the quiz all right and we'll see that in action in here in just a moment all right guys number four Oh lose a little bit of time gonna talk quicker I'm trying to stand five minutes per per item so here we go numbers four five and six are all very common we're actually going to do these all three together so maybe I'll make up a little bit of time on these three and again you will see the password protection in action as soon as we move into these next ones here so the next three we're going to talk about are kind of a group and all of these have to do with some special features that flubaroo has built-in now this is not a Google Forms specific trick it's actually a flubaroo trick so we're gonna use flubaroo later to grade these quizzes well this is the the these are this isn't code built into flubaroo that we can take advantage of so the first one we're talking about is multiple correct answers what if you give these students a question like let me find my question here question one history name a president who came from Ohio like we said there's a Mount eat front two three or four front yep eight seven seven or eight seven I think it's seven I'm sorry about seven presidents who came from Ohio I should know this I live here the question is just name a president who came from Ohio well that's seven possible right answers now you know normally when you're using flubaroo again if you die please please please refer back to the first webinar where we talked all about how that works we're not gonna redo all of that here today but when you use flubaroo the way that you create your answer key is you take the quiz yourself and you fill in the right answers so normally if I were to take the quiz myself and fill in the right answers I would just put in the answer well there's not just a answer here there's there are seven possible answers okay so how does that work well here's the way it works if I go ahead and take the quiz myself so I'm gonna go up and click on View live form and when I do it opens up in its own new window and of course there we go guys were greeted by the password question unlike we expected so I do actually have to type in password to be able to move on so I'll click path type and password and hit continue if I did not know the password I could not go on to the rest of the quiz I'll demonstrate a failure of that later we'll go ahead and try it again and I'll put in something incorrect but now that I'm actually into the quiz I would want to fill out my answer key and so normally what we do is we type in like answer key for our name and we put in our email address and then we go ahead and start putting in the correct answers well here the answers there's you know 700 possible answers for a president who came from Ohio the trick to this is flubaroo allows you to put the code percent or percent o R percent or in between the different possible answers and so I've already typed that up and I'm gonna copy and paste that in here for you so if I come over here to take the quiz and I paste that in you'll see that what I've put in is actually let me just click back in here there we go I've got Harrison space percent or space grant space percent or space Hays and then Garfield and then McKinley and then and then Harding and in each case I'm putting the percent or in between the possible answers with a space as well in between those so that is how I create the answer key in such a way that flubaroo is going to recognize that percent or and go AHA I know what that means that means there's more than one possible answer so great trick and we'll see that in work will see that at work once we go ahead and fill this out as a student as well all right so that's one of the these three let's look at the second in this little group here and that is having a range of possible mathematical answers to a question well when you're doing math sometimes there's not an exact answer because you might be using an irrational number like pi or using square roots and it really kind of depends it depends upon where the student rounds things off to now unless you tell them specifically you know or if they're using different values of pi if they're using 3.14 versus something much more specific they could come up with some different possible answers there well flubaroo can adjust for that by using percent to as a number as a code between the two boundaries the lower and upper boundary of the acceptable mathematical answers so let's go back to our quiz and on our quiz I asked the question what is the circumference the distance around for the circle shown below well this circle below has a ten centimeter diameter and so the circumference is pi times diameter or pi times twice the radius while pi times ten is going to be 3.14 times 10 31.4 well that's if you use that we all know pi really is you know 3.1415 blah blah blah blah blah so it depends on what value of pi you use to determine what you're gonna get out for the answer there so really we're looking at a range of possible answers so to be safe I could say something like this for my answer key I could say 3.14 is perfectly fine if they just use 3.14 so 31.4 for the answer percent two and then let it go all the way up to like 31 point four two that's gonna catch all kinds of stuff in between there based upon what value of pi' they used this it'll catch all of the acceptable answers within there now it also will ignore any letters they put in because I'm using percent - if they type in centimeters or if they don't it will not make a difference so it does strip out any letters and it just focuses on the numbers when you're doing that okay so that's how I create the answer key when I want to have a range of mathematical answers all right and the third one in this batch is all about case sensitivity so here we're talking about what about when you need something to be capitalized where you don't want it to be capitalized well normally flubaroo does not pay attention to capitalization so whatever student types in it just matches the letters it doesn't worry about uppercase and lowercase well what if you need it to well you can use % CS for case sensitive and you can put that in front of your answer so the next question in my quiz was the city of blank is the capital of Ohio and I put spelling and capitalization counts well the capital of Ohio is Columbus and if we want to do that right then I would need a capital C so when I fill out my answer key what I'm gonna put in is % CS space Columbus with a capital C now that % CS is gonna tell flubaroo when grading to make sure that it is case-sensitive alright and again we'll see all of that play out when we actually grade the quiz and just a little bit all right guys well at that point I should go ahead and finish off the rest of my key so this should be 8 and number 5 we're talking about contrast excellent so I'm going to go ahead and I'm going to submit my answer key give that a second to do its thing very good and so now we can close out of that so now I have taken the quiz myself and I have submitted that and if you want to see I'll go ahead and open up the view responses so you can see all of those codes actually show right up there in the spreadsheet so here are some percent or grant 31.4% to blah blah blah % CS Columbus those show right up in that spreadsheet just like so alright very good keep on a movin here guys we're doing good now okay advanced trick number seven mmm auto turn off the quiz alright well we mentioned a little bit ago about setting it so that students can't take the quiz sooner than you wanted them to and we talked about ways of doing that including password protecting the quiz what about the other end what about making it turn off at some point so maybe you want to say Tuesday at midnight that's the end if you'd if you have not taken the quiz by then it's off we're turning that thing off at that time well again what has been the answer in the past was basically you doing something manually you would have to go into your quiz and you would have to go to responses and you'd have to click accepting responses you'd have to turn it off like we said and then of course you could always go back and turn it back on by clicking the same option but that means you have to be up at midnight in maybe you don't want to be up at midnight to turn it off well the beauty of this is there is an add-on called forum limiter that will allow you to set a date and time to turn off the quiz automatically now there's other ways to turn it off besides date and time you can turn it off after a certain number of responses have come in so that's that's a good option too but for quizzes most of the time people think date and time so let's use forum limiter and let's set a time limit on our quiz so if I'm going to go up to my add-ons you'll see I've already installed forum limiter you would of course go to get add-ons and then you would go ahead and install it from get add-ons I've already got it installed so I'm gonna go over and click set limit that's gonna go ahead and open up a panel over here on the right-hand side where I can choose what kind of limit I want to set on this forum well I'm gonna set a date and time limit and at that point I now can choose the date it's gonna turn off which we'll pick today which is April 14th and then we need to pick a time now for the time I'm gonna pick something that gives me just a little bit of breathing room that I'm gonna I'm gonna take the quiz now as a student I'm gonna go ahead and take it as a student so we have a few because we can't grade it without a few answers in so I'm gonna take it as two different students so I'm gonna get myself a little bit of a bit of breathing room let's go let's go with something around I don't think 4:15 is gonna give me quite enough but I guess we'll have to we'll have to see I might have to adjust this after I put this in here let me change the time yeah well I'm gonna give myself just a little bit of breathing room I'll say 417 all right so at this point I'm gonna click Save and enable so what's gonna happen is that 417 p.m. this quiz should turn off well let's see if that works I'm going to go ahead and save and enable and now I'm going to go ahead and try to take the quiz so I'm going to go ahead and come here I'm gonna save you live form at the moment it's working all right so let's go and we'll put in password to get started and now we're on to the quiz and I'm gonna take this quiz as a test user and I'm gonna take it wrong to begin with so we'll put in we'll just in test before the user actually would do test is 0-1 and we'll put in his email address and we're gonna put in some incorrect information so I'm going to do William McKinley for the president I'm not following the directions I'm putting in first name and last name I'll put in 31 for the circumference which is too small I'll put in Columbus with a lowercase C and then I'll go ahead and let him get the last two correct will give him a couple of them right there and we'll hit submit and whoosh it made it in okay that was close but we made it all right so I've got the first one in let's go ahead now and try to take it again and see if we get too close to our time and whoops actually I think I did give myself too much breathing room there I just realized that I gave myself a little too much let me pull that back I did not mean to give myself quite so much I think I meant 11 sorry about that guys there we go what do 11 after this is live we're doing it live so we'll go ahead and that should be saved and enabled now okay so hopefully that is now ready to go at a at the right time so let's go ahead now and we'll try it again and now I'm going to go ahead and take it again as another student and this time we'll do the correct answers for this student so we'll let them get these answers right test two and for this we'll put in some correct answers so we'll do Taft and we'll put in 3.14 and a whole bunch of good stuff there we'll put in Columbus with a capital C and we'll give him again the right answers on these last few and we'll submit that okay so far we're doing fine so at this point we should be creeping up on win form limiter is going to kick us out let's go back and check the time it's got it's still at 4:17 whoops I need to go back in and see if I can change that I wanted it to be right around the time we're at right now because I want to show you what happens when it turns it off or maybe I my clock might be off that may be the problem and I may be picking a time that's too close I may be picking something I'm sorry guys and may be picking something now I've probably gone too far the other direction let me see if I can bump it out just a little bit there we'll do 413 and see if that saves well I may have officially made it mad so yeah but the idea is that what happens is once you get that saved and then it hits that time what will happen is the form will automatically turn itself off rather than you going in all it really is doing is going though it did take it finally true I just need to learn to be patient and how about that here just learn to be patient there so now it looks like it has taken it so if I go to add-ons and form limiter it should be at 4:13 and yes it is okay so just be patient here there we go so now if a student goes to view the live form eventually here it's going to kick us out still okay at the moment oh by the way let me show you if I type in that's not really the password and I hit continue it yells at you and says that's not correct try again so you do see the password really does work it actually doesn't work let's go back here let's try it again and oh there we go it turned off we even saw it turn off right there so once we get 4:13 it turned off if I go to view the live form now or Inc it is now turned off and it's not accepting responses anymore so as long as you actually know what time of day it is which apparently I'm struggling with a little bit as well do you know what time of day it is and you said that it will then turn it off appropriate for you now you can go back in and you can click on responses and you can click not accepting responses to toggle it back over to accepting and so that's fine you can turn it back on later if you want but form limiter is a great tool to help you turn it off at a certain time when you would like that to be okay we're getting close to the end here guys number eight and nine are very similar as well these are some more advanced tools from fluru that happen after you have graded a quiz so we're going to take a look at both of these but before we do let's go ahead and grade the quiz so that we can see how these work so let me go back over to my quiz and you'll see here that it's got my answer key then it's got the two test users with their answers in there I'm gonna go ahead and quickly grade this I'll go to add-ons I'll go to flubaroo turn flubaroo on and again if you don't know how to use flubaroo please watch the first webinar on that it's just another add-on we'll go to add-ons will go to flubaroo I'll choose grade assignment and at this point we're gonna ask or answer the two questions we always do for flubaroo the first question is how much is everything worth well typically we keep things all worth one point but remember we've got a password question now and that doesn't count that's not we're not grading the password question so for the password question will choose skip grading so that one does not get included in there but everything else can just be a point hit continue and that wants to know where the answer key is well it's row number one so or the first row so we'll get that and continue and chugga-chugga-chugga let's get it graded and it should all be done perfect there we go so now we now have a new tab called grades there's the student submissions here's the grades and the grades now have how the students did and you'll see that you know test user one missed quite a few test user two got them all right okay now that we've graded this normally the next step is we evaluate the results and that's great we look through and we see who's struggling and what questions they're having trouble with and normally we go to add-ons flubaroo and we say email grades and we send the grades out to the kids well we're gonna veer from that a little bit here today and we're going to talk about options 8 and 9 for these other cool things you can do so advanced technique 8 is to provide helpful feedback for questions now here's the idea let's say that after the quiz is done and you're gonna send an email out to the students giving them their grades on that quiz what if you could provide a little bit of extra help for each of the questions or maybe just some of the questions like maybe a YouTube video they could watch or maybe a website that reviews those questions or maybe just a little note that helps remind them of the correct way to answer the question well you can do that in flubaroo using something called help tips so if you go to flubaroo and you turn on if you can choose edit help tips what it does is it will add a new row right below the questions okay so in your spreadsheet if I go to add-ons and I go to flubaroo and I choose edit help tips watch what happens behind here I'll click on that and suddenly a new row appears at all there it is it pushes the answers down and now anything I type in underneath the questions is going to get included in the email when I mail it out so let's say that I wanted a student to watch a video to help them understand circumference so this question here about the circumference I could come here and I could paste in let me paste in I could paste in see help at blah blah blah blah blah YouTube such-and-such this is a YouTube video circumference by pasting that into the box below the question when I do send the emails it's going to include that inside the emails to give them some additional help pretty nice along the same lines advanced feature number nine is feedback per student now what I mean by this is you can also provide individual feedback like a note to each of your students they may say well Eric I thought we could already do that when I go to add ons flubaroo and email grades don't I get a little box that pops up for feedback yes you do but that goes to everybody that's a global comment instead if I go over to the grades tab here and if I go up to add-ons flubaroo and if I choose edit student feedback so very much like the other one add-ons then flubaroo and then edit student feedback what it does is it opens up a new column for me so watch and see it'll pop up there it is blink just showed up so now there's a column H over here that gives me an option for each student test user one test user two to put in specific feedback for those students so maybe I want to give a note just to test user one and I want to tell them please review the help video and so I can type that in there and they'll get that feedback where I could say good job or nice improvement or please see me I can put that into the student feedback so with that done let's see that in action now let's go ahead and actually email those out so I'll go to add-ons and I'll go down to flubaroo and I'll go to email grades like we normally would when this pops up I can choose to include the answer key as normal I could do a global message but I've got a personal one and they're all ready for that one student I'll just hit continue and we'll let that do its thing so this is now sending out emails to those students now I should have in another window here here it is excellent I'm gonna bring it up and I'm gonna drag this over to the screen here so put this on our screen here there we go so here is the email that was just received by test user zero one and you'll see that it's got the normal stuff that you get in the flubaroo reply you get your grade but look right below there your instructor has feedback just for you please review the help video and then if I go further down to the question on geometry oops okay now it's gonna make me it's not who didn't do it okay well apparently I did something wrong I'm just going to show you how awesome that looks and I barely did something wrong because it's not including it in there and it did in my test I'm sorry guys death technology things don't always work though nobody expect them to but it really does work so forgive me for whatever error I did when I was setting that up I may have skipped over something in the process there but typically what it will do then is it will include that right there in the message and I may have I can look I may have another one that I sent earlier as a test that I could drag over to show you what that looks like but that's okay I will drag that off and trust me that it that it does in fact work alright so last thing boy we're almost out of time but I think we're just gonna make it and that is advanced tip 10 so the last thing is Auto grading the quiz now you may say well Eric isn't that kind of what we're doing is it flubaroo Auto grading well I guess it's grading okay it's grading for you which is fantastic but what I mean by Auto grading is you can turn it on so that you don't actually have to go up and click the flubaroo menu option and go through and force the grade the grading to run you can turn it on so that anytime a student takes the quiz all by itself automatically flubaroo will run graded email them the whole process yes so basically here's the way it works first thing you want to do is go to the add-ons menu at the top and go down to flubaroo and then you're gonna go to the Advanced section so this has hidden away a little bit deeper than you'd normally go so add-ons flubaroo and then advanced off the side of there is the option that says enable Auto great so if you click enable auto grade what its gonna do is pop up a screen or it's gonna ask me what I like to update my settings now what does it mean by that those are the normal settings we always go through of how much is each question worth where's the answer key do you want to send emails to students well I've already done that because I went through it once so I don't really need to make any changes to that so if you've already graded the quiz once you can say nope we don't need to make any changes to that on the other hand if you haven't then yeah you could go ahead and go through those normal steps which you would have to do how much is each question worth where's the answer key what you want to email the students so at that point I'm just gonna say no I don't need to make any updates to it and it's gonna go with my normal setting so it's just gonna keep the settings I already had there okay it says that I do have some things that have not been graded yet what I like to grade them first no everything is fine just as it is excellent so now with that turn on I should be able to take the quiz again so I'm going to go ahead and grab a different email address we'll be test user three and let's go ahead and take the quiz again now so we'll put in our password and we'll be test user three and we'll put in our email address and we'll go ahead and put it in Taft and 3.14 and put in Columbus we'll give them the right answers here and eight and contrast and when we submit this what we should see happen I'm not gonna do anything just yet we should see first of all it's show up on the student submissions tab but then it should auto grade it over here let's see how it goes let's hit submit and let's take a look and Z so there it is on the student submissions tab so it is shown up there let's go over to the grades tab and what do you know there it is so right there you can see I now have test three showing up and it looks like oh I know what I maybe should have I maybe should have run through my should have run through those settings again because it looks like it lost where my answer key was so maybe it's better advice to go ahead and write and run through those settings again rather it so I'm gonna go ahead and turn it off and I'll turn it back on and we'll try it one more time probably should have gone ahead and done that I was hoping my settings would have been okay the way they were but I'll go back to advanced and enable auto grade and I'll go ahead and I'll run through this I'll run through the settings this time I won't just assume that it's okay so I'll say skip the password and I'll tell it that the answer key is on the first row and I'll tell it that it can go ahead and email the grades all right probably better to be safe than sorry I was trying to save a little bit of time there but it was probably better not to do that so I will take the quiz one last time and we will see how we do here on our final or final attempt here so I just put in my name there and give my email address in there and just put in a couple of quick answers whoops sorry about that guys just take a moment to get those in whoops will go with Columbus here we don't want to do Canton we'll get it wrong and we should be done now hit submit and we're gonna hope for the best now nothing like live TV is it guys so here we go so there's the student submissions and we go to the grades so excellent so there it is so as long as again you know how to tell time and you actually follow directions this will work very well for you to do excellent now I don't know if I had sent out another grade for my student or not probably not I didn't erase that I was gonna see if we got another grade report so I could show you one that worked that's okay actually I am looking to see oh yeah where does I did this earlier so this is proof that this really does work guys I wasn't lying so here's the sample one earlier and you'll see that underneath geometry it says help for this question see and then there's a youtube video linked in there so it really does work all right very very good well that brings us to the end of our 10 advanced techniques so what I'm going to do is I'm going to pause for a moment and I'm gonna see if anthony has any questions that have shown up in the Q&A doc before we do some wrap-up so hang tight here there was a question can you use multiple codes on one question in flubaroo and I do not know I've never tried anything like that that is my first guess is probably not a hood I don't know so there's the challenge somebody try it I'd probably use like percent CS to make something case-sensitive and then I throw in like the president's names and make them capitalized so hey nothing nothing wrong with experimenting and finding out so that's how we all do things we poke a stick at it and we see what happens when we try it so we'll do that and then anything else up there oh the question was do you have a limit as to how much text you can enter in a section break option and Anthony you said you look that up and use do you think there may be a limit but it's very large you got 210 scrolling pages and you didn't run out of room okay so if there is a limit it's incredibly large that it's out there all right well guys we're coming close to to the end here so as we do that I'm going to go ahead and just remind you of a couple more things as we kind of wrap up here so first of all I want to remind you that all of the resources for today's session can be found at tiny dot CC slash spark two one three and I'll pull that up one last time just so we can see that site there's where you can find the video from today you could find the help guide you can find the session evaluation which again please fill that out it's great to hear from you guys you love to get feedback so we can improve these webinars this is also we can take the quiz on this session to earn yourself a certificate of attendance for one hour so please take advantage of that that's great this is also where you can go to look up our PD schedule of upcoming webinars you can go to our recorded trainings for past webinars you can sign up for our spark newsletter you can also contact us all of that information available there for you so again thank you guys so very much for being with us today we hope to see you again in the coming weeks for more educational technology webinars thanks and take care

Channel: Eric Curts

Views: 16,827

Rating: 4.9285712 out of 5

Keywords: gafe, google apps, google forms, online assessments, Eric Curts, SPARCC

Id: vE--KxDt25Y

Length: 59min 43sec (3583 seconds)

Published: Tue Apr 14 2015