Image Annotation Tutorial - V7 AI Academy

by the end of this tutorial you'll know most of the basics of using v7 Darwyn let's start with camera movements the pen around you can press the middle click or scroll wheel on your mouse hold and drag and move the image around you can use the scroll wheel also to zoom in or the shift button and to finger drag if you were on a trackpad you can also use the w a s and D Keys press the z key to activate the zoom tool you can click or shift click to zoom out you can also drag in a certain region to zoom right in to it when you're done press 0 to reset when you're familiar with these controls you can press the period button to cycle to the next image let's start with some bounding boxes you can press the B key or the bounding box button here on the left to activate this tool let's enclose this lantern by first zooming in to it and making sure that we align the crosshairs to make sure that we capture the pixels that only belong to this lantern hold and drag and release and then we can double-click on the lantern clasp to select it now we can zoom back out and continue with other lanterns we can zoom all the way in to this one and see the very pixels of the image and then enclose it in a bounding box when done I'll press 0 to look at the whole image make sure I've included all the lanterns and I haven't but I'll skip it for this tutorial and when I am done I will press the center review button here on the top right which also has a shortcut of Enter or shift enter in some cases now let's switch classes there are many ways to do this the first one is to simply double-click on the label that appears when you're looking at a class in this case I can press the edit tool v and click on this lantern label here with a double click and then select the person class you can also use this class selector which is present in every tool in this case these are the bounding box classes that we can select and I can press person and will annotate another person here you can also use alt V to paste a class name onto another and obviously control-c or command-c in a mac and control-v or command-v on a mac to paste classes get familiar with copying and pasting classes and moving them around repeat some bounding boxes to enclose some additional people in this much larger image when you're done take a look at these keyboard shortcuts on the top right by pressing this command button over here these keyboard shortcuts are going to be essential for becoming a power user in Darwin and they will save you a lot of time as you get familiar with the tool there are many keyboard shortcuts to learn so make sure you keep referring to this keyboard shortcut panel when you want to improve your speed when you're familiar with this image press the center review button to continue now let's start using some polygons you can press the P key to activate the polygon tool let's zoom into this large car at the front we can click to add some points and move the mouse to start building a polygon around it we can click as fast as we need to to enclose this car you can close a polygon by clicking on the last virtus or by pressing enter as I will do now again since we haven't selected a class before and it will prompt us to do so I'll select the car class and it will complete my polygon now let's find a better way of making these polygons let's use the auto annotate tool alternated is a very powerful AI based tool that knows any class or any object and encloses it with a pixel perfect polygon let's select a car class and by default we will have the generalized model this will know practically any object we'll try to enclose this vintage car next to our other friend here and it will do a much better job at enclosing it in the first go but sometimes it won't be perfect it forgot a bit of wheel so we will click on this region to include some more pixels and we'll click again if we want to include another piece I also want to include this rearview mirror so I will simply click and it will expand to include a new object let's try it on some other objects such as this other car and you can also try it on other objects that are not cars simply to try things out so just perhaps this road sign when you're familiar with Auto annotate and its command including the addition of points the Clear button and the rerun which also activates whenever you resize all to annotate you can continue to the next image you can also spend some time here familiarizing yourself with the polygon tool as you may use it frequently in your annotation now let's steel with some layers layers are used to save you time without having to delete objects that are next to one another you can simply have them overlap for example let's select the sky class and make a very rough polygon around this image I will make four points and will enclose this image with a large sky also at the polygon tool again select the wall class and I can type in to filter it quickly and add five points to include a wall you'll notice that on this panel on the right well is now on top of sky this means that in the JSON order or XML order that we will export the file in the wall will be placed in a position above it the JSON order it is technically below but if you were to export a PNG mask of this image the wall will be covering the blue color of the sky therefore being true to what's represented on the image let's finish this image off by adding some chimney stacks here I'm going to press CH to filter the chimney stack and then start adding the chimney stacks from the back to the foreground we'll add the first the second the third and the last one now let's say that for some reason we want the sky to be above all the other annotations you can click and drag and reorder it to the very front I'll move it in between the first chimney stack in the second and to demonstrate how this works I'm going to ramp up the annotation fill opacity and you'll notice that the sky polygon is now overshadowing all the other ones if you ramp it to a hundred percent this gives us an idea of how this image will look like as a PNG export I'm going to move the sky now back to the background now that looks a lot better this new image looks different than the other it has a yellow border around it saying reviewing and then potentially your name this is a review image it has been annotated by someone before you it's not your turn to mark it as complete or reject it back to them or apply some Corrections and then mark it as complete in this case the error seems quite evident we're going to make a correction select a dog class for this guy and maybe just for the completeness sake we're going to annotate this other dog as well and I think that looks like a pretty good annotation to me we can also do in datasets outside of this tutorial is leave comments this will allow you to communicate with the users that have worked on this image with you in this case another version of myself you can leave comments such as mentioning that someone forgot on notation or that the MANET ation is wrong note that applying corrections to images in review will affect the scorer of the person that worked on this image before you so be mindful of whether you want to apply the corrections yourself or send the image back projecting the image with comments provide them with some textual feedback so they may know what they did wrong likewise making a correction will impact their score and allowing to review the image later now let's move forward and mark this is complete here we have a bunch of horses and if we cycle forward one image you will notice that this is somewhat temporal there's not quite like two video frames but there is some consistency with these six horses on the frame let's label one with Auto annotate I'm going to pick this one on the front we have an annotation of the horse note that there is a figure over here saying zero this is an instance ID it is a sub annotation selected for this class that tells us that this is horse number zero and it is a unique identifier for the source this is quite useful if this specific horse may reappear in the data set and we want to re-identify it we can also add an attribute to the source by defining its color in this case we'll say it's brown moving on to the next image well notice that the very same horses have moved around I can press this copy instances button on the right to copy over whatever annotations were in the previous frame the horse annotation from the previous image has reappeared but it is clearly in the wrong spot if you want to make a comparison one handy trick is pressing this reset zoom lock button until it is in the crosshair mode which will fix zoom whenever we switch images so if I press comma to switch back and peer to switch forward I can see exactly where the camera corresponds to in next image in this case fixing this will be easy I'm going to move this annotation to the position of the new horse and press the edit Auto annotate button I'll make an adjustment to the box around Auto annotate and it will automatically adapt to this new position and pose of the horse with one error here which I can correct by clicking and having it exclude the head of what is clearly another horse we can now compare the two images and see that there is consistency in the instance ID which is also marked by unique set of three colors and obviously the horse itself you can edit any auto annotate by pressing this button over here or the shortcut of m4 Mike we have an image here that probably won't give our model any further learning it is blurry you can't really distinguish objects but before we discard it with this button over here let's make sure that we're not missing out on anything open the image manipulation panel and set the brightness up a little bit clearly we cannot see any further objects and I think it's the right decision to discard this image well click on this trash can and pick motion blur as a reason as it is the most prevalent prevalent error in this image this image will be set as discarded and will be sent to review automatically I can either press the period button or press descending to review button to cycle forwards automatically before you do so make sure that you press this reset button over here to put the parameters of image manipulation back to the default setting otherwise all the images you will see will have very high brightness this is also quite useful if your entire data set is very dark or perhaps very low in contrast we have a very simple task here we only need to classify this image with a classification tag classification tags are present in the bottom right of the image in this tag appliers section you can simply click on a tag to apply it to the specific image you can also type to create new tags you can press ENTER or this button over here to create a new underwater tag which will be usable throughout the whole data set let's play some sub annotations these are like annotations on top of annotations a bit like attributes before or instance IDs there are many of them available on Darwin we'll pick the gauge class here and zoom on to this pressure gauge and close it with auto annotate and then select the directional vector sub annotation over here this will allow us to give a direction to this object whether it's a person car animal it can set a value between 0 and 365 in this case we will use it to define its hand we can also add attributes to it for example the fact that it's pressure is 0 you can always paste sub annotations to other annotations of the same class by using ctrl shift V or command shift B in a Mac let's move forward ok we will play a bit with the brush tool here the brush tool shortcut is F and it has some additional commands on the top you can increase its size with these buttons or by using these square brackets as you would in most image editing software we're going to zoom in into these windows and make a very simple annotation of them note that while in edit mode the brush tool will always make a red mask this is because it's not converted to a polygon yet all annotations in v7 Darwin or stored as vectors these are both lighter and much easier to manipulate than brow pixel values to confirm your annotation press Enter or switch to any other tools such as the Edit tool with V this will prompt you to name this class and we will make it a window now that we have this window class in its instructions it mentions that if objects are visible through the glass excluded in this case we will select it and press e to access the eraser tool which is also available through a button in the brush tool when we have the eraser tool selected we can start editing polygon annotations and create holes within them you can also create compound annotations with multiple parts in this case we will create four holes into this window so that we may exclude the glass if I want to correct issues such as this I can simply switch back to the brush tool with F reduce the brush size and paint in these pixels of the window when I'm done I can press ENTER and note that it now has four holes within it another tip is to press shift to switch between the eraser and brush whenever the other is selected we're almost at the end of this short tutorial the last annotation type that we will play with is text let's select a bounding box tool and the printed text class and close one of these words and then use the text sub annotation to define whatever text is contained here and press ENTER to confirm this is used in OCR or text detection or simply to add three text to any annotation before we conclude a few extra tips here is that you can hide any annotations by pressing the I button here or delete them by pressing the trashcan you can also hide all annotations by pressing this teal colored eye and you can hide any sub annotations or the colored label of each annotation by pressing this circle this may be useful when your annotations start getting really really dense finally you may have noted that there is a timer at the top you can pause this anytime and it will pause automatically whenever you leave this tab you can also move between images with these top buttons or press undo and redo with these two finally this timeline at the top can navigated to see how annotations were at a previous stage by simply clicking on it and going into time travel note this will be particularly useful if your annotation workflow has many many steps where in the end of this tutorial where this amazing cat will greet us if you'd like to get in touch with myself or any of the developers on the v7 Darwin team you can always use this feedback button on the left click on it and enter some text here you can use this to report bugs or even for feature requests we implement many feature requests that our users put forward to us and finally if you want to learn from more tutorials like this you can go on visa and labs comm slash Academy that is all for now to return home simply press this team icon on the top left and then we'll get and it will send you back to your data set panel thank you

Channel: V7

Views: 79,116

Keywords:

Id: v90norZUy58

Length: 16min 34sec (994 seconds)

Published: Tue Jun 30 2020