Agisoft Metashape - Process HUGE Projects Without Using Chunks!

Processing the model for a small garden office  like this piece of cake, any of you can do it.   however what happens if it's a great expansive  area like this how would you go about doing it in   Agisoft Metashape I've seen a lot of people taking  all of their photos breaking it up into various   chunks maybe doing it per flight then trying to  combine it all together this method is going to   show you something very different how we can use  Agisoft to break down all of the images itself   and process them as one single chunk so that you  don't have to do the work yourself the first thing   you want to do is you want to go to wherever  your data is stored and you want to share it   across your network find the folder right click  go to properties select sharing at the top and   then the share button when you have the drop down  menu select everyone add them to the list and then   change their permissions to read write so that  the software can do what it needs to whilst it   is processing Click Share it's going to run for a  while depending on how many images you have there   and when it's done you can close that dialog  window this is the start of network distributed   processing for Agisoft Metashape but we're  going to be doing it on a single computer it's going to be helpful to open up a notepad  document just so you can save a few items as   we go along and you'll see when the sharing is  finished under the folder name it has given us a   directory in this case backslash backslash  sm012 backslash LG under bar meta shape   save that because you're going to  need it later on in this process   the next thing you want to do is just ensure  that you've copied that down correctly so paste   it in your address bar and there we have it it's  come up with the right location and I see within   those folders are my image folders as we can see  on the screen now First Step complete we're good   to carry on next thing you're going to want to  do is find your computer's IP address to do this   open up a command prompt and there's a few ways  of going about doing this if you have your own by   all means use it but what I'm going to show you  now is just to click on your search button type   CMD it will show you command prompt and open that  up simply type ipconfig and hit your enter button   the address you're looking for now is your  ipv4 address as you'll see on the screen 10.49.20.253 add this into your notepad document   as well because again you're going  to need this for the additional steps so once you've done that  we can go about configuring   the server and the node for our meta shape  processing the server will be this or our   computer in this case S2 will be the node the  beauty of this method is that if you have two   three four five twenty different workstations  you can configure all of them as individual nodes   before we get to that just a small caveat if we  want to use multiple nodes make sure that you're   also sharing your meta shape directory so wherever  you have your meta straight Pro installed make   sure that this directory is also shared on the  network and you'll see we use the same principles   in this case access backslash sm012 metashape Pro  if yours isn't already shared go ahead and do so   right now that that's out the way let's get back  to configuring our server and our nodes I've   already done mine so you might want to just pause  as I go through these and copy it down otherwise I   will leave the the text in the description for the  video as well you'll see this is the setup for the   server so we're calling the metashape application  then the next step is to say that this is the   server and the server has control over the IP  address which we found earlier this is where you   would enter your IP address not mine of course  and the dispatch function to the same save it   go to the node do it exactly the same way here we  are calling the metal shape program we're saying   that it's a node and again we are dispatching it  to the same IP address but you see the roots at   the end of this now the root is showing us where  our data is remember that's the other folder   location that we saved earlier the difference  now however is that in this case it's forward   slash forward slash sm012 whereas when we shared  the folder it had backslashes choose the forward   slash because this is how it functions in network  notation once you've got your text document saved   you can then convert them into batch files either  rename them or make a copy of them first and then   rename them it's completely up to you either  way works perfectly well right click on the   file rename get rid of the dot text function add  a DOT bat if on your workstation you don't have   your extensions enabled so you can't see the dot  txt as an example enable your extensions first   in your folder permissions then you'll be able to  do this once you've got a batch file created it's   a simple process of double clicking on the server  or double clicking on the Node and it will start   running these functions on your own Workstation  once you've gone through this part of the process   you are setting up eggiesoft and getting it ready  to be able to process extremely large projects   so set them up get them both going make  sure that your registration is accepted   so that the server has accepted your node  and then we can go into metashape itself   because there's a few small settings in there  that we want to set up and configure as well in order to check that everything is working   you can go to metashape and then  select the monitor.exe application   you'll see at the top of the screen we've got  our IP address which we copied earlier and take   careful note of the port on the right hand  side this is the default setting for metal   shape if your computer doesn't allow you access  here maybe you just need to give it permission   through your firewall but you'll see as we hit  the connect button in the middle section it has   now given us permission or it shows notification  that we are running an active meta shape node in meter shape go to tools and then to preferences  because this is the last setting we need to set   in our Network function again enable Network  processing set the hostname your IP address make   sure their port matches and again the root folder  as we headed earlier you'll see in this case   there's a slight spelling error it's lowercase  lowercase sm012 so I'm going to correct it just so   everything is in keeping with what we have it and  notice the difference again backslash backslash   sm012 just do it exactly the same as you're  seeing in this video and everything will be fine   then you go ahead and you start your  process normally you want to add all   of your images to the project so  wherever they are add them all in and just make sure you add them to a single chunk  and you'll see once I've done this in this case   I'm only going to have one Chunk on the left  hand side of our screen with 6454 images this   is a medium-sized project I have done this  exact process on this machine with over 35   000 images in a single chunk and it has worked  perfectly using the high settings with processing   so have a look make sure everything's in order  and then you want to save the project you won't   be able to run the networking functionality if  you don't save the project first so make sure   you save it to a folder of your choosing give it  whatever name makes sense for you for your project   hit the save button and then initiate your  processing so I'm going to start by aligning   my images over here you'll see we're running High  settings standard number of Agisoft key points and   here comes the trick now it asks you do you want  to process over the network and we say yes we do   you'll see a window pops up here and this  is different to the window we are usually   familiar with we're not seeing the number  of key points being found in this window   but if we switch over now to the network  monitor look in the top section we see now   there is a project in the top section and  look at the nodes column you'll see we are   running one out of 100 nodes so in memory what  Agisoft is now doing it's dividing the project   into 100 separate sections to be processed it's  not the same as 100 separate chunks this is just   breaking the data processing down into 100  separate work items and that's what enables   it to process massive data volumes if you look  in the middle section you'll see this node or   the computer here has already processed 83  percent 84 Etc of Node 1 out of 100 so work   Group 1 out of 100 is complete and if we have a  look at our nodes now we see 100 has become 99.   so it breaks it up into these small chunks and  just processes it super efficiently and by doing   so you can process everything from your line  photos right the way down to your final products   because metal shape is going to break it all up  in memory and do all the work for you and I've   always found by doing this that your alignment is  vastly superior to when we use multiple chunks and   then have to add chunks together that that just  never really works out as well as you would like   it to this method is proven it works really well  and if you do have again two three four twenty   workstations you add those nodes separately and  then your processing just happens that much faster   you'll see what this monitor is also really good  at is managing your project so in the middle   section where which is our nodes you can right  click and select the number of settings pause um   resume we can tell it to enable CPU functionality  disable GPU functionality whatever you might want   to do so the middle section handles the processing  nodes as you can see here just running through a   few of the options at the top where it says big  project.psx that's the project setting so at the   same time we can start stop resume our nodes we  can also do it to the entire project if we are   running more than one node and we pause it at  the project level that will of course pause all   of your nodes so the options really are quite  varied involves and it's up to you gives you   great functionality which you don't find when  you're just processing within metashape itself   so spend some time here view all of the  functionality and see what you can do so   lining images will see it's going really well  no problems no hitches at all what's weird is   that meta shape actually recommends against doing  this setting up a server and a node on the same   PC yet I have run honestly tens of projects using  this functionality and never have I had a problem   I'm going to go ahead now and cancel this you can  see that it's working just fine because I want to   load up a pre-existing project and just show you  how it functions a little differently when we   move on to something like the mesh phase so I'm  going to open up a previous project that I have   and then decide on the settings I want to  go ahead and use this isn't a big project   by any stretch of the imagination I'm just  trying to illustrate the functionality here   so we've seen this case it's already aligned  the markers are assigned it's been cleaned up   everything looks good and ready to go so I'm going  to go workflow build mesh and I'm going to go from   depth maps arbitrary using the high settings and  we know that this is taxing on any Workstation   so once you've decided on the settings hit apply  yet again it's going to ask you locally or via   the network we say Network and there we see it  running now initially it's only saying one out   of one node however you just want to pause here  for a while give it a bit of time and it's just   doing the calculations on the background and  deciding how many nodes it needs to process   there it has selected 25 separate nodes to  be processed if you have a much larger model   I mean this this one is pretty small obviously a  much larger model will have more nodes again you   could benefit from having multiple nodes  if you have multiple workstations to use   again the beauty though is that this is not going  to fail the same way they're trying to produce   large models or process massive Point clouds or  using 30 000 images just within metashape on its   own would otherwise do and that's a quick overview  of how you can use this network processing but on   a single workstation and you can process massive  projects without breaking it down into chunks   give it a go if you have any questions put  them in your comments I'll answer as many as   possible and if this has been beneficial to  you please like And subscribe to the channel   I'm trying to build it up to be as helpful to  the community as I can be thanks for watching

Channel: Geospatial Tips

Views: 24,671

Keywords: Agisoft, Metashape, DJI, Photogrammetry, Big Project, Pix4D, 3D Model, UAV, Drone, Drones, Volume Caculations, Volumes, TerraScan, TerraModeler, Global Mapper, Survey, agisoft metashape, photogrammetry, agisoft photoscan, terrasolid, mine surveying, dji mavic, dji mavic mini, dji mavic mini 2, dji mavic mini 3, drone, agisoft metashape tutorial, gis, argis, qgis, arcgis pro, lidar

Id: BYRIC-qkZJ8

Length: 14min 35sec (875 seconds)

Published: Thu Oct 20 2022