CAD to GIS Integration

I would like to say good morning to everyone that's on the line hopefully wow it's a pretty full audience today so I'm Janelle Disick we know with the mid-atlantic geospatial transportation users group and I'd like to welcome you to the mag cog webinar entitled CAD GIS integration thank you for being with us today just a little housekeeping before we start this webinar is made possible by James cane Technology Group the progressive geospatial and information and Technology Services Provider special uses in transportation application solutions we thank AMT for the use of their WebEx account please note that this webinar is being recorded and will be available on the United wordpress.com website shortly after today's event please visit our website for more information and to register for upcoming events like the open source GIS and open data symposium that will be held on May 25th and is being co-sponsored by the mid-atlantic chapter of the Urban and Regional Information Systems association or vac yosef for short we hope that you'll participate in today's webinar by typing in questions you have for our presenters into the Q&A box on the bottom right of the WebEx screen I or Bob will read your questions at the end of webinar to the present so that the presenters can answer them and now it's my pleasure to introduce Eric Ruttenberg solution engineer with the ESRI transportation team and I'm not sure if J Cecilia is on the line but he's the mid-atlantic regional Account Manager also with yesterday that's made this possible today Eric will be exploring the integration of AutoCAD with ArcGIS to support better decision-making the virtual four is yours thank you thank you all right so about five months ago I was asked by colleagues and and we've been exploring this idea of a CAD to GIS lifecycle in there there is indeed a lifecycle that is generally pretty standard that almost all organizations use or would like to use in order to convert CAD data to G is the we are going to explore what that workflow looks like and we're going to explore some of the problems and issues that CAD to GIS integration presents I also plan to spend a little bit of time just going over the solutions that I put together to help make this process possible in terms of bringing CAD over to GIS so it is part of the transportation practice at ESRI I work with all 50 state deities and I've recently been working a lot with local cities and counties as well from an ad from the addressing and LRS perspective so I've been doing a lot of work with roads and highways educating the locals on what roads and highways can do for them and this topic of CAD integration comes up quite a bit in fact GIS T was last week GIS sees the big transportation conference sponsored by ash tow and that was in Raleigh North Carolina last week and every year they do a rolecall where every state do T stands up and talks about what they're working on for the upcoming year and almost every single state brought up this idea of CAD integration so it's a hot topic and judging by the number of attendees today it's obviously a hot topic for you as well so I want to walk you through some of the challenges then I'm going to walk you through some solutions and then I'm going to spend a little bit of time showing you basically going through a call to action in terms of things that you can start doing things that you can start doing with your with your contractors if you use contractors or things you can do with your designers if you have CAD designers on staff and I'm not just going to solely focus on AutoCAD but also MicroStation as well because the do TS are heavy users of MicroStation so I have to be somewhat agnostic when I deal with CAD because we are dealing with multiple organizations that use not only AutoCAD but Bentley and other solutions as well so that's a little bit about how this next hour is going to go so the five months ago when we undertook this project there were really four things that we wanted to explore and four things that kept coming up over and over again as we're talking to different state deities and even the locals the first and foremost a lot of a lot of do TS right now are under pressure to develop these construction information models in a 3d landscape and push that out on the web a lot of them are being asked to do this so there is a challenge right now in understanding how to get this CAD data out of its format and into a 3d GIS format so that's that's one of the things I'm going to be looking at very closely to start off this morning then once we have those 3d features we obviously want to visualize that and I want to show you what you have available to you to do that visualization excuse me in addition we are in talking with deities we we encountered this need for vo T's to provide a way for contractors to take the design files out in the field and mark them up or possibly even edit them and so I've put together a workflow that does just that using ArcGIS online and collector and I'm going to show you that today the next thing and this is something that's a little bit longer term project because it is a little bit more complex there is a requirement by many organizations to validate CAD files that come in to them from contractors and designers to ensure that they meet their standards now I'm going to talk about that at the end I've got to kind of set the stage here with the discussion on standards and and the issues and challenges we face before we get into what what we're going to be working on next but that's a little bit about how the morning is going to go so I'm going to jump right into CAD to 3d GIS and to do that I'm going to get a little help here I'm going to recruit a little help from RJ's Perot and what you're looking at is state of Alaska and I received some CAD files from them and as I was prototyping some tools I developed some some workflows to help extract out the 3d features that they were that they had in their CAD files so in this in this in this file we're going to be jumping into an area along the richardson highway which is in Valdez Alaska Valdez is obviously famous for the oil spill that happened in the 80s and you're going to start to see this take shape there are as i zoom in so as i zoom in some more we're going to zoom in on that richardson highway and you see this CAD file come to life you see these 3d features we're going to see the the base map render and of course if I need to make changes I can easily do that just by updating the base map and displaying on the fly a new base map so this base map runs right along this river that feeds into the Valdez Bay and you get a really nice picture of things that we can see so I've taken this cat violent they provided me and I've extract everything from it everything I possibly could they had tree data contours on road right away edge of pavement center lines they even have some underground features which I'll share with you in a minute and of course as you pan and zoom around you can see things like the electrical the high the high um the electrical lines you see the signs a mess switches back to the topo base map because I think it shows a little better so you see the high-tension power lines that's why I was thinking of and as we zoom again you get this and view of the trees and you get this view of the landscape so so taking this camp while this design for this road expansion I'm able to make it come to life and Pro through this scene viewer so being able to build these scenes is powerful because then I can take those and publish those out to the web I can publish those out as I can publish those out as videos and then when we go to post this on the website the public can get a real-time sense of what the particular project is going to look like that the d-o-t is about to undertake and we see lots of deities starting to do this with other platforms but the beauty of doing this all in GIS is that once I save these features in GIS I make updates to those features the the updates to the website pulled in and picked up because we're just making changes to features now then the other nice thing about this is I can easily make changes so for instance if I select my tree layer you can see here that right now it's using elm trees well if I wanted to change that to something more appropriate for for for Alaska I can easily do that on the fly and those trees change based on the the type that I choose so so these features are really easy to manipulate and and modify to get out of it what you want to see so let's zoom in again and let's get a bird's-eye view in the trees and of course I can always turn these features off and we can start to see other things like now you see a culvert actually two culverts running under the highway so we see these out Falls we see the culvert pipes they're actually sticking out through the scene so if I if I tilt up you can see that those culverts stick out of the ground and they show up on the other side of the road as well underneath the contours so now if I if we zoom in to the road view and we'll turn our trees back on now because they won't be in the way we get a nice view down the road of this particular section so I see all my my high tension power lines I see my signs center lines culvert out Falls I've got everything in here I've even got the stream data that's flowing through those culverts and of course the advantage of 3d is not only can I look above ground but I can also look under ground so I have the ability to go under this surface and see those pipes actually crossing through the earth to the other side of the road which is very powerful you also see the underground telco so this is telephone lines and nodes along that that those lines that connect from one node to another so if I click on one of these I can get the attributes about it and all that information is available to me now that I've converted it out of CAD and into GIS and I can start to expose it and everything I've done was done using model builder so not one thing was coded not one thing was was done with out of the with third-party tools it was all done using out-of-the-box geoprocessing and that enables me to make this possible so I'm going to get into what that process looked like in a minute but let's just continue on here and move through so finally we'll take another look under ground and we see that we see we've got a really good idea of our geometry we even see the stanchions for the high mass power lines you see the stream that feeds that culvert and you've got a really nice bird's-eye view of the project so with that let's jump back into the slides and I'll talk through the process I used to get to this point so this is the end result this is what I'm trying to achieve so the whole purpose of this project was get to get to a point where we could view this data in two or three D so I want it to be able to have the option to switch back and forth because having that option is important to me because that gives me the ability to do things like I said publishes web seems out on the web edit those 2d features if I need to and make those changes filter through no matter what no matter what way I'm looking at this data so that was really important being able to create and interact with not only three duty but 3d features I'm going to show you later on how we can also collect data in the field or possibly even just mark up a CAD file because there are some there are some caveats to editing CAD data with collector or just data in general with collector and I want to show you that so so the requirements were to ensure successful CAD conversion workflow so there are three challenges when we do this the first is location and I'm going to spend a minute showing you that what that what that means the next is submission standards and the final challenge is attribution so we'll spend a little bit of time going through all three of these items so there's really three when you're talking about location there's three ways to work with CAD data in GIS the most common one and the one I've probably seen the most over time as a is a representative of ESRI and as just working in county government where I started this is the most common way I deal with CAD data I get this CAD file comes in to me from someone and it has no geo referencing it just shows up in the middle of the Atlantic Ocean off the coast of Africa at point zero zero so what that means is that that CAD file was referenced to paper space generally speaking so it wasn't tied to any coordinate system it wasn't tied to any any measurement values on the earth it was just tied to paper space and when we get those we call that area of the world null island it's not really an island it's just generally where unreferenced GIS data and CAD data goes to when it doesn't have a home that's the first way I typically deal with data and that's the most challenging way because when it comes in to me then I've got a geo reference it and generally speaking the data I'm working with in CAD doesn't always line up with the data I'm dealing with in GIS so you wind up doing rubber sheeting and stretching and skewing in the CAD file and that's always good so in fact that's never good so if I have things too tied down to like control points that's always the best scenario although that's probably the most rare I rarely see that happen but in the deity's it's it's fairly common for that to be the case where they can tie these CAD files down to control but I still have run into quite a few deities where that's not the case Alaska being one they had some of their files were not tied down so it was a pretty big challenge at first I have found some organizations will do they will reference they will create a reference coordinate system it's not the true it's not a true state plane coordinate system so this was the case in Alaska they created this this reference coordinate system of Alaska UTM which is what they work in and when I initially loaded the data and in this slide here what you're seeing is that null Island typically when that data comes in unreferenced unprojected it shows up right in this area right in here off of the coast of Africa but the case of the CAD data that Alaska gave me that I just showed you an improper in in inside of the continent of Africa so you can see here it's near Libya near the near the border of Libya and Niger and Chad it's kind of like right at this tip where these three trees meet up and it's interesting and when I saw this I didn't know what to make of it at first I was a little bit confused and thrown off because I thought okay maybe this is reference somehow and when I talked to the cat the CAD designers and turns out that they use this reference coordinate system it's not the true UTM system but it's a reference system so I did a little digging and it turns out that it's projected it's just the coordinates are unknown to arcmap when you initially load them in so you get this data it just drops in the middle of Africa somewhere or somewhere on the globe and and so what I had to do I did a little research and it turns out when that happens there is the best practice there's a way to deal with that so it turns out that in Alaska they have 14 UTM zones that they deal with their cat operators so in that case I would build 14 fours in my file directory and in each one of those folders what you have to do is you have to take that projection whatever that projection is for that zone that that CAD file falls in and you need to rename that cat file so in this case I was working with UTM zone 7 I had to rename UTM zone the UTM zone 7 prj file to ESRI underscore CAD prj and then I had to dump it in that folder Alaska state plane zone 7 then any CAD files that fall in that zone automatically inherit that projection so if you're not following me what I'm doing here is I create a folder within my computer directory structure I name it whatever the zone is for that area so in the case of Alaska this cat file was working with I name the folder Alaska UTM zone 7 or zone 17 and then I took the ESRI underscore CAD prj which I renamed from whatever the projection was for that zone and I stuck it in that folder and then all the CAD files that live in that folder automatically inherit that projection so what I got was this so if we zoom in when I when I made that change all of my CAD files for the state of Alaska for this particular zone just dropped right into place then I have the same issue come up with Colorado I did the same exact thing set up a folder with their different they I think they're stapling north and south created a state plane north and a state plane south folder took a couple of the CAD files they shared with me stuck them in that folder and then created a rename the PR J's for Colorado state plane north and Colorado state plane south to ESRI underscore CAD and stuck them in the respective folders and when I loaded those tab files into arcmap they just dropped right into place exactly where they needed to go so the thing we learned is that the best solution is to always have the CAD file be projected and referenced so that means that the CAD operator has tied that CAD file into cord into into known control points if that's done then I can easily connect that CAD file to those same control points in GIS because the points will be the same in GIS and CAD they'll have the same coordinate values I drop the CAD file and it overlays perfectly that's the number one scenario that's the scenario we always hope for scenario number two is this one where if even if it's using a reference coordinate system as long as I create that folder structure stick the appropriate projection files inside of that and rename them ESRI underscore CAD ArcGIS will know what to do with the files when I add them in the map the least desirable is the situation where we're missing edge where we aren't geo reference and we aren't projected at all and it drops into to null island then I've got a lot of work to do and I can't guarantee it's always going to be perfect so what we're saying here is when you're writing a CAD submission standard that's what I'm telling people to ask for make that a requirement that they have to tie into control or that they have to use a reference coordinate system that way when you go to load that file in you're not adjusting it skewing it and distorting it because that's ultimately what's going to happen if you get a file and that's missing a geo reference now this is a challenge for those historic files right if I got a file that was made a cat file that was created ten years ago it's not going to be practical or maybe I've got hundreds of CAD files or thousands of CAD files from ten years ago it's not going to be practical to go back and fix those so we're going to have to we're going to have to deal with those separately on a one-on-one basis there is unfortunately no easy button to go back and fix these the next issue is submission standards and this is a challenging issue as well I ran into this with Alaska and Colorado the naming conventions the number one problem I find so here I have a CAD file it's the same one from from Richardson Highway and you can see the layer names I'm looking at the layer names in my crustacean and for instance this airline is called V - drive or deep V - driv - CNT R so then indicates the centerline so when I convert this and bring it into ArcGIS learning comes through perfectly that's not the issue the issue is when I've got another CAD file where maybe they spell Center instead of C and T R or driv e instead of driv or some other derivation of that layer name that's when I get run into problems or generally if it's missing that's not as big a deal but when it's a different name that's a big deal because what I'm doing is I'm using queries to extract out these layers so I've got a bunch of query set up in my geoprocessing model that identifies the layers the appropriate layers and then extracts those out individually and puts those into the appropriate feature class so I have a centerline feature class that I map this CAD layer to and if it's different that causes problems so I need to know that ahead of time and that's really where that CAD validation I talked about earlier is going to save us a lot of time because theoretically I would be able to run it through that tool and it's going to spit out a report saying whether or not the CAD file meets my standards so again if you can develop a standard that says a centerline is always going to be called V - driv - CN TR then do it because that's going to make it easier for you to pull out this information and get it where it needs to go because that's really what tad conversion is all about is mapping data from CAD to the appropriate feature classes in ArcGIS and using the geoprocessing tools to extract it all out and get it where it needs to go that's the biggest challenge and the other challenge in this is that there are over 5,000 counties in the u.s. that means there's 5000 ways that people deal with this and there are 5000 standards even in the deal Keys every state does a little different they all have a different standards so that means I've got 50 standards to work with it's not one single data model generally speaking although that would be nice it's not the case we're finding that everybody does this a little different they have a little bit different naming convention from state to state which I would think you would make it a difficult task for contractors as well especially if they have to operate in multiple states but we find that this is probably the biggest challenge next to projection another challenge I've seen is that CAD tends to render symbologies differently than GIS does right so I think you guys will understand this way when you see this the slide I've got this CAD file of a sign in green here that you see on the left this is actually constructed from 14 polylines now in GIS we represent that that sign is a point same with the light we've got a streetlight that's represented as 8 polylines that is a challenge to me because if I want to grab that that light and move it I've got to know to grab 14 polylines and that's not the easiest thing to do especially in a mobile situation that's not going to be very practical now I have found and I want to show you this real quick and I've tested this I can tell you that this works I've tested it in collector and it works perfectly if I select this CAD node for this sign you see here it has a handle ID f/32 now if I select one of these lines there we go it has the same handle as that point so I did a test back in December where I created a relationship class between the points and the lines and the CAD so I went in and I created a relationship class specific to signs and I use the handle as the foreign and primary key or the primary and foreign keys and I created a composite relationship and for those of you who have ever dealt with things like like feature linked annotation is a great example when you move and when you move a feature the annotation moves with the feature that is using a relationship class called a composite of relationship I did the same thing here I created a composite relationship between the points and the lines in this light and identified out the specific layers and when I grab the point and collector and moved it all the lines moved with it when I set the point where I wanted it it was pretty amazing now the trick is while I can do this the trick is to get it automated so that when I write this out to a file geodatabase it automatically creates these relationships that's the part of it I haven't worked out yet so I will tell you that you can build these relationships right out of the box it's really easy to do no no difficulty in doing it I just want to automate it so I don't have to do this for 5,000 CAD files but this would it allow me in a mobile environment to move a point and all the lines move with it now some layers are very inconsistent this gets back to standards again like for instance this culvert node has a handle ID f30 the culvert itself has a completely different handle so in this case it wouldn't work the relationship wouldn't work because the foreign and primary keys are different I would have to go in and manually relate those features together and that's going to be way too much work so we've got a I've got to understand a little bit more about what that handle does and if we can make it consistent between these nodes and and these lines and so far I haven't been very successful in finding what that relationship is but I know in some features it's the same and others it's not so we've got to work through that but that's that's a problem for another day so as I mentioned in GIS we typically recommend er these features as points it's the easiest way to render them and then I can assign attributes and then I can do relationships to things like signposts so if I move the pose the sign moves with the post it stays with it and they can be a one two main relationship right because signs can assign pose can have many signs attached to it so we think about it a little differently than CAD does now the next the next challenge is attribution now this is less critical than the other two but there is an enhancement effect that this can provide your your organization if it's available I have seen in some instances and I've only seen this actually twice I've seen this in my career I've been with ESRI 14 years and I've worked in county government two years so I've been I've been at this for about 16 years I've only seen this happen twice where a developer provided me a CAD file and then they provided me with a companion access database that had attributes about that CAD file so basically in an AutoCAD map they can create a relationship to the CAD features back to the Access database using the entity ID so with the entity ID I can I can populate attributes about that feature and then when I bring those into GIS I can actually use that Access database to basically merge those attributes in with the geometry that I pull in so now my CAD file that was separate from the Access database it's all one now it's all together I've got geometry and attributes but again it's very rare and it doesn't impede the ability to convert data it just means that if I don't have those attributes I'm not going to have a lot of data I'm gonna have to go in and populate that myself it's like a street name or a address block range or the type of power pole it might be are the type of culvert it might be or the material all that I would have to go in and populate ever converted so all of this yields this process so taking all these these challenges I was able to create a process to get my CAD to 3d GIS so to do this I created a geo processing model and the reason is it's complex workflow but the execution is really simple I provide it with an input CAD file I provide the model with an input CAD file and I tell it where I want the data to go and then the can plot or the the model runs the job and extracts transforms and loads of data into a file geodatabase and then from there I can visualize it or I can publish it out the ArcGIS online so that's the goal so that's the process in four very simple broken-down steps now within the program within the model I'm doing three types of things because I'm dealing with three types of geometries I'm dealing with points I'm dealing with lines and in some cases polygons in the case of points I have to identify the CAD layers and copy the 3d points to 3d point feature classes that's the process for converting points in the case of lines I've got to do a little bit more work I can I have to identify the CAD layers or lines by their layer names so like the culvert I had to find that either find the V - div - C n TR to pull out the centre lines and get those into a sera line feature class and I intersect those with that 3d point geometry so I don't know if you notice here but in this in this file I've got these nodes along the centerline and every node has a 3d elevation so when I run my process when I run my process to convert I'm extracting out the 3d value the 3d elevation value and inserting it into the end of that particular line so every end point of every line has an elevation so the elevation of one end might be different than the elevation of the other that's how in that 3d demo you saw earlier I was able to get my that's how my my culverts are able to slant downward towards the drainage point towards the sink so we've got a source and we've got a sink so all the flow is coming this way down into the end of the culvert and then out and down to the river so I'm using those elevations from those nodes to populate the ends of those lines and then once we have those those those elevations we've got 3d lines and we can represent those lines with the appropriate pitch and then if I know things like the diameter of the culverts then we can do some really crazy stuff we can model out the culverts to their appropriate size as they would appear if you were sitting in spec ting one so so there's lots of possibilities here once you start populating that data in the case of polygons is a little bit more challenging in most cases I have to create polygons from lines so in the case of my right-of-ways i did take all my lines run them through and check for closure to make sure that they closed off the boundaries and and the shoulders I had to make sure all that data closed off in order to create polygons and it's not a perfect process by the way in the case of building structures those are pretty easy I check those for closure and if they close then it creates polygons pretty easy but some of the things like shoulders road shoulders Road right away edge a pavement that's a little bit more challenging and then I get the elevation by interpolating against the DM so if I have my own de mi can interpolate those elevations if I could also interpolate from the contours so I could create a surface on the contours provided and interpolate from that as well to get a 3d Polly Polly's are a challenge on that I'm going to be upfront with you there that's not the easiest thing in the world to work with so this is a this is a section of the model doing everything I described so I've got this incoming CAD layer and make it a feature layer in geoprocessing and then I convert that feature which is a virtual kind of a basically an in-memory layer I convert that in memory feature layer to a feature class I call it what culvert lines I do the same thing with my outfalls my outfalls our points those points contain elevation and I create this this in-memory layer I convert that to an outfall feature class and then I intersect my culvert lines with those points to create 3d culverts now that I have 3d culverts I can export those out to a byte to my final process to feature class of culverts so I've got this process feature plastic culverts and I've got this process feature class of outfalls and that's generally that is the process in the simplest form so I tell it what the input can't file points and lines are and then it runs through this process now the one thing on you're not seeing is that there's about 40 other layers in here that use the same process so it just runs through each of the different layers center lines culverts to pod topography the contours the telco all the telco nodes all the all on the street control points all of those different layers contribute to this final output file geodatabase and I'm going to make this geoprocessing set of tools publicly available but just keep in mind just because you download these tools and plug them in it doesn't mean they're going to automatically work with your data especially if you're naming conventions are different that CAD submissions standard is the key so you would have to go in to the kit to the model and rework all the queries to match your submission standards that is the one downside it's unfortunately not an easy button that I can just press and all this data just spits out nice into a nice file geodatabase there's going to be a little bit of work to make it work on your end so what we get is this nice beautiful scene that I just showed you a little while ago with my trees with my high tension power lines with all the underground features all the above-ground features and a nice visualized environment alright so the last thing I want to show you here is this idea of CAD to GIS to CAD so you Tod do T came to us and said we really want to give our contractors the ability to go out in the field and markup or possibly even edit a CAD file and we looked at them and said wow that is a challenging process primarily because we can't get CAD into our chess online so me being one did not turn and get turned down any challenge I took it and I started investigating workflows and I found a workflow and it works pretty well though the workflow is this you're going to start with a CAD file and I have a now this I did have to code but I've made it all configurable so it's just that it's just another GP tool basically so it'll interact like any other GP tool but basically what I do is I take a CAD file I extract it or export it or import it rather to a file geodatabase and then I create I've got this I've got this template MXD that I merged the file geodatabase to so I add that file geodatabase I imported from CAD to this MHD and I create a web map and all the colors are preserved exactly the way they came from CAD so I've got layer files set up so everything matches what it looks like in CAD and then this creates a web map that I then publish in an automated workflow to ArcGIS online so once it's in ArcGIS online I have a hosted feature service along with a web map of that CAD file and that looks something like this so here's the same exact CAD file in ArcGIS online as a hosted feature service so I have a hosted feature service out there that I created and I built it using this set of tools so I'll show you the tools so this tool called CAD the web map so if I open this up it's configurable so you don't have to know anything about the model or the strips you can just input your CAD file give it a name give it a spatial reference tell it what layer files to use tell what the MXT is and it does everything else it takes care of packaging up the CAD file creating a file geodatabase screen the MXD and then publishing that out our JSON line I've taken care of everything even logging into ArcGIS online is handled by this particular tool so once this data is in ArcGIS online as a web map like you see here I can also view it here in an app that you're probably very familiar with so this is collector and I've got the same exact the same exact CAD file inside of collector using ArcGIS online so I can zoom in so we're going to zoom into that culvert I'm going to edit node look let's edit the note first let's update that now I'm going to edit the line I'm going to drop it now I have to warn you collector does not support snapping yet so and I told it use all this I said I would be very wary of allowing people to edit the actual geometry you would be much better off giving them a redline layer that we could bring back into the CAD file so that the designers can be notified so this is the this is the main issue the main crux of the issue that you tell wanted to solve they need to give their designers or their their contractors the ability to add at a CAD file but they also want their designers to be notified when changes are made because what's happening now is these contractors are making changes and they're never getting relayed back to the design team so that the CAD file can get modified and they want to approve changes so if I if a contractor just moves a sign just to move it they want to be able to see that and say no you can't do that but if the contractor said well we can't dig the hole here because there's this gigantic Boulder and we can't get around it so then the conda's Iyer can say okay well then move it by feet to the north or to the south the roads running east-west so that or move it east-west depending on where you need to move it to get away from that rock but still give the sign the visibility it needs to the motorists so this allows the designers and the contractors to be in better collaboration with one another but like I said we don't support snapping so you probably want to at the beginning open this up to redlining at this time and eventually we are going to support snapping it's going to happen in the next one of the next releases I'm not sure if it's going to be in jr. in the fall but they are that is on the list of enhancements to collector so when that does happen I would be able to edit this with confidence that everything is snap together otherwise right now if you do want to do editing you can do it but you would have to have some geoprocessing on the back end to make sure that this is all post processed and snap back together then you got to decide what takes the precedence at the note of the line long story short I would recommend that if you're going to do editing you edit red lines to start until we get to a point where we can reliably do snapping so now I'm going to update this and so now I'm going to move collector out of the way and if we zoom into my web map you see that that the culvert and the node moved everything moved exactly the way I wanted it to all right so now the last thing I'm going to do before I take questions is I've got a process so when I'm done I have this folder called CAD updates it's currently empty there's nothing in it I'm going to take this web map the CAD GP task I've built and I'm going to download that CAD file to DWG R to 2010 so I'm going to click OK here and I'm going to let this run so unfortunately for this process to work I do have to be signed in because we changed our login model but basically what's happening is I've logged in to ArcGIS online through Python and I found that item that cat item that I just edited with with collector and it is in the process right now of running export the export function so if you know anything about our just online you know you can go to any feature service and export it out to a file geodatabase that's exactly what I'm doing here and an automated process so I'm exporting out that CAD file and now it's done it's downloaded the zip file so we provide that geo database back as a zip file I unpack the zip file I rename it to the appropriate CAD name and then I export it to a DWG so now what I have you can see now that this folder has something in it now I've got a file geodatabase and the CAD file now I have an issue right now on my PC specifically where it shows all these layers multiple times I've got a work I'm actually getting a new computer in a couple weeks and I expect this problem I don't know what the problem is but I've got a problem but anyway I've got lots of problems but that's beside the point when we zoom in you see my CAD file now has the change I just passed in from collector so I was able to take and this is where it initially ended right here inside this green triangle this outfall area so I was able to take through collector through a process to upload a DWG or DXF to ArcGIS online as a feature service edit that feature service and collector and then bring those edits back down to the ground in a DWG that might CAD operators can then compare and make the necessary changes they need to make so if they want to accept this change they've got everything they need to do so against their original CAD file so that's the workflow I really want to with you so to finish up the road ahead what else is possible well my goal is by user conference to have a process in place to do validation to find out if a CAD file I'm going to input in is going to be able to a be converted to GIS features and B can I get it uploaded ArcGIS online so that's the process I want to do next I want to figure out if it's projected if it's your reference and I'm pretty sure I can do this all through a combination of Python and model builder I'm going to require I'm going to check to see if the required layers are included and if not I want to reject it and report to the end-user so I'm going to make this a geoprocessing service that is going to live on our chess server that someone could take upload a CAD file to it and if it fails they'll get a report back to them saying no and here's why it didn't so that's the goal so to summarize today I showed you three things that really matter when bringing CAD to GIS the first is location in standards you've got to have the campouts have to be location aware and we've got to have standards that's going to ensure that it's easy for me to to migrate the data to up to geo database to GIS I need a way to access and share this data so I want to be able to create realistic scenes I'm going to collaborate in the field and I want to use GIS keep CAD in sync finally I want to develop all of this and it cuts supported environment so I chose to you're processing because ultimately at the end of the day all of our tools are supported so if you want to incorporate these workflows they're all fully 100% supported because they use the Geo processing framework I didn't have to use any third-party things I'm using Python I'm using model builder and I'm using art toolbox and all of these things that I built are fully supported there defendable the repeatable and they're all documented so I thank you all for your time and I'm going to post these out on the Geo net so I don't know if you're familiar but we have a group on the Geo net so if you go into Geo net as recom and you go to communities type in Department's of Transportation and you will find our group and this is a public group that any of you can join so when you get to this group you'll find on the lower right-hand side under projects I've got a CAD in the GIS integration subgroup so if you click on this group you will find the the presentation I shared with you today and then in the next week or so I'm going to work to get those cab those geoprocessing tools that I used to do all this prototyping and development out there on the geonets you guys can download it and using your own workflows so with that that's all I have to share today I thank you very much for your time and Bob if you and Janelle if you want to open the floor to questions let's do it thank you very much Eric that was Eric Rutenberg from the asuras transportation solution team we have some questions that that have been flowing in Oh Eric pretty much showed us where we would might be able to get these answers very soon but let's just go over some of them there was it you said the do-do-do-do processing models will be available in the week to come on the website that's showing up right now I can share the mag Doug - if that's easy for you guys I can just share links to everything so you can just reference it right on your website awesome that'd be great and look at more places the easier it will be for attendees to get it right someone also did ask is if there's a sore personal put tutorials on this process would that be available as a training selection through their local account managers would you be able to have a training for so you know this is something we've been kicking around we're not sure the best way to do this um we've actually kicked around like a jump start like a two day focus jump start through professional services and and it's something that I can talk to edge services about as well as rehab services to see if they would want to tag onto this and possibly develop a curriculum around this but um right now I need to have some conversations with a few different folks and I don't necessarily know that I have a good answer but I know through art through the transportation teams professional services practice we do have a jump start that we can offer and it's a two-day jump start where we come on-site with one of our guys and we basically deliver these tools to you and show you how to use them and configure them with your own workflows okay I'm sure there's a lot of people to then that will be excited to hear about that possibility would it be best for them to contact Jason see Lee if they're in the mid-atlantic area oh yeah don't yes so have them contact Jason see Lee or or um I'm blanking out here um I can't um I can't say his name I'm sorry I'll think of it in a second but most people do know Jason see Lee if you don't have a gmail address it's J SD a ly at ESRI calm and just mention that you heard it in today's webinar and Sutton Aiken was the other contact okay he's a Philadelphia regional office as well okay one of the attendees also asked if they feel if we get at an email link with the presentation and the data model unfortunately no because because it's sort of an all volunteer organizations we have a lot of different people helping with different parts of the webinar so you will have you will get an email that says that you attended this webinar but the the recording will be on the magnet ugh wordpress.com site in a few days and of course Eric also showed us where you could get information on the ESR ESRI geo net so you will be reminded that this information is available but you will have to navigate to find it and it will take us some time to get those pieces together is there any more questions on the audience that that we haven't gone over I'm trying to see I think that's all I see there Janelle okay that's what I would just I would urge the audience if you have follow-up questions that you come up with later on we can certainly get them to a Eric you know give them address for here yeah and we have actually hit the 11 o'clock so I don't want people to be late for their next important mating so we will cut it there I just hope that you all enjoyed this webinar today and will join us on May 24th for our next installment which is going to be a talk on GIS based local agency permanent management system thank you very much and have a good day Thanksgiving there a lack of life you

Channel: MAGTUG - Mid-Atlantic Geospatial Transportation Users Group

Views: 2,073

Rating: 5 out of 5

Keywords: GIS, CADD, CAD, GIS Integration, Geospatial, Esri, Transportation

Id: 02DvI-tp6Kk

Length: 60min 26sec (3626 seconds)

Published: Thu Mar 30 2017