7 Ways to Unlock the Power of GE Smallworld

thank you for joining us and taking time out of your busy day and I hope you're as excited as we are to be here to present to you guys so looks like we're going to be launching a poll here just to kind of get to know who's attending today we're grateful that you're here with us I was like we're just going to do the agenda there okay so I'm missing the agenda I thought you were covering that yep giver yeah so we've got we're going to be working with FME desktop an FME server for small world we're going to be covering some working with versioning and alternatives cat to GIS demo we'll get a database with a replication demo and we're going to cover off some schema mapping and dynamic workflows that's going to be really good stuff and then hopefully we're going to have time for that self-serve data download at the end there mark is that right I hope so and while ordering actually yeah and we've also got a bonus if we we don't go over time you've got some a bonus mo on location intelligence all right okay so now we're ready for that poll question so Stephanie is going to launch that poll for us so have you used FME with GE small world so you got a few selections there so if you can run through there everybody's please please submit your answer that will greatly help us understand who we were presenting to you today a little bit Tibbett and information on small world they were one of our earliest partners here at safe group in Denver developed the first small world reader/writer small world 2.2 we think it was so yeah that was a long time ago and that was still in the old mapping file phase of the FME so that was pre workbench so that was a big struggle for people to get data in and out of small words when in those days I had to write the mapping files to generate that and then we moved on to workbench which made life a lot easier all right um just okay so did we we shared the polder and we had the top one we didn't really talk about that if you want to bring that up again so okay so we've got 42% of the audience has used all the time okay okay so that's good spread so we've got a good experienced group today so that's nice to know because we are so busy flying through some of these demos just a small group that haven't used that for me yeah much in in the past and it out of curiosity of everybody anybody that's used that small world to point to read write or just raise your hands there in the and the dialogue that'd be great to know okay so please please ask questions we got Mark and Ken standing by Ken Ken's over in France so he's like nears bedtime and and we're well I shouldn't say bedtime because it's probably five or six over there now mark Ireland and central time zone he's been up longer than us too so they're all hot ready to go the webinar is being recorded so you'll receive an email with a link and the recording and all the example workspace after the fact all the examples are based on the abacus cambridge data base so you guys will probably have access to that all right we don't have our arrows on our screenshot there to see so who's there so if you happen to be new to FME there was a few years please um you know stay with us it's going to be a moderate level technical webinar here so there might be some things that you may not quite get but that's quite all right because stick with us and after the show's over you can go visit these two great resources online and get going on FME on hopefully hopefully we've raised your energy level enough after the presentation that you're all excited about looking into the world FME as well it's going to reduce your stress level although that's not medically proven but we do believe here at safe software we got a great product and it helps with increase your productivity all right so let's get going here get another slide coming up all right so we have yep giver um so just an introduction to the small world readers and writers um there is a I mean small is one of them all flex of the format's that we support for a number of reasons is power of its virtual managed data store the multiple geometries but also the large number of versions but we've supported over the years and so there are two primary offerings for small world if you want to get data in and out there's the reader of the writer that comes from GE themselves it's called the FME translator it comes on a DVD I have to get that DVD from them but there's no cost for that from them um it supports a wide range of the versions you do have to make sure you've got the right version of the FME translator to work with that I'm working with the small board 4.3 today and I'm using FME 2014 with that 4.3 reader and writer the small book geyser was a little bit more conservative so if you ask them what version of FME is compatible with their read and write it they'll probably always tell you an older version I'm not quite sure what the current version is probably FME 2012 that they would suggest because that's one that they've done their validation on but we would always encourage you to move forward and you can install multiple versions of FME so if you want to test the latest FME against any workflows that you already have then you can do that install a couple of copies of FME your production copy and a test copy of every 2014 and then you can move forward to the new system and then there's a second read and writer available from spatial business systems they've built a plugin for smaller it's a little bit more advanced I think then the GE small what one does has better support for more complex joins than the GE one so really whether you need to move to that reader/writer will depend on the level of sophistication of your data loads and extracts and and also their specialties reader/writer is very much tuned to data replication especially to Oracle databases so if you that's kind of an interest you then you might want to have a look at that spatial biz region writer there is an extra cost to get in there and there is also the small world song for FME and friend offered Sawatzky who's been a long-term smaller than if in the user made a little video on his blog so that link will go out these slides so that you can find that little video if you want to learn more about that some for FME essentially it just extends the format reach of this more world song okay well let's get going with the first kind of introductory look at FME and working with the small world data so one of the nice things about the small the newer of the small world region writers which I think Steve I think this was kind of introduced around 4.2 I think the newest Smallwood reader yep and it makes it very easy to work with versions or alternatives and also checkpoints and has a database connection service so that you don't have to have the small world is running which makes the whole thing compatible with our FME server product if that's appropriate for you so let's have a quick a look at using data inspector with the small world reader writer just one thing to remember is at the moment the G small world reader writer doesn't dig out the coordinate system that so your small world system is running in and that's the world coordinate system generally so always remember to include the coordinate system when you're working and with this guy alright so here's the data inspector and so when we look at some small old data we get to open up the reader there and then we've got the parameters as usual on most of the readers and writers and a couple things you can change here as so the FME service there's two options here FME no factory and you can also put in just FME and this tells the small world reader whether you going to preserve the multiple spatial columns in small world or whether you going to split out the spatial columns and break those into separate features so if you have a location and an annotation do you want two forms you want to keep one feature with those two spatial columns or do you want to split that object into two features one with just the location on one with the only the annotations and then down lower down here we've got the options for working with alternatives so we can work with the an alternative here so I've opened up the FME alternative and and we what's a great feature with the small reader writer is that you can export Delta's or changes from a baseline alternative so let's first look at the small DD is that our got open here and just have a quick look so this is all the data we're working with today's from the Cambridge database and I've added a couple of extra features into this FME alternative just a couple of properties here that save software folks are going to try and buy up and down at the bottom there so those are being added to the FME alternative answer if we read from that alternative in the FME world and we'll see those additional features and okay so they're right there I forgot to add the coordinate system so we're not getting a background map so that's why it's useful to remember to include the coordinate system because then you'll get a background map I'm going to try and follow my own advice here another thing to mark we're looking at the FME data inspector for those new to FME this is a visualization tool that can interpret or a read art all the format's that we work with so yeah yeah thanks Steve yeah that's absolutely right so if you asked to load some AutoCAD data into you're small then you don't have Autodesk products on your machine you can look at those data sets okay so I'm just clicking on one of those added features there and them you can see that come through from from that alternative those these are the new features the proposed ones are the new features the cables in this case will that feature ok so if I now continue that and I go back to the parameters and now what I do is I say I want to export changes from baseline and that's going to be the top so that's just a pipe symbol there that represents the top notice here that we can use a search engine so if I had features outside this search envelope which is in the world coordinate system which is in millimeters for small world that's what we're going to get and and so now I'm asking for differences only and there we have them so those are that features are different between the top and that FME alternative and that can include any deletes as well if there were deletes between those alternatives we would get those what's very nice here though is the note that there's a column here the FME DB operation and that is kind of an internal attribute that FME can use for incremental updates between databases and in this case they're all set inserts because they're all new features but if we were doing data replication which we're going to do a little bit later on if you set this FM EDB operation each record knows what's going to happen whether it's an insert update or a delete and so that option here that we had export changes from a baseline when you put in a baseline alternative automatically populates that FM EDB operation for us so the destination database knows whether it can do an insert upset them insert update or a delete so that's pretty cool okay just so um so there we are going back to the original data now what you'll see is as I'm working around in here if I click on one of these features let me just zoom in a little bit more there I've got the supply point now a supply point is a multi-part geometry in the small world and so here we can see that we've got two geometries the text location and sorry that so that would be the annotation in in the small world and we've also got the load location object which is the actual location of that supply point to symbol in the small world GIS and so if we were to look at that equivalent feature in the GIS we could probably select one of those and then have a look at the editor you can see that the location and the label have geometries and so that's what we're preserving in most cases if you are exporting small world out to shape or something like that you probably don't want to do that and that's why we have this the second option which is called the service and and you would just replace that which is actually the default to FME and then what will happen is that all the geometries will get split out independently and they will each have their own feature representation so typically if you're going out to say more simpler data jeaious format and that would be the approach you would take so we could zoom in here a little bit again and text doesn't always come out perfectly in FME but you can see now that this text object that I clicked on there's only got that one geometry on it and the service point to itself the supply point itself has been given a separate geometry so typically if you're going out to a simpler do a slaughter multi spatial column database you would use that FME factory sorry just the FME option instead of ethylene olfactory there's a weird name it's kind of historic underneath the covers there's a very old function in FME called the smaller geometry Factory so well that's where this name seems to have come from so FME no Factory if you want to preserve the nature spatial multi spatial column nature of your small data service FME if you just want to UM split out the geometries into separate objects okay yeah some flexibility there because a lot of formats aren't going to deal with those multiple geometries like smallworld does definitely yeah all right okay well this is the very typical use case for FME but actually the demo that I'm just kind of skip over today we are I'm going to ship with the UM work with the webinar materials that you're going to get at the end of this webinar the workspace that we created do this but to loading CAD data into GIS is a very typical workflow fits very well within FME server but on our FME scissors so on our FME pedia website there is AG live demo which is very similar it's not loading data into smaller GIS but that's a much smaller part of the problem so that people who are watching today can go there download the workspaces as well and actually run this demo live so we're going to skip this demo just for the sake of keeping things moving but the key part to loading data CAD data especially into GIS is the validation and so often that includes some connecting text and/or annotations in the jet in the CAD data to line work or symbols and geometry validation you can use the geometry validator attribute validation and you can also validate Network data and we're going to have a look at that in the separate demo today so so that's an example there waiting to be looked at for loading CAD data into GIS very big part of I think our small world users doing that okay so extracting CAD data from the small world data database so obviously the first thing is to do is to choose the right CAD format you're working with if you're working with MicroStation obviously you've got to choose between whether you're working or your customers are working with version 7 or version 8 AutoCAD is even more confusing and we got just native AutoCAD DWG some people might still be using extended entity data there you've got AutoCAD 3d map which is much stronger more GIS GIS like in terms of preserving attribution that's the CAD format that I generally use civil3d plus as well you've actually got the autocad version that you might have to support might indeed be an older version so you've got to work through all of that patient and math info as well I believe we've got the DWG styler transformer and the dgn styler so they help you connect M blocks or cells to your objects help you style create line styles or so on and then we also have the concept of templates well call them templates for AutoCAD I shouldn't remember what we call them for MicroStation what are they feed files or MicroStation seed files yeah yeah you seeds and so they have the predefined symbols and less cells and so on so and if I've got a workspace here that I can open up so so libraries the other part of those symbols to ring yeah so typically what you're gonna what you might do is do some labeling so this is reading a from the small data store you might want to create new labels depending on whether the label locations in small world line up with where you want them in the AutoCAD the AutoCAD styler allows you to use this template file and then you from that template file you can choose what line type you want to use that might be in that template file so template file in AutoCAD is really just an AutoCAD drawing an empty AutoCAD drawing where all the line types blocks and so on have been predefined and then you can run and strike it and have a look at the result but the great thing about this is this is where and this would be a very good use case for connecting to FME server and we could upload this so workflow to in my case just a local FME every server market looks like you're trying to put together a little scenario where people can actually go and pull their own data down instead of the GIS person doing the extracts is that what we're seeing that's exactly right yeah absolutely so we could publish that up to server and a couple of quick steps there that's gone up to the FME server so if I now go to zoo any webpage I can open up my FME server now typically people will brand these web pages as their own these are the default web pages that we ship with the FME but you can see in that previous data upload demo that so we've hidden the actual web pages of FME server away a little bit um I'm going to run this one that I loaded up earlier and there might be a few configuration prayers that you want to that you have to work with and then you can run the workspace so this is where somebody can start to do some self-serve data downloads instead of as deeps as pestering the GIS users and the other nice part about this here with FME server you could create like you alluded to a custom interface and those parameters that were looking at there could be drop-down boxes and that sort of stuff and that could be very easily programmed pulling information from the workspace if you could set up option lists on say the coordinate systems that you want to go up to and that sort of stuff that's right and in most cases this would be delivered back to you rather than asynchronous it would be delivered back to you as in the email and here we can see that we've got the sort of said open and here we've got the zip file that contains that resulting AutoCAD data set there we go so that's the downloaded AutoCAD data set now just going back to look at those parameters that we have there so this is where this would typically tie in very nicely with a nice web mapping tool maybe the science or the equivalent in small world so that you would be able to draw your own bounding box instead of just typing them in here a bit of a plain web page and the web form so you could have this integrated into a nice web mapping environment draw a bounding box and that would be the region of interest that you would code for this CAD extract and yeah and another thing to note there on those published parameters those are actually coming from the workspace so we've exposed those in the workspace when you push an FME server now you have access to let your users manipulate those parameters as well so pretty well any of the demos that we've got here today could be published up to the FME server this was a big advance with the newer small world reader and write about the G small world and the spaceship is we try to support this idea that you no longer need to have the small GIS running which really opens up by automating your small world workflows now and through FME server if that seems to be appropriate um I mentioned that you can do a network validation in FME as well and so I've got a very short example here that we can look at so this can be done either during the data load or it could be done after you've done the data load to look at the results and make sure that the data that you learned in and has actually loaded successfully and that they do form a contiguous Network if you're adding additional features so here I'm just reading the cable data and that includes those proposed cables that we added in the FME alternative and then a key part of this is the network topology calculator transformer in FME which sort of builds the networks and to sees how the network is constructed and then what I'm doing is I'm testing to see whether features are on a major network or whether they're kind of hanging out by themselves and so I can run this and what we'll get in this case I'm pumping this out into a KML data set and again this would be a great target for FME server because you'd be able to automate it and then you'd be able to open up stream this data directly to Google Earth and open up Google Earth right away and so over we go to a Cambridge database and you can see here that blue is the proposed network which in in my model means that it is nicely connected the cyan saris would post but it means that it is nicely connected to the major network and the purple objects here those disjoint cables that don't really connect to any other part of this small Cambridge network so you can start to see whether your network data does line up if you're doing data loads or your validating CAD data as in to your GIS yeah and that ties back into another way we could be looking at this by having contractors and such email in CAD files and have them validated before involving anybody on the JSI report back to them any of the issues and then you know obviously make those changes in and maybe submit them back and possibly even load them into a temporary version or a version that can be then reviewed by the GIS and loaded into the main system so pretty pretty neat stuff that's a really good point there Steven so actually that a CAD data loading example that we was mentioning earlier on and there I think that one does that that's an email in so you can you when you run this live demo you can email in these CAD files and then I'm just going to try and stop this little phone ringing in the background so yeah keep pouring any questions there team anybody out there in the audience were if you've got anything to pop up don't hesitate to bug mark and Ken with some some questions and even if they're really really difficult and we can't answer them online we'll get back to you after the webinar so yeah sorry about that Emma so this is an email invalidates the data so that's a really good and the thing I was just going to add that Steve to what you were saying is that the reporting of the errors is very very important so that's a part that mu can play there and in this case of this example you get a very nice email back with all the errors and the location of the errors okay so working with CAD data loading car data into small world extracting CAD data validating CAD data all very strong parts of FME and hopefully you can use the O's as you go all right so moving on database replication so this seems to be a very common task in force mobile users and so I think typically people are replicating into Oracle the spatial bears smaller plug-in has been fine-tuned to do this kind of work but you can do it with the GE small world reader and writer if that's the one that you have a big part of database replication is preserving the multiple spatial columns so you can do that if you're going to sequel server oracle or even post juice or something like that and then there's typically two steps in database replication process the data load itself and then the ability to do incremental updates so let's have a look at how that looks so let's go back to a workspace here move a little to our next demo there that sound and bit more of a complex kind of workflow here and not in terms of the natural data transformation because here what I'm really what we're really doing may may not be the cases we're doing a mirror really of the small in this case I'm going off to a sequel server but it could just as well be Oracle so not doing a lot of schema manipulation here but there is still a fairly large amount of detail in the workspace the first thing is that we're using the service FME no factory so remember what that does that preserves the multiple spatial column nature of your source so small world database then on the sequel server database writer that I'm using if you're working with multiple spatial columns in any of our databases you have to use this parameter that tells the writer that it is working with multiple or columns not just a single spatial column so that handle multiple spatial columns a parameter is available and all our database writers Oracle's super server posters and so on and that tells that we're going to be working in this special mode then there's a transformer that you can use which server we call the geometry property setter and that sets the name of the geometry and that's essentially telling ever me the name of the geometry is the name of the spatial column that you want to insert this particular object into and so so that's how you can use that and in this particular case here we've got the sequel server executor now one of the restrictions in FME is that you can't some create tables with the database writers that have multiple spatial columns that's not actually that called common anyway if you're going to be doing data replication you can have a system administrator created there's data typically but if you do need to create some those tables on the fly you can use the sequel executor so here's the sequel calls that you would need to create these tables with multiple spatial columns so here you can see what the electric supply point got the label geometry as well as the location of the supply point so those are the two spatial columns for that particular object um and that's about it so then what you're going to do is to run the workflow so I've got to what's not that guy I've got the sequel server management studio up here we've got some our database ready to go so I'm just going to run this workspace I've published some of the key parameters that we need here so my faster workflow is going to be using doing a data load and so I'm going to say if the tables exist you I want to truncate the tables otherwise my sequel executor will will recreate them for me my writer mode is set to insert and and the source alternative I'm using is the is the top so off we go going to create those tables and load them up with the objects from that cambridgeshire Network back to my sequel server management studio it's just do a quick refresh here so here the new tables that we've added let's have a look at the supply points and so these are the supply points that have come in from that small data store the top alternative and we've got the label column and the location spatial column that have been happily populated okay so that would be your first seed of your database so now you might want to publish this up to a FME server and automate this task but now what we can do is we can run this in increment 8 road and we might be working from an alternative so what we're going to say is no we don't want to truncate the tables yes we want to do some updates our source alternative is going to be the affirmative where we have the new objects that we were adding we could add a check point in here if you are working with check points in your Smallville database yes we do want to export the differences from the baseline alternative and that baseline alternative is the top which is just a single pipe like oh okay there and then we're going to do those incremental updates you can see that we've got far fewer features on the feature counts come across here and and let's just get rid of a couple of these and you wouldn't think that on a such a remote island there'd be so many calls and buzzing is going on but there we go okay and so what I'm going to do is I'm going to select the top few rows of this guy and hopefully down at the bottom here we will see the couple of new entities that we added which of the three new supply points and the same for the cables and so on we would have with the those two spatial columns populated the label and a location and of course some of these can be null so if you don't populate a geometry that would be fine too okay mm-hmm so fairly a complicated workspace in terms of some of the configuration but otherwise so we can sue both the data load and incremental updates across from small to another database so relatively straight forwardly and I think there we're going to take a couple shots to see if there's any interesting questions so that was Steve yeah there's one little bit of housekeeping there related to the workspaces someone's asked about that these these will be provided afterwards you'll get an email with a link in it we've got another person that's asked a question related to making joins so for instance they got a cable a fiber cable and I got a geographic area so could we within F and E make that relationship tie and then enter it into the small world database we yeah so with the Gigi small reader writer I think that just supports reading writing simple joins so those are joins that do not go through a join table so in the Cambridge database the supply points and customers are linked through an intermediate join table we can view those intermediate tables in FME and actually you can extract the lits one of the parameters on the reader if I can bring up the inspector here you can see that there's an option here expose internal tables and that would allow you to see those internal tables which are the intermediate to join tables where those I think it would just search for int and they will come up somewhere with the electricity there it is so that's one of the intermediate to join tables there I think or something like that and I know there's one for the electricity but I can't see it right off the top there Olivia so that simple joint I know the spaceship is reader/writer has got a lot more strengths there in terms of more complex joins including multiple using intermediate join tables so if that's a big part of your workflow you might want to just talk to the spatial physics to see how they support them awesome ok so that's some pretty good stuff you were shown the remark the the graphical interface allowing users FME users to really cut down on that development time and creating some customized workflows without using you know traditional development methods absolutely okay so we're going to now talk about sort of from a slightly different way of using FME and that's around lettuce concept of dynamic workflows so dynamic workflows and a schema mapping that go very closely hand-in-hand um so schema mapping is the process of the data from Oster destination and this is a big job that most people underestimate how long it's going to take it's got nothing to do with FME at all actually so if you're going to move data from small world to a CAD system or from small world to another database maybe a public database that you want other users to look at and so on you have this task of doing the schema mapping which is to say okay if I have a layer in AutoCAD what object is that going to go into in small world and so you have to build up some sort of a table sometimes called a crosswalk table or schema mapping table that tells you how the data maps between the layer to the code collection and small world how he might be renaming attributes or reached attributes maybe setting default values if the data doesn't exist in your CAD data may be a mapping descriptive values in a CAD data set to enumerated lists or domains in your small world database so as a lot of Transformers that you can use for this schema mapping tasks it's called there's one the attribute renamer actually a creator which does attribute renaming or copying as well as allowing you to set some conditional values which is very powerful attribute value mapper which is a great transformer for doing enumerated lists and then and that's fine you can use those transformers and that's a very good way to do your schema mapping but it does create large workspaces with a lot of repetition so we have another kind of schema mapping transformer that is called filling of the schema mapper and that allows you to do this schema mapping here I've got example on this slide that but instead of doing it individually by trans Transformers you can do that in a spreadsheet and one of our colleagues brah Pontus just damn whoops so that's supposed to be a link but it's not so working has just updated our FME pedia web pages with a brand new set of schema mapper articles so you can go to FME Peter and search for schema mapper and you will find those so if you want to learn more about the schema mapper we're going to have a quick look at it in the next step or in this demo so then the next part of that is how that relates to what we call dynamic workflows so by default when we've looked at any of the workflows that we've had in so far you can see that FME is kind of very tightly bound to the schema of the source and destination objects you kind of have to list out the target layers in this case going to AutoCAD what source objects you're coming from in small world what all the attributes are so basically describe in detail the data model that you feel working with on the source and destination side and sometimes that's a little bit inconvenient and creates very repetitive workflows so FME has this slightly different approach which we call the dynamic workflows so why go dynamic well it makes your workspaces a lot easier to maintain workspaces are very flexible so if something changes either on your source data set are you add a new object or the attributes on an object are changed by a database administrator FME can handle that without a lot of updates and also what is great is this ties in very well with the schema mapper transformer so that's where that goes and of course all this ties in very well with FME server so you can publish these dynamic workflows up to FME server and you can then automate them so it's my expertise is the nice thing about both of these things always you really can save yourself a lot of effort once you get familiar with them and using them I really want to stress that they they're quite daunting when you get going on them to start with but if you master it it's going to make your life so much better working in after me with those kind of workflows absolutely yep so if it works for you and you can get it experimenting and then that yeah absolutely Steve that's absolutely right make your life in the longer-term a lot easier and really the hard part actually is the schema mapping process here so this workspace here that I'm illustrating here that I'll bring up in a second in FME workbench is a dynamic workflow it's the equivalent of doing that a small world to CAD extract except you can see that there's only one source feature type one destination feature type we dropped all the multiple DWG stylers and any attribute renaming and tools and they've been replaced by a single schema map of essence so let's go and have a look at and see what that looks like here's a workbench so um yeah so essentially what we're doing is replacing all these transformers so let's go and have a look at what that might look like that's the workspace let's have a look at what this for this particular workspace what that schema mapping table might look like here and then I'll just walk through the workspace quickly so what we're saying here is extracting from small world these are the small world objects that I'm going to do the schema mapping for if I decide to add another attribute object that I want to work with and export out to my CAD data I don't need to edit this workspace at all all I needed to do is add a few more rows to my crosswalk table here and those features will be mapped out successfully in this if the main part of the schema mapping is renaming the source objects into a naming convention that more or less follows the national card standard which seems to be very common for people doing design work in AutoCAD so the object names are being renamed into layers that more or less follow this national CAD standard and I've got a few other AutoCAD like attributes I'm setting these are essentially the attributes that are set in the DWG stylus so this is where you would set what AutoCAD symbol or block is being set there and so just working through this workspace again the actual configuration can be a little tricky but once you get to understand it so it works pretty and pretty well one of the key parts for this workflow is something that's been way down here but when you create these dynamic workflows is cool is this a parameter here called the feature types to really eat and this dynamically reads the objects from your source database whoops looks like I've lost my connection but so so that's where this workflow becomes very flexible you can dynamically read the objects as you go we've got the schema map a transformer that is reading the schema from a crosswalk table that I've just shown there so that's where most of the schema mapping is done and then we've got what we've called a dynamic output feature type has this special parameter set here used dynamic properties and in this case here what's happening is this schema for my AutoCAD data is coming from a table that we call the in this case I'm calling the AutoCAD the schema table and that's um you can just open up briefly basically that a table that tells us what two attributes what layers we're going to have and what the data types are on that particular object so for the cable I'm going to call it the that's the AutoCAD layer name and these are the attributes that I'm going to create on that particular layer in the AutoCAD data set and that's driven by something in this workflow that is called the dynamic properties and then what we call the schema sources so let's see if this thing will still run looks like I've lost my connection I don't that is so that is right yeah that's good and so just to recap this is really the equivalent of that very first workspace we were looking at that had the multiple schemer and called them a DWG stylers and so on and so we can just go and have a look at the results of that that's that AutoCAD file and I can double click on that and it will open up in true view actually this is something interesting here that FME supports whoops I've lost that them but maybe I'll just point out while we're looking at that and it's Darryl I say it's something that is reintroduced but FME supports and so anybody can take advantage of this is that if you add a dot prj fall which is really just the shape format prj fall and you call it ESRI CAD or and or you give it the name of the file this will tell you what the coordinate system of this data set what a curb data set is so that's a handy thing if you have AutoCAD files where you know they that they're in a good projection if you just drop a projection file into the folder where those AutoCAD files or FME will understand that projection okay and they're in AutoCAD TrueView is the result of that AutoCAD translation okay so that's a quick review of dynamic workflows really recommend people check that out and have a look at that yeah I do too the very getting Beeler to learn at the master sir brian has updated the schema mapping articles using the schema map a transformer and we're just in the same process of updating all the dynamic workflow articles on FME pedia so that's very timely with this webinar so if you feel that that workflow will suit your needs so have a look at those articles ok so I think we have time for a little bonus um demo which is cool about location intelligence so this is a bit of a contrived example so what if the Cambridge electric utility there they decide they want to do some major updates on their substations there's two substations associated with this Cambridge data set in the small database and so they're going to do some long-term maintenance there and the union wants to know if there are any public WCS close to these Cambridge substations so that if they have to take a toilet break and they can walk to a public toilet otherwise we're going to have to install some jiffy Jones at these substations where people are working on them so it does you see is a water closet which is the old english term for a toilet so we're going to do some location intelligence on our substations and find the public toilets that are close to these substations and put out some sort of a report on that so we built a WC finder workflow and so within the location intelligent kind of arena that FME can work in some of the things that we can do there to merge in different data sets so that's a very strong part of FME you can take data from different formats and merge them together we've got tools where we can tap into many different web services or in this workflow we're doing that the building service areas we can do some spatial simple spatial analysis in this case so match points with polygons and we've also contacted some web services such as a shortest path finder and so on and then we can produce a PDF file if we will review that so that's sort of seizing what that workflow that does that kind of work would look like marca last night when I was looking at reviewing these slides again I got an idea for like a great mobile app and I went on the app store just to see if it was anybody else out there - had a great idea and you know what lo and behold there was three apps created for locating washrooms one of them was for London right there you go yeah yeah you never know what's there's always somebody thought up the idea before us that's what that's the sad thing yeah okay that's just a little bit on my work right here so merging disparate dataset so that's a very strong part of FME and so I am reading from my Cambridge database here so here's the location of the substations they're coming in in British National Grid millimetres so I'm going to reproject those two a lot long because that's where the other source data is coming from the substations do come in as polygons so I'm using the center point replaced they're here to convert that polygon into a point so that we can do the appropriate analysis on it so that's the first step so the other data that I'm reading is coming from the cambridge city of cambridge open data and webpage actually and so it's just an XML file that they've got up there yes and that has the locations of the public toilets and the kind of the status of those toilets whether they have somebody sitting there what time they're open and so on and so actually I'm instead of having to download that XML file and then process that ever and actually read that directly from their web page and so that's what I'm doing here hopefully you can see that so you can see here I've got an HTTP to the Cambridge gov website that's pointing at the Veda XML file that's up on their website so if they ever go ahead and close the public toilet for service or add a new toilet so we would get that live right off their website for this special analysis we're doing so that's kind of interesting part of after me that we can read this data live from a website okay so some of the web services that we're using in this case it's a custom transformer that we've built that just uses in this case the ArcGIS online services for the service area calculation so they've got some that you can make if you're an ArcGIS user we have a subscription to our gso line and and what these do is they build service area polygons in this case for a 0.2 of a kilometer about two polygons for each substation point two of a kilometer which would be walking distance of a public toilet one kilometer if they have to drive to that public toilet which would be a reasonable drive time if you just need you to take a bio break and then we're going to match the public toilets that we're reading in from that XML file coming in here to though service area polygons and we're going to find out whether any public toilets are within range of that dataset if there are some public toilets within range we can use another web services call again using IDs online but any other tool I know they're what used to be NAVTEQ are now here also have these online services where you can do routing or drive time analysis so if you are subscribed to those services you could build a custom transformer that would access those as well but so this is the ArcGIS online routing tool that will give us the route and then at the end of this workflow what I'm doing is building a table one of our colleagues iris get our ski built a custom transformer for building simple tables in FME and then that's going out to a PDF template and the PDF writer so we can run this little workflow and hopefully have a look at the results and again this would be a great target for FME server because we can read the small database now without having to be having to have the J's client running and we can then have a self-serve kind of website where people could search for public toilet near Cambridge electric facilities if we wanted to and now we're a little bit over time but which always upsets our webinar organisers Stephanie a little bit so let's just have a quick look at those results that we've created there so there's the resulting PDF file it's got the drive time polygons I don't know why I've chosen dark green for all this stuff and that there we have it and so we've got the drive time polygons the locations of the public toilets I forgot to put in the location of the substations but obviously they're at the center of these drive town photons and the walking time polygons and for the two public toilet that's that are within driving range we've got the routes there and then a list of public toilets that are kind of nearby in a little table format that's great a fun example of what you can do with us enough for me that's writing yeah and of course that could be some more serious kind of analysis looking at properties in that are close to somewhere where you're going to do some work that might need you to UM tell those property owners that activity is going on or something yeah all right boy that's it for the demos yeah thank you very much mark does a lot of great information there a lot of wonderful examples of what we can do with FME in small world and I hope I hope people in the audience there really got an idea of some of the things they could be looking into and doing and have lots of energy now to see that see to investigate some of that so just a touch on training we've got a couple of training coming up later this month FME desktop August 19 to 20th this is free training so please check out safecom and look out for your training link and then you'll be able to sign up there we also have Vance FME desktop coming up at the same gates I guess going side by side that's an interesting one and we're also going to small right and kind of dates are wrong actually so much ayah they all might anyone yeah might want to go online to safecom slash training and also we have a small world training session coming up this fall we don't have a gate set yet but that's just keep checking out on that our website and you'll find that information we have a miss mark next slide there we've got a couple of new adventures coming up August 26 we're going to be doing spatial data based tips robin and myself are going to be doing that and a little bit later on in september we're going to happen other webinar MicroStation dgn how to integrate cat and GIS so really hope that you're going to be able to take part in some of those we should mention that there is a webinar happening tomorrow how to develop for data transformation for FME server that's coming up tomorrow it's going to be a pretty advanced technical level with FME server but there's possibly some people in the audience that could be still interested in that all right so now it's on the Q&A we're very sorry we'll run over there six or seven minutes yeah so we could probably skip the Q&A hopefully can a mark of being able to keep up if they haven't we will answer any questions later on as an email I think yeah that's right we can follow up with them we'll get a list of any of the unanswered questions or questions that need to be revisited and we'll get back to you okay and so with that thanks a lot to everybody for attending remember that you will get a follow-up email that has the link to the powerpoints and all those workflows that we've created and so with that it's goodbye for me yeah and I really hope that some people learned some valuable information today and are excited about FMEA and what you might be able to do that with your small world systems and again thank you very much for your time taking time out of your busy days to be with us today

Channel: FME Channel

Views: 16,716

Rating: 4.6444445 out of 5

Keywords: FME, GE Smallworld, Smallworld, FME 2014, network, network assets, data validation, self-serve, data download, download, automation, automated workflow, location intelligence, managment, formats, CAD, GIS, Database relication, dynamic workflows, Visioning, inspecting data

Id: c8Kx6KAT2Ys

Length: 65min 52sec (3952 seconds)

Published: Wed Aug 06 2014