00:04All right, so you've downloaded the aggregated live feeds tools from the Resource Center...

00:09...and you want to know a little bit more about how they work and what they were built for.

00:13So we're going to go through a couple exercises here of showing the first live feeds... action within the sample viewer, the Emergency Management COP viewer.

00:23And then we'll go through the architecture and then we'll look at the scripts...

00:26...themselves in a little bit more detail.

00:30And I'll turn on some of our aggregated live feeds that we have...

00:35...set up in the sample that you've downloaded.

00:38So we'll first turn on our METAR, which is the current wind and speed.

00:44So you can see we have our wind symbolized... the directional arrows and which way the wind is actually headed.

00:51We also have stream gauge information, and this helps you understand if a stream is...

00:56...overflowing or where the stream level is at.

01:00And lastly, we have the Weather Warning and Watches.

01:04And we can even go so far as to identify any of these feeds...

01:08...and get some information about the feed itself.

01:13This is essentially the aggregated live feeds architecture, where we are aggregating data...

01:19...from the web, pulling it down, processing that data and then adding it to ArcSDE...

01:28...and then finally serving the data through ArcGIS Server from...

01:33...a SOAP endpoint or REST endpoint as well as map services and globe services.

01:37So from that area, any Esri client can really consume that whether it's Desktop...

01:41...or it's web-based.

01:43Now for the real - this is where all the magic really happens - is we have our FeedScripts...

01:49...and then we have Utilities and then we also have the batch files for the feeds themselves.

01:56So these batch files are what go out and grab the data from the web...

01:59...pull it into ArcSDE and then serve it through ArcGIS Server.

02:05So let's back it out of there for a second and we'll take a look at some of these utilities...

02:09...and I just want to highlight a couple of the important utilities for...

02:13...Weather Watches and Warnings, that's the feed we're going to take a look at right now.

02:18So the main ones that we're going to leverage and ask for is this asc2sde.exe

02:22That's a freely available script from ArcScripts, that's been out there for quite a long time.

02:29We are also using wget.exe, which is a really powerful...

02:34...command line script that lets you download data from the web.

02:39And lastly, we're going to use xml2csv.exe.

02:44So all of the feeds that we've installed in this package...

02:50...all utilize those same executables and scripts that were in that folder.

02:56So let's take a look at the scripts themselves.

03:00And from there, we're going to focus in on the Weather Warnings and Watches.

03:05This is a pretty simple script -- there's a lot of information here, but a lot of it is just...

03:10...echoing out to the user what's happening in the script.

03:13So the first thing you do, when you call this script, you have to pass in a user and...

03:18...a password and that's for your ArcSDE instance.

03:22And let's see -- this is our SDE Server as well as the SDE instance name.

03:30And the user and password will get passed into the script.

03:35And we just took a look at a couple of those tools before.

03:39We're going to take a look at them in some more detail now some

03:42We're using wget.exe, I mentioned that as being a really important executable.

03:47Here, we're calling wget.exe, all we're doing is going out to the National Weather Service...

03:53...and downloading that .xml file that has all the information we want.

03:57And let's scroll down some more.

04:03The Weather Warnings and Watches is actually an .xml file.

04:07And we want to push that into SDE using our ArcSDE using the ASCII to SDE command...

04:13...which takes a .csv.

04:15So here we're going to leverage this .xml to .csv utility.

04:19Again, this is free for the public to use.

04:23And finally, we will push that information into ArcSDE using the ASCII to SDE command.

04:35So once you've entered in that information on the top of this script...

04:41...which is your server, your instance, your instance name, you need to set up a...

04:46...scheduled task on your system that will be running these tasks at a periodic interval.

04:50For this script in particular, I believe it updates every five minutes.

04:56So let's go through and we'll go to our Task Manager, our scheduled task creator...

05:07...and we'll create a task, and you can first name a task.

05:11This is like the Task Scheduler used before.

05:18You give it a trigger, and this is where you will tell it how long you want it to update...

05:24...and in this case, it will be every five minutes.

05:28And the last thing you need to do is just point this task at the batch file.

05:34This batch file takes in -- if you remember the demo or the username as well as the...

05:40...password and that's where you will enter in the arguments in this area here.

05:46So once you've created your scheduled task -- and I've done it right here, I have my...

05:50...Weather Warnings and Watches, and I've run that on my system already.

05:54We can now go into ArcCatalog and we'll see what gets...

05:57...created from these scripts themselves.

06:01So once you run all these scripts, you will see all the tables that you see in ArcCatalog.

06:06On my screen, you'll have one for the stream gauges, one for the weather observations...

06:12...and then one also for our Weather Warnings and Watches.

06:16And in this case, I mentioned earlier that the Weather Warnings and Watches come...

06:22...down as a non-spatial XML table.

06:26So that's where we import that .xml, or we transform it to .csv...

06:32...and then actually import it into ArcSDE as a stand-alone table.

06:37So here is our stand-alone table of all the Weather Warnings and Watches.

06:43And since it is stand alone, we also create a feature class that has all the counties...

06:50...since Weather Warnings and Watches are always county-driven.

06:52We now have a feature class within ArcSDE for those counties.

06:57So what the user will ultimately use in their application, which is what we saw in the...

07:03...Flex viewer, was a spatial view created from that non-spatial table... well as that county feature class that's spatial.

07:12So this is a standard view.

07:16Once we have that view, we can use the sample .mxd that we looked at earlier... give us some symbologies.

07:26This is the same symbology that's in the Flex viewer that I was showing earlier.

07:29And you can simply stitch the data source to your local ArcSDE database.

07:39And from there, it's as simple as publishing using 9.3.1.

07:43Here's our publishing wizard for ArcGIS Server.

07:45You can publish it to ArcServer as a service...

07:48...and then plug it into whatever application you want to view it in.

07:53And that's really going from not having any data at all and downloading it to your client...

08:01...importing it into ArcSDE and then serving it in an open viewing application.

Copyright 2016 Esri
Auto Scroll (on)Enable or disable the automatic scrolling of the transcript text when the video is playing. You can save this option if you login

How to use the Emergency Management Live Feeds

In this video, Technical Marketing Technology team lead Derrick Burke walks you through the components of the Emergency Management Live Feeds template.  He’ll show you the live feeds configured in the Emergency Management COP template, orient you to the architecture, and give you an overview of the scripts used to aggregate the live feeds of data.

  • Recorded: Apr 2nd, 2010
  • Runtime: 08:15
  • Views: 658
  • Published: Aug 31st, 2011
  • Night Mode (Off)Automatically dim the web site while the video is playing. A few seconds after you start watching the video and stop moving your mouse, your screen will dim. You can auto save this option if you login.
  • HTML5 Video (Off) Play videos using HTML5 Video instead of flash. A modern web browser is required to view videos using HTML5.
Download VideoDownload this video to your computer.
<Embed>Customize the colors and use the HTML code to include this video on your own website
Start From:
Player Color:

Right-click on these links to download and save this video.


Be the first to post a comment
To post a comment, you'll need to login.
If you don't have an Esri Global Login ID, please register here.