Thursday, February 26, 2015

Exercise 5 - Creating A Geodatabase with Domains

Introduction

Geodatabases are a key part in using GIS technology and analyzing geospatial data. When creating one to be used in the field you must create domains beforehand to make collecting data in the field easier. A domain is a key for the data to follow when you are collecting it in the field in order to reduced the occurrence of data mishaps. An example would be setting a temperature field to between 0 and 100 so that if you accidentally input 200 degrees instead of 20 the feature class doesn't allow you to do that.

An important part of creating a geodatabase is planning your field methods ahead of time in order to get as much information collected out in the field as possible. In this exercise we used the example of collecting micro-climate data at different points on campus which we will do in the following exercise. We first need to plan out what we will be looking at and then any domain we will need to create for those fields. The table below shows the field of the factors we will look at in the field as well as any domains needed for the data collection.

Field
Domain
Temperature (surface)
Floating integer (-30-60°F)
Temperature (head level)
(same as above)
Dew Point
(same as above)
Wind Chill
(same as above)
Wind Speed
Floating integer (0-50 mph)
Wind Direction
Floating integer (0-360°)
Ground Cover
Text with coded values:
GRA - grass
SNW - snow
CON - concrete
BLK - blacktop
SAN - sand
GRV - gravel
OTH – other (specify in notes field)
Notes
Text (extra information not included in the fields above)

The following video goes through the process of creating the geodatabase, domains, feature class and fields. Once this is finished we can clip a basemap using the Extact by Mask spatial analysis tool and we'll be ready for next week's exercise out in the field.


Exercise 4 - Unmanned Aerial Systems (UAS) Mission Planning

Introduction

Unmanned Aerial Systems or UAS is a very important tool in the geospatial sciences. It allows us perform field analysis that couldn't be possible on foot. We can collect aerial imagery and analyze spatial patterns from the air quickly and cheaply. In this exercise we were required to log a couple of hours in the flight simulator program RealFlight and try out different types of UAS aircraft. After we have become familiar with the different kinds of UAS aircraft we then will look at two scenarios where UAS would be useful and decide which type of aircraft would be best suited for each specified scenarios.

Flight Simulator

We needed powerful computers to use the RealFlight 7.5 UAS flight simulator software due to the intense processing power needed to render the graphics. We were to chose two fixed-winged aircraft and two multi-rotor aircraft. I chose the Slinger and F-86 Sabre for the fixed-winged aircraft and the Quad-copter and Explorer 580 for the multi-rotor aircraft I was to try out. I picked different locations for the flight sessions for each different aircraft. I was pretty good at this simulator due heavy practice in my youth through Xbox video games. Below I go through each aircraft flight and what I think they are most useful for.
RealFlight 7.5 software package with controller
Fixed-Wing

Slinger

The Slinger was the first fixed-winged aircraft I tried out. It is battery-powered and propelled by a motor propeller in the rear. It was fairly easy to fly and fun to fly around obstacles and was very fast. However, when flying it from a ground viewpoint it was hard to keep in the air when it got far away. This was very fun to fly and entertaining to try and fly it through buildings and other openings.

Slinger aircraft from RealFlight 7.5

Flight 1
Flight 2
Flight 3
Time

8 minutes
12 minutes
7 minutes
View

From ground
Third person behind aircraft
First person
Wind

15 mph
5 mph
0 mph
Airfield

Junkyard
Junkyard
Junkyard
Reason for crash

Lost view of aircraft and hit the ground
Ran out of battery
Hit bird (kind of on purpose)

F-86 Sabre (Ducted Fan)

This aircraft was a small replica of a real-life aircraft and handled similarly to the Slinger except with more maneuverability and more speed. I tried some trials where I flew through rings and its maneuverability made that pretty easy. The high speeds did make it harder to control but if I kept it higher it wasn't an issue.

F-86 Sabre aircraft from RealFlight 7.5

Flight 1
Flight 2
Flight 3
Flight 4
Time

5 minutes
7 minutes
8 minutes
6 minutes
View

First person
First person
From ground
From gound
Wind

5 mph
5 mph
5 mph
20 mph
Airfield

Buena Vista
Buena Vista
Buena Vista
Buena Vista
Reason for crash

Hit ground
Hit tree
Hit log cabin trying to go through it
Hit ground


The fixed-wing UAS aircraft had some strengths and some weaknesses. Their strengths are that they can cover large distances quickly, they can fly very high and they are very easy to fly in first person. Their weaknesses are that they aren't maneuverable enough to go through small spaces, they crash easily when out of view or near ground and they aren't easy to fly from the ground. They would be best for collecting data over large distances and collecting data that could be collected high above.

Multi-rotor

Quad-copter

The multi-rotor aircraft were much more difficult to fly than the fixed-winged, but they were also harder to crash. They also were way more maneuverable and stable than the fixed-wing aircraft because you were able to hover and move slowly. However, falling hard will break the rotors and it won't be able to take off again. It is a very fragile aircraft but very stable. I was able to easily maneuver around the castle building and landing was a breeze.

Quad-copter aircraft from RealFlight 7.5

Flight 1
Flight 2
Flight 3
Flight 4
Time

6 minutes
8 minutes
7 minutes
7 minutes
View

From ground
From ground
First person
From ground
Wind

25 mph
0 mph
0 mph
10 mph
Airfield

Castle
Castle
Castle
Castle
Reason for crash

Flipped over and broke
Hit the ground in the courtyard of the castle and broke most of the rotors
Hit eagle statue
Hit lamp post

Explorer 580

I didn't notice much different between the quad-copter and this one, it was just a different model of the same design. I did notice that flying from the ground was hard to control because it was hard to figure how the aircraft was moving in relation to my perspective. As the aircraft turned it was hard to tell which was the front and changing direction proved difficult in that view. In first person however it was very natural and understandable.

Explorer 580 aircraft from RealFlight 7.5

Flight 1
Flight 2
Flight 3
Time

5 minutes
18 minutes
6 minutes
View

First person
Third person
From ground
Wind

0 mph
0 mph
15 mph
Airfield

Sierra Nevada Cliff
Sierra Nevada Cliff
Sierra Nevada Cliff
Reason for crash

Ran into a window that wasn't open
Hit tree
Ran into ledge I was standing on overlooking valley

The multi-rotor UAS aircraft had some strengths and some weaknesses as well. The strengths are that they are very maneuverable allowing for flying into buildings, they have longer battery life than fixed-wing, they can move slowly allowing for low flights and they are easy to fly in first person view. The weaknesses are that they can't cover large distances quickly, they can go super high and they are harder to fly from the ground until they are mastered. They would be most useful in data collection that required slow, low fly aircraft. They are most

Scenarios

We were provided a variety of scenarios to chose from that had dilemmas that could be cured by using UAS. Using the information we found in the flight simulator we were to figure out which type of UAS would best serve each scenario.

Scenario 1 - Power Lines

"A power line company spends lots of money on a helicopter company monitoring and fixing problems on their line. One of the biggest costs is the helicopter having to fly up to these things just to see if there is a problem with the tower. Another issue is the cost of just figuring how to get to the things from the closest airport."

In this situation there is a need to not only get a high view but also a stable view so that a diagnostic can be performed on the power line tower. For this situation I would recommend using a GoPro on a multi-rotor UAS aircraft. This would provide the operator to cheaply examine the tower without having to fly an expensive helicopter from the airport. The GoPro would allow them to see everything at the top of the tower which would provide easy analysis of the tower. They would be able to just bring the quad-copter with them and fly it up to any tower they needed to see if further work was needed on any given tower. No matter how many times they would need to analysis a tower or how many towers needed to be looked at, the savings would be immense.

Scenario 2 - Pineapple Plantation

"A pineapple plantation has about 8000 acres, and they want you to give them an idea of where they have vegetation that is not healthy, as well as help them out with when might be a good time to harvest."

This situation covers a large area and needs a moderate level of detail in the data collection. I would recommend a fixed-winged UAS aircraft with a infrared camera under the payload for this situation. The fixed-wing would provide the user with the ability to cover the large plantation. The height of the fixed-wing and the speed at which it would fly would determine the amount of detail that would be achieved. The infrared camera would be used to collection lidar data that could then be processed using normalized difference vegetation index or NDVI analysis which would let the farmer know which parts of their plantation was healthy and which were not. This process could be repeated as frequently as the farmer wanted providing a extremely cheap and up-to-date solution.

Conclusion

Both types of UAS provided different needs in data collection and it is very important to know which to use in different situations. Fixed-winged aircraft are best for data collection that require large distances to be covered and don't require close detail. Multi-rotor aircraft are best for data collection that require slow moving and close, detailed analysis. Some projects could even use both so that you can achieve detail in places while covering large distances.

It is most important to plan ahead and know what kind of data you're collecting (either a need for detail or large area) in order to know which type to use. If you plan ahead, UAS can solve any spatial data collection need with ease.

Sources
Scenarios provided by Dr. Joe Hupy.
RealFlight 7.5 Simulator

Photos:
RealFlight w/ controller: Link
Slinger: Link
Quad-copter: Link
F-86 Sabre (Ducted Fan): Link
Explorer 580: Link

Friday, February 13, 2015

Exercise 3 - Field Navigation Map

Introduction

For this exercise we were to create two maps that are to be used in a later exercise. The maps are of a property outside of town that is owned by the University of Wisconsin-Eau Claire called The Priory. The priory was a former nunnery that was bought by the University in 2011 and started using the property for a child day care and a field methods laboratory in 2012-2013. We were to create these maps with one being in a coordinate system of decimal degrees and the other in Universal Transverse Mercator (UTM).

Each map will need to have specific coordinate system and projection requirements that are the most useful for their features and usefulness. I will go through each step of making these maps as well as the reasoning behind choosing each specific projection and coordinate system. I will also include some background information behind navigation, projections, coordinate systems and other things that I chose to include in my maps.

Methods

The first objective was to measure our personal pace count which is the length of two strides. To figure this out we needed to first measure 100 meters out. One person walked down the sidewalk behind Phillips Science Hall and another on the other end. The person at the far end held a receiver while the other held a laser measuring device. Once the person with the receiver was far enough away the person with the laser called out when they were 100 meters away. They then marked the point where that was and each of us took turns counting how many paces it took to traverse that distance. We counted every time our right foot was forward (two strides) and repeated this on the way back. On the way there I had 69 paces and on the way back I had 65. I took the average and set my pace count at 67. This will be used to measure out distances once we are out in the field at The Priory.

The next step was to create the maps I will be using out at The Priory. For the exercise we were given a geodatabase with all kinds of feature classes and data from The Priory. We were to chose from the data given to us what we needed to be most useful to us. I elected to use a satellite imagery of the area of Eau Claire County that The Priory was in, a five meter contour feature class of The Priory, and a feature class of the study area. I thought these were all that were needed when navigating The Priory in the future exercise. We then were to create a sheet with two separate maps on each side. One was to be in a geographic coordinate system and the other in a Universal Transverse Mercator (UTM) projection. The coordinate system map needed decimal degree measurements along the borders of the map while the UTM map need to have meter measurements. Each map will have their own usefulness when navigating.

In order to chose the correct projections for each map we need to know more about UTM and coordinate systems. Below is a image of the 60 evenly sliced UTM Zones across the globe (fig. 1). The equator separates the north and south UTM Zones. These zones help us create projections that give us an undistorted projection of specific zones on the globe. If you were to map in UTM Zone 34S for example you would get a great map of the area that lies in UTM Zone 34S but the rest of the globe would be distorted. So for my UTM map I chose a projection that encompses Eau Claire County, UTM Zone 15N. UTM projected coordinate system's are measured in meters instead of degrees so this map gives us a good representation of The Priory. Both maps were in the North American Datum of 1983 (NAD 83).

The 60 Universal Transverse Mercator Zones divided by the equator. (fig. 1)

Below are the two maps that I created in decimal degrees (fig. 2) and in UTM meters (fig. 3). Click on the maps to enlarge them. For each map I had to create a ticked border with measured increments for the respective units along with a grid. The UTM map was in meters and the Coordinate map was in decimal degrees. I then added the five meter contour lines and study area feature class on top of the satellite imagery. Next I put a north arrow, scale and metadata (projections, data sources and author) to each map.

Map of The Priory in decimal degrees. (fig. 2)
Map of The Priory in UTM (meters). (fig. 3)

Discussion

In the next exercise when we are using these maps I believe that I will have all the necessary information and data that will be need to help me navigate The Priory. The satellite imagery will prove useful when looking for landmarks and getting my bearings.

Some problems that could come up include the fact that my contour lines do not have a reference line and this might be a problem with figuring out if certain areas are sloped upwards or downwards. Another problem could come from the satellite imagery which could make it hard to see where the exact point I am along with the fact that this imagery is not super up to date. The Priory could have changed in the time since the image was taken and I could have incomplete or false data that causes me to make an error in the next exercise.

Conclusion

These maps will be very useful in navigating The Priory with just the right amount of information. The two separate maps should prove useful when measuring distances and slopes. I hope the maps I made will give me everything I need to have when navigating in the subsequent exercise and not lead me to get lost.

Sources

Map of the UTM Zones from National Geospatial-Intelligence Agency: Link

Friday, February 6, 2015

Exercise 2 - Visualizing and Refining Terrain Survey

Introduction 

The purpose of our second exercise was to take the data that we gathered in the first exercise with the survey and create a terrain model in ArcGIS. In this exercise we reformatted our data so we could put it into ArcGIS and then looked for any areas in our survey that could be improved upon. We would then resurvey the areas needed and create a finalized terrain model.

We had to overcome some different challenges in being able to create a working terrain model from the data we collected. As well as update and format our data we needed to make sure that our model was close enough to the real thing. We needed to make sure that each feature was properly represented and the resolution was high enough to provide the detail needed to show all the features.

Methods

As was hinted to in the first exercise, we needed to normalize the data so that we could put the data into ArcGIS. The original table seen in exercise 1 gave us a grid with letters on one side and numbers on the other, which could not be put into ArcGIS. I needed to first create a table with x, y and z-values in separate columns. As the table below shows (fig. 1) I took the letters and made them into numbers (A=1, B=2, etc.) and left the y-values as previously numbered. I took each letter and stacked the data on top of each other. So I changed all the A column into 1 and then started on the B column right below as you can see in the figure below which was changed to 2. This was repeated for all of the numbers.

Part of the finalized table with the corrected x and y values, ready for ArcGIS. (fig. 1)

Next, I put the table into ArcGIS and created points based on the x and y columns in the table. I did this by importing sheet1 which is the table within the excel file that I created and just dragging and dropping it into the table of contents. I then right clicked on the table once it was in ArcGIS and selected Display the XY Data. I then saved the resulting points as a feature class by exporting it into my geodatabase. The output was a grid of data points and the image below shows what the points looked like in ArcGIS(fig. 2).

Original layout of the data points imported from the table in ArcGIS. (fig. 2)

Once I had the data points in I was able to run some 3D-analysis tools. I ran five different tools that are used to extrapolate x, y and z-values into a surface. They all use different methods to create a surface between the given points based on the other points around them. I ran a IDW (fig. 3), a Natural Neighbor (fig. 4), a Kriging (fig. 5), a Spline (fig. 6) and a TIN (fig. 7). Each of the tools had the same window open with places to input a Input point feature, z value field, and location of the Output raster. There were some more optional inputs that I didn't use in this exercise.


IDW model (fig. 3)
The first interpolation was the IDW shown above (fig. 3). I input the point feature I made above, set the-z value to the z-column in the points feature and that was the resulting output raster. IDW is an interpolation raster surface that is made from points using an inverse distance weighted (IDW) technique. "[IDW] interpolation determines cell values using a linearly weighted combination of a set of sample points. The weight is a function of inverse distance. The surface being interpolated should be that of a locationally dependent variable" (1).

Natural Neighbors model (fig. 4)
The next interpolation technique was Natural Neighbors (fig. 4). I did the same as the last interpolation where I set the point feature as the input and z-value to the z-column in the points feature class. The resulting raster above shows a surface using the natural neighbors technique. "The algorithm...finds the closest subset of input samples to a query point and applies weight to them based on proportionate areas to interpolate a value (Sibson 1981)" (1).

Kriging model (fig. 5)
The third interpolation technique I used is the Kringing technique (fig. 5). I again input the point feature and set the z-value as the z-column in the point feature. The raster above is the output of the interpolation using kriging. "Kriging is an advanced geostatistical procedure that generates an estimated surface from a scattered set of points with z-values...[Kriging] involves an interactive investigation of the spatial behavior of the phenomenon represented by the z-values before you select the best estimation method for generating the output surface" (1).

Spline model (fig. 6)
The last interpolation technique I used was the Spline model (fig. 6). I again input the point feature and set the z-value as the z-column in the point feature. The raster above is the output of the interpolation using spline. "Spline...uses an interpolation method that estimates values using a mathematical function that minimizes overall surface curvature, resulting in a smooth surface that passes exactly through the input points" (1).

TIN model (fig. 7)
After the interpolation methods we also wanted to add another model which was a Triangulated Irregular Network or TIN (fig. 7). This is done by creating triangulated surfaces between the points provided. I input the point feature and z-values in the same way as the interpolations above.

My group discussed the different models and we concluded that the best one was the Spline model because of its smooth look and close resemblance to the actual terrain. However, we noticed that in the bottom left third of the terrain there was a canyon that was not properly shown in any the models. We needed to resurvey this area and create new points and model as well.

We went back out to the sandbox and resurveyed the area that covered the canyon not properly displayed and surveyed points every 5 centimeters instead of every 10. The image below shows the new points added to the previous points which should fix the error in the original terrain model. The portion we resurveyed was 50 centimeters by 60 centimeters and was 30 centimeters right of the origin (bottom, left-hand corner) and 50 centimeters above. This area covered the valley that was not modeled correctly and once we resurveyed would give us the detail we needed.

I then was able to add the newly surveyed points to the table and import that table back into ArcGIS just like I did above with the original table. I then used the table to Display XY Data the same as before and exported the new points into a points feature class in my geodatabase. The resulting points are shown below (fig. 8).

Revised layout of points after the resurveying of the terrain.
Providing a more detailed representation of the terrain.  (fig. 8)

I was then able to create a new Spline 3D-analysis model of the terrain using the updated data and giving me a more accurate model. I just input the new points feature class and set the z-value as the new z-column in the points feature. Below is a new terrain model including the new points (fig. 9). We chose to do it using the Spline tool because that gave us the best model for our terrain with the original data.

Finalized Spline model using the revised data points. (fig. 9)

The image below shows the area that was changed in the revised version of the data survey and shows the valley that was supposed to be there (fig. 10). The revised version has much better detail and gets rid of the "land bridge" between the ridges that shouldn't be there. The resurveyed points get rid of any misrepresentation caused by the low resolution of the first survey and a more detailed and accurate model in the end.


Close up of the area that was revised.
The resurvey giving us a more detailed representation of the valley (fig. 10)

Discussion

The data we collected was very good and closely matched the real life terrain we created in the sandbox. We were able to transfer the data from our grid drawing of the sandbox into the (x, y, z) points with relative ease. We just need to stack the x-values on top of each other and change the x-values from letters into numbers. This wasn't a difficult problem to fix.

Once we made the models and found the errors that needed to be addressed we were able to quickly resurvey and create more accurate data with great results. We didn't have to resurvey any other part of the terrain though, which was lucky. The area we did resurvey was a quick procedure and fixing this problem was also not too hard.

Selecting the Spline model was a easy pick due to its smoothness, especially compared to the other interpolation methods. Our terrain was very smooth however and other group's terrains might have needed something with more sharp or jagged looking surfaces.

Conclusion

In this exercise we were able to use our critical thinking skills and problem solving skills to fix any problems that we had such as the formatting of the data, resurveying the terrain and the choosing of the best interpolation technique.

This exercise showed us the importance of resolution and the needed for higher resolution when dealing with complex features. It is important to know what resolution is needed for certain projects once we enter our careers because you don't want to waste money on high resolution when it's not needed and you don't want to have inaccurate data with too low of resolution.

This exercise was a fun challenge that utilized our ability to circumvent problems and improve our accuracy in data collection and model building as well as knowing what resolution to use in certain places.

Sources

1. Interpolation technique descriptions provided by ArcGIS 10.2.2 Help.