{"id":1425,"date":"2015-04-20T10:06:59","date_gmt":"2015-04-20T17:06:59","guid":{"rendered":"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/?p=1425"},"modified":"2015-04-20T12:02:15","modified_gmt":"2015-04-20T19:02:15","slug":"nasa-vs-noaa-part-i-using-hot-spot-statistics-and-spatial-autocorrelation-to-measure-differences-in-temperature-readings","status":"publish","type":"post","link":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/2015\/04\/20\/nasa-vs-noaa-part-i-using-hot-spot-statistics-and-spatial-autocorrelation-to-measure-differences-in-temperature-readings\/","title":{"rendered":"NASA vs. NOAA Part I: Using Hot-Spot Statistics and Spatial Autocorrelation to Measure Differences in Temperature Readings"},"content":{"rendered":"<p>As stated in previous posts, the goal of my project is to explore the difference between point-source temperature recordings at NOAA monitoring stations and the land surface temperature images made available daily from the NASA MODIS satellites. As a first step in comparing these datasets, hot-spot statistics and spatial autocorrelation were used to identify any areas where the difference between the data was significantly non-random. The steps below outline this process.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Data Selection and Cleaning<\/strong><\/p>\n<p>To begin exploring the data, I selected a single day (January 1, 2015) and linked the measurements from both sources into one shapefile. The NOAA data were downloaded as a CSV file from the NOAA National Climate Data Center (<a href=\"http:\/\/www.ncdc.noaa.gov\/\">http:\/\/www.ncdc.noaa.gov\/<\/a>). This data arrives as a mostly cleaned CSV and the only transformation required was to convert the temperature readings from tenths of a degree Celsius to degrees Celsius. The MODIS raster image was downloaded from the USGS Earth Explorer engine (<a href=\"http:\/\/earthexplorer.usgs.gov\/\">http:\/\/earthexplorer.usgs.gov\/<\/a>) and required some work before it could be used. The raster was re-projected from the unspecified cylindrical projection used for MODIS products to WGS84 to match the point shapefile using the \u2018Project Raster\u2019 tool in ArcGIS (<a title=\"(http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/00170000007q000000\" href=\"http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/00170000007q000000\">http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/00170000007q000000<\/a>).\u00a0 Once re-projected, the image then had to be re-scaled and converted from Kelvin to Celsius [OutRaster = ((InRaster * 0.02) \u2013 273.16)] before being used.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Joining the Data<\/strong><\/p>\n<p>Once both data sets were cleaned and ready to be used, the two were joined together for analysis. This was done using a custom Python script, however the \u2018Extract Values to Points\u2019 tool in ArcGIS (<a title=\"http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/009z0000002t000000.htm\" href=\"http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/009z0000002t000000.htm\">http:\/\/help.arcgis.com\/en\/arcgisdesktop\/10.0\/help\/index.html#\/\/009z0000002t000000.htm<\/a>) or QGIS completes the same task. The final shapefile contained a point for each monitoring station with fields for the NOAA and MODIS values along with the difference between the two represented as the absolute value of the MODIS value minus the NOAA value (Difference = |MODIS \u2013 NOAA|). This difference figure is what is used for the analysis.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Hot-Spot Map in ArcGIS<\/strong><\/p>\n<p>The next step was to create a hot-spot map of the difference figures to identify any areas of significantly greater or less difference. This was done using the \u2018Hot Spot Analysis\u2019 tool in ArcGIS (<a title=\"http:\/\/resources.arcgis.com\/en\/help\/main\/10.1\/index.html#\/\/005p00000010000000\" href=\"http:\/\/resources.arcgis.com\/en\/help\/main\/10.1\/index.html#\/\/005p00000010000000\">http:\/\/resources.arcgis.com\/en\/help\/main\/10.1\/index.html#\/\/005p00000010000000<\/a>). In the image below, we can see that there is an area of greater difference in central Oregon and an area of less difference near Portland.<\/p>\n<p><a href=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/hotspot.png\"><img loading=\"lazy\" decoding=\"async\" class=\" size-medium wp-image-1427 aligncenter\" src=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/hotspot-300x160.png\" alt=\"hotspot\" width=\"300\" height=\"160\" srcset=\"https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1572\/files\/2015\/04\/hotspot-300x160.png 300w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1572\/files\/2015\/04\/hotspot-1024x546.png 1024w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1572\/files\/2015\/04\/hotspot.png 1400w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>It is important to note that neither of these are significant, and most likely represent differences in the terrain. I suspect that the area of higher difference in central Oregon is due to the fact that fluctuations in temperature are much greater there than in the valley. Furthermore, the temperature in the area of less difference is more stable and therefore would not be as prone to error. It is important to remember that the NOAA data represent daily temperature averages, while the MODIS data represent the land surface temperature at the specific time when the image was taken. To explore this idea further, future analysis will include some variable to account for location or land-use type.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Spatial Autocorrelation<\/strong><\/p>\n<p>Finally, the Moran\u2019s I statistic was calculated to further explore if there is any significant spatial autocorrelation in the difference measurements. This was done using the \u2018Spatial Autocorrelation\u2019 tool in ArcGIS (<a href=\"http:\/\/resources.arcgis.com\/en\/help\/main\/10.1\/index.html#\/\/005p0000000n000000\">http:\/\/resources.arcgis.com\/en\/help\/main\/10.1\/index.html#\/\/005p0000000n000000<\/a>). The output is shown below:<\/p>\n<p><a href=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/modis_moransi.png\"><img loading=\"lazy\" decoding=\"async\" class=\" size-medium wp-image-1428 aligncenter\" src=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/modis_moransi-300x273.png\" alt=\"modis_moransi\" width=\"300\" height=\"273\" srcset=\"https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1572\/files\/2015\/04\/modis_moransi-300x273.png 300w, https:\/\/osu-wams-blogs-uploads.s3.amazonaws.com\/blogs.dir\/1572\/files\/2015\/04\/modis_moransi.png 540w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/moransi_value.png\"><img loading=\"lazy\" decoding=\"async\" class=\" size-full wp-image-1429 aligncenter\" src=\"http:\/\/blogs.oregonstate.edu\/geo599spatialstatistics\/files\/2015\/04\/moransi_value.png\" alt=\"moransi_value\" width=\"191\" height=\"65\" \/><\/a><\/p>\n<p>This statistic showed that there is no significant spatial autocorrelation. The combination of the very low Moran\u2019s I and the high P-value lead to the conclusion that the difference figures are randomly dispersed throughout the points.<\/p>\n<p>&nbsp;<\/p>\n<p>There are some areas in the map that have very high difference on this one day. The next step is to explore these data over a larger time frame to see if the pattern of the difference is the same or different. I plan to download data for at least a few days from each month of 2014 and explore the spatial pattern of the difference between each data set.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As stated in previous posts, the goal of my project is to explore the difference between point-source temperature recordings at NOAA monitoring stations and the land surface temperature images made available daily from the NASA MODIS satellites. As a first step in comparing these datasets, hot-spot statistics and spatial autocorrelation were used to identify any&hellip; <a href=\"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/2015\/04\/20\/nasa-vs-noaa-part-i-using-hot-spot-statistics-and-spatial-autocorrelation-to-measure-differences-in-temperature-readings\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":3462,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1425","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/posts\/1425","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/users\/3462"}],"replies":[{"embeddable":true,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/comments?post=1425"}],"version-history":[{"count":2,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/posts\/1425\/revisions"}],"predecessor-version":[{"id":1430,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/posts\/1425\/revisions\/1430"}],"wp:attachment":[{"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/media?parent=1425"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/categories?post=1425"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dev.blogs.oregonstate.edu\/geo599spatialstatistics\/wp-json\/wp\/v2\/tags?post=1425"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}