National Scale Rainfall Map Based on Linearly Interpolated Data from Automated Weather Stations and Rain Gauges I

J Alconis a,b, C Mongaya a,c, IL Saddi a, RN Eco a,d, KG Figueroa e , AMF Lagmay a,d

a Nationwide Operational Assessment of Hazards, Department of Science and Technology, Philippines
b Geodetic Engineering Department, College of Engineering, University of the Philippines Diliman
c Graduate Studies Journalism Department, College of Mass Communication, University of the Philippines Diliman
d National Institute of Geological Sciences, College of Science, University of the Philippines Diliman
e Computer Science Department, College of Engineering, University of the Philippines Diliman

Abstract

In response to the slew of disasters that devastate the Philippines on a regular basis, the national government put in place a program to address this problem. The Nationwide Operational Assessment of Hazards, or Project NOAH, consolidates the diverse scientific research being done and pushes the knowledge gained to the forefront of disaster risk reduction and management. Current activities of the project include installing rain gauges and water level sensors, conducting LIDAR surveys of critical river basins, geo-hazard mapping, and running information education campaigns. Approximately 700 automated weather stations and rain gauges installed in strategic locations in the Philippines hold the groundwork for the rainfall visualization system in the Project NOAH web portal at http://noah.dost.gov.ph. The system uses near real-time data from these stations installed in critical river basins. The sensors record the amount of rainfall in a particular area as point data updated every 15 minutes. The sensor sends the data to a central server either via GSM network or satellite data transfer, for redundancy. The web portal displays the sensors as a placemarks layer on a map. When a placemark is clicked, it displays a graph of the rainfall data for the past 24 hours. The rainfall data is harvested by batch determined by a one-hour time frame. The program uses linear interpolation as the methodology implemented to visually represent a near real-time rainfall map. The algorithm allows very fast processing which is essential in near real-time systems. As more sensors are installed, precision is improved. This visualized dataset enables users to quickly discern where heavy rainfall is concentrated. It has proven invaluable on numerous occasions, such as last August 2013 when intense to torrential rains brought about by the enhanced Southwest Monsoon caused massive flooding in Metro Manila. Coupled with observations from Doppler imagery and water level sensors along the Marikina River, the local ocials used this information and determined that the river would overflow in a few hours. It gave them a critical lead time to evacuate residents along the floodplain and no casualties were reported after the event.

1. Introduction
Until recently, researchers and the general public have had limited access to updated rainfall data. In addition, published weather advisories are usually limited to generalized descriptions of atmospheric conditions that are of little use, if at all any, to the public. E orts to show near-real time rainfall data through automated rain gauges have proven invaluable, however, spatial representation of point data can be limited. To address this, we take advantage of the automated sensors distributed across the country and use these data to generate an approximation of the spatial extent of a particular rainfall event.

2. Methodology
This section presents the methodologies used to arrive at a rainfall map of the country. The whole system is subdivided into two processes: (a) data collection from the sensors, and (b) interpolation proper and post processing. Figure 1 shows a flow diagram of sensor data collection. Automated rain gauges and weather stations installed in strategic locations all over the country (Figure 2) record the amount of rainfall measured by the number of tips of the device. A tip may be equivalent to one millimeter of rain or one inch of rain over a 15-minute period depending on the size of the tip installed within the sensor. Sensors send data through a GSM gateway by default to a flat MySQL database as a temporary repository of the message in raw format. As redundancy during extreme weather events which can possibly take the network down, the message is sent from the sensor via satellite through an SMTP gateway to the MySQL database. The MySQL database serves as a temporary receiver of all data sent from the sensors. An SMS parser processes the data and pushes it to a relational PostgreSQL database. Rain gauge readings are converted from tips to millimeters of rain if applicable. The parser also converts particular data such as station pres-
sure to atmospheric pressure values when station elevation is present. An external repository site archives the data as comma-separated values for each sensor per day. The archived data is then harvested to be used for interpolation.

n1

Sensors are distributed to all local government units upon approval of prospective sites for installation from the national weather bureau, PAGASA (Philippine Atmospheric, Geophysical and Astronomical Services Administration). These point data, however, are valid only for the sites the sensors are installed in. Interpolation of these point data to approximate values on a continuous area is therefore applied. Interpolation is a mathematical function that estimates the values at locations where no measured values are available [1]. The computation considers spatial attributes substantially. This spatial dependency indicates that at a point, the area close to it is likely to have similar values. As we move farther from the point, the values drift apart.

n2

 A fast interpolation algorithm is essential to create the output rainfall map under a ten-minute interval for near real-time streaming. It should also consider the large and still growing input dataset of more than 1,000 sensors to the system. We use linear interpolation to satisfy both conditions. To implement the algorithm, we use the SciPy library written in Python programming language. It is an open source software package for scientific computing. Figure 3 shows the flow diagram of the system. The program takes as input the location coordinates and array of rainfall values of each sensor. Values are then interpolated to produce a contour map of the area. The distance between sensors are also considered in the interpolation. An acceptable distance between two sensors is also an input to the program. This disregards one sensor if another is less than the acceptable distance each other with similar values to disregard.

n3

The color values are based on PAGASA’s rainfall intensity color code (Table 1). The contour map is then intersected by the country’s coastline shape. Edge blurring is performed next to address minimal boundary discrepancies between the base map and the coastline data. Finally, the annotation is added to the image. Details such as the number of stations included in the interpolation and the date and time of last update are indicated.

n4

An output rainfall map (Figure 4) shows torrential rains in Panay and Negros islands over a three-hour period. Local government units are advised to monitor water levels using automated stream gauges installed along bridges in major rivers in the area.

n5

In Figure 5, the Rainfall Contour item under the OVERVIEW tab and the Stream Gauges item under the WEATHER STATIONS tab are checked. Image transparency is set automatically to 50 percent in the Project NOAH web portal to reveal terrain and critical area information. The upper watershed of the Cagayan de Oro River Basin experienced torrential rainfall as shown in the map. The user can then click on the stream gauges installed to monitor increase in water level, which may result to floods.

n6

3. Successful Utilization of the NOAH Website
On December 4, 2012, Typhoon Bopha (local name Pablo), a Category 5 typhoon, made landfall in Mindanao, south of the Philippines. PAGASA warned that the typhoon is one of the
strongest to make landfall in the Philippines that year, and the brunt of the rainfall will be in the northern part of Mindanao, including Cagayan de Oro City. [2] Cagayan de Oro City is one of the highly-urbanized cities in Mindanao, with a population of more than 600,0000 residents [3]. The city has barely recovered from the devastating Typhoon Washi (local name Sendong) the year before, which resulted to 674 fatalities in the city alone. [4] Bracing for yet another impending disaster, the local disaster risk reduction oce of Cagayan de Oro City monitored the volume of rainfall through the rainfall contour and noticed the intense-torrential raining in the Cagayan de Oro upper watershed. The automated rain gauges and automated stream gauges which are installed in strategic locations within the watershed areas in the region showed an exponential rise in the rainfall volume. When Typhoon Bopha made landfall in the upper watershed area of Cagayan de Oro River in Bukidnon, the volume of rainfall and water level were monitored by the disaster management ocers and the local government units through the NOAH website.

On December 4, 2014, at 12:50 PM, a sudden rise of water level in Bubunawan Bridge, Bukidnon was reported by the automated stream gauge in the area. The 7.65-meter increase reflected on the website in near real-time (Figure 6). The researchers of Project NOAH immediately called the local authorities to warn them of imminent flooding in the Cagayan de Oro River. Just in time, the LDRRM ocers also monitored the NOAH website, and had already ordered the evacuation of residents living in low-lying areas along the Cagayan de Oro River. With the data provided by the sensors, the local government unit and the disaster ocers were empowered by the information, which helped them save their communities. The early warning system was e ectively utilized in the community, resulting to zero casualties in Cagayan de Oro City during Typhoon Bopha. Cagayan de Oro City was spared from yet another disaster trauma and since then, they have continued rebuilding their communities and their lives.

n7

The city of Marikina, located in the eastern part of Metro Manila, is among the most flooded cities in the metro where casualties are often anticipated. With more than 400,000 residents [5], their exposure and vulnerability to flood hazards is heightened by the meandering Marikina River which flows through the heart of the city. The Marikina River system easily overflows especially after incessant and heavy rains. Marikina City had its fair share of disasters, from Typhoon Ketsana (local name Ondoy) which a ected 15,600 residents
and the Habagat (Southwest Monsoon) in 2012 and 2013 which resulted to more than 100 casualties. On August 17, 2013, Typhoon Trami (local name Maring) made landfall in Metro Manila. PAGASA warned the city to expect heavy to intense rains and prepare for possible flash floods. As Trami made landfall, the rainfall contour in the NOAH website indicated heavy to intense rains in the Upper Marikina Watershed.

The City Disaster Risk-Reduction Oce (CDRRMO) in Marikina then prepared for the evacuation of residents in low-lying areas and those living along the Marikina River, especially in the villages of Nangka and Tumana. The CDRRMO monitored the water level in Marikina River through the NOAH website and shared these information to the public through social media. As the stream gauges showed continuous rise in water level, the CDRRMO ordered for the emergency evacuation of residents and communicated the necessary response to the communities vulnerable to the flood. The local government aptly coordinated the preparation and response to the impending disaster, before the flood reached them. With the active monitoring of the rainfall amount and water level from the accurate data streamed by the sensors to the NOAH website, Marikina City had zero casualty when the typhoon hit them. Project NOAH’s role in achieving zero-casualty in Marikina City was reported in the media after the typhoon waned. Paul Sison, the public information ocer in Marikina City said in media interviews that without Project NOAH, they would not have comprehensively coordinated preparedness and response mechanisms in their community. ”Without NOAH, you don’t know what to expect,” Sison said in an interview with the Philippine Daily Inquirer after the typhoon. [6]

4. Conclusions and Recommendations
A runtime assessment of the algorithm implemented for the interpolation process is performed on a server with specifications as seen on Table 2. The actual server has the same specifications.

n8

Table 3 and Figure 7 show the results of the assessment. The number of sensors included in the interpolation were determined randomly. Column 1 in Table 3 shows the runtime or the execution time of the program starting from sensor data parsing, actual linear interpolation, to post-processing of the rainfall map. Column 2 shows the number of sensors actually used for the test runs. The program removes particular sensor data in the computation that are not updated. The third column shows the intended number of sensors to be included in the run.

n9

Figure 7 shows the linear trend when the number of sensors included was increased for each run. Note, however, that a decrease in runtime was also observed when 378 and 435 sensors
were included in the runs. One reason is due to the program’s exclusion of particular sensors that are below the acceptable distance.

n10

The system has been used as a very e ective early warning system to flood-prone communities as discussed in the previous section. However, it is equally important to ensure the validity, accuracy, and timeliness of the output. Recommendations and corresponding course of action are discussed hereafter to improve the systems overall implementation and enhancement of communication channels.

The Law of Large Number dictates that having a large set of observations will make the set closer to its expected value. The error in sensor values is proportional to the distance of the sensors or data points from each other, and as the distance between the sensors decreases, theoretically, there is less error in the interpolation. It is therefore recommended that more sensors be deployed in the country. Another phase of the sensor deployment project is ongoing and will be completed by 2016. A dense sensor network is expected to cover critical locations as approved by the national weather bureau. Tweaking the input parameters is also recommended to improve accuracy. The Philippines, with its highly variable topography and tropical climate, receives rainfall which varies from 965 to 4,064 millimeters annually (http://kidlat.pagasa.dost.gov.ph/cab/climate.htm). Studies suggest adding the elevation as an input parameter to the interpolation, which is also an important factor in rainfall distribution. In a research and development study by Hofierka et al. [7] on precipitation interpolation, the incorporation of terrain improved their spatial model in terms of its predictive error and spatial pattern. The approach was implemented using datasets from Switzerland and Slovakia.
Having a dense sensor dataset and adding additional input parameters also equate to an increase in runtime due to the amount of data to be processed. To address this, the following options may be explored:
a). Higher server specifications especially processing power can significantly decrease runtime.
b). Decreasing sensor data communication time to the servers can improve network latency. This can also be reduced by removing the temporary flat database.
c). Using a di erent programming language and native libraries may be explored and compared with the existing implementation of the interpolation algorithm. For instance, R is a highly extensible language and environment for statistical computing and graphical representation. Finally, a comparison of results with other rainfall maps in the Philippines is needed to ensure that the methodology employed is accurate. Data on rainfall intensity detected by several Doppler radars deployed in di erent parts of the country may also be used to assess the accuracy of the rainfall maps visually.

References

[1] S. Anderson, An evaluation of spatial interpolation methods on air temperature in Phoenix, Arizona State.

[2] O. G. of the Republic of the Philippines, E ects of typhoon pablo ndrrmc, Online, accessed at: http://www.gov.ph/2012/12/14/situation-report-on-the-e ects-of-typhoon-pablo-ndrrmc-december-14-2012-as-of-7-a-m/.

[3] PSA, National statistical coordination board, Online, accessed at: http://bit.ly/1hJHp1v.

[4] NDRRMC, Final report on the e ects and emergency management re tropical storm sendong (washi), Online, accessed at: http://www.ndrrmc.gov.ph/attachments/article/358/Final(February 2012).

[5] PSA, National statistical coordination board, Online, accessed at: http://bit.ly/1oLrvZg.

[6] K. Mangunay, Marikina: ’noah’ helped save lives, Online, accessed at: http://newsinfo.inquirer.net/475287/marikina-noah-helped-save-lives.

[7] J. Hofierka, J. Parajka, H. Mitasova, L. Mitas, Multivariate interpolation of precipitation using regularized spline with tension. transactions in GIS, in E. Gruntfest and J. Handmer, eds., Coping with Flash floods, Kluwer Academic Publishers (2002) 135–150.

2 Comments:

  1. pls help me find the flood, landslide and storm surge maps of the municipality of sibunag, guimaras, western visayas.thank you

    • Hi,

      You may visit: beta.noah.dost.gov.ph
      Using the left menu toolbar choose the Storm Surge, Landslide or Flood icons and then populate Region, Province, and municipality to load the said hazard maps

Leave a Reply

Your email address will not be published. Required fields are marked *

83 + = eighty nine