Keywords

Big Data; TensorFlow; Spatio-temporal simulation; distributed computing; scalability

Start Date

25-6-2018 3:40 PM

End Date

25-6-2018 5:00 PM

Abstract

The recent technological advances in massive geospatial data collection assessing both the temporal and spatial dimensions of data add significant complexity to the data analysis process, provides new dimensions for data interpretation. Accordingly, geographical information systems (GIS) must evolve to represent, access, analyze and visualize big spatiotemporal data in a scalable integrated way. Often, sharing and transferring of such information through deep-dive and automated analysis cause scalability challenges at the software level that impacts the overall performance, throughput, and other performance parameters. In this paper, we demonstrated the whole implementation explaining some practical steps to scale solar irradiation calculations for entire cities at very high space-time resolution by using scalable tensor data structure and inherent parallelism offered by data-flow based implementation. We attempt to improve the understanding of the underlying equations and data structures from an analytical, a geometric and a dynamical systems perspective. The entire model is implemented in Tensorflow, an open source software library developed by the Google Brain Team using data flow graphs and the tensor data structure. To assess the performance and accuracy of our TensorFlow based implementation we compared to the well known r.sun from GRASS GIS and PVLIB from National Renewable Energy Laboratories (USA) implementation for solar irradiation simulations. Results show that we achieved noticeable and significant improvements in overall performance keeping accuracy at negligible differences.

Stream and Session

Session A1: Towards More Interoperable, Reusable and Scalable Environmental Software

Share

COinS
 
Jun 25th, 3:40 PM Jun 25th, 5:00 PM

Solar Energy Potential Assessment for entire Cities - a reusable and scalable approach

The recent technological advances in massive geospatial data collection assessing both the temporal and spatial dimensions of data add significant complexity to the data analysis process, provides new dimensions for data interpretation. Accordingly, geographical information systems (GIS) must evolve to represent, access, analyze and visualize big spatiotemporal data in a scalable integrated way. Often, sharing and transferring of such information through deep-dive and automated analysis cause scalability challenges at the software level that impacts the overall performance, throughput, and other performance parameters. In this paper, we demonstrated the whole implementation explaining some practical steps to scale solar irradiation calculations for entire cities at very high space-time resolution by using scalable tensor data structure and inherent parallelism offered by data-flow based implementation. We attempt to improve the understanding of the underlying equations and data structures from an analytical, a geometric and a dynamical systems perspective. The entire model is implemented in Tensorflow, an open source software library developed by the Google Brain Team using data flow graphs and the tensor data structure. To assess the performance and accuracy of our TensorFlow based implementation we compared to the well known r.sun from GRASS GIS and PVLIB from National Renewable Energy Laboratories (USA) implementation for solar irradiation simulations. Results show that we achieved noticeable and significant improvements in overall performance keeping accuracy at negligible differences.