HPC and Big Data Technologies for Global Challenges

Hidalgo brings together the HPC, HPDA and Global Challenges communities in order to bridge the gap between traditional HPC and Data-centric Computation.

HiDALGO focuses on excellent simulations of Global Challenges and in particular, the integration of different problem statements in order to establish a sustainable Centre of Excellence, especially for future problem statements. It advances the proposed technology of the CoeGSS  project in any sense, builds on innovative agent-based simulation packages, such as AMOS or RepastHPC and integrates them with the state-of-the-art data analytics tools (e.g. Apache Spark, Apache Flink or Apache Hadoop) and the mighty Vistle many-core visualisation platform.

Essentially, HiDALGO relies on coupled simulations, which are common in the engineering sector. By applying a series of dependent simulations at once, distinct problem statements can be analysed, which represents the only way to address the dependencies of the input parameters. Furthermore, real-world sensor data from the Internet of Things world, such as mobile phones, weather sensors or even camera data will be integrated in the simulations to improve the statistics-based input data by live information. Taking this approach, statistical errors can be minimised and the accuracy of simulations, especially for rapidly changing influencing factors, significantly increased.

In pilot studies, HiDALGO will use the computing power of HPC systems to solve problems in three selected areas:

  • Migration - to predict the destinations of refugees escaping armed conflicts,
  • Urban air pollution - a real time, highly accurate application for urban air pollution simulation and evaluation according to hotspot analysis at street level
  • Message spreading in social networks - understanding the structure and dynamics that govern social networks and the processes therein, simulating the behaviour of these processes on a large scale and identification malicious and/or unusual types of postings/messages in these networks.


PSNC role in the project

As one of the technical core partners of the HiDALGO project, PSNC contributes to manifold tasks and work packages. In particular, PSNC leads WP3, which targets the developments of HPC and HPDA components for the Exascale era. Furthermore, PSNC supports the Pilot applications in WP4 and leads the task concerned with HPC technology innovation in order to bridge the gap between software-oriented optimisations and the hardware-oriented Co-Design activity. Finally, PSNC has been appointed as Quality Manager of HiDALGO.

Scheduled start date: 2018-12-01
Scheduled finish date: 2021-11-30
Status: current

Marcin Lawenda
ul. Jana Pawła II 10
61-139 Poznań, Poland
+48 61 858 2051