Parallel I/O and management of large scientific data

Monday, 5 June 2017 (All day) to Wednesday, 7 June 2017 (All day)

This course is in Italian.

Description:

The growing availability and power of computing resources, has led in recent years to the production of a huge amount of data. However, writing to disk results of numerical simulations is a serious bottleneck in high-performance computing. Moreover, sometimes data are stored without a specific organization or format, making them no portable neither accessible on other resources, severely limiting their use.

Thus, today issues are both the choice of the best way to write and to read data taking into account of the hardware resources available, like bandwidth and the filesystem's properties; and the choice of the better techniques to write and to read data in order to obtain portable and accessible data.

Aim of this course is to introduce the basis for the usage of the MPI-2 I/O library for binary data, and HDF5 one of the most used standard data formats, that allow for data writing and reading in an organized, efficiency and portable way

Some note about the hardware features affecting the I/O performance are also provided.

Topics: 

Managment of large scientific data. I/O: basic concepts. Parallel file I/O with MPI2. HDF5 library.

Target audience: 

Students and researchers of any scientific field, interested in improving their knowledge in production and managment of scientific data.

Pre-requisites: 

Experience with Linux operating systems. Knowledge and experience of Fortran, C, or C++. Knowledge and experience of MPI
 

Target: 
Companies
Research Institutions
Universities
Area: 
Data
Length: 
3 dd

Next courses

Any question?

For HPC and computer graphics courses, write to corsi.hpc@cineca.it

About CINECA

Cineca is a non profit Consortium, made up of 70 Italian universities, 5 Italian Research Institutions and the Italian Ministry of Education.

Today it is the largest Italian computing centre, one of the most important worldwide. With more seven hundred employees, it operates in the technological transfer sector through high performance scientific computing, the management and development of networks and web based services, and the development of complex information systems for treating large amounts of data.

It develops advanced Information Technology applications and services, acting like a trait-d'union between the academic world, the sphere of pure research and the world of industry and Public Administration. .

Visit the Cineca website