2021 HDF5 Users Group - October 13, 2021
[ Ссылка ]

Many pre-exascale systems have a fast storage layers, such as node-local SSDs, burst buffer, etc. We developed an external HDF5 VOL connector, Cache VOL, for caching data on the fast storage layer to improve the parallel I/O efficiency. The data transfer between the fast storage layer and the parallel file system is performed asynchronously through the Async VOL, which allows hidden the I/O cost behind the compute. All the complexity is hidden inside the library. Existing HDF5 applications can use the Cache VOL with minimal code modifications. Cache VOL is useful for applications with heavy check-pointing I/O or with intensive repeated read.

свернуть