Processing large dataset - best file format and parallel performance


I use my own FORTRAN code to do CFD simulations which generate large datasets (> 40 million grid points) on a rectilinear grid. What is the best data format to write my postprocessing files? I have tried VTK but that is quite slow.

Also, the cluster I use provides a native installation of paraView which can be accessed through a virtual desktop. How do I ensure that paraview is using all the cores (I can access about 48 cores at a time for paraView)?


Hi Sushrut,

You need to read about distributed processing: 7. Remote and parallel visualization — ParaView Documentation 5.10.0 documentation