# Processing large dataset - best file format and parallel performance

**URL:** https://discourse.paraview.org/t/processing-large-dataset-best-file-format-and-parallel-performance/10746
**Category:** ParaView Support
**Created:** [November 14, 2022, 8:13am UTC](https://discourse.paraview.org/t/processing-large-dataset-best-file-format-and-parallel-performance/10746 "2022-11-14T08:13:15Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![Sushrut\_Kumar](https://discourse.paraview.org/user_avatar/discourse.paraview.org/sushrut_kumar/32/10375_2.png) [@Sushrut\_Kumar](https://discourse.paraview.org/u/Sushrut_Kumar)
#### Post date: [November 14, 2022, 8:13am UTC](https://discourse.paraview.org/t/processing-large-dataset-best-file-format-and-parallel-performance/10746/1 "2022-11-14T08:13:15Z")

</div>

Hi,

I use my own FORTRAN code to do CFD simulations which generate large datasets (\> 40 million grid points) on a rectilinear grid. What is the best data format to write my postprocessing files? I have tried VTK but that is quite slow.

Also, the cluster I use provides a native installation of paraView which can be accessed through a virtual desktop. How do I ensure that paraview is using all the cores (I can access about 48 cores at a time for paraView)?

Thanks

---

<div class="post-metadata">

### Author: ![mwestphal](https://discourse.paraview.org/user_avatar/discourse.paraview.org/mwestphal/32/17_2.png) [@mwestphal](https://discourse.paraview.org/u/mwestphal)
#### Post date: [November 14, 2022, 8:14am UTC](https://discourse.paraview.org/t/processing-large-dataset-best-file-format-and-parallel-performance/10746/2 "2022-11-14T08:14:31Z")

</div>

Hi Sushrut,

You need to read about distributed processing: [7. Remote and parallel visualization — ParaView Documentation 5.10.0 documentation](https://docs.paraview.org/en/latest/ReferenceManual/parallelDataVisualization.html)

Best,