Building Paraview through spack

Has anyone ever installed paraview for off-screen GPU rendering through spack?
I’d love to learn how to do that and was unable to find documentation for the build parameters,
because

All I found was

1 Like

Sorry, I was going to comment, however my experience is with osmesa rendring, not off-screen GPU rendering.

I know we’ve been working on it but only for the new spack concretizer.
@Chuck Atkins What is the status of that work?

I have also been trying to build 5.11 with spack for Cray systems, where no X windows is available. My current cmake flags (working and already installed in production) use, for GPU systems

-DVTK_OPENGL_HAS_EGL=ON -DVTK_USE_X=OFF 

or for nodes without GPUs

-DVTK_OPENGL_HAS_OSMESA=ON -DVTK_USE_X=OFF -DOPENGL_gl_LIBRARY= -DOPENGL_glu_LIBRARY= 

Now the current paraview package on the spack repo does not include any VTK_OPENGL_HAS_EGL option. Is that in the works?

Currently Spack does not support the EGL frontend. This is something that has been asked for a couple of times but required changes to how Spack handled OpenGL frontend/backend. These changes have started, but adding EGL support requires additional work to get it working correctly across numerous packages.

A spec you could try that I have used before, it is assuming that you are only building ParaView and nothing else.

spack install "paraview +osmesa ~qt 
  ^mesa +osmesa +llvm
    ^llvm ~clang ~flang ~lldb ~lld ~libcxx ~gold +llvm_dylib"

The best that is currently available is OSMesa. If you use this backend you will also want to specify mesa +osmesa +llvm. The LLVM extensions provide needed acceleration to make CPU rendering tolerable.

To help speed up the LLVM build, you should turn off most of the stuff it tries to provide. I have used llvm ~clang ~flang ~lldb ~lld ~libcxx ~gold +llvm_dylib

Hi Ryan, I know I have succeeded with your tips in the past but this time on 5.13.1 I am getting

spack install "paraview +osmesa ~qt 
  ^mesa +osmesa +llvm
    ^llvm ~clang ~flang ~lldb ~lld ~libcxx ~gold +llvm_dylib"
==> Error: No such variant {'osmesa'} for spec: 'paraview+osmesa~qt ^llvm~clang~flang~gold~libcxx~lld~lldb+llvm_dylib ^mesa+llvm+osmesa

I am trying this is sub-steps as well

spack install mesa +osmesa ~qt
==> Error: No such variant {'qt'} for spec: 'mesa+osmesa~qt'

but one step lower does work

spack install mesa +osmesa

succeeds but it looks like the paraview through spack does not support mesa???

spack info paraview
CMakePackage:   paraview

Description:
    ParaView is an open-source, multi-platform data analysis and
    visualization application. This package includes the Catalyst in-situ
    library for versions 5.7 and greater, otherwise use the catalyst
    package.

Homepage: https://www.paraview.org

Preferred version:  
    5.13.1    http://www.paraview.org/files/v5.13/ParaView-v5.13.1.tar.xz

Safe versions:  
    master    [git] https://gitlab.kitware.com/paraview/paraview.git on branch master
    5.13.1    http://www.paraview.org/files/v5.13/ParaView-v5.13.1.tar.xz
    5.13.0    http://www.paraview.org/files/v5.13/ParaView-v5.13.0.tar.xz
    5.12.1    http://www.paraview.org/files/v5.12/ParaView-v5.12.1.tar.xz
    5.12.0    http://www.paraview.org/files/v5.12/ParaView-v5.12.0.tar.xz
    5.11.2    http://www.paraview.org/files/v5.11/ParaView-v5.11.2.tar.xz
    5.11.1    http://www.paraview.org/files/v5.11/ParaView-v5.11.1.tar.xz
    5.11.0    http://www.paraview.org/files/v5.11/ParaView-v5.11.0.tar.xz
    5.10.1    http://www.paraview.org/files/v5.10/ParaView-v5.10.1.tar.xz
    5.10.0    http://www.paraview.org/files/v5.10/ParaView-v5.10.0.tar.xz
    5.9.1     http://www.paraview.org/files/v5.9/ParaView-v5.9.1.tar.xz
    5.9.0     http://www.paraview.org/files/v5.9/ParaView-v5.9.0.tar.xz
    5.8.1     http://www.paraview.org/files/v5.8/ParaView-v5.8.1.tar.xz
    5.8.0     http://www.paraview.org/files/v5.8/ParaView-v5.8.0.tar.xz
    5.7.0     http://www.paraview.org/files/v5.7/ParaView-v5.7.0.tar.xz
    5.6.2     http://www.paraview.org/files/v5.6/ParaView-v5.6.2.tar.xz
    5.6.0     http://www.paraview.org/files/v5.6/ParaView-v5.6.0.tar.gz
    5.5.2     http://www.paraview.org/files/v5.5/ParaView-v5.5.2.tar.gz
    5.5.1     http://www.paraview.org/files/v5.5/ParaView-v5.5.1.tar.gz
    5.5.0     http://www.paraview.org/files/v5.5/ParaView-v5.5.0.tar.gz
    5.4.1     http://www.paraview.org/files/v5.4/ParaView-v5.4.1.tar.gz
    5.4.0     http://www.paraview.org/files/v5.4/ParaView-v5.4.0.tar.gz
    5.3.0     http://www.paraview.org/files/v5.3/ParaView-v5.3.0.tar.gz
    5.2.0     http://www.paraview.org/files/v5.2/ParaView-v5.2.0.tar.gz
    5.1.2     http://www.paraview.org/files/v5.1/ParaView-v5.1.2.tar.gz
    5.0.1     http://www.paraview.org/files/v5.0/ParaView-v5.0.1-source.tar.gz
    4.4.0     http://www.paraview.org/files/v4.4/ParaView-v4.4.0-source.tar.gz

Deprecated versions:  
    None

Variants:
    advanced_debug [false]           false, true
        Enable all other debug flags beside build_type, such as VTK_DEBUG_LEAK
    build_edition [canonical]        canonical, catalyst, catalyst_rendering,
                                     core, rendering
        Build editions include only certain modules. Editions are listed in
        decreasing order of size.
    build_system [cmake]             cmake
        Build systems supported by the package
    cdi [false]                      false, true
        Enable CDI support
    cuda [false]                     false, true
        Build with CUDA
    development_files [true]         false, true
        Install include files for Catalyst or plugins support
    examples [false]                 false, true
        Build examples
    eyedomelighting [false]          false, true
        Enable Eye Dome Lighting feature
    fortran [false]                  false, true
        Enable Fortran support
    hdf5 [false]                     false, true
        Use external HDF5
    kits [true]                      false, true
        Use module kits
    mpi [true]                       false, true
        Enable MPI support
    nvindex [false]                  false, true
        Enable the pvNVIDIAIndeX plugin
    opengl2 [true]                   false, true
        Enable OpenGL2 backend
    pagosa [false]                   false, true
        Build the pagosa adaptor
    qt [false]                       false, true
        Enable Qt (gui) support
    raytracing [false]               false, true
        Enable Raytracing support
    rocm [false]                     false, true
        Enable ROCm support
    shared [true]                    false, true
        Builds a shared version of the library
    tbb [false]                      false, true
        Enable multi-threaded parallelism with TBB
    use_vtkm [default]               default, off, on
        Build VTK-m with ParaView by setting PARAVIEW_USE_VTKM=ON,OFF.
        "default" lets the build_edition make the decision. "on" or "off" will
        always override the build_edition.
    visitbridge [false]              false, true
        Enable VisItBridge support

    when +rocm
      amdgpu_target [none]           none, gfx1010, gfx1011, gfx1012, gfx1013,
                                     gfx1030, gfx1031, gfx1032, gfx1033,
                                     gfx1034, gfx1035, gfx1036, gfx1100,
                                     gfx1101, gfx1102, gfx1103, gfx701,
                                     gfx801, gfx802, gfx803, gfx900,
                                     gfx900:xnack-, gfx902, gfx904, gfx906,
                                     gfx906:xnack-, gfx908, gfx908:xnack-,
                                     gfx909, gfx90a, gfx90a:xnack+,
                                     gfx90a:xnack-, gfx90c, gfx940, gfx941,
                                     gfx942
          AMD GPU architecture

    when +cuda
      cuda_arch [none]               none, 10, 11, 12, 13, 20, 21, 30, 32, 35,
                                     37, 50, 52, 53, 60, 61, 62, 70, 72, 75,
                                     80, 86, 87, 89, 90, 90a
          CUDA architecture

    when build_system=cmake
      build_type [Release]           Debug, MinSizeRel, RelWithDebInfo,
                                     Release
          CMake build type
      generator [ninja]              none
          the build system generator to use

    when build_system=cmake ^cmake@3.9:
      ipo [false]                    false, true
          CMake interprocedural optimization

    when @5.6:
      python [false]                 false, true
          Enable Python support

    when @5.8:
      adios2 [false]                 false, true
          Enable ADIOS2 support

    when @5.9:
      fides [false]                  false, true
          Enable Fides support

    when @5.9:+python
      openpmd [false]                false, true
          Enable openPMD support (w/ ADIOS2/HDF5)

    when @5.7:
      catalyst [false]               false, true
          Enable Catalyst 1

    when @5.10:
      libcatalyst [false]            false, true
          Enable Catalyst 2 (libcatalyst) implementation

Build Dependencies:
    adios2             freetype      libcatalyst  netcdf-c          py-mpi4py
    boost              gl            libogg       ninja             py-numpy
    bzip2              glew          libpng       nlohmann-json     python
    cdi                gmake         libtheora    openimagedenoise  python-venv
    cli11              hdf5          libtiff      openpmd-api       qt
    cmake              hip           libxml2      ospray            silo
    cuda               hsa-rocr-dev  libxt        pegtl             tbb
    double-conversion  jpeg          llvm-amdgpu  proj              xz
    eigen              jsoncpp       lz4          protobuf          zlib-api
    expat              kokkos        mpi          pugixml

Link Dependencies:
    adios2             freetype      libcatalyst  mpi               qt
    boost              gl            libogg       netcdf-c          silo
    bzip2              glew          libpng       nlohmann-json     tbb
    cdi                hdf5          libtheora    openimagedenoise  xz
    cli11              hip           libtiff      ospray            zlib-api
    cuda               hsa-rocr-dev  libxml2      pegtl
    double-conversion  jpeg          libxt        proj
    eigen              jsoncpp       llvm-amdgpu  protobuf
    expat              kokkos        lz4          pugixml

Run Dependencies:
    openpmd-api    py-mpi4py  py-pandas  python-venv
    py-matplotlib  py-numpy   python

Licenses: 
    Apache-2.0
```