# Updates to Virtual Reality support in ParaView

**URL:** https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046
**Category:** Development
**Tags:** vr
**Created:** [June 14, 2019, 2:13pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046 "2019-06-14T14:13:26Z")
**Posts on this page:** 18
**Page:** 1

<div class="post-metadata">

### Author: ![martink](https://discourse.paraview.org/user_avatar/discourse.paraview.org/martink/32/2082_2.png) [@martink](https://discourse.paraview.org/u/martink)
#### Post date: [June 14, 2019, 2:13pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/1 "2019-06-14T14:13:26Z")

</div>

There have been some updates to the VR capabilities in ParaView that I wanted to share. They are still in early development but I have put up an executable [here](https://data.kitware.com/#item/5d0922c4676794a06e4cf623) if you would like to try them out. They include displaying parts of the PV GUI directly in VR, the ability to add points to a source using the controller in VR, and collaboration. I created a quick example video here to show what some of this looks like. It is not a fancy video, more of a live screen grab 🙂 Just wanted to get the idea across.

The changes to support this are merged into VTK (including putting Qt widgets into renderers) but not yet merged into PV. Over the next week or so I’ll try to get the PV changes merged in as well. There are rough edges etc so if you run into problems please feel free to let me know.

Thanks!  
Ken

---

<div class="post-metadata">

### Author: ![cory.quammen](https://discourse.paraview.org/user_avatar/discourse.paraview.org/cory.quammen/32/11193_2.png) [@cory.quammen](https://discourse.paraview.org/u/cory.quammen)
#### Post date: [June 14, 2019, 2:22pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/2 "2019-06-14T14:22:30Z")

</div>

Awesome stuff, Ken!

---

<div class="post-metadata">

### Author: ![Joachim\_Pouderoux](https://discourse.paraview.org/user_avatar/discourse.paraview.org/joachim_pouderoux/32/38_2.png) [@Joachim\_Pouderoux](https://discourse.paraview.org/u/Joachim_Pouderoux)
#### Post date: [June 14, 2019, 3:10pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/3 "2019-06-14T15:10:34Z")

</div>

Wow, this is really great!  
I like the principle of having the Qt GUI in the renderer opens a lot of opportunities.

---

<div class="post-metadata">

### Author: ![martink](https://discourse.paraview.org/user_avatar/discourse.paraview.org/martink/32/2082_2.png) [@martink](https://discourse.paraview.org/u/martink)
#### Post date: [June 18, 2019, 5:47pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/4 "2019-06-18T17:47:29Z")

</div>

Updated with a new executable from here [https://data.kitware.com/#item/5d0922c4676794a06e4cf623](https://data.kitware.com/#item/5d0922c4676794a06e4cf623)

The original executable would crash if you pressed some of the buttons before bringing up the PV VR gui.

---

<div class="post-metadata">

### Author: ![Aashish\_Chaudhary](https://discourse.paraview.org/user_avatar/discourse.paraview.org/aashish_chaudhary/32/300_2.png) [@Aashish\_Chaudhary](https://discourse.paraview.org/u/Aashish_Chaudhary)
#### Post date: [June 18, 2019, 5:56pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/5 "2019-06-18T17:56:20Z")

</div>

Looks great @martink. How is the GUI / QT rendered inside the rendered view?

---

<div class="post-metadata">

### Author: ![martink](https://discourse.paraview.org/user_avatar/discourse.paraview.org/martink/32/2082_2.png) [@martink](https://discourse.paraview.org/u/martink)
#### Post date: [June 18, 2019, 5:59pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/6 "2019-06-18T17:59:39Z")

</div>

Using the new vtkQWidgetWidget class in VTK (event handling). Which in turn uses a vtkQWidgetRepresentation which uses a vtkQWidgetTexture (the actual drawing). The basic gist is we share a texture between Qt and VTK. Qt paints the texture, VTK then renders it as part of the VR world.

This MR has the key pieces [https://gitlab.kitware.com/vtk/vtk/merge\_requests/5553/diffs](https://gitlab.kitware.com/vtk/vtk/merge_requests/5553/diffs)

---

<div class="post-metadata">

### Author: ![Aashish\_Chaudhary](https://discourse.paraview.org/user_avatar/discourse.paraview.org/aashish_chaudhary/32/300_2.png) [@Aashish\_Chaudhary](https://discourse.paraview.org/u/Aashish_Chaudhary)
#### Post date: [June 20, 2019, 2:38pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/7 "2019-06-20T14:38:43Z")

</div>

Nice thanks @martink it seems to work well. One caveat is that the QT UI might be too dense for the VR so perhaps we may need a custom interface for interactions in the VR environment.

---

<div class="post-metadata">

### Author: ![Jacob\_Boehnke](https://discourse.paraview.org/letter_avatar_proxy/v4/letter/j/0ea827/32.png) [@Jacob\_Boehnke](https://discourse.paraview.org/u/Jacob_Boehnke)
#### Post date: [June 25, 2019, 9:04am UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/8 "2019-06-25T09:04:58Z")

</div>

Those are awesome new features @martink !

Is it possible to trigger an animation from the VR-GUI?

---

<div class="post-metadata">

### Author: ![martink](https://discourse.paraview.org/user_avatar/discourse.paraview.org/martink/32/2082_2.png) [@martink](https://discourse.paraview.org/u/martink)
#### Post date: [June 25, 2019, 1:53pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/9 "2019-06-25T13:53:38Z")

</div>

Animation performance (and then exposing the GUI in VR) are definitely on the todo list for this summer/early fall.

---

<div class="post-metadata">

### Author: ![hdz19900725](https://discourse.paraview.org/user_avatar/discourse.paraview.org/hdz19900725/32/7157_2.png) [@hdz19900725](https://discourse.paraview.org/u/hdz19900725)
#### Post date: [June 26, 2019, 8:38am UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/10 "2019-06-26T08:38:52Z")

</div>

Nice work, Ken.

---

<div class="post-metadata">

### Author: ![Jacob\_Boehnke](https://discourse.paraview.org/letter_avatar_proxy/v4/letter/j/0ea827/32.png) [@Jacob\_Boehnke](https://discourse.paraview.org/u/Jacob_Boehnke)
#### Post date: [June 28, 2019, 8:34am UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/11 "2019-06-28T08:34:38Z")

</div>

Sounds great.

Will the VR-feature support clustering/CAVE in future again?

---

<div class="post-metadata">

### Author: ![bilke](https://discourse.paraview.org/user_avatar/discourse.paraview.org/bilke/32/1003_2.png) [@bilke](https://discourse.paraview.org/u/bilke)
#### Post date: [July 5, 2019, 2:58pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/12 "2019-07-05T14:58:31Z")

</div>

Works just perfectly like in your video! The only thing I noticed that some UI elements (text, buttons) are displayed too large in VR (in an HTC Vive) because I have a 24 inch 4K monitor where I had to scale up the user interface in the Windows display settings.

I guess this will not land in ParaView 5.7?

---

<div class="post-metadata">

### Author: ![martink](https://discourse.paraview.org/user_avatar/discourse.paraview.org/martink/32/2082_2.png) [@martink](https://discourse.paraview.org/u/martink)
#### Post date: [July 9, 2019, 2:18pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/13 "2019-07-09T14:18:41Z")

</div>

I _ **believe** _ the OpenVR support (and dialog, menu) will be in 5.7 but without the collaboration support as the superbuild does not build those parts right now.

---

<div class="post-metadata">

### Author: ![romangrothausmann](https://discourse.paraview.org/user_avatar/discourse.paraview.org/romangrothausmann/32/1021_2.png) [@romangrothausmann](https://discourse.paraview.org/u/romangrothausmann)
#### Post date: [May 29, 2020, 10:13am UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/14 "2020-05-29T10:13:14Z")

</div>

@martink This looks really great. We now have the hardware and would like to try to use PV with VR. What is the current status? All info I can find is older than this thread. Is the plugin still limited to Linux/MacOS?

---

<div class="post-metadata">

### Author: ![romangrothausmann](https://discourse.paraview.org/user_avatar/discourse.paraview.org/romangrothausmann/32/1021_2.png) [@romangrothausmann](https://discourse.paraview.org/u/romangrothausmann)
#### Post date: [June 22, 2020, 8:42pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/15 "2020-06-22T20:42:47Z")

</div>

It works under Windows with PV-5.8.0

---

<div class="post-metadata">

### Author: ![ep513140](https://discourse.paraview.org/letter_avatar_proxy/v4/letter/e/6f9a4e/32.png) [@ep513140](https://discourse.paraview.org/u/ep513140)
#### Post date: [July 12, 2020, 2:39am UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/16 "2020-07-12T02:39:24Z")

</div>

I am having trouble using Windows with PV-5.8.0, all I have done is downloaded PV-5.8.0, loaded the OpenVR plugin, rendered an object, and clicked “Send to OpenVR” while my headset was connected to SteamVR. Is there something I am missing? In VR there is a page that says “Paraview waiting…” and then my computer shuts down. Thanks!

---

<div class="post-metadata">

### Author: ![sistja](https://discourse.paraview.org/user_avatar/discourse.paraview.org/sistja/32/6711_2.png) [@sistja](https://discourse.paraview.org/u/sistja)
#### Post date: [September 11, 2020, 4:17pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/17 "2020-09-11T16:17:29Z")

</div>

Hello @martink,  
many thanks for this amazing video! I wonder about the hardware setup you need for the collaboration mode. Could you please give some details? I guess you need two VR sets (obviosly 😉) connected to two separate GPUs plugged into one computer? Or are the two headsets connected to a single GPU? Also, will it work equally well for Oculus Rift S and HTC Vive? Or are there some limitations?  
Thank you very much for sharing your experience!

---

<div class="post-metadata">

### Author: ![mwestphal](https://discourse.paraview.org/user_avatar/discourse.paraview.org/mwestphal/32/17_2.png) [@mwestphal](https://discourse.paraview.org/u/mwestphal)
#### Post date: [December 27, 2021, 3:22pm UTC](https://discourse.paraview.org/t/updates-to-virtual-reality-support-in-paraview/2046/18 "2021-12-27T15:22:21Z")

</div>

A post was split to a new topic: [Help with vtkQTWitdgetWidget](https://discourse.paraview.org/t/help-with-vtkqtwitdgetwidget/8705)
