Initial XR support by AoGao-Kedoka · Pull Request #3245 · f3d-app/f3d

AoGao-Kedoka · 2026-06-16T19:17:54Z

Describe your changes

Adding XR support in rendering. Interactions will be handled in another future PR.

Steps to build and test

To build the branch, first clone, build and install the openxr, then build vtk with:
https://www.kitware.com/using-vtk-with-the-meta-quest/

To use VTK with XR devices, enable the CMake option VTK_MODULE_ENABLE_VTK_RenderingOpenXR when building VTK, and set the OpenXR_DIR variable to provide the path to the OpenXR SDK install directory.
Build F3D with: -DF3D_MODULE_OPENXR=ON
Choose between two and run with f3d ../testing/data/<data>.<datatype> --rendering-backend=xr
1. Attatch a HMD, open steamvr or
2. - Install monado, recommend installing from source https://monado.freedesktop.org/getting-started.html#installation-from-source
  - Set monado as active openxr runtime and set using simulation mode (script below)
  - use right mouse to move around or change HMD's position/orientation by giving value in the monado UI (see pic)

#!/bin/bash
# set monado as active openxr runtime
rm ~/.config/openxr/1/active_runtime.json
ln -s /usr/share/openxr/1/openxr_monado.json ~/.config/openxr/1/active_runtime.json

# set simulated monado options
export XR_RUNTIME_JSON=/usr/share/openxr/1/openxr_monado.json
export QWERTY_ENABLE=1
export SIMULATED_ENABLE=1
export XRT_DEBUG_GUI=1
export XRT_COMPOSITOR_FORCE_XCB=1

# start service
monado-service

Checklist for finalizing the PR

I have performed a self-review of my code
I have added tests for new features and bugfixes
I have added documentation for new features
If it is a modifying the libf3d API, I have updated bindings
If it is a modifying the .github/workflows/versions.json, I have updated docker_timestamp

AI Disclosure

I did not use AI to generate any of the content of that pull request
I used AI to generate code in that pull request, if yes please disclose which part of the code was generated and with which model.
GPT5.5 for Creating the bounding box and align objects to the bounding box. Reviewed and tested carefully.
...

Continuous integration

Please write a comment to run CI, eg: \ci fast.
See here for more info.

github-actions · 2026-06-16T19:19:36Z

You are modifying libf3d public API! ⚠️Please update bindings accordingly⚠️!
You can find them in their respective directories: c, python, java, webassembly.

mwestphal

Nice!

AoGao-Kedoka · 2026-07-06T18:59:35Z

\ci fast

Meakk

Here's a first review. I'll try your branch before going more in depth.

mwestphal · 2026-07-22T21:34:26Z

please rebase on master @AoGao-Kedoka

mwestphal

Quick high level review.

Please capitalize it: XR or do not capitalize it at all xr depending of the context.

mwestphal

missing doc.

make sure to document which libf3d and cli options have no effect in XR mode

mwestphal · 2026-07-28T05:54:00Z

+  this->FrameBufferObject->StartNonOrtho(size[0], size[1]);
+  this->DelegatePass->Render(state);
+  this->FrameBufferObject->RemoveColorAttachments(1);
+  this->FrameBufferObject->UnBind();


is this a change in behavior ?

Not in our use case. RenderDelegate supports rendering into an another image size, which it will create a new temporary camera. Copying a vtkOpenXRCamera into a vtkCamera would cause data loss, hence rendering result changes.
In our case we never render into an another image size, so the behavior should be the same.

mwestphal · 2026-07-28T06:06:18Z

in resources/xr_actions_manifests/ add a .md file acknolowdging the origin of the files and their license and copyright.

…ormatting issues, add openxr to vtkmodule

AoGao-Kedoka requested a review from a team as a code owner June 16, 2026 19:17

AoGao-Kedoka marked this pull request as draft June 16, 2026 19:18

mwestphal reviewed Jun 16, 2026

View reviewed changes

Meakk reviewed Jun 17, 2026

View reviewed changes

Comment thread vtkext/private/module/vtkF3DRenderer.cxx Outdated

Comment thread library/CMakeLists.txt Outdated

Comment thread library/src/interactor_impl.cxx Outdated

AoGao-Kedoka force-pushed the xr branch 5 times, most recently from ab981be to 308a5c4 Compare June 27, 2026 04:42

AoGao-Kedoka force-pushed the xr branch from 0696be2 to 7f6edfd Compare July 6, 2026 18:59

mwestphal added the ci:fast label Jul 6, 2026

AoGao-Kedoka force-pushed the xr branch 2 times, most recently from c73a8a1 to f391604 Compare July 6, 2026 19:29

AoGao-Kedoka marked this pull request as ready for review July 6, 2026 19:33

AoGao-Kedoka force-pushed the xr branch 2 times, most recently from f9a4f4c to 7c9b1e4 Compare July 7, 2026 08:09

Meakk requested changes Jul 7, 2026

View reviewed changes

AoGao-Kedoka requested a review from Meakk July 13, 2026 14:22

AoGao-Kedoka force-pushed the xr branch 2 times, most recently from 88ac1e5 to 0228731 Compare July 13, 2026 14:27

AoGao-Kedoka requested a review from mwestphal July 22, 2026 20:14

AoGao-Kedoka force-pushed the xr branch from 0228731 to 5436df6 Compare July 22, 2026 21:51

mwestphal reviewed Jul 23, 2026

View reviewed changes

Comment thread library/src/window_impl.cxx

mwestphal reviewed Jul 23, 2026

View reviewed changes

Comment thread library/src/window_impl.cxx Outdated

mwestphal reviewed Jul 23, 2026

View reviewed changes

Comment thread library/src/engine.cxx

mwestphal requested changes Jul 23, 2026

View reviewed changes

AoGao-Kedoka requested a review from mwestphal July 26, 2026 14:00

AoGao-Kedoka force-pushed the xr branch from 1a50baa to 9dd8f8a Compare July 26, 2026 14:03

mwestphal requested changes Jul 28, 2026

View reviewed changes

mwestphal linked an issue Jul 29, 2026 that may be closed by this pull request

Request: VR support for viewing and even manipulating models #749

Open

AoGao-Kedoka added 4 commits July 31, 2026 10:27

feat: initial xr implementation

05ba5a9

fix: use generic resource folder, handle grid by grid-absolute, fix f…

1cef660

…ormatting issues, add openxr to vtkmodule

fix: add context::xr, adjust exceptions

3e9d33f

fix: fix naming, fix interactor actions manifests path

7881b8f

AoGao-Kedoka force-pushed the xr branch from e3a7da3 to 7881b8f Compare July 31, 2026 08:28

Uh oh!

Uh oh!

Conversation

AoGao-Kedoka commented Jun 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Describe your changes

Steps to build and test

Checklist for finalizing the PR

AI Disclosure

Continuous integration

Uh oh!

github-actions Bot commented Jun 16, 2026

Uh oh!

mwestphal left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

AoGao-Kedoka commented Jul 6, 2026

Uh oh!

Meakk left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mwestphal commented Jul 22, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mwestphal left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mwestphal left a comment

Choose a reason for hiding this comment

Uh oh!

mwestphal Jul 28, 2026

Choose a reason for hiding this comment

Uh oh!

AoGao-Kedoka Jul 28, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

mwestphal Jul 28, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

AoGao-Kedoka commented Jun 16, 2026 •

edited

Loading