NanoVer iMD-VR

You can use the NanoVer iMD-VR application to incorporate VR into your workflow, including:

• visualising molecular systems in VR, including real-time MD simulations, recorded trajectories, and static structures

• interacting with real-time molecular simulations using VR controllers

• joining together with others for multi-person sessions in VR

To install the NanoVer iMD-VR application, go to Installation & Getting Started. For help choosing your VR setup, see Choosing your iMD-VR setup. For guidance on using the NanoVer iMD-VR application, see Navigating NanoVer in VR.

---

Navigating NanoVer in VR

Introduction

We call an instance of the NanoVer iMD-VR application an iMD-VR client, or simply a VR client. This is different to a python client, which connects to a NanoVer server from a python script or Jupyter notebook. This distinction is important since the two types of client offer different functionalities. For example, both can connect to a NanoVer server to access simulation data, run commands such as play/pause/reset, & apply forces to the molecule system (interactive MD). However, only a VR client allows you to visualise & interact with a simulation in VR, and only a python client allows you to change the visualisation of the molecular system.

Key point

A VR Client or iMD-VR client is an instance of the NanoVer iMD-VR application that has connected to a NanoVer server.

---

Your VR controllers

Below are diagrams showing the positions of the VR controller buttons that you will use in NanoVer iMD-VR, using the Meta Quest 2 controllers for demonstration. These buttons are in similar positions on most common VR controllers, but please refer to your VR headset’s documentation if you cannot locate them.

Important

To press a button on a menu in VR, place the end of your controller on the button and click the trigger.

	Trigger button
	Grip button
	Joystick

---

A typical iMD-VR workflow

You should now have NanoVer iMD-VR and your VR setup ready to go! To begin, follow these steps:

1. Start your NanoVer server (see Running a server)

2. Setup your VR kit & open NanoVer iMD-VR (see Installing the iMD-VR client)

3. Select your option for connecting to a Server: using either the in-VR main menu or desktop main menu (PC-VR only)

4. Check out your molecular simulation in VR! See instructions for the VR controls and menus, or check out the tutorials page for examples of how to integrate NanoVer iMD-VR into your workflow

---

Connecting to a NanoVer server

You have several options for connecting to a NanoVer server:

• Autoconnect: connect to the first server (using the default port) found on the network

• Discover: find all servers (using the default port) on the network and list them for the user to choose from

• Manual: allow the user to specify the IP address and port of the server they wish to connect to and then, if found, connect to it

In-VR main menu

Important

To press a button on the in-VR main menu, place the end of your right controller on the button and click the trigger.

Select from the dropdown options below to see the video tutorials:

Autoconnect

Click Autoconnect. If a server was found, the menu will close and you will see your simulation.

Discover

Click Discover to show a list of available servers. Click your chosen server or click Refresh to search again.

Manual

Click Manual, then type your IP address & port and click Connect. If a server was found, the menu will close and you will see your simulation.

Desktop main menu (PC-VR only)

When you open the NanoVer iMD-VR application on your PC, you will see a small menu on the top left of your monitor with the below headings. In Server, you can connect to your NanoVer server. Select from the dropdown options below for further information and to browse other features:

Server

Autoconnect	Connect to the first server found on the network, using the default parameters.
Direct Connect	Toggle a menu where you can change the IP address and trajectory/multiplayer ports of the server you wish to connect to.
Discover Services	Toggle a menu to search for servers running on the network. Click “Search” to show the available servers.
Disconnect	If connected to a server, disconnect.

User

Interaction Force

Scale the user’s interaction force.

Simulation

Play	Play the simulation.
Pause	Pause the simulation.
Step	Move to the next frame of the simulation.
Reset	Reset the simulation to the starting positions.
Reset Box	Move and resize the box to the original dimensions and position in the VR space.

Colocation

Colocated Lighthouses	Toggle colocation. This is only compatible with players using HTC base stations.
Reset Radial Orientation	Orient players’ VR play spaces into a mandala.
Radial Displacement	Slide players’ VR play spaces inwards and outwards from the centre of the shared space.
Rotation Correction	Adjust the rotation of players’ VR play spaces to align with the shared space.

Debug

Simulate Controllers

Toggle the simulation of random interaction forces.

Misc

Quit	Quit the program.

---

VR controls & menus

Once you have connected to a server, you can visualize & interact with your simulation. You now have access to your VR controls & several menus:

• In-simulation controls

• Right handheld menu

• Left handheld menu

• Fullscreen menu

In-simulation controls

You can access the in-simulation controls anytime you are connected to a server and don’t have any menus open. Select from the dropdown options below to see the video tutorials:

Interact with the simulation

Press and hold the trigger button on either controller to apply a force to the nearest atom of the molecule. You can use both controllers at the same time.

Move the simulation box

Press and hold the grip button on either controller to move the simulation box.

Resize the simulation box

Press and hold both grip buttons to move & resize the simulation box.

Change the magnitude of the interaction force

Push and hold the joystick on the right controller to the right to increase the force, or to the left to decrease it. Doing so will alter the scaling value of the interaction force (see video). Note that this changes the force for both controllers.

Right handheld menu

Here you can adjust aspects of your interaction with the molecules, such as:

• Select your interaction type: toggle between interacting with individual atoms or entire residues

Important

Open the right handheld menu by holding the joystick of your right controller in the down position. With the joystick held down, move your controller to a button and press the trigger to click it. Release the joystick to close the menu.

Open the dropdown below to see the video tutorial:

Select your interaction type

Select your interaction type: Single (default): when interacting, you will apply a force to the nearest atom. Residue: when interacting, you will apply a force to the nearest residue.

Left handheld menu

Here you can access the fullscreen menu and run simulation commands such as:

• Pause: pause a running simulation

• Play: play a paused simulation

• Reset: reset the system to its initial coordinates

Important

Open the left handheld menu by holding the joystick of your left controller in the down position. With the joystick held down, move your controller to a button and press the trigger to click it. Release the joystick to close the menu.

Select from the dropdown options below to see the video tutorials:

Pause

Select the Pause button.

Play

Select the Play button.

Reset

Select the Reset button.

Fullscreen menu

Click Menu on the left handheld menu to open the fullscreen menu. Here you can:

• switch between loaded simulations

• customize your avatar name & color

Important

Once you have opened the fullscreen menu, release the joystick on your left controller and use your right controller to interact with the buttons. When you are finished, click Back to return to the simulation.

Select from the dropdown options below to see the video tutorials:

Switch between loaded simulations

Select Sims and choose from the list of simulations loaded onto the server. Click Back to return to the fullscreen menu.

Customize your avatar

Change your avatar name Click on your avatar name at the bottom of the fullscreen menu. Delete the previous name, type a new one, and click > to return to the fullscreen menu. Change your avatar color Select one of the colored circles around your avatar (on the fullscreen menu). Although not visible to you, these fields are stored in the shared state and determine how others will see your avatar during multiplayer sessions.

---

Choosing your iMD-VR setup

If you wish to visualise and/or interact with your simulations in VR, you will need to use an iMD-VR client. We focus on NanoVer iMD-VR as the prototypical iMD-VR client, but these instructions can be generalised to any iMD-VR client, e.g. your own custom VR application that uses the NanoverUnityPlugin.

Please feel free to use the instructions below to help you choose your VR setup, then search online (or follow the links given below) for the documentation of your chosen method for the latest instructions on configuring your setup.

1. For help choosing your VR setup, see our flow diagram in Choosing your VR setup

2. Once you know your VR setup, head to Choosing your installation method

3. Once you’re ready, head to Installation & Getting Started

Note

VR is developing fast and there are constantly new features/apps/ways of doing things. Therefore, these instructions may not be an exhaustive list of all the possible VR setups. Please feel free to choose whichever one you are most comfortable with! We also recommend checking out the online documentation for your VR headset if you run into any problems relating to setting up your VR kit.

Choosing your VR setup

Below is a flow diagram to help you decide which setup to choose based on: the operating system of your computer, the type of network you have access to, your VR headset, and your desired configuration (single-/multi-person VR).

Key point

For a wireless setup you will need to have a strong and stable internet connection that allows communication over the network. This option is often incompatible with public / institutional networks.

Key definition

Tethered: using a cable to connect your VR headset to your computer.

Choosing your installation method

Please choose from the dropdown options below to learn about how to install NanoVer iMD-VR with your chosen VR setup:

Using PC-VR

This option is compatible with the following VR setups:

• Meta Quest Link (tethered)

• Meta Quest AirLink (wireless)

• SteamVR (tethered)

• Steam Link (wireless)

You can use either NanoVer iMD-VR installation method:

• Downloading the latest release of the NanoVer iMD-VR executable, see Download the latest release.

• Conda installation of the NanoVer iMD-VR package, see Conda installation.

Running locally on a Meta Quest headset

This option is compatible with the following VR setups:

• Run directly on the App store of a Meta Quest headset (wireless)

• Meta Quest Link with Meta Quest Developer Hub (tethered)

You must use the following NanoVer iMD-VR installation method:

• Download the latest release of the NanoVer iMD-VR apk and sideload this onto your headset, see Download the latest release. If you wish to use your VR headset wirelessly, then you must meet the requirements for a wireless setup (see above).

Choosing this option means that you cannot run NanoVer iMD-VR via conda.