Getting Started With VR Interface Design
The virtual realm is uncharted territory for many designers. In the last few years, weâve witnessed an explosion in virtual reality (VR) hardware and applications. VR experiences range from the mundane to the wondrous, their complexity and utility varying greatly.
The virtual realm is uncharted territory for many designers. In the last few years, weâve witnessed an explosion in virtual reality (VR) hardware and applications. VR experiences range from the mundane to the wondrous, their complexity and utility varying greatly. Taking your first steps into VR as a UX or UI designer can be daunting. We know because weâve been there. But fear not! In this article, weâll share a process for designing VR apps that we hope youâll use to start designing for VR yourself. You donât need to be an expert in VR; you just need to be willing to apply your skills to a new domain. Ultimately, as a community working together, we can accelerate VR to reach its full potential faster.
In the top-left quadrant are things like simulators, such as the rollercoaster experience linked to above. These have a fully formed environment but no interface at all. Youâre simply locked in for the ride.
In the opposite quadrant are apps that have a developed interface but little or no environment. Samsungâs Gear VR home screen is a good example.
Designing virtual environments such as places and landscapes requires proficiency with 3D modelling tools, putting these elements out of reach for many designers. However, thereâs a huge opportunity for UX and UI designers to apply their skills to designing user interfaces for virtual reality (or VR UIs, for short). The first full VR UI design we did was an app for The Economist, created in collaboration with VR production studio Visualise. We did the design, while Visualise created the content and developed the app.
Weâll use this as a working example throughout the next section, in which weâll lay out an approach to designing VR apps, before getting into the nitty-gritty of designing interfaces for VR. You can download the Economist app for Gear VR from the Oculus website.
A Process For VR UI Design Link
Whereas most designers have figured out their workflow for designing mobile apps, processes for designing VR interfaces are yet to be defined. When the first VR app design project came through our door, the logical first step was for us to devise a process.
TRADITIONAL WORKFLOWS, NEW TERRITORY LINK When we first played with Gear VR by Samsung, we noticed similarities to traditional mobile apps. Interface-based VR apps work according to the same basic dynamic as traditional apps: Users interact with an interface that helps them navigate pages. Weâre simplifying here, but just keep this in mind for now. Given the similarity to traditional apps, the tried-and-tested mobile app workflows that designers have spent years refining wonât go to waste and can be used to craft VR UIs. Youâre closer to designing VR apps than you think! Before describing how to design VR interfaces, letâs step back and run through the process for designing a traditional mobile app.
1. WIREFRAMES
First, weâll go through rapid iterations, defining the interactions and general layout.
2. VISUAL DESIGN LINK
At this stage, the features and interactions have been approved. Brand guidelines are now applied to the wireframes, and a beautiful interface is crafted.
3. BLUEPRINT LINK
Here, weâll organize screens into flows, drawing links between screens and describing the interactions for each screen. We call this the appâs blueprint, and it will be used as the main reference for developers working on the project.
Set Up Link CANVAS SIZE
The simplest problems can be the most challenging. Faced with a 360-degree canvas, one might find it difficult to know where to begin. It turns out that UX and UI designers only need to focus on a certain portion of the total space.
We spent weeks trying to figure out what canvas size would make sense for VR. When you work on a mobile app, the canvas size is determined by the deviceâs size: 1334 Ă 750 pixels for the iPhone 6 and roughly 1280 Ă 720 pixels for Android.
To apply this mobile app workflow to VR UIs, you first have to figure out a canvas size that makes sense.
Below is what a 360-degree environment looks like when flattened. This representation is called an equirectangular projection. In a 3D virtual environment, these projections are wrapped around a sphere to mimic the real world.
The full width of the projection represents 360 degrees horizontally and 180 degrees vertically. We can use this to define the pixel size of the canvas: 3600 Ă 1800.
Working with such a big size can be a challenge. But because weâre primarily interested in the interface aspect of VR apps, we can concentrate on a segment of this canvas. Building on Mike Algerâs early research on comfortable viewing areas, we can isolate a portion where it makes sense to present the interface. The area of interest represents one ninth of the 360-degree environment. Itâs positioned right at the centre of the equirectangular image and is 1200 Ă 600 pixels in size.
Letâs sum up: â360 Viewâ: 3600 Ă 1800 pixels âUI Viewâ: 1200 Ă 600 pixels
TESTING
The reason for using two canvases for a single screen is testing. The âUI Viewâ canvas helps to keep our focus on the interface weâre crafting and makes it easier to design flows.
Meanwhile, the â360 Viewâ is used to preview the interface in a VR environment. To get a real sense of proportions, testing the interface with a VR headset is necessary.
Using Avocode, you can visually compare revisions of designs easily.
TOOLS
Before we get started with the walkthrough, here are the tools weâll need:
Sketch
Weâll use Sketch to design our interfaces and user flows. If you donât have it, you can download a trial version. Sketch is our preferred interface design software, but if youâre more comfortable using Photoshop or anything else, that would work, too.
GoPro VR Player
GoPro VR Player is a 360-degree content viewer. Itâs provided by GoPro and is free. Weâll use it to preview our designs and test them in context.
Oculus Rift
Hooking Oculus Rift into the GoPro VR Player will enable us to test the design in context.
A Process For VR Interface Design Link
In this section, weâll run through a short tutorial on how to design a VR interface. Weâll design a simple one together, which should take five minutes tops.
A Process For VR Interface Design
In this section, weâll run through a short tutorial on how to design a VR interface. Weâll design a simple one together, which should take five minutes tops.
Download the assets pack, which contains presized UI elements and the background image. If you want to use your own assets, go for it; it wonât be a problem.
1. SET UP â360 VIEWâ
First things first. Letâs create the canvas that will represent the 360-degree view. Open a new document in Sketch, and create an artboard: 3600 Ă 1800 pixels.
Import the file named background.jpg, and place it in the middle of the canvas. If youâre using your own equirectangular background, make sure its proportions are 2:1, and resize it to 3600 Ă 1800 pixels.
2. SET UP ARTBOARD
As mentioned above, the âUI Viewâ is a cropped version of the â360 Viewâ and focuses on the VR interface only.
Create a new artboard next to the previous one: 1200 Ă 600 pixels. Then, copy the background that we just added to our â360 View,â and place it in the middle of our new artboard. Donât resize it! We want to keep a cropped version of the background here.
3. DESIGN THE INTERFACE
Weâre going to design our interface on the âUI Viewâ canvas. Weâll keep things simple for the sake of this exercise and add a row of tiles. If youâre feeling lazy, just grab the file named tile.png in the assets pack and drag it into the middle of the UI view.
Duplicate it, and create a row of three tiles.
Grab kickpush-logo.png from the assets pack, and place it above the tiles.
Looking pretty good, eh?
4. MERGE ARTBOARDS AND EXPORT
Now for the fun stuff. Make sure the âUI Viewâ artboard is above the â360 Viewâ artboard in the layers list on the left.
Drag the âUI Viewâ artboard to the middle of the â360 Viewâ artboard. Export the â360 Viewâ artboard as a PNG; the âUI Viewâ will be on top of it.
5. TEST IT IN VR
Open the GoPro VR Player and drag the â360 Viewâ PNG that you just exported into the window. Drag the image with your mouse to preview your 360-degree environment.
Weâre done! Pretty simple when you know how, right?
If you have an Oculus Rift set up on your machine, then the GoPro VR Player should detect it and allow you to preview the image using your VR device. Depending on your configuration, you might have to mess around with the display settings in MacOS.
Technical Considerations LOW RESOLUTION The resolution of the VR headset is pretty bad. Well, thatâs not entirely true: Itâs equivalent to your phoneâs resolution. However, considering the device is 5 centimeters from your eyes, the display doesnât look crisp. To get a crisp VR experience, we would need an 8K display per eye. Thatâs a 15,360 Ă 7680-pixel display. Weâre pretty far off from that, but weâll get there eventually. TEXT READABILITY Because of the displayâs resolution, all of your beautifully crisp UI elements will look pixelated. This means, first, that text will be difficult to read and, secondly, that there will be a high level of aliasing on straight lines. Try to avoid using big text blocks and highly detailed UI elements. Finishing Touches Link BLUEPRINT Remember the blueprint from our mobile app design process? Weâve adapted this practice to VR interfaces. Using our UI views, we map and organize our flows into a comprehensible blueprint, ideal for developers to understand the overall architecture of the app weâve designed.
MOTION DESIGN
Designing a beautiful UI is one thing, but showing how itâs supposed to animate is a different story. Once again, weâve decided to approach it with a two-dimensional perspective.
Using our Sketch designs, we animate the interface with Adobe After Effects and Principle. While the outcome is not a 3D experience, itâs used as a guideline for the development team and to help our clients understand our vision at an early stage of the process.
We know what youâre thinking, though: âThatâs cool, but VR apps can get way more complicated.â Yes, they can. The question is, to what extent can we apply our current UX and UI practices to this new medium? How Far Can VR UIs Go?
INTER-YOUR-FACES
Some VR experiences rely so heavily on the virtual environment that a traditional interface that sits on top might not be the optimal way for the user to control the app. In this case, you might want users to interact directly with the environment itself.
Imagine that youâre making an app for a luxury travel agent. Youâd want to transport the user to potential holiday destinations in the most vivid way possible. So, you invite the user to put on the headset and begin the experience in your swanky Chelsea office.
To transition from the office to some far away place, the user needs to choose where they want to go. They could pick up a travel magazine and flick through it until they land on an appealing page. Or there could be a collection of interesting objects on your desk that whisk the user to different locations depending on which one they pick up.
This is definitely cool, but there are some drawbacks. To get the full effect, youâd need a more advanced VR headset with handheld controllers. Plus, an app like this takes quite a bit more effort to develop than a set of well-presented options organized like in a traditional app interface.
VIVA LA REVOLUCIĂN!
The reality is that these immersive experiences are not commercially viable for most companies. Unless youâve got virtually unlimited resources, like Valve and Google, creating an experience like the one described above is probably too costly, too risky and too time-consuming.
This kind of experience is brilliant for showing off that youâre at the cutting edge of media and technology, but not so great for taking your product to market through a new medium. Accessibility is important.
Usually, when a new format emerges, itâs pushed to the limit by early adopters: the creators and innovators of this world. In time, and with enough learning and investment, it becomes accessible to a wider range of potential users.
As VR headsets become more commonplace, companies will start to spot opportunities to integrate VR into the ways that they engage with customers.
From our perspective, VR apps with intuitive UIs â that is, UIs closer to what people are already accustomed to with their wearables, phones, tablets and computers â are what will make VR an affordable and worthwhile investment for the majority of companies that pursue it.
TIME TO BOARD THE ROCKETSHIP
We hope weâve made the VR space a bit less scary with this article and inspired you to start designing for VR yourself.They say that if you want to travel fast, go alone. But if you want to travel far, travel together. We want to travel far. At Kickpush, we think that every company will have a VR app someday, just like every company now has a mobile website (or should have â itâs 2017, dang it!).So, weâre building a rocketship, a joint effort by designers around the globe to boldly go where no designer has gone before. The sooner that producing VR apps make sense for companies, the sooner the whole ecosystem will blow up.Our next challenges as digital product designers are more complex applications and handling other types of input through controllers. To begin to tackle this weâll need robust prototyping tools that let us create and test designs quickly and easily. Weâll be writing a follow up article that looks at some of the early attempts to do this, and at some of the new tools in development.Stay tuned!










