#lab visits

On 12th of October, we have got the chance to visit the HUB Studio to experience the oculus rift.  

Key Roles and activities

Hub Studio is a VR and game prototyping studio with a range of artists, designers, and programmers selected from across QUT faculties (Polson, 2015). We visited the studio to experience the Oculus Rift Virtual Reality World where student artist, Wesley Heard, presented some of the Unreal Engine interface and explained how to construct 3D assets using 3D Max. Nathan Corporal, the sound designer, demonstrated how to record and edit the sound not only in 2D, but also in 3D Audio integration in virtual reality using FMOD, a game audio software tool.

Inspiration

Virtual reality is the future of the technology industry, its affordability and opportunities for daily use will mean it is increasingly desirable. Using super high resolution display for each eye gives a seamless combination between computer-generated images and reality. Virtual reality worlds are being developed at a time when big companies are entering this market such as Facebook partnering with Oculus Rift, and Microsoft with HoloLens.

Main Stakeholders of the work undertaken

- Interactive and visual designers

- Mobile Game designers 

- Artists - Architects - Industrial designers

- Sound designers 

- Academic staff - Researchers - Scientists

- Film directors 

- Programmers

Design Opportunities

DXP403 Lab Report

Designing Interactions, Masters of Creative Industries, Interactive and Visual Design.

Submitted by: Weile Zhang (n9036539)

Project Journal: http://weilezhangarg.tumblr.com

The Hub Studio

Date of visit: 12.10.2015

Name of Lab/Studio: Hub Studio

Actual Address: Z Block, Kelvin Grove Campus, QUT

Virtual Address: https://www.facebook.com/HubGames

                            https://twitter.com/HubGamesAus

Key Roles and activities

Virtual reality (VR) technology, is a popular term in IVD industries since last two decades. This technology is dedicated to present audience a real world scene via electronic screen and devices. This technique brings new possibility to traditional game and video industries. In addition, both audiences and players can enjoy the immersive experience to become part of component in the story world. To simulate the real world settings, VR technology can offer multiple sensory feelings, which include eyesight, listening, touch feeling and even smell or taste (Wikipedia 2015).

The work or mission of HUB Studio is to research and develop relevant demos and software products for VR devices such as, Oculus Rift. Firstly, Wesley Heard, the VR Artist of Hub Studio started off by showing us all how he creates a 3D environment setting by using 3D Max. For example, the furniture in a house, some old marks on the wall to form a scary environment. The 3D modelling process is really complex and it will cost a large amount of time to simulate the real world, so that audience can take part in the environment fast. Then Wesley introduced us a really useful tool named Unreal Engine 4. It is an excellent development tools created by game developers. Developers can use this game engine product creates many types of VR related games (Unreal Engine 2015).

Subsequently, Nathan Corporal, the sound designer, give us interesting introduction for his work. Theoretically, Nathan’s work is to offer audience a real sound experience in the VR products. They use professional audio devices, named Zoom recorder (The Zoom H4nSP), to collect sound in real environment. Additionally, editing them via professional audio edit software, such as: FMOD Studio, an audio middle ware to add logic and environment speciality on the original audio. Designers add different effectiveness on the original sound. Hence, the audience can feel the different environment just by audio. For example, the footsteps on stone road is opposite different to that of on grassland. Their work utilises the natural working theories of human’s ear. Overall, a virtual reality project is the cooperation of 3D landscape design and sound edition.

Lastly, the most interesting and attractive thing is we tried the latest VR devices – Oculus Rift, accompanied by several demos, such as Showdown (a slow motion demo), Dreadhalls (a horror game), painting tool and Colosse (3D interactive animation). I am so excited that I can try the Dreadhalls. This game demo is work perfectly through Oculus Rift. As a game player, I can explore the map and use tools to open a lock door. When the monster shows, I just want to escape. Overall, I cannot wait to play a complete game product like this one.

Main Stakeholders of the work undertaken

The direct stakeholders are the product designer and the large amount related game designers and video makers. These professional designers are directly construct the VR technology. A remarkable product should accompany by numerous demo to ensure their work performance maintains a high level. This demo can also support the development of this technology. For example, the VR painting software is a good attempt on education and creative design industries.

Subsequently, the indirect stakeholders are the industries that can develop via this technology, such as: education and medical care fields. Initially, VR technology is a great change for educator to change their teaching methods. For example, student can wear VR helmet to experience the inaccessible historical event, study the structure of scientific model. The exciting immersive environment will increase people study efficiency. Meanwhile, the medical clinician, especially psychological doctor can apply this technology with their patient to help them conquer the fear in their mind.

Inspiration

The most interesting aspect for me is the VR helmet can bring me such immersive feelings. Virtual reality and mix reality (this term from Microsoft 2015 event) technology redesigns the human-computing interactive industries. People can actually transfer the fiction environment to the real world. The remarkable experience is human being never met before. I gain the inspiration that people can decrease the steps of designing a virtual world. Currently, we still need brilliant designers to create the environment for audience. In the future, the advanced technology may has possible to read people’s mind and transfer peoples mind to the VR computer system, so that audience can have individual customised experience.

But this development may increase some ethic problem. Some people may lose direction between virtual and real world. The real immersive game world will let some audience addicted on it and avoid their real daily life.

Design Opportunities

This technology can offer audience immersive and vivid sense experience. Hence, I assume this technology is suit for education and medical industries. Firstly, the dramatic format is more acceptable than traditional media, such as paper book and video. If the educational institution can apply this technology in class, student will understand knowledge easier than before.

Meanwhile, visual reality technology can be used for mental health therapy, such as autism. Psychological clinician can customise different types of immersive video for patients. This method is efficient and scientific than “hypnosis treatment”.

 References

Dr. Deb Polson’s Tumblr site: http://argplay.tumblr.com/

FMOD Studio Website: http://www.fmod.org

Mobile VR jam: http://vrjam.devpost.com/updates/3462-meet-your-mobile-vr-jam-winners

Resources for experience: http://www.jauntvr.com/content/

Rift – the VR Mask or glasses: https://www.oculus.com/en-us/rift/

Unreal Engine official website: https://www.unrealengine.com/what-is-unreal-engine-4

Lab Visits: VR Technology Part 1 - Global Goggles

This class we experienced the VR technology briefly by using “Global Goggles”, a simple but fascinating handcraft leaves interesting first impression for us to recognize VR industries.

DXP403 Lab Report

Designing Interactions, Masters of Creative Industries, Interactive and Visual Design.

Submitted by: Weile Zhang (n9036539)

Project Journal: http://weilezhangarg.tumblr.com

Bio-fabrication Printing Lab

Date of visit: 14.09.2015

Name of Lab/Studio: Bio-fabrication Lab

Actual Address: 60 Musk Ave, IHBI Building

Virtual Address: woodruffgroup.org

Key Roles and activities

This lab visit is fascinating because of the 3D printing technology is another revolution that can bring change to many industries. My professional background is product, hence, I recognised 3D printing technology in my university. This technology is amazing because it links virtual models and physical products closely. This is helpful for industrial design. Basically, 3D printing machine prints layer by layer to construct the whole shape of a model. It cost plastics in most of times. Because this the cost is cheap and fast than many traditional manufacture, people nowadays can use many materials for 3D printing techniques. For example, food, furniture, motor vehicles and even a house. while in this Lab, the more exciting item is people nowadays can apply 3D printing in medical care region, which is called “bio-fabrication technology”. This project devotes to customize tissue replacements to save people’s life and help them to recuperate from accident, disease and birth defects. This technology needs the cooperation of dynamic research group, including some science practitioners, such as bio-scientist physicist engineers and clinicians. This is also a new work pattern that can bring more creativity for traditional medical care industries.

Work flow of 3D organ printing

Associate Professor Mia Woodruff introduced the work flow of 3D printing in medical fields for us. Theoretically, the whole process is divided to three main steps. First of all, they use clinical scan machines, such as CT, MRI and 3D laser, to produce the specific shape and data from patients’ wound.

subsequently, after the analysis of the condition of the injury and patient’s body, researchers will draw the bio-fabricate tissue by special software. The large difference to normal 3D printing in this stage is researchers will add “bio-inks” in the printed organs. This technology is the key to whether patients can be cured perfectly. As the image shown, we can still see the break between the 3D printed organ and original parts of patient’s body, but the cells have already grown together, which means the body tissues have recovered.

Lastly, the print machine will print out the specific shape of organs, such as an ear, a piece of bone, to match the wound of patient. After these advanced developments, patients can save a lot of time in recovery and it is also helpful for them to release the physical and psychological burden.

Material safety

As I mentioned above, 3D print machine can use almost all materials. However, because of the specialty of medical surgery, the materials they used in a patient’s body should be safe. Currently, the materials they apply are entirely safe for people’s physical health. They often use PCL or PLA plastics. These materials passed the test by the National Health and Medical Research Council of Australia (NHMRC), and the study shows the material is 100% biodegradable, healthy and nontoxic for human bodies.

Main Stakeholders of the work undertaken

Initially, in the medical field, the obvious direct stakeholders of 3D printing technique are medical doctors and patients. This technology brings efficiency to the daily works of hospital. Doctors can apply their professional skills more easily and patients do not need to bear too much pain in the recovery stage.

Considering the complex working process, there are also some indirect stakeholders. Because this technology is new in traditional medical industries, there are some issues may exist, for example, ensuring the accuracy of the model or choosing the most suitable material for artificial cells.

Generally, 3D printing is more mature in other industries, for example, people can use 3D printing technology to construct many houses in a short time period, because the budget cost of this technology is affordable and the work process is efficient. Therefore, the traditional manufacturer is another direct stakeholder. The traditional factory may apply this technology to increase the quantity and this can be another unique point for advertising and selling.

Inspiration

The most interesting aspect to me is the transformation process of 3D producing. Currently, this technique is used in many industries. For example, the fashion designers use it to produce a new style of dressing. It inspired me that this technology can play important role in sustainable development. If the 3D printing can popularize in the future and the printing speed become faster, everyone can have their own printing machine. They can print any products they like. It is convenient that people can customise their own lifestyle without restriction. The best thing is we will not produce too much rubbish anymore, because all plastics can be collect and reused in 3D printing machines.

Design Opportunities

After this lab visit and the followed research, there are some design opportunities can be recognized. Firstly, this technology can be more accessible by the intervention of interactive design. In the future, it is easy to imagine that people can apply 3D print technology more easily. It may transform the market environment of traditional manufacture. The traditional shopping mall may not exist because people can shop online, and even the material express service is not necessary, because customers can “print” their fashionable clothing. Therefore, the short term design opportunity is to create a 3D print access or application that normal users can get access to 3D print service everyday.

In the long term future, the brands will become the app or cooperators with 3D print company. These product companies can launch their virtual product online and receive profit from data download quantity. The industries will become similar to the mobile technology industries today.

 References

ABC news: http://www.abc.net.au/news/2014-10-31/preparations-continue-for-pioneering-medical-3d-printing-degree/5857376

Dr. Deb Polson’s Tumblr site: http://argplay.tumblr.com/

http://www.nature.com/news/the-printed-organs-coming-to-a-body-near-you-1.17320

Organ printing technology in QUT: http://www.qutnews.com/2014/05/09/aussie-universities-leading-the-way-in-3d-printed-body-part-technology/#.VhN1qbwZiKw

3D printing introduction: https://www.youtube.com/watch?t=141&v=Vx0Z6LplaMU

Absolutely bio-fabulous: https://www.youtube.com/watch?v=71y-Pw9XYbw&feature=youtu.be

DXP403 Lab Report

Designing Interactions, Masters of Creative Industries, Interactive and Visual Design.

Submitted by: Weile Zhang (n9036539)

Project Journal: http://weilezhangarg.tumblr.com

The Cube & Movement Tracking

Date of visit: 03.08.2015

Name of Lab/Studio: The Cube Installation

                         The latest foot tracking and gesture technology

                         G-Speak Motion Capture by Oblong

                         Leap Motion

Actual Address: P Block, Garden’s Point Campus, QUT

Virtual Address: http://www.thecube.qut.edu.au

Key Roles and activities

The Cube is located in level 4, P Block, QUT GP Campus. This lab includes one of the world's largest digital screens and advanced technologies of movement tracking. The intention of the lab is to provide an inspiring, explorative and participatory experience for science and engineering research.

The Cube - Multi-touch screen system

The Cube has a large screen and is unique because of several aspects. The first aspect is the large screen, MultiTaction® Cell 55, produced by MultiTouch Ltd. This company first introduced the largest multi-user LCD display. The display demonstrates an incredible user experience for the audience. It can satisfy unlimited number of users, multiple tools such as hands and electronic pens. Lastly, this screen is suitable for almost any environment, such as desks or walls. The display system located in QUT is composed of five zones. These screens often present different types of games or interactive interface, for example, the Chemistry World, Physics Playroom and The Arcade. These projects illustrate an enjoyable experience for the audience. People can receive useful knowledge by playing these interesting games.

Foot tracking system

We visit the lab for foot steps and gesture tracking technologies subsequently. This lab includes two large screens, several camera systems on the celling and three unique devices on the ground. These advanced devices demonstrate the latest technology of gesture tracking. First of all, Adam introduced the laser tracking system which is produced by SICK company. The tracking system is combined by three separate scanners. We could easily watch our footprint movement on the screen.

Gesture tracking system

Then, Adam showed the gesture tracking technology. It includes a special glove, which is called Oblong G-speak, and a sensor, the leap motion controller, which looks like a normal USB key connected to computer system. Users could immediately see a virtual image on the screen following their movement in real time. This technology is a mature product that can be used in many industries, including a smart drive system, art creativity, education, medical care and retail fields. This technology offers fantastic experience and possibility for human beings. Meanwhile, the Oblong G-speak glove is another amazing technique. Users can transform their hand to be a remote controller. They can cooperate with the software to do interesting interactions. These technologies illustrate uncountable achievement for many industries. For example, they can be used in Virtual Reality games (VRG). Overall, these technologies really blur the edge between virtual and real world.

Main Stakeholders of the work undertaken

According to the visits and further research on this area, there are some direct and indirect stakeholders that can be identified. Firstly, the interactive and visual designers are the direct stakeholders, because the technology offers possibility for the designers’ creativity. On the other hand, the entertainment industries, especially filming industries, are the indirect stakeholders as they have already experienced the benefits from 3D movement tracing technology. For example, the translation between a storyboard, such as in science fiction, and the real movie shot becomes achievable. 3D technology also helps reduce a budget for a film company as they do not need to hire many actors.

Inspiration

There are several technologies of the Cube that are interesting. Firstly, the large touch screen is remarkable. At first glance, I believed the panels were special because of their large size; but when I experienced it and received the introduction sessions, I now understand that these large touch screens catch and analyze people’s movement by computer behind the screens. The working concepts are totally different to the small touch screen on our mobile devices. Secondly, the technology of movement and gesture tracking contain incredible possibility. They can be used everywhere as a new choice. As the introduction video of multi-touch screen shows, these advanced technologies can be used in educational fields. Children and teenagers can receive knowledge by a new method or they can explore a new area for using these technologies.

Design Opportunities

Basically, I believe the multi touch screen, movement and gesture technologies have large potential in entertainment, education and healthcare industries.

Firstly, creating something interesting is always offers people enough energy to stay creative and critical. The gesture and movement tracking technologies can be used in game and film area perfectly. Actually, the difference between game and film is becoming unclear, because of the VR techniques. I believe it has opportunities that these technology companies can work with film company to create a new type of movie. In this situation, the audience can control the storytelling via special devices and decide the environment of the settings or the result of actors’ fate.

Then, the gesture tracking technologies and multi-touch technology can offer the unique study experience for children and adolescents. For instance, if the Oblong glove is popular in school, teacher can show the knowledge in another way. Student can watch the Solar system in 3D environment and they can control the movement of planets to observe the change.

Finally, these tools can be used in medical area. For example, the Oblong G-speak skills can be used in presentation of professional medical models. Because the biological models are often complicated, the VR technology can help professional staff to increase working efficiency. On the other hand, clinicians and patients can have more specified communications. Patient may observe their organs so they can have more detailed recognition about their body.

References

Dr. Deb Polson’s Tumblr site: http://argplay.tumblr.com/

The Cube website: http://www.thecube.qut.edu.au/about/

The Cube at QUT: https://www.youtube.com/watch?v=HTjjX5mW_aY&feature=youtu.be

The official video for this display product: https://www.youtube.com/watch?v=7ve44jMgrvk

The product page of MultiTouch company: http://www.multitaction.com/products/displays/

The lean motion website: https://www.leapmotion.com/?lang=en

12th October 2015    The HUB Studio

The HUB Studio is working for design and test the related product about VR helmet. Basically, their work includes two parts, the 3D model design and sound design.

Firstly, Wesley Heard, introduce the landscape design by 3D Max. he designs a 3D environment which can be used in VR devices for testing and real game. The environment settings are important to offer audience a real feeling. Every individual stuff or furniture in the landscape is moveable.

Secondly, the sound design is exciting. theoretically, sound designer dedicates to offer audience a real sound environment. they use professional audio devices to collect sound in real environment and then edit them via professional audio software. designers add different effectiveness on the original sound. Hence, the audience can feel the different environment just by audio. they use the working theories of human’s ear, like a sonar.