Main Content Region

Projects

Home

Projects

Every year, xREAL partners with campus faculty and the larger community to create, produce and assess innovative immersive projects that redefine teaching and learning and advance the public good. Our lab student assistants and interns engage in hands-on, project-based research to create project assets with mentorship from Lab faculty fellows, staff, and academic partners.

Contact our team

Read more about our research

See our resources for teaching with XR

Reconnections
Reconnections concept art showing a temple object, the island guardian and the map of the island
Reconnections concept art

xREAL has partnered with the MUVE Lab at the University of New Mexico to develop a multiplayer educational game using the Unreal Engine 5. “Reconnections” will help players build empathetic connections with the environment and ethical environmental stewardship. The game is part of an experiment conducted by the MUVE Lab which tests whether learning to solve cooperative tasks selflessly increases feelings of interpersonal connection, empathy for others, overall well-being, and positive attitudes toward the environment. Reconnections will be available in 2023 on the Oculus platform.

Watch the Reconnections project presentation

 

Motion Capture (MoCap) for Theatre Arts
Photos from Irfran Merchant's MoCap training session for Theatre Arts students, Spring 2022
Photos from Irfran Merchant's MoCap training session for Theatre Arts students, Spring 2022
Top left: Yutong Liu demonstrating the Rokoko suit.

Prof. Kristi  Papailler (Theatre Arts) is leading the "Inaugural Poets" project in which theatre students use MoCap technology to create a virtual poetry performance and explore a groundbreaking MoCap curriculum. Our future MoCap Studio will support the study of motion, VR embodiment, and 3D perception with motion capture (MoCap)  technology.

Watch the MoCap process in action.

 

Embodied Conversational Agents (ECA) for VR-based student-client interaction in Kinesiology
The VR environment and photos from the alpha test of the project, 2022
The VR environment and photos from the alpha test of the project, 2022

Led by a multidisciplinary team, the VR-taught Exercise Physiologist Certification Preparatory Course provides the knowledge and skills necessary to prepare individuals as Certified Exercise Physiologists (EP) recognized by the American College of Sports Medicine (ACSM) and the United States Registry of Exercise Professionals (USREPS).

The course uses a multiplayer VR environment designed with Unreal Engine 4.26 and an embodied intelligent virtual agent to demonstrate how to conduct a battery of health-related physical fitness assessments correctly. The virtual agent uses a custom Google DialogFlow API for Unreal Engine 4 and motion capture (MoCap) technology to simulate socially-appropriate reactions.

Watch an overview of the VR experience

 

Using immersive journalism to document experiences of displacement
Stills from the Shatila Refugee 360-degree video project (2021)
Stills from the Shatila Refugee 360-degree video project (2020)

Dr. Ahlam Muhtaseb and Lab alumnus Naim Aburaddi (Ph.D. student, University of Colorado, Boulder), with creative support from xREAL Assistant Director James Trotter, are using decolonial media theories and 360-degree journalism to chronicle the everyday experiences of Palestinians in Gaza and promote their self-representation. This project continues Dr. Muhtaseb and Mr. Trotter's work to document experiences of Palestinian displacement from a decolonial lens, as in this first-person immersive view of the Shatila Refugee Camp. 

Read more about xREAL graduate fellow alumnus Naim Aburaddi's research

Watch a 360-degree first-person video of Shatila (2020)

 

"Virtual humans" for nursing education
Stills from the VR Nursing Simulation of COPD training.  Bottom left: Dr. Muheidat presents his algorithm at ITS Tech Talks 2022
Stills from the VR Nursing Simulation of COPD training. 
Bottom left: Dr. Muheidat presents his algorithm at ITS Tech Talks 2022

Dr. Fadi Muheidat (Computer Science and Engineering) is training a rule-based nature language processing (NLP) algorithm to animate a socially-aware Embodied Conversational Agent (ECA), "Cody," impersonating a patient. The ECA will help future nurses engage in a real-life simulation of how to teach a patient the basics of a COPD long-term management plan. 

 

**Using VR to teach spatial perception in design classes
1, 2 and 3: Johnie Harrell, __Vestiges of the Past__.Augmented Reality Project. DES 4610 Fall 2021 4: Eman Bautista, __Cyber City__. VR Project. DES 4610 Fall 2021. 5: Vanessa Gaspard, __Farm Life__. VR Project. DES 4610 Fall 2021
1, 2 and 3: Johnie Harrell: Vestiges of the Past. Augmented Reality Project. DES 4610 Fall 2021
4: Eman Bautista: Cyber City. VR Project. DES 4610 Fall 2021.
5: Vanessa Gaspard: Farm Life. VR Project. DES 4610 Fall 2021

In Prof. Rob Ray's (Art and Design) design classes, students use extended reality to improve their ideation and prototyping skillsets and develop interactive experiences. For instance, in DES 4610 Virtual Reality, students learn about the histories, terminology, and theories of virtualization. They also discover how virtualization technologies solve problems, create knowledge, and connect humanity in the arts, humanities, engineering, medicine, science, and journalism fields. In the laboratory section, students conceptualize, storyboard, and prototype augmented reality experiences using Google Scene Viewer and Apple Quick Look frameworks. Students also develop interactive virtual reality experiences using Mozilla Hubs (WebXR) and Unreal Engine (VR).

 

3D multiperceptual models for students with disability
Student Mirna Campos demonstrates her use of multiperceptual 3D models
Student Mirna Campos demonstrates her use of multiperceptual 3D models

Using 3D modeling and 3D printing, assistive technologist Kevin Cleppe creates multiperceptual 3D models that help students with disabilities create mental maps of the objects they learn about in class.

Learn how student Mirna Campos uses a 3D-printed multiperceptual model of a neuron to connect to the content in her psychology courses.