Reimagining Urban Navigation with Augmented Reality
Exploring how AR can enhance city navigation and interactions with self-driving cars.
― 9 min read
Table of Contents
- Understanding Augmented Reality
- Simulating AR Experiences in Virtual Reality
- Case Study 1: AR Pedestrian Navigation
- Designing the Application
- Developing the VR Prototype
- Evaluation Study
- User Feedback
- Case Study 2: Interacting with Autonomous Vehicles
- Designing the Application
- Developing the VR Prototype
- Evaluation Study
- User Feedback
- Gathering Insights from VR Simulations
- Functional Benefits of AR
- Impact of Urban Context
- Limitations of VR Simulations
- Recommendations for Future Research
- Conclusion
- Original Source
- Reference Links
Augmented Reality (AR) could change how we interact with our cities. This technology blends digital images with the real world, allowing people to engage with their surroundings in new ways. However, creating AR experiences for busy urban environments can be challenging. These challenges include technical issues and safety concerns. To address these issues, researchers are using Virtual Reality (VR) to simulate AR experiences. By doing this, they provide a safe setting for testing and gathering Feedback on future AR applications.
In this article, we explore two applications of wearable urban AR that were tested in VR. The first application focuses on helping pedestrians navigate through the city. The second application supports interactions between pedestrians and self-driving cars. By collecting feedback from users in the VR Simulations, the researchers aim to learn more about the advantages of these AR concepts and the effects of the urban environment on user experience.
Understanding Augmented Reality
AR is a technology that adds digital elements to the real world. It works by combining computer-generated images with what we see around us. Over the past twenty years, AR has become more popular, mainly due to smartphones. Many people now own smartphones that can run AR applications, making this technology accessible to a broader audience. A well-known example of AR is the game Pokémon Go, which became popular in 2016 and showcased the potential of AR in urban settings.
While smartphones have made AR widely available, wearable devices like smart glasses are thought to offer an even better experience. These devices allow users to see digital content seamlessly integrated into their view without losing awareness of their surroundings. However, there have not been many studies using these devices in urban situations. This is partly due to technical difficulties, such as ensuring the devices work well outdoors.
Researchers are looking at how VR can help simulate AR experiences to overcome some of these challenges. VR provides a controlled environment for testing and allows designers to create a realistic urban setting without the limitations of current AR technology. By simulating AR, researchers can gather feedback from users about how well these applications might work in real life.
Simulating AR Experiences in Virtual Reality
Prototyping is a way for designers to test their ideas and learn about different features of a product before it is built. Since AR relies heavily on 3D elements, it is important to visualize spatial relationships early in the design process. Various methods exist for prototyping AR, ranging from simple sketches to complex 3D models.
By using a VR simulation, designers can create virtual environments where users can experience AR concepts. This approach allows for testing various interface designs and gathering meaningful insights. For example, users can interact with AR Navigation tools in a virtual city without any real-world risks.
Two case studies demonstrate how VR can simulate urban AR experiences: one for pedestrian navigation and one for interactions with self-driving cars. Both studies were designed to evaluate how well users could provide feedback about the functionality of AR applications and the influence of different urban factors.
Case Study 1: AR Pedestrian Navigation
Designing the Application
Finding our way around the city can be difficult due to the complex networks of streets and buildings. AR can improve navigation by overlaying directional information onto our view, but many issues have not yet been addressed. For example, the narrow field of view (FOV) of existing AR devices can limit the amount of information displayed.
In this study, researchers created a VR simulation of an AR navigation app that tested three different map placements: in front of the user, on the ground, and in the user's hand. The VR simulation allowed for a safer way to test these designs since it removed concerns about pedestrian safety and other limitations faced with real-world navigation.
Developing the VR Prototype
The team used the Unity game engine to create a virtual city for testing the AR navigation app. Participants used Oculus Quest 1 VR headsets to experience the simulation. Key features of the app included a map interface that provided navigational information and turn-by-turn guidance through 3D arrows.
Participants used controllers to move around the virtual environment, which helped them to experience the AR interface without needing specialized equipment. The team paid special attention to the design, ensuring that the maps provided adequate information without being overwhelming.
Evaluation Study
User testing took place using a within-subjects design, where each participant experienced all three map placements. The goal was to understand which interface worked best for navigation. Participants completed standard questionnaires and a feedback form after using each map interface.
By conducting interviews afterward, researchers gathered insights into what users found helpful and what could be improved.
User Feedback
Feedback from participants emphasized the importance of safety while navigating. Many expressed concerns that using an AR map could distract them from their surroundings. While the map was designed to enhance navigation, participants noted that it needed to provide information without obstructing their view of potential hazards. Other suggestions included the addition of cardinal directions and estimated arrival times.
Participants appreciated the functionality of the app but noted that they would prefer more straightforward navigation tools that enhance their awareness of their environment.
Case Study 2: Interacting with Autonomous Vehicles
Designing the Application
Self-driving cars are becoming increasingly common, and ensuring safe interactions between pedestrians and these vehicles is critical. To help facilitate this, researchers created an AR interface that allows pedestrians to signal their intention to cross the street. This approach enhances communication between pedestrians and vehicles without requiring additional infrastructure, like crossing buttons.
The study examined how participants preferred to interact with vehicles using AR glasses compared to traditional methods. The researchers also explored different ways to display vehicle communication to pedestrians.
Developing the VR Prototype
Participants in this study used Oculus Quest 2 for a more immersive experience. The virtual environment was designed to mimic a busy urban street with two-way traffic. Using pre-made 3D models, researchers created a realistic atmosphere with pedestrians and vehicles, alongside sounds from the urban environment.
The AR application featured ways for participants to send crossing requests to vehicles, which were visually represented by vehicles changing colors or displaying messages. This allowed participants to feel more secure when crossing the street.
Evaluation Study
Participants engaged in a within-subject experiment that compared the AR application with the traditional pedestrian button method. This setup allowed researchers to collect feedback about user experiences with both approaches. Participants were guided through the simulations, and they shared their observations through questionnaires and interviews.
User Feedback
Participants provided insights into how useful the AR application could be for enhancing safety when crossing the street. Many appreciated the convenience of signaling vehicles about their intent to cross. However, some participants voiced concerns about how well the system would work in real-world situations, especially in mixed traffic.
Feedback indicated that users wanted clear and straightforward cues to help them cross the street safely. Participants emphasized the importance of understanding the vehicle's stopping distance and reliability of the AR system for signaling.
Gathering Insights from VR Simulations
The use of VR for simulating AR applications has highlighted several key advantages and limitations. The main insights gained from these studies were related to the functional benefits of AR and the impact of the urban setting on user experience.
Functional Benefits of AR
Participants consistently recognized the potential advantages of AR navigation and communication, provided the interfaces remained user-friendly. They appreciated the ways AR could enhance their awareness and understanding of urban spaces, especially when navigating complex environments.
While participants found value in the AR applications, their feedback indicated that users needed to feel confident in the technology. Many expressed concerns about relying solely on AR for navigation or communicating with autonomous vehicles.
Impact of Urban Context
The urban environment significantly affected how participants perceived AR applications. Safety concerns emerged as a key theme, with users expressing caution about distractions while using the AR tools. The feedback underscored the need for designs that balance functionality with users' situational awareness.
Participants noted that real-world factors, such as noise and traffic conditions, could potentially complicate the user experience. They suggested that the designers should consider these aspects when developing wearable AR applications.
Limitations of VR Simulations
While the benefits of VR simulations are evident, there are limitations to consider. The feedback gathered may not fully reflect how users would react in real-world situations. For example, the design of AR content in VR may differ from how it would appear on actual AR devices.
Moreover, the VR simulations lacked some physical traits of wearable devices, such as weight and comfort. Participants expressed thoughts on these aspects, but their responses were influenced by their experiences with the VR equipment rather than realistic AR glasses.
Recommendations for Future Research
Advancing the field of wearable AR applications requires careful attention to various aspects of design and prototyping. Based on findings from these studies, several recommendations can be made to improve the process of simulating AR experiences in VR.
Emphasize the Experience of Wearing Smart Glasses: Designers should strive to give participants a more authentic experience of using AR glasses. This can help users envision how these devices might fit into their daily lives.
Make AR Content Stand Out: It is essential to render AR elements in a way that visually separates them from the surrounding environment. Using distinctive colors, transparency, and high-quality models can help users identify and engage with the AR content.
Simulate Contextual Factors: Create realistic urban environments by incorporating social and environmental elements. Doing so can enhance the user experience and provide valuable evaluations of AR applications.
Incorporate Feedback Mechanisms: Including user feedback during the testing process can lead to better prototypes. Designers should actively engage with participants to refine the AR applications and address their concerns.
Conduct Field Studies: After prototyping in VR, taking the applications to real-world settings can validate the findings. Field studies can offer insights into how users interact with AR in their daily lives.
Conclusion
Wearable AR applications have the potential to transform how we interact with urban environments. Through the use of VR simulations, researchers can better grasp what users need and how to address their concerns. By focusing on functional benefits and the context in which AR applications will be used, designers can create effective and engaging experiences for users.
As technology continues to advance, these AR applications could become essential for navigating and enhancing our interactions with cities, ultimately improving the quality of urban life. The research and insights gathered from these studies pave the way for future work in this exciting field.
Title: Simulating Wearable Urban Augmented Reality Experiences in VR: Lessons Learnt from Designing Two Future Urban Interfaces
Abstract: Augmented reality (AR) has the potential to fundamentally change how people engage with increasingly interactive urban environments. However, many challenges exist in designing and evaluating these new urban AR experiences, such as technical constraints and safety concerns associated with outdoor AR. We contribute to this domain by assessing the use of virtual reality (VR) for simulating wearable urban AR experiences, allowing participants to interact with future AR interfaces in a realistic, safe and controlled setting. This paper describes two wearable urban AR applications (pedestrian navigation and autonomous mobility) simulated in VR. Based on a thematic analysis of interview data collected across the two studies, we found that the VR simulation successfully elicited feedback on the functional benefits of AR concepts and the potential impact of urban contextual factors, such as safety concerns, attentional capacity, and social considerations. At the same time, we highlighted the limitations of this approach in terms of assessing the AR interface's visual quality and providing exhaustive contextual information. The paper concludes with recommendations for simulating wearable urban AR experiences in VR.
Authors: Tram Thi Minh Tran, Callum Parker, Marius Hoggenmüller, Luke Hespanhol, Martin Tomitsch
Last Update: 2024-03-17 00:00:00
Language: English
Source URL: https://arxiv.org/abs/2403.11377
Source PDF: https://arxiv.org/pdf/2403.11377
Licence: https://creativecommons.org/licenses/by/4.0/
Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.
Thank you to arxiv for use of its open access interoperability.
Reference Links
- https://dl.acm.org/ccs.cfm
- https://blog.google/products/maps/take-your-next-destination-google-maps/
- https://support.google.com/maps/answer/9332056
- https://design.sketchbox3d.com/
- https://docs.microsoft.com/en-us/windows/mixed-reality/design/maquette/
- https://tvori.co/
- https://unity.com/
- https://assetstore.unity.com/
- https://www.mixamo.com/
- https://www.e-tron-gt.audi/en/e-sound-13626
- https://youtu.be/fvtlobbMENo
- https://www.acm.org/publications/taps/whitelist-of-latex-packages
- https://www.acm.org/publications/proceedings-template
- https://capitalizemytitle.com/
- https://www.acm.org/publications/class-2012
- https://dl.acm.org/ccs/ccs.cfm
- https://ctan.org/pkg/booktabs
- https://goo.gl/VLCRBB
- https://www.acm.org/publications/taps/describing-figures/