New System for Collecting Pedestrian Data
A portable system gathers detailed data on pedestrian behavior for better robot design.
― 5 min read
Table of Contents
Research on how people behave and move in social settings has become very popular. A big part of this research focuses on how people interact with each other and with Robots. To study these interactions, scientists need large amounts of detailed Data about how people behave in different environments. This article talks about a new system designed to collect a lot of this kind of data in a way that is easy to use and provides high-quality information.
The Importance of Pedestrian Data
Understanding how people move and act in public spaces can help researchers design better robots that can work alongside humans. Reliable data can help robots recognize what people might do next and how they can behave in a way that seems friendly and appropriate. Having access to good data can help improve robotic Systems used in social settings, such as in stores, offices, or public transportation.
The New Data Collection System
The new system allows researchers to easily gather data in many different locations. It uses a mix of cameras and sensors to capture how people move and behave. One important aspect of this system is that it allows for the collection of data in both top-down and human-like views. This means that the data can show both an aerial perspective and what it looks like from a person’s point of view.
The data collection setup is designed to be portable. This means researchers can quickly set it up in various locations without needing permanent fixtures or a lot of equipment. It can gather data in busy areas where many people are walking around, which is crucial for studying real-life Behaviors.
How the System Works
The system uses several cameras to capture video from multiple angles. Some cameras are placed high up to show the area from above, while others are at eye level, mimicking how a person would see the world. The cameras work together to track the movement of Pedestrians accurately.
To ensure that the labels on the data are correct, a web-based application has been developed. This app allows humans to review the automatically gathered data and fix any mistakes. The goal is to have each piece of data verified by a person, ensuring quality and reliability.
Features of the Dataset
The dataset collected using this system is unique for several reasons:
Quality Labels: The data includes human-verified labels that accurately represent where people are and how they move in a three-dimensional space. This is important for researchers because it minimizes errors that can come from technology alone.
Diverse Views: The combination of top-down and human-like views provides a full picture of pedestrian behavior. Researchers can analyze how people interact in their environment while also seeing things from their perspective.
Natural Behavior: Because the data is collected with a robot that looks like a normal suitcase being pushed, it captures real human reactions. People are less likely to behave unnaturally when they don’t see a strange robot moving around, making the data more reliable.
Dataset Size and Growth
The dataset is part of a larger effort that is ongoing, with plans to keep gathering more data. Early results show that the dataset is much larger than previous ones, making it a valuable resource for researchers looking to study pedestrian behavior in natural settings.
The initial collection has already produced thousands of unique trajectories, capturing how people move and interact over time. The researchers plan to expand the dataset by collecting data in various environments and situations, including different crowd densities and types of pedestrian interactions.
Challenges and Future Work
Despite the promising results, there are challenges to overcome. For instance, when a lot of people are stationary, it can be hard to track their movements accurately. People changing their poses can cause confusion for the tracking system, making validation tricky.
Going forward, the researchers aim to improve the way they handle situations where people are not moving. They also want to enrich the dataset with more labels, such as describing what actions pedestrians are taking-like whether they are standing, walking, or talking. Adding this kind of detail can help in understanding interactions better.
Benefits of the System
This new data collection method offers significant benefits for researchers and developers.
Real-World Applications: The data can be used to improve robotic systems that need to interact with people in everyday environments. By making robots more aware of human behavior, developers can create machines that are safer and more effective in social settings.
Versatile Data: The richness of the data allows for a variety of research applications, from predicting how people move to studying social dynamics in crowded places.
Community Contribution: The tools developed for this project, especially the verification app, are open-source. This means that other researchers can use them and contribute to the ongoing effort to collect better pedestrian data.
Conclusion
The development of this new data collection system represents an important step forward in understanding pedestrian behavior. By capturing a wide range of interactions in real-world settings, researchers can better model how humans and robots can coexist and work together. The ongoing collection of data in diverse environments promises to provide even more insights into pedestrian behavior, helping to shape the future of robotics and social navigation.
As this project continues, it will not only enhance robotic systems but also contribute valuable knowledge to the fields of social science and robotics, making interactions in public spaces more intelligent and responsive.
Title: TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Data
Abstract: Social navigation and pedestrian behavior research has shifted towards machine learning-based methods and converged on the topic of modeling inter-pedestrian interactions and pedestrian-robot interactions. For this, large-scale datasets that contain rich information are needed. We describe a portable data collection system, coupled with a semi-autonomous labeling pipeline. As part of the pipeline, we designed a label correction web app that facilitates human verification of automated pedestrian tracking outcomes. Our system enables large-scale data collection in diverse environments and fast trajectory label production. Compared with existing pedestrian data collection methods, our system contains three components: a combination of top-down and ego-centric views, natural human behavior in the presence of a socially appropriate "robot", and human-verified labels grounded in the metric space. To the best of our knowledge, no prior data collection system has a combination of all three components. We further introduce our ever-expanding dataset from the ongoing data collection effort -- the TBD Pedestrian Dataset and show that our collected data is larger in scale, contains richer information when compared to prior datasets with human-verified labels, and supports new research opportunities.
Authors: Allan Wang, Daisuke Sato, Yasser Corzo, Sonya Simkin, Abhijat Biswas, Aaron Steinfeld
Last Update: 2024-03-03 00:00:00
Language: English
Source URL: https://arxiv.org/abs/2309.17187
Source PDF: https://arxiv.org/pdf/2309.17187
Licence: https://creativecommons.org/licenses/by/4.0/
Changes: This summary was created with assistance from AI and may have inaccuracies. For accurate information, please refer to the original source documents linked here.
Thank you to arxiv for use of its open access interoperability.