Home > Technology peripherals > AI > Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

WBOY
Release: 2024-01-31 18:06:11
forward
846 people have browsed it

Written in front&The author’s personal understanding

In Collaborative, Connected and Automated Mobility (CCAM), intelligent driving vehicles have greater capabilities in perceiving, modeling and analyzing the surrounding environment. The stronger they are, the more aware and able they are to understand, make decisions, and execute complex driving scenarios safely and efficiently. High-precision (HD) maps represent road environments with centimeter-level accuracy and lane-level semantic information, making them a core component of intelligent mobility systems and a key enabler of CCAM technology. These maps provide automated vehicles with a powerful advantage in understanding their surroundings. HD maps are also considered hidden or virtual sensors because they bring together knowledge from physical sensors (maps), namely lidar, cameras, GPS and IMU, to build a model of the road environment. HD maps are rapidly evolving towards holistic representations of smart city digital infrastructure, including not only road geometry and semantic information, but also updates on real-time perception of road participants, weather conditions, work zones and incidents. Large-scale deployment of autonomous vehicles requires these maps to be built and maintained by a large fleet of vehicles that work together to continuously update the maps so that the autonomous vehicles in the fleet can function properly. This paper provides an extensive review of the various applications of these maps in highly automated driving (AD) systems. We systematically review recent advances in different methods and algorithms for constructing and maintaining high-precision maps. Data, communications, and infrastructure requirements for HD map distribution are also discussed and synthesized. Finally, current challenges are reviewed and future research directions for next-generation digital mapping systems are discussed.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

History of high-precision map development

A.Digital map

Modern satellite The advent of systems and imaging technologies revolutionized the creation of accurate and detailed digital representations of the world, resulting in what we now call digital maps, such as Google Maps, OpenStreetMap, Apple Maps, Garmin, and Mapbox. Digital maps encode road structure and basic semantic information as well as points of interest (POIs). There are several methods and techniques for extracting and identifying the geographic features needed to construct these maps from satellite imagery. Digital maps are now an essential tool in our daily lives, especially when integrated with GPS. In fact, this integration has been a core component in building a large number of digital services, most importantly navigation and routing. Developed primarily to aid humans, these maps are now available in the latest vehicles to aid human drivers. However, these maps are limited in their accuracy and precision and the update time required by AD, where vehicles require a certain degree of location accuracy as well as detailed lane-level information.

B. Enhanced Digital Map

Digital map has been significantly improved to meet the requirements of advanced driver assistance system (ADAS) functions such as lane keep assist and Adaptive Cruise Control (ACC). Typical features in these enhanced digital maps include speed limits, road curvature and gradient, lane information, and traffic signs and traffic lights. Enhanced digital maps, also known as ADAS maps, are now an integral part of most modern vehicles, enabling ADAS functionality. Although enhanced digital maps introduce lane-level information, their geometric accuracy and level of semantic detail limit their applicability at higher levels of autonomy. In AD systems, vehicles are required to position themselves with high precision relative to their environment, understand the current situation, and plan collision-free trajectories. To achieve this level of autonomy, automated vehicles need to acquire not only maps with centimeter-level position accuracy and lane-level geometric information, but also a 3D model of the environment, with all static and dynamic features of the road environment.

C. High-precision map

It is necessary to generate a high-precision map, or a high-precision map, to meet the above requirements. Figure 1 illustrates the evolution, characteristics and uses of maps, as well as the information, accuracy and level of detail contained.

D. Scalable Maps: Overview

Over the past decade, both academia and industry have made high-definition maps available through huge research and development efforts. Pushing the limits of being affordable, self-maintaining, and scalable. However, there are still some unresolved issues in building HD maps to scale that hinder the full potential and ultimate goal of HD maps in enabling autonomous mobility. These challenges can be divided into the following categories.

  • 1) Data collection: Data collection for HD maps can be a time-consuming and labor-intensive process. It typically involves using a combination of sensors such as GPS, IMU, lidar, and cameras to collect detailed information about the environment.
  • 2) Data communication: Data communication includes transmitting map data from the collection place to the processing place to build a high-precision map, and finally to the consumption place, such as self-driving cars. Mapping vehicles generate large amounts of data from different sensors, which needs to be processed to build and update maps. Processing this data from a large number of mapping vehicles in real time is indeed a challenge.
  • 3) Data processing: Data processing is the step of creating a high-precision map by extracting the elements and features required to build a high-precision map. This can be a very complex task, especially for large maps, as it involves aggregating and aligning data from multiple sources and ensuring that the map is accurate and up-to-date. Where a large number of mapping vehicles are involved in the mapping process, precise time synchronization must be ensured to avoid data misalignment. Synchronization using GPS-generated pulses per second (PPS) signals tends to be the most common method of synchronizing all onboard sensors.
  • 4) Map maintenance: Map maintenance refers to the process of continuously updating high-precision maps based on changes in the road environment, such as construction sites, road blockages, and modifications to road connections. Since the road environment is highly dynamic and subject to change, this process requires frequent data collection and processing efforts.
  • 5) Data privacy and security: Data security and privacy are critical to HD maps because they often contain sensitive information such as the location of buildings and infrastructure. Ensuring that this data is protected and not misused is a major challenge.
  • 6) Mapping cost: In the process of creating high-precision maps, map cost is an important factor. Large-scale mapping requires the use of a large number of mapping vehicles, each equipped with a set of expensive mapping equipment with high-precision sensors. This cost becomes important when mapping large areas. High-precision mapping is possible using consumer-grade sensors, but this comes at the expense of using complex mapping algorithms.

E. Main contributions

This paper provides an in-depth overview of HD maps, including a unified model of its layered architecture. At the same time, the importance of high-precision maps in the modular AD system is emphasized, and their use in various AD core functions is synthesized. This article provides an extensive review of challenges in map data collection, communication, processing, security, and cost, including cost-effective solutions and communication and map data requirements from generation to distribution. Additionally, current challenges in building and maintaining HD maps are discussed. Finally, some inspirations are provided for future and next-generation mobile high-precision maps. To summarize the main contributions:

  • A stand-alone overview of HD maps as a context for the wider intelligent transportation systems community.
  • Detailed review of the most advanced technologies used by high-precision maps in various core functions of the AD system.
  • Comprehensive survey of different approaches, methods and algorithms to maintain HD maps at different levels and keep them up to date.
  • Discuss the main challenges and future prospects of HD mapping in integrated administration and beyond.

HD Maps: Overview

Early HD maps were just extensions of the enhanced digital maps used in ADAS, they were called early maps . The term HD Maps has only recently emerged, but is now widely accepted by the CCAM industry, including Tier 1 automotive companies, map providers and OEMs. HD maps encapsulate all the necessary information for automated vehicles to understand the driving environment with very high accuracy. While it is generally accepted that HD maps are the core enablers of CCAM, there are no clear guidelines or standards for what information constitutes HD maps and how to represent this information. Nonetheless, HD maps available on the market share common features. Centimeter-level position accuracy and the availability of lane-level geometric and semantic information are essential features in most HD maps. At its most basic level, an HD map can simply be a set of points and line segments whose exact locations represent road signs, lane markings, lane boundaries and lane separators. Due to the requirements of AD systems, today's high-precision maps are becoming more and more complex, and data from different sources constitute multiple layers of information about the driving environment. Breaking down HD maps into multiple layers allows for a more structured data representation of the road environment. This facilitates the accessibility of different components of the AD system, which require the environment to be modeled at different levels of detail. Additionally, hierarchical data representation makes map construction, storage, retrieval, and maintenance easy. Examples of these layers are given in Figure 2.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

As mentioned above, there are several ways to represent map information used in AD systems, including lane-level details such as lane boundaries, lane marking types, traffic directions, crosswalks, drivable area polygons, and intersection annotations. Although the driving environment is highly dynamic, the data represented in these three layers is static. The overall representation of the environment should also include real-time traffic information on observed speeds, weather conditions, congestion areas, road blocking areas (construction), etc. This section attempts to provide a global overview of the information stored in these layers in a unified manner. Although most HD map providers have their own definitions and formats, and there is no single standard for HD maps, we divide the information contained in HD maps into six different layers, as shown in Figure 2.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

A. Base Map Layer

The base map layer is the foundation of the HD map and is considered the base upon which all other layers are built. Reference layer. It contains a highly accurate three-dimensional geospatial representation of the environment, such as the location and shape of roads, buildings, and other structures. Three-dimensional geospatial models of the road environment are becoming an important source of information for autonomous vehicles. Today, HD maps often contain three-dimensional representations of the environment. Base map layers are typically created using point clouds from lidar and/or images from one or more cameras, sometimes with the help of GPS/IMU. This suite of sensors forms an MMS that creates a highly accurate and detailed 3D point cloud representing the environment. Geometric and semantic features of roads and lanes are extracted from this layer to build other layers in the HD map. Because this layer contains a dense data representation of the environment, it plays a crucial role in the precise localization of autonomous vehicles. Several techniques for point cloud registration allow vehicle pose to be estimated by matching raw sensor data to the point cloud of that layer. Building and updating this layer is challenging in terms of data processing and communication needs.

B. Geometry Map Layer

Although the base map layer provides a precise and dense representation of the environment, it lacks meaningful features in its representation that support understanding the environment. capabilities are limited. Geometry layers in HD maps provide detailed information about the geometry of the road environment, including the location and shape of roads, lanes, curbs, and other features. The geometry layer typically includes information about the width of the road, the number of lanes, the centerline of each lane, the boundaries of the lanes in each road, and the elevation of the road surface. It also includes information on the precise location and shape of curbs, sidewalks, crosswalks, and vertical and horizontal traffic signs. Each of these features is represented by basic geometric primitives, namely points, lines, polylines, and polygons. For example, the location of a vertical traffic sign can be represented by a point. A lane centerline or boundary can be represented by a set of interconnected line segments, such as a polyline. Similarly, a crosswalk can be represented by a polygon. The geometric features of this layer are created by processing the data from the base map layer. Building a geometry layer from base map data typically involves several processing steps, including road segmentation, lane information extraction, road signs, poles, traffic signs, curbs, obstacles, and pavement features. This layer provides a highly accurate lane-level geometric representation of road features. Geometric features in HD maps are crucial for various AD core components, most importantly accurate motion prediction of dynamic road participants, and safe planning of geometrically feasible trajectories.

C. Semantic Map Layer

The semantic map layer defines the importance of road features provided by the geometry map layer. The data in this layer provides context and meaning to the features represented in the map. For example, a semantic map layer in an HD map contains information such as road type (e.g., highway, residential road) and lanes (e.g., may change to the left or right), their numbers, traffic direction, and whether the lane is used for turning or for turning. Information about parking. It also includes information about speed limits, lane boundaries, intersections, crosswalks, traffic signs, traffic lights, parking spaces, bus stops and many other features that are important for building contextual representations of the environment. The semantic map layer allows autonomous vehicles to build detailed situational representations of their environment and understand traffic rules, enabling them to make correct and safe decisions in different traffic scenarios. Simply put, the semantic map layer assigns semantic labels to road features and objects defined in the geometric map. For example, a point in a geometry layer is nothing more than an ordered set of coordinates in a map coordinate reference system. Only the semantic layer defines whether the point corresponds to a traffic light, yield sign, or stop sign. As we all know, high-precision maps contain rich semantic information. The semantic layer also associates metadata with road features, such as road curvature, recommended driving speed, and unique identifiers for each semantic feature. In fact, semantically rich HD maps enable self-driving cars to better understand the driving situation and make complex decisions in complex scenarios. However, constructing reliable and high-fidelity semantic graphs of road environments is not a simple process. Several processing steps are required, not limited to scene segmentation, object detection, classification, pose estimation, and mapping. With recent advances in computer vision, deep learning, sensor fusion, and semantic SLAM algorithms, it has become possible to build accurate semantic graphs.

D. Road connection layer

The road connection layer describes the topology of the road network and how various geometric elements are connected. Contrary to the standard definition of a digital map, which only contains road-level information and road-level connections, HD maps contain lane-level geometric and semantic information, so the connections between roads become complex as it defines two or more sets of lanes. connections between. More precisely, this layer provides the layout and connectivity of the road, including lane boundaries and centerlines and intersections. Lane-level connectivity information is necessary for planning legal transitions between roads and lanes and for planning allowed operations at each intersection, which is critical for path planning for autonomous vehicles. Simply put, this layer defines how the primitives that make up the geometry layer are connected to each other. These connections are established by defining sequential pairs of geometric and semantic elements. Assigning a unique identifier to each geometric and semantic element enables the representation of this information using graph data structures, where each element is represented by an edge and their connections as nodes. The graphical structure allows for quick querying and searching of maps, and efficient route planning.

E. Prior map layer

This layer is also called the prior map layer because it represents and learns information from past experience. It involves geometric and semantic elements in the map whose state changes over time. Learning traffic flows and the status of accident areas from fleet data allows for more efficient and predictive driving behavior. This layer also acquires and learns information that helps predict human driving behavior and the dynamic state of traffic lights at intersections. It also adapts to temporary road settings such as parking orders, occupancy and timetables. For example, on-street parking in some cities changes on certain weekdays, the probability of occupancy is predicted, and the time rules governing a given parking lot are derived from previous map layer sensor readings of different fleet vehicles passing through that parking lot. out. Learning and predicting the driving behavior of road drivers can be challenging due to sociocultural differences between different societies. Empirically modeling these behaviors is critical for a general and scalable AD system.

F. Real-time map data

The real-time layer in HD maps is a dynamic layer that provides real-time information about the environment, such as traffic conditions, road closures, and other possible impacts Events for autonomous vehicle navigation. This layer is typically created by combining data from various sources, such as cameras, sensors and other connected devices mounted on vehicles or located on the roadside. Through crowdsourcing of participating vehicles or smart infrastructure using specific communication networks, data is collected in real time and used to update high-precision maps. The real-time layer can include information such as the location and speed of other vehicles, the location and status of traffic signals, and the presence of construction zones or other obstacles and blockages on the road. This information is critical for autonomous vehicles to make safe and efficient driving decisions in real time to optimize traffic flow and reduce congestion. Additionally, the real-time layer can be used to improve the accuracy and completeness of HD maps by providing up-to-date information about the environment that may not have been captured by the sensors used to create the map. Simply put, the real-time layer in HD maps provides a dynamic, up-to-date representation of the environment. Real-time updating of HD maps with dynamic elements is challenging and requires complex intelligent communication infrastructure and cooperation among multiple actors. Data transmission between intelligent transportation systems (ITS), HD map providers and vehicles must be reliable and meet certain requirements described later in this survey.

High-precision map in the autonomous driving system architecture

High-precision map provides the AD system with a detailed and accurate representation of the road environment. These maps contain lane-level geometric, topological, and semantic information required for safe and efficient navigation of autonomous vehicles. The use of HD maps in self-driving cars allows them to better understand their surroundings, plan routes, and make more accurate driving decisions to ensure the safety of passengers and other road users. This section discusses the importance and use of high-precision maps in AD systems. Ultra-precision map data is now an integral part of most of the different core components in AD systems. In order to discuss the importance and use of HD maps in AD, we briefly introduce the architecture and standard components of a typical modern AD system. Figure 5 shows the standard components of an AD system, showing those components that rely on HD maps. This section begins with a brief introduction to the architecture of the AD system, how it works, and its various components. The remainder of this section provides an extensive review of the state of the art in AD components that rely on HD maps.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

A. Autonomous Driving System Architecture

An automated vehicle is a complex cyber-physical system in which different components must work together to complete the whole in a robust, reliable and safe manner driving tasks. Although there is no unique architecture for AD systems, we rely on a common architecture in this work that helps us understand how HD maps can be used to improve different functions of AD systems. Similar to any robotic system, an autonomous vehicle can be viewed as a cognitive agent with three main components, (1) sensors, (2) perception, and (3) behavior. Breaking these elements down into an industry-grade AD system results in several components, as shown in Figure 5. Sensing components in modern AD system architecture usually include different sensors such as IMU, GPS, cameras, lidar and radar. A subset of these sensors allows the vehicle to know its position relative to the environment, i.e. for localization, and the remaining sensors are used to sense the environment itself. The role of the sensing component is to read and preprocess raw sensor data and provide it to other parts of the AD system. In its simplest form, a sensing component consists of a set of sensor drivers that read raw sensor data in real time. The positioning component is one of the most critical components for the reliable operation of the entire AD system. Its purpose is to accurately estimate the vehicle's position. Localized errors are propagated to the rest of the AD processing pipeline. Localization is simply a state estimator that fuses raw sensor data from sensing components. Furthermore, the availability of maps allows for improved and robust localization, especially in areas where some sensors have failed or degraded performance. The role of perception is to generate an intermediate-level representation of the current state of the environment, including information about obstacles and road factors. This representation also includes details about lanes (location, boundaries, markings, and types), traffic signs, traffic lights, and drivable areas. Computer vision and deep learning techniques are widely used for segmentation, clustering, and classification tasks. Additionally, target-level fusion is also an important part of this component. The output of perception is a list of tracked objects and a semantic segmentation of the image for scene understanding. Geometric and semantic information from HD maps can also be used to improve object detection and fusion. Accurate perception is critical to safety, as perception errors can affect the quality of information used by the entire AD system. Therefore, using redundant sensor data sources can increase confidence in the accuracy of the perception, thereby improving the robustness of the overall system. The scene understanding component is the bridge between the perceptual component in the AD system and the abstract mid-level state representation of the environment given by the high-level cognitive component. This component aims to provide a higher level of contextual understanding of driving scenarios by building high-precision maps and data provided by the perception component. Later in this section, we discuss how these two sources of information can be fused to build a scene representation for understanding the driving environment. Another component in the AD pipeline that relies on HD maps is the motion prediction component. It builds on high-level spatiotemporal representations of the environment provided by scene understanding to predict the behavior of road agents around the vehicle. The role of HD maps in motion prediction is to provide the previous trajectories of each road agent in the scene. Motion prediction is a highly multimodal problem in which HD maps play a key role, which is discussed in detail in this section. The motion planning component is designed to calculate feasible, collision-free and safe trajectories for autonomous vehicles. This is achieved by optimizing the global shortest path obtained by the routing algorithm running on the HD map data and the predicted trajectory of the road agent. Motion planning also includes behavior planning capabilities that rely on the state of the current scene defined by detected objects and HD maps. The control unit receives the planned trajectory and calculates control commands for the steering, braking and acceleration drive systems. The control component does not explicitly rely on map data, so it will not be considered in this investigation. Finally, as shown in Figure 5, a special component is used to serve all other components by handling requests to provide map data. HD map data is typically stored in a database that is queried by a map server (local or cloud) to route, tile, and update requests from map clients in the vehicle. Since the routing element requires special algorithmic processing, we will consider it in the survey of HD map applications in AD systems.

B. Positioning

The positioning component in the AD system is designed to estimate the position and orientation of the vehicle relative to the global reference coordinate system. Its key role is to continuously maintain high accuracy and robustness in the required estimates of successive components in the system. The accuracy of the positioning algorithm determines the reliability of the entire AD system. Robustness of positioning under adverse weather conditions is a key requirement for modern AD systems, as degraded estimation performance can lead to severe consequences and potential damage. Over the past two decades, significant research on positioning has achieved remarkable results, resulting in a variety of methods. To ensure normal operating conditions and achieve global system safety, autonomous vehicles need to be positioned with an accuracy of within 10 centimeters.

C. Perception

The perception component in AD systems is often associated with processing raw camera images and lidar point clouds, and is not only used to detect and track static targets (e.g., traffic signs and road markings), and is also used to detect and track dynamic obstacles such as surrounding vehicles, pedestrians, and cyclists. Perception is one of the key core functions of AD systems. Ensuring its reliability and real-time performance is critical to ensuring collision-free navigation. Fusing perception data with the detailed and precise geometric and semantic information contained in the layers of HD maps can potentially improve perception by focusing on the most relevant regions of interest (ROI). More precisely, the geometry of the HD map allows defining ROIs to filter the point cloud, leaving only those of particular interest to the perceptual function, thereby simplifying and increasing the computational efficiency of unhurried detection.

D. Scenario Understanding

Understanding the driving environment is crucial for autonomous vehicles to make correct and safe decisions. One of the early motivations for HD maps was to provide autonomous vehicles with precise and detailed information to help understand their environment. This information enables the AD system to understand the current driving situation and interpret all entities that make up the scene. The geometry and semantics contained in the map make it possible to systematically build compact data models and environment representations, allowing vehicles to handle complex driving scenarios. More precisely, the scene understanding component in AD systems, supported by the geometric and semantic information of HD maps, can consistently provide meaningful perceptual context. In addition to raw object detection, scene understanding aims to extract and estimate safety-critical information and make it available for subsequent processing stages.

E.ROUTING

Road-level digital maps aid human driver navigation. Route calculations in these maps cannot go beyond using road-level connections because these maps do not include lane-level details. Accurate and optimized driving routes are necessary to save time and energy and promote vehicle safety worldwide. Efficient and low-cost driving route calculations must consider lane-level models of the environment. Furthermore, in highly dynamic environments, detailed information about traffic status and lane occupancy is critical to dynamically adjust routes as autonomous vehicles navigate the environment. Taking into account the detailed and accurate lane-level information as well as the a priori and real-time layers of the HD map static layer, efficient dynamic route calculation is possible. In order for the routing subsystem in an autonomous vehicle to calculate a drivable path from the current location to a set destination, the system must be provided with the latest map from the HD map server, as shown in Figure 5. Alternatively, like digital maps, route calculations can be provided as a service. After its accurate position is sent to the HD map server, the optimal route can be calculated and fed back to the vehicle to support other core components of the system. In the past few years, these routing services have involved taking into account real-time traffic conditions and energy factors (e.g., the most energy-efficient route). For autonomous vehicles, other factors can be considered, such as routes that avoid complex urban environments that are difficult to navigate with ADS, or routes with good network coverage to guarantee continuous connectivity to online services, including real-time high-precision map services.

F. Motion planning

The role of motion planning in the AD system is to generate feasible, safe, collision-free and energy-saving trajectories. Motion planning tasks typically include trajectory generation and behavior planning. Behavior planning is an advanced decision-making function used to decide transitions between different driving states, such as lane changes, following vehicles in the lane, slowing down and parking, etc. To perform these transformations safely, the behavior planner requires local maps and vehicle awareness to build a transformation model of the vehicle environment. Unlike navigation in mobile robots, the road environment is highly structured and all road users must obey traffic rules. The generated AD trajectories are strictly required to ensure compliance with traffic rules and movement within drivable road areas. Different methods exist for motion planning of autonomous vehicles, and they all rely to some extent on geometric and semantic information provided by high-precision maps to comply with traffic rules. In sample-based motion planning methods, the lane geometry of the HD map is used to restrict the search space by rejecting infeasible candidate trajectories.

G. Motion Prediction

The driving environment is highly dynamic and involves different road actors such as pedestrians, vehicles and cyclists. Predicting the future movements and behaviors of these road actors is critical for autonomous vehicles to build context-aware representations of their interactive environments, thereby predicting potentially hazardous situations. From an abstract perspective, these traffic participants can be thought of as a complex multi-agent system. In fact, developing reliable solutions for predicting road agent motion and behavior will improve the safety and ability of autonomous vehicles to adapt to human-like behavior in real-world traffic conditions. Predicting the behavior of these traffic participants is crucial to AD systems and is mainly used for risk assessment and safe and comfortable movement planning. Motion prediction refers to estimating the future behavior of road agents based on their current state and a model of their environment. Various research efforts have addressed the problem of predicting future movements of road participants.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

H. Third-party applications

High-precision maps can provide accurate and reliable GT data, which can be used as a reference for calibrating sensor output. For example, lidar can be calibrated using high-precision coordinates of geometric elements of a high-definition map and perfectly aligned with an IMU. By comparing sensor measurements to HD map data, any errors or discrepancies can be identified and corrected, improving sensor calibration. Additionally, HD maps can be used for online (self-)calibration. The availability of HD maps, real-time raw sensor data and algorithms to perform comparisons makes it possible to calculate the error between sensor measurements and GT. Therefore, it allows continuous correction of sensor calibration errors in real time. This makes the AD system more robust and reliable to changing environmental conditions as well as changes in sensor performance. Online calibration enables more accurate and robust sensor calibration compared to offline calibration methods. More recently, HD maps have also been used to enhance road annotations to create large datasets for traffic landmark detection.

Building high-precision maps

A. Mobile mapping system

Constructing high-precision maps is a complex process. Several steps are required. The first step in building an HD mapping program is to dispatch specialized vehicles equipped with a suite of highly accurate and well-calibrated sensors to survey and collect data about the environment. Data collection vehicles used for mapping may be equipped with connections to correction services with RTK (real-time kinematics) positioning accuracy up to a few centimeters or high-precision GNSS enabling correction services. GNSS positioning measurements are often integrated with measurements from high-performance IMUs (Inertial Measurement Units) and wheel odometers. There are several commercial products integrating GNSS and IMU as an inertial navigation system in one unit. Mapping vehicles are also equipped with one or more high-resolution lidar and cameras to collect raw 3D/2D data of the road environment. There are two ways to set up a data collection tool for mapping. The first step is to purchase the above sensors, select the appropriate configuration and install them on the vehicle. Although this approach offers the flexibility of pre-defined sensor configurations; however, calibrating several different sensors to the accuracy required for plotting is not trivial and time-consuming, especially for cameras. Alternatively, some manufacturers offer an entire set of sensors in a single package, called a mobile mapping system (MMS). An example of a commercial MMS is shown in Figure 6.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

High-definition map maintenance

Having the latest high-definition maps is crucial for the correct operation of various AD core components. Bugs in HD maps can cause serious damage due to poor decisions made by the system. Wrong decisions can be avoided through frequent updates of map vehicles. The road environment is highly dynamic and may change frequently due to new infrastructure construction, road maintenance, and lane expansions. The mapping vehicle must be able to detect changes in the environment and send them to update the map. The map update process involves complex processing steps, including processing data from multiple sources and sensors at different scales, identifying deviations between the stored map and newly collected environmental data, and finally integrating these deviations to update the different layers of the map. Several methods and approaches have been developed in the literature to capture changes in HD maps and update them. In the following, we review different methods and methods for detecting changes in HD maps and how this information can be applied to update maps. The approach we followed to investigate previous efforts to maintain HD maps is based on analyzing the layers maintained by each state-of-the-art method, as shown in Table 3.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

A. Map change detection

Change detection in HD maps refers to the process of identifying changes in the environment, such as new buildings, Road closures etc. The map's layers are then updated accordingly. HD maps change regularly, and having a map that can be trusted by self-driving cars is critical to safe navigation. Change detection is typically achieved through the use of various sensors, such as cameras, lidar, and radar, combined with computer vision algorithms and machine learning techniques. Even before the advent of high-definition maps, change detection algorithms have found their way into many applications. Remote sensing is one of the early applications of map change detection and updating. It has also been successfully used in urban monitoring, forest changes, crisis monitoring, three-dimensional geographic information updating, construction progress monitoring and resource surveys. At the most basic level in these applications, the problem amounts to comparing raw sensor data, primarily 3D point clouds, 2D images, or a combination of both.

B. Map data update

The second phase of HD map maintenance is to update map elements based on the results of change detection. Simply put, map updating is equivalent to a probabilistic data fusion problem. Continuously monitoring changes in an ever-changing environment in near real-time and fusing different data patterns in time and space, as well as updating multiple layers from different sources, is indeed a challenging task. Cadena et al. note in their survey paper that the distributed process of updating and maintaining high-definition maps created and used by large fleets of autonomous vehicles is a compelling topic for future research. In this direction, Kim et al. proposed a solution to keep new feature layers up-to-date from crowdsourced point cloud data. This new feature map forms the basis for building different semantic and geometric features for HD maps.

Data and Communication Infrastructure for HD Maps

Building and maintaining HD maps at scale is a data exchange problem between multiple stakeholders, e.g., as an ITS Governments, map providers, and vehicles as roadside infrastructure owners, as shown in Figure 7. The collection, construction, maintenance, and distribution of map data require reliable communications and distributed computing infrastructure. This section discusses the data and communications infrastructure required to scale the creation, maintenance, and distribution of HD maps.

Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps

Challenges and Future Outlook

While CCAM has made significant progress over the past decade, achieving full vehicle autonomy still remains is an unresolved challenge. For autonomous vehicles to be deployed at scale, a scalable solution for HD mapping is critical. In this section, we shed light on the various challenges that need to be addressed to realize the full potential of HD map CCAM. There is no doubt that the availability of cost-effective and flexible solutions for building, maintaining and distributing map data among stakeholders will greatly enhance the scalability of CCAM in future generations of smart cities. Additionally, we discuss the future prospects and applications of HD maps.

A. Challenges

  • Standardization and data representation: The concept of high-definition maps has been widely accepted and has become a key technology for CCAM. However, there is no consensus on how to represent map data, how many layers are needed, what map data must be stored in each layer, and in what data format the map data must be stored. Due to the complexity of HD maps and the large amounts of data and information they contain, it is difficult to define a universal standard for them, making it challenging to create a standard that is comprehensive and easy to understand, store, maintain, update, and effectively distribute. Defining a common standard for map data will provide more data compatibility and facilitate access to data while reducing development and integration costs. Furthermore, this will improve the quality, consistency and privacy of data, thereby improving road safety for all actors, including automated vehicles.
  • Scalability: Scalable HD mapping solutions are critical to the large-scale deployment of autonomous vehicles. Building high-definition maps of cities, regions, and countrywide and keeping them updated remains a huge challenge, especially when dealing with the different standards, traffic rules, and regulations used to represent geometric road features and traffic signs. These standards vary by region. Mapping algorithms must be generic and able to work across different regions and countries. Mapping should be a continuous process of data collection and processing to fix changed areas. This process becomes challenging over large geographic areas where large numbers of vehicles must be part of the mapping process. The cost of mapping depends directly on how large the area is to be mapped and the number of vehicles required to serve it. As discussed earlier in this article, mapping vehicles are very expensive. Additionally, using individual vehicles equipped with consumer-grade sensors requires complex algorithms that are not yet mature.
  • Network and Computing Infrastructure: Handling and processing large amounts of data in the context of building and updating scalable HD maps requires reliable network and computing infrastructure that is coordinated and near real-time. With the emergence of 5G/6G cellular communications, Internet of Things (IoT), and edge computing architectures, many opportunities for in-vehicle communications are generally available, making solutions that handle building high-definition maps a commercially viable option. These communications and computing infrastructures are designed to handle such data-intensive applications and meet their latency and bandwidth requirements. Large-scale crowdsourced maps with large numbers of connected vehicles will be one of the main applications of these infrastructures.
  • Limitations of Mapping Algorithms: Despite significant R&D efforts in automating the process of building HD maps, recent research results on HD maps clearly demonstrate that Topological mapping algorithms are still limited to simple features. Current state-of-the-art algorithms can detect simple geometric features but cannot handle high-curvature features such as roundabouts. Furthermore, most of these methods require several post-processing steps to obtain features in a suitable vector format. Map semantic features are still limited to a very small number of easily detectable traffic signs. Few recent works have begun to address the problem of constructing lane topologies to build simplified road/lane connection networks. Developing a generic map pipeline enables the construction of a fully functional HD map containing geometric, semantic and topological information. Building such a pipeline remains a challenge.
  • Map Data Ownership, Privacy, Integrity and Distribution: The future of building and maintaining HD maps will be automating and distributing the processes involved to millions of vehicles. Collecting, processing, and storing large amounts of distributed data from the environment raises several concerns about data ownership, privacy, integrity, and distribution. Raw map data is generated in the vehicle, aggregated with other data sources from public authorities, processed and distributed by map providers. Ownership of map data from collection to distribution may need to be addressed in large-scale HD maps. Additionally, protecting the privacy of individuals and vehicles is critical and must be considered during the drawing process. Map data can include sensitive user information such as the vehicle's precise location and a precise description of the vehicle's environment. The integrity of HD map data must be ensured to avoid erroneous and fatal decisions, especially when used in autonomous vehicles. Constructing accurate and reliable high-definition maps remains an ongoing research problem. Commercial HD maps are typically manually reviewed and verified. Generating accurate and reliable high-definition map data from multiple data sources, such as through crowdsourcing, poses a number of technical issues that need to be solved. Ownership, privacy, and integrity of scalable high-definition maps have recently begun to attract the attention of researchers. Blockchain, on the other hand, has proven to be a promising solution for ensuring data integrity due to its distributed and secure nature. The use case of building and updating scalable HD maps while maintaining traceability, privacy and integrity of data is a perfect application for blockchain. This technology is expected to play a central role in building and distributing the next generation of high-definition maps.

B. Future Directions

  • Precision: Precise positioning has been one of the main motivations for introducing high-definition maps to autonomous vehicles.The existence of a dense, compact representation of the road environment is fundamental to HD maps; especially when it comes to localization. There has always been a trade-off between the density of information contained in HD maps and the computational effort required to process this information. Recent advances in neural 3D scene representation make it possible to reconstruct photorealistic 3D scenes in very compact representations. Representing the base map layer using Neural Radiation Fields (NeFR) allows to benefit from a compact and photorealistic representation of this layer. This technology could usher in a new era of self-driving cars.
  • Applications beyond autonomous driving: HD maps were developed primarily to help autonomous vehicles understand their environment and navigate safely within it. Since HD maps provide a detailed and precise representation of the environment, they can also be used to improve the quality of various services provided by classic digital maps. Additionally, HD maps play an important role in digital assistive technology for people with disabilities. If visually impaired people are equipped with appropriate sensors and have access to highly accurate, detailed, and semantically rich representations of their environment, their mobility and safety can be significantly improved. If positioned accurately, digital assistive devices will be able to interpret and understand the environment to generate voice navigation messages for safe navigation. The real-time status of traffic lights and other traffic information in pedestrian HD maps is relevant to enhancing the functionality of these devices. Currently, most HD map providers only provide maps that represent the vehicle environment. Routes involving participants other than vehicles, such as pedestrian walkways and bicycle paths, are still not mapped in today's HD maps. Building and updating high-definition maps for all participants will pave the way for a wide range of autonomous and non-autonomous navigation, as well as a number of useful digital services.
  • Towards digital twins: An environmental digital twin is a holistic digital representation of an environment, including all of its physical and functional characteristics. City-scale digital twins are an emerging concept in CCAM that aims to build a data-driven model that will come from various sources of IoT sensors, connected vehicles, buildings, smart infrastructure and transportation networks, and all other data sources The data is combined to help create a comprehensive, real-time city model to improve road services. This concept generalizes HD maps as digital models for connected and autonomous vehicles to a holistic digital model that helps all entities in society. Digital twins can even be used to model the behavior of different entities in an environment, even at a microscopic level of detail. The HD map will be a single module of the digital twin, supporting different features and services for connected and autonomous vehicles in our smart cities. As high-definition maps can be used to simulate complex driving scenarios, digital twins will be used to simulate and analyze complex city-scale scenarios for these vehicles. Digital twins will allow the study, analysis and simulation of the impact of new developments or changes in traffic patterns and can help urban planners and decision-makers analyze and optimize the performance of cities by predicting future scenarios and identify opportunities for improvement. Building a city-scale digital twin is indeed a huge challenge, requiring large amounts of data, and it can be a complex and time-consuming process. Cross-validation, integrity and trustworthiness of distributed large amounts of data remain challenges in creating digital twins. Crowdsourced road mapping from vehicles will be replaced by a unified process for outdoor and indoor mapping using massive amounts of data from heterogeneously connected sensors simultaneously.

Conclusion

HD mapping continues to be a rapidly growing aspect of real-world CCAM applications, driving innovation and advancement in the field. Although a large amount of research and development work has been carried out on the application of HD maps in AD systems and on the algorithms and infrastructure for building and maintaining HD maps, there is very little literature that can summarize and provide a foothold for these efforts. This paper provides an extensive review of previous work on building and maintaining HD maps, including cost-effective solutions, as well as communication and map data requirements from generation to distribution. Additionally, this article discusses current challenges in building and maintaining HD maps. More precisely, we provide an independent overview of the HD map as a context for the wider intelligent transportation systems community. We also discuss and analyze the latest technologies for using HD maps for various core functions in AD systems. Furthermore, we extensively discuss and review different approaches, methods, and algorithms for building HD maps at different levels and keeping them up-to-date. Finally, we shed some light on the future development of HD maps for next-generation mobile applications.

The above is the detailed content of Cloud-based and car-based MapNeXt is all done! Construction of next-generation online high-precision maps. For more information, please follow other related articles on the PHP Chinese website!

Related labels:
source:51cto.com
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Popular Tutorials
More>
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template