Satellite Cameras from Continental Improve Safety and Comfort

Cameras are increasingly becoming the central sensory organs of automobiles. Surround view systems consisting of several satellite cameras provide an all-around view of the vehicle environment from a bird’s eye perspective. Cameras look forward to identify traffic signs, traffic lights or lane markings. And they look back and to the side, for example to make objects in the blind spot visible. The technology company Continental is bundling these components, which were previously deployed separately, to form a complete system: several satellite cameras provide high-precision image data that is processed and evaluated by a central control unit. The system is modular, scalable and connected – and it comes from a one-stop shop. Above all, however, the combination of several satellite cameras enables numerous new functions that make driving safer, more comfortable and – if desired – increasingly automated.

Award-winning view through the hood – Continental ensures transparency

The “transparent hood” function developed by Continental and awarded a CES 2020 Innovation Award highlights what an intelligently integrated camera system is capable of. This function went into series production for the first time at the end of 2018 in a SUV of an European car manufacturer. When driving slowly – such as when parking or off-roading – the ground beneath the engine compartment is displayed on the screen in the vehicle. With the help of the new optical information, a vehicle can be maneuvered precisely and in a controlled manner in narrow parking spaces with high curbs, over speed bumps and potholes, or when off-roading over rocks and rough terrain. To the driver it looks as though the hood and the engine compartment beneath it are transparent. “The image of the terrain around the vehicle is provided by the satellite cameras already installed in many vehicles. They are located at the front of the radiator grill, at the rear and there is one at the bottom of each of the side mirrors. However, the satellite cameras themselves cannot depict the space underneath the car. An intelligent Image Processing Algorithm developed by Continental, which also includes different vehicle sensor data, is reconstructing the image under the vehicle and inserts this image exactly into the surround view displayed to the driver,” said Markus Friebe, Head of Visualization Functions at Continental.

The “transparent hood” is a further extension of what experts call “human vision” systems, which are based on camera displays and support the driver. Basically, this extends the surround-view system to include a view under the car. “We now combine this ‘human vision’ with so-called ‘computer vision’. This term encompasses all camera assistance systems that go beyond mere display to provide a warning or intervention function, such as accelerating, steering and braking,” said Sascha Semmler, Head of Program Management Camera at Continental.

“Computer vision” systems include, for example, intelligent front cameras that not only detect traffic signs, traffic lights, lanes or obstacles, but can also recognize and evaluate them. The driver then receives the appropriate acoustic, visual or haptic information or warnings – for example, if the car threatens to leave its lane. The camera can also be used as an emergency brake assist: If the system detects another road user in front of the vehicle, it automatically initiates emergency braking in order to avoid a collision as far as possible. “In the future, this intelligence will no longer be linked to the front camera alone, but to several satellite cameras,” remarked Sascha Semmler. “Functions where the vehicle will automatically brake in the future when reversing if, for example, it comes too close to a person behind the car, are going into series production.”

Camera system functions can be individually configured in line with customer requirements

If all four satellite cameras, which permanently record the surroundings of the car anyway, are connected to a central control unit that can evaluate the image information and trigger the corresponding functions, not only is automated parking even safer, but remote or valet parking functions can also be implemented. The driver can then get out, and the vehicle finds its way into the gap by itself at the push of a button and parks in and maneuvers out of the space again.

The example of parking shows that Continental’s new satellite camera system has a modular design and is scalable in terms of performance and functionality. From purely optical support for the driver with a 360° surround image of the vehicle environment to automated parking and completely autonomous parking after the driver has left the vehicle, all stages of the parking and unparking support can be realized by the system.

The rear-view mirrors can also be replaced by cameras in the future

Satellite cameras with an image resolution of 1.3 megapixels are currently being installed on cars, and a new generation of cameras with a resolution of 2.5 megapixels and excellent night vision performance is about to go into production. And Continental is already developing the next expansion stage for future applications: a camera with eight-megapixel resolution. It will be possible to replace the traditional rear-view and inside mirrors with these high-end cameras in future. They not only provide a pin-sharp image, but also the necessary data to precisely identify a motorcyclist coming up from behind, still far away but approaching rapidly, even in difficult light conditions. In such a scenario, the system could warn the driver or, if necessary, prevent the vehicle from changing lanes as planned.

Here, too, intelligently integrated satellite cameras not only reproduce reality as accurately as possible, they also evaluate the optical information in combination with a central control unit and help with an appropriate reaction. It is not only the camera technology that plays a key role here, but also the Assisted & Automated Driving Control Unit (ADCU) from Continental. In combination with the appropriate software, the ADCU always has an overview of the vehicle, its surroundings and the driving situation – and can react appropriately at any time. The satellite camera system is also making a major contribution to realizing Vision Zero – Continental’s vision of a future without road traffic accidents.