A system for processing multi-modal data representing an environment to generate scene graphs of the environment is described. The system can obtain sensor data associated with a vehicle operating in the environment. In examples, the system can determine a...

A Bird's Eye View (BEV)-based object detection framework for autonomous vehicles. The disclosed embodiments pretrain a diffusion model system on BEV representations generated from sensor data, such as cameras, LiDARs, and radars. The pretrained diffusion m...

In various examples, methods and systems are provided for determining, using a machine learning model, one or more of the following operational domain conditions related to an autonomous and/or semi-autonomous machine: amount of camera blindness, blindness...

Systems and methods are provided for vehicle navigation. In one implementation, at least one processing device may receive, from a camera of the host vehicle, at least one captured image representative of an environment of the host vehicle. The processing ...

A device and a method for improving the object recognition performance of an autonomous driving controller are disclosed. According to the present disclosure, it is possible to recognize an object by using raw data received from multiple different sensors,...

Systems and methods described herein relate to self-supervised scale-aware learning of camera extrinsic parameters. One embodiment processes instantaneous velocity between a target image and a context image captured by a first camera; jointly training a de...

A vehicle image processing device includes: a processor configured to: acquire information comprising at least one of time information, position information, or vehicle information; estimate an operation scene of a vehicle based on the acquired information...