Occupant Monitoring

The Occupant Monitoring System (OMS) is a vital active safety and intelligent interaction technology within modern smart vehicle cabins. By integrating in-cabin infrared cameras, millimetre-wave radar, deep learning vision algorithms, and seat occupancy sensors, it performs all-weather, high-precision real-time monitoring and intelligent analysis of the physiological status, posture, seating position, and actions of the driver and occupants. Driven by global automotive safety regulations (such as Euro NCAP assessment standards) enforcing mandatory requirements for Child Presence Detection (CPD) as well as driver distraction and drowsiness monitoring, OMS has evolved from an isolated feature into a core system dedicated to protecting occupant safety and enabling in-cabin smart interaction.

Core Technical Architecture and Working Principles

The technical architecture of OMS primarily comprises in-cabin multi-modal sensing hardware (such as near-infrared / NIR cameras, ToF 3D depth sensors, and in-cabin millimetre-wave radars), high-computing-power cockpit domain controllers, and edge-level deep learning algorithm models:

In-Cabin Multi-Modal Vision and Millimetre-Wave Radar Fusion Perception: 

The system's perception layer typically adopts an infrared-illuminated camera paired with a roof-mounted in-cabin millimetre-wave radar. Even in pitch-black conditions at night, the infrared camera can clearly capture the driver's eyelid movement, gaze direction, and subtle head motions; meanwhile, the millimetre-wave radar can penetrate thick clothing or blankets to accurately detect faint chest movements, achieving seamless, all-weather coverage of vital signs throughout the cabin.

Deep Learning Pose Estimation and Biometric Recognition Algorithms:

Leveraging the cockpit processor's robust AI computing performance, OMS algorithm models perform real-time inference on captured image and point-cloud data. The system can accurately recognise faces for identity authentication, determine if the driver is fatigued or distracted (DMS functionality), verify the proper installation of rear child safety seats, evaluate occupant seating posture (preventing severe secondary injuries from airbag deployment if an occupant is reclining or resting their feet on the dashboard/centre console), and trigger emergency alerts for unattended children or pets left in the rear (CPD functionality).

Safety Guidelines and Physical Limitations

Strictly prohibit deliberately obstructing in-cabin OMS cameras, unplugging monitoring hardware, or using physical stickers to block infrared sensors during daily vehicle use:

OMS serves as the underlying physical foundation for passive safety systems (such as tailored airbag deployment strategies) and active safety warnings. Users must strictly refrain from tampering with or obstructing monitoring hardware out of privacy concerns or convenience; without real-time occupant posture data from the OMS, airbags cannot deploy adaptively in multi-stage sequences suited to the occupant's actual build and posture during a severe collision, drastically increasing the risk of fatal injuries.

Strictly prohibit relying solely on the OMS Child Presence Detection (CPD) function to leave infants, young children, or pets unattended in locked, enclosed, hot vehicles for extended periods: 

Although advanced OMS solutions deliver ultra-precise vital sign monitoring and remote alert capabilities, all electronic sensors and cloud connectivity remain subject to physical limitations, including power cuts, system crashes, or extreme network dropouts. Drivers must never take chances by leaving children or pets alone in the vehicle; under extreme heat or cold, temperatures within an enclosed cabin can surge or plummet rapidly in a very short time, which can easily lead to irreversible tragedies.