SenseAuto unveils advancements in smart cockpit, intelligent driving tech

Beijing (Gasgoo)- On November 27, the 2024 SenseAuto AI DAY was held Shanghai, showcasing SenseAuto’s "driving-cabin-cloud" integrated AGI (Artificial General Intelligence) ecosystem and strategic roadmap. The company revealed advancements in intelligent cockpit interaction and end-to-end smart driving solutions.  

Photo credit: SenseAuto

Intelligent Cockpit Innovations  

SenseAuto introduced an innovative large model product for intelligent cockpits named "A New Member For U", aimed at transforming onboard voice assistants from mechanical tools into intuitive companions. This solution is underpinned by three core features: perceptive interaction, intuitive understanding, and continuous operation.  

Photo credit: SenseAuto

The "A New Member For U" features a native streaming multimodal large model, which is capable of real-time perception and comprehension across text, images, audio, and video. The models are fine-tuned for in-vehicle scenarios.  

Meanwhile, its "Always-on" framework enables real-time inference, zero-copy transmission, and rapid response times. Data latency is reduced to under 1 millisecond, with first-packet delays as low as 60 milliseconds and inference speeds of 40 tokens per second.  

Photo credit: SenseAuto

The Always-on framework is compatible with major automotive chip platforms, such as those from NVIDIA, Qualcomm, and MediaTek, ensuring its seamless deployment across most vehicle models.  

Upgraded Smart Driving Solutions

SenseAuto has developed three mass-production intelligent driving solutions, including the basic smart driving solution, the advanced all-scenario smart driving system, and a mass-producible end-to-end UniAD-based smart driving system.  

Based on the J6E and J6M platforms, SenseAuto launched the AD Pro and AD Max mass-production intelligent driving solutions. The AD Max is capable of supporting urban NOP (Navigate on Pilot) function without HD maps. The company disclosed that smart driving solutions based on the J6 platform will begin mass production and delivery in the second quarter of 2025.

Photo credit: SenseAuto

Additionally, SenseAuto also introduced the AD Ultra end-to-end smart driving system based on the UniAD. The solution adopts a technology roadmap independent from HD maps and LiDAR sensors. It uses one millimeter-wave radar, eleven cameras, and a onboard computing platform capable of 200+TOPS of computing power.

Up to now, SenseAuto has formed partnership with Chery-backed ZDRIVE, and Dongfeng Motor. The end-to-end solution will enter mass production by the end of next year.

Enhanced "Kaiwu" World Model  

SenseAuto's "Kaiwu" world model has also been upgraded, supportting high-quality data generation for training and simulation.

Kaiwu is now able to perform real-world comprehension and scenario generation. It offers customizable elements and parallel world simulations. The model can also generate videos of up to 150 seconds at 1080P resolution, with 11-view perspectives.  

Notably, powered by the multimodal large model, the Kaiwu model now supports the controlled generation of various autonomous driving scenarios and corner cases. SenseAuto has built an expansive database generated scenarios based on 1,024 diverse scenarios. The database will be available to the industry by 2025.