Bilgesu Erdem
General Motors’ Cruise division, dedicated to developing autonomous vehicles (AVs), faces intense scrutiny after recent reports emerged of its AVs’ struggles with recognizing children and requiring frequent human intervention. Amidst this, Cruise has decided to halt the production of its fully autonomous Origin vehicle temporarily.
Safety Issues and Production Halt
Documents have revealed that Cruise’s AVs may not adequately detect children, a significant concern for a technology meant to enhance road safety. This revelation follows the California Department of Motor Vehicles’ suspension of Cruise’s driverless permits over safety issues. The AVs’ difficulty with children was underscored by a simulation where the vehicles could not dismiss the risk of striking a child.
Remote Assistance and Risk Assessments
The AVs’ shortcomings extend to their need for remote human control every four to five miles on average, suggesting the technology may not be as self-reliant as intended. Moreover, Cruise’s internal documents indicate that their AVs also struggle to detect large road hazards, posing “major risks” to both the vehicles and roadside workers.
Public Safety and Corporate Responsibility
These issues cast doubt on whether Cruise’s operations should continue on public roads, as the inability to recognize and react appropriately to children could pose high-risk scenarios. The company has recognized the issue, stating improvements have been made, but the exact measures taken remain undisclosed.
Cruise’s Response to Controversy
In response to the backlash, Cruise emphasized their commitment to safety and claimed their on-road performance exceeds human benchmarks. They contend that their AVs maintain the highest safety priority for children and that no collisions with children have occurred on public roads.
Legislative and Public Reaction
The situation with Cruise’s AVs has sparked discussions about the appropriateness of testing such technology in public spaces. Law professors and engineers specializing in AV safety have criticized the use of machine learning for safety technology, arguing it only improves after negative incidents occur, which is an inadequate approach to ensuring safety.
The AV industry stands at a crossroads as it navigates the challenges of integrating complex technology into everyday life. The current issues with Cruise’s AVs serve as a reminder of the need for stringent safety measures and the potential consequences of deploying underdeveloped technology in public spaces. As Cruise halts production of its flagship Origin vehicle and addresses these critical safety concerns, the eyes of the world will be watching, anticipating the company’s next move and the industry’s future direction.
