Starsky says “miles per disengagement can be gamed. Yes they can. But so is Starsky’s overall response here.
— They say accidents are a lagging indicator. yes but only if you use public shadow or remote driving vs proper simulation.
— The key problem with miles and disengagement metrics are the lack of scenario context. Starsky never says they will provide that.
— “Safety is the number one priority”. No it is clearly not. You cannot use processes that put people’s lives at risk for no reason and claim safety matters. Neither public shadow or remote driving can be made safe in critical scenarios. If they keep this up they will create thousands of needless casualties running thousands of accident scenarios thousands of times over to train the system.
If Starsky and most of the AV makers looked outside the echo chamber they would see the answer is aerospace/DoD/FAA level simulation and systems/safety engineering practices.
SAE Autonomous Vehicle Engineering Magazine End Public Shadow Driving
https://www.nxtbook.com/nxtbooks/sae/ave_201901/index.php
Remote Control for Autonomous Vehicles — A far worse idea than the use of Public Shadow “Safety” Driving
Common Misconceptions about Aerospace/DoD/FAA Simulation for Autonomous Vehicles