Andrej Karpathy is either incompetent or lying. (Given he is obviously intelligent, as is Elon, I assume it's the latter.) Either way it is selfish and negligent. He is party to needless injuries and deaths. And it's not only the fatal sensor design flaw. The overall development method and the problematic simulation technology Tesla uses makes the injuries and deaths for naught. As they will never get near L4.
The Autonomous Vehicle Industry can be Saved by doing the Opposite of what is being done now
More on sensors and this article.
His point about LiDAR needing a map is ridiculous. They have enough fidelity to be treated just like a camera. You can classify objects, and determine location and speed far better than you can with a camera. (For both of them you have a massive amount of compute and associated latency issues to deal with.)
Now on radar. It solves virtually all of camera and LiDAR shortfalls. Cameras being better than radar let alone 100X better is a joke where it comes to cameras shortfalls, especially if you use a good radar. Not the crap they and others use that has such low lateral fidelity they have to ignore stationary/crossing objects. Why not an imaging radar? What happened to the Arbe Tesla said it was evaluating.?
Let me tell you what is happening here. Karpathy and Musk are so embedded in the lies and incompetence they cannot dig a way out. If they tied they would get crushed in civil suits and probably see criminal charges. Then of course there's the ego and overall financial concerns.
(While I understand the settlements it would be great to see one AP lawsuit go to trial. These two would get crushed in discovery, especially depos.)
LiDAR companies are now coming out with FMCW and other LiDAR tech to make tracks, detect speed etc. All to respond to better radars. It helps but I think they need to be extremely cheap so it can augment camera and imaging radar. Or the camera/ and imaging radar combo will be it.