The overwhelming majority of drivers will spend their entire driving lives without causing a major accident to themselves or others. So whereas there might be an argument for many or most drivers being crap or careless about certain minor aspects of driving such as parking skills, which is about as dangerous as drinking a glass of water, most drivers are anything but awful at the aspects of driving that matter the most. If most drivers were awful, there would be 300,000 deaths a year in the UK instead of 3,000.
On the other hand the overwhelming majority of pedestrians are indescribably fucking incompetent, useless, careless and lacking even the most basic notions of self-awareness and self-preservation when out and about. It is in fact only thanks to the diligent actions of the great majority of people operating vehicles of all types that a hundred thousand peds don't get seriously hurt or killed every year.