For once, the PM has said something in tune with the average Briton – and those who are supposedly on his side are punishing him for it ...