I don’t know if he would have been the ‘worst’ PM, but he certainly managed to alienate a lot of voters, and his supporters currently waging a civil war within the party are in danger of doing the same.
The usual disclaimers apply......IMHO, YMMV etc.