Sir Oliver worked alongside Baroness May and her ministers, and became a hate figure for the eurosceptic Tory right, who ...