It has become rare for prime ministers to vault directly across the street from the Foreign Office, but why isn't it a good path to the top job?