‘Always a bit of tension’: Simon Birmingham discusses Keith Pitt’s swipe on way out