Outgoing chancellor moved by military tattoo in his honour