A Speaker who tried to restore 'respect' to Parliament is now accused of disrespecting it