Simon Bridges says his colleagues haven't called him out over Judith Collins leadership comments