Without creating fear ‘Victoria’s incompetence would be exposed’