Removal of Grenfell Tower inquiry judge isn't survivors' main demand