Doctor cautions against lifting COVID-19 restrictions too quickly