After several days of rainy weather, the Houston region will be under a heat advisory on Thursday and Friday, according to the National Weather Service.