Temperatures will warm up for much of the country over the next few days, bringing a taste of spring.