Search Engine News reports that Matt Cutts described at Pub Con Las Vegas that Google may start using page speed as a factor in ranking sites.

Load time is already a quality factor for AdWords and there is a strong chance that speed will factor into the organic ranking algorithm.