Mortgage rates factor into home sales and the refinance market and the new rates may start slowing down housing activity.