Nearly 70% of Americans believe the economy is headed in the wrong direction and 73% think it's a bad time to buy a house, according to a Fannie Mae survey.