A recent survey by market financing company Freddie Mac showed that most Americans are worried about paying for housing, according…