A new survey has found the majority of people were worried about house prices, interest rates and inflation, and almost half were not confident in the economy.