There is a lot in the news right now about high interest rates and unaffordability. But the rates aren’t the main problem.