Housing affordability deteriorated to its worst level in over 30 years, according to data from the Bank of Canada.