The average age of giving birth in the UK is 30. The average life expectancy is 81, so the average person is 51 when their parent dies. The retirement age is let's say 65 for now. That's 14 years of work.
You inherit a house that's let's go fairly high and say is worth £500k, the tax bill (assuming IHT remains as-is) would be 40% of £375k, that's £150k, you have to pay it off at an approximate rate of £11k a year which in that timeframe is just over £900 a month. Add a bit on for interest but hey, it's a 30% LTV mortgage, it's not that much.
This is far less than you would feasibly pay in rent and you just inherited an asset worth half a million quid that if necessary you can draw down or sell, so at that point I think anyone taking massive issue with that can probably get fucked.