Markets are mechanisms we use to accomplish goals. They are not ends in themselves. They are certainly not universal moral guides. If you think in this case a market is the best mechanism to achieve a particular social goal, you'll have to make the case.
If we were to give houses to the people who worked hardest, every single immigrant construction worker I have met would get the houses, and comfortable office-dwellers like me would be out of luck.
I certainly cant argue with that, but wouldnt the people buying them be the hard workers in industries that reward them for that work (the reward values are a whole different issue imo).
If we were to give houses to the people who worked hardest, every single immigrant construction worker I have met would get the houses, and comfortable office-dwellers like me would be out of luck.