What is the biggest barrier to a human civilization on Mars?

Is it the weak gravity? Oxalate in the soil. Not enough water available? Space X says they plan on creating a human colony on Mars. What's the worst they can expect?