Gentrification issues

I really don't get anti-gentrification activism. Everyone deserves to live somewhere. And people banding together to keep a hated "other" out just always strikes me as wrong. I get that people like affordable housing but to me the solution would seem to be build more housing. Not keep those people from moving in!

Am I completely off base about this?