My body sure agrees on avoiding dairy. I suppose I'm mildly lactose intolerant, but once I stopped eating dairy I started feeling a lot better. Less gas if nothing else.
Anecdotal for sure but most of the people I know who take diet seriously agree that dairy is bad.
I also believe the saying that humans are the only animals that drink milk after infancy.
Fermented dairy products, e.g. yogurt, kefir, are usually fine even if you're lactose intolerant. They're also high in protein and help maintain healthy intestinal flora.