[1] https://en.wikipedia.org/wiki/Hedonic_treadmill
I do think that a lot can affect one's baseline though: health, drug dependency, stress from life, emotional baggage, etc.
And, I think that happiness can be achieved through practice (gratitude, letting go, etc..).
But yeah, that baseline - life gives some people a below neutral baseline.
[1] https://en.wikipedia.org/wiki/Hedonic_treadmill