Agriculture is also more intensive than hunting / gathering, supporting more humans per area. When the two conflicted, the agriculturalists won by strength of numbers.

Generally, more intensive civilizations outcompete less intensive ones, even though the average individual may be worse off in that society.