Safety and cost is another reason. For example in the Bay Area the materials allowed for 4 story buildings is different than 5+ because it needs to have much higher fireproofing. The result is many 4 story buildings and almost nothing above that because of the cost difference.