Perhaps it's time to stop using untyped value as a concept entirely.
It has always been unclear--in cases where people's objectives differ--just whose values are used determine what counts as "value".
It's a simplification that served us well when the common threat was famine or disease or war, but those threats weigh less on us these days. We're more concerned with mistreatment from each other, so we probably need something that answers "whose values?" instead so that we can be reminded to check if that person's agenda is actually worth persuing.
Such a shift might help interrupt dangerous optimizations such as optimizing for GDP at the expense of biosphere stability.
It has always been unclear--in cases where people's objectives differ--just whose values are used determine what counts as "value".
It's a simplification that served us well when the common threat was famine or disease or war, but those threats weigh less on us these days. We're more concerned with mistreatment from each other, so we probably need something that answers "whose values?" instead so that we can be reminded to check if that person's agenda is actually worth persuing.
Such a shift might help interrupt dangerous optimizations such as optimizing for GDP at the expense of biosphere stability.