Or we could use a real binaries path (e.g. %programfiles%/bin) and symlink (NTFS supports symlinks I think) the binaries from there. Then include that in the %path%.

There are many ways to do this but until Windows and its developers decide on one, it'll remain a big mess.