Walking like that is only something I ever do when being instructed to march by shouty people, who then proceed to get unbelievably pissed off about it. This is not intentional and I find it very hard to end up doing this in any other circumstances, it just seems like my subconscious enjoys causing me shit.
Try not moving the torso at all, and keep your hands in front of your thighs. Simply flip your palm up and slightly forwards when you want that leg to move forwards, It's called Namba Aruki in japan.
Right leg forward, right arm forward. Left leg forward, left arm forward