Very cool! Looking forward to experiment with it. In the same spirit but less advanced (my "language" has bugs, I know) I wrote this toy project: http://sound-of-ascii.herokuapp.com/. There's a demo and you can play around with it.