For sure. The little buggers are robbing me blind. Somehow they know when I think to myself "the peaches are almost ready, I'll start to harvest them tomorrow".
For some reason they mostly leave the plums alone. So go with the plums.
Big problem with plums is that as far as I can tell the entire tree goes ripe the same millisecond, and you have about three days to pick them all and figure out what the hell to do with a million plums before the birds get to them and they fall off the tree and make these terrible little lumps on the lawn.
Sauces and alcohol. Plums are good for both. Oddly, plum-coriander sauce is pretty good (try a small amount before you take my word for it -- I love it, but YMMV).
For some reason they mostly leave the plums alone. So go with the plums.