If you're looking for differences between frames, have you tried using a differencing algorithm, e.g. so every frame is subtracted from the previous frame? EffecTV (http://effectv.sf.net/) uses a variation of this technique to do interesting things like cloaking and hologram effects.