This is one of a number of ideas I've been playing around with in my attempt to make a quick cutting music video, controlled by the music itself. After Effects already has the ability to do this kind of thing, but the software I built in Max MSP is all real-time. This kind of technique works really well with very syncopated tracks like this one from Interpol.
Rather than jumping to a frame directly the software tweens from the current frame to the new frame - all triggered by the volume of the track. This is very rough at the moment and I'm nowhere near happy with it, but it's just the bare bones of an idea. Currently moving on to look at using bass, middle and treble rather than just volume.