Assumptions
wConstant time difference between capturing of two pictures of the image sequence.
wThe change of brightness is entirly caused by absolute object motions, not by camera or light motion. The whole scene is stable over time.
wPoints from the one image appear in the second results at other positions but with the same brightness value.