Analyzing the behavior of humans in continuous video recordings is still a very difficult task In the fully supervised setting  temporal models like RNNs are trained on videos that are annotated at a frame-level