Responsive video-based motion synthesis using motion graphs

Video-Based Motion Synthesis is a technique for synthesizing controllable animations from captured video data. We take an input video and automatically label clips within the video that we will reuse to create new video sequences. We manually designate specific motion types that we will search the video for to have multiple clips from a particular motion type to choose from when we wish to render a sequence. We will specify which types of motions can transition into other motions by creating a motion type graph and a video clip graph to explicitly state which pairs of clips can be spliced together. These two motion graphs will allow us to produce animations responsive to user input real-time. We present results of our method on a variety of data sets.