This week at the ACM Conference on Document Engineering, Laurent and Scott are presenting new work on direct manipulation of video. The ShowHow project is our latest activity involving expository or “how to” video creation and use. While watching videos of this genre, it is helpful to create annotations that identify useful frames or shots using ShowHow’s annotation capability directly, or by creating a separate multimedia notes document. The primary purpose of such annotation is for later reference, or incorporation into other videos or documents. While browser history might be able to get you back to a specific video you watched previously, it won’t readily get you to a specific portion of much longer source video efficiently, or provide you with the broader context in which you found that portion of the video noteworthy. ShowHow enables users to create rich annotations around expository video that optionally include image, audio, or text to preserve this contextual information.
For creating these annotations, copy and paste functionality from the source video is desirable. This could be selecting a (sub)frame as an image or even selecting text shown in the video. Also, we demonstrate capturing dynamic activity across frames in a simple animated GIF for easy copy and paste from video to the clipboard. There are interaction design challenges here, and especially as more content is viewed on mobile/touch devices, direct manipulation provides a natural means for fine control of selection.
The interaction enabled by the system is probably best described in the video below:
Go find Scott or Laurent in Florence or contact us for more information.