Bin Zhou

US Patent:

20160012296, Jan 14, 2016

Filed:

Jul 14, 2015

Appl. No.:

14/798657

Inventors:

- Pittsburgh PA, US
Bin Zhou - Pittsburgh PA, US

Assignee:

CARNEGIE MELLON UNIVERSITY - Pittsburgh PA

International Classification:

G06K 9/00
G11B 27/30
G11B 27/02
G11B 27/22

Abstract:

With the widespread availability of video cameras, we are facing an ever-growing enormous collection of unedited and unstructured video data. Due to lack of an automatic way to generate highlights from this large collection of video streams, these videos can be tedious and time consuming to index or search. The present invention is a novel method of online video highlighting, a principled way of generating a short video highlight summarizing the most important and interesting contents of a potentially very long video, which is costly both time-wise and financially for manual processing. Specifically, the method learns a dictionary from given video using group sparse coding, and updates atoms in the dictionary on-the-fly. A highlight of the given video is then generated by combining segments that cannot be sparsely reconstructed using the learned dictionary. The online fashion of the method enables it to process arbitrarily long videos and starts generating highlights before seeing the end of the video, both attractive characteristics for practical applications.