Liangyin Yu

US Patent:

8379979, Feb 19, 2013

Filed:

Feb 25, 2011

Appl. No.:

12/932457

Inventors:

Liangyin Yu - Fremont CA, US
Ming-Chang Liu - San Jose CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

G06K 9/00
G06K 9/34

US Classification:

382173, 382181

Abstract:

A system and method for effectively performing a scene rectification procedure comprises an image manager that includes a segmentation module, a label module, and a rectification module. The segmentation module initially performs a segmentation procedure upon an image to produce corresponding sub-scenes. The label module then categorizes the sub-scenes by assigning initial labels without utilizing context information from other sub-scenes in the image. The rectification module performs a semantic grouping procedure upon the sub-scenes to produce semantic group nodes corresponding to pairs of the sub-scenes that have a predefined semantic relationship. The rectification module converts a sub-scene graph of the sub-scenes into a semantic graph that includes the semantic group nodes. The rectification module then performs a rectification procedure to convert the initial labels of the sub-scenes into rectified labels. A processor of an electronic device typically controls the image manager for performing the scene rectification procedure.

US Patent:

8411161, Apr 2, 2013

Filed:

Oct 4, 2010

Appl. No.:

12/897537

Inventors:

Liangyin Yu - Fremont CA, US
Ming-Chang Liu - San Jose CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

H04N 5/225
G06K 9/32
G06K 9/50

US Classification:

3482221, 382289, 382296

Abstract:

A method of and an apparatus for automatically estimating the tilting angle in tilted images enables level correction of the images. A preferred orientation of objects in an image and the deviation of the current orientation from the preferred orientation is determined by tilt image analysis without object recognition. Tilt image analysis includes several steps such as gradient feature computation, line segment tracking, line segment estimation and orientation deviation estimation. Once the tilt angle is determined, the image can be corrected so that an object or scene is not tilted or is tilted by only the appropriate amount.

US Patent:

8452089, May 28, 2013

Filed:

Mar 31, 2011

Appl. No.:

13/065874

Inventors:

Liangyin Yu - Fremont CA, US
Ming-Chang Liu - San Jose CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

G06K 9/34

US Classification:

382165

Abstract:

A system and method for effectively performing an image identification procedure includes an image matching manager that derives source characteristics for a source image and target characteristics for target images. The image matching manager compares the source characteristics and the target characteristics to determine whether the source image matches any of the target images. The source characteristics and the target characteristics may include color-space characteristics and curve-space characteristics from the respective images. A processor of an electronic device typically controls the image matching manager to effectively perform the image identification procedure.

US Patent:

8605972, Dec 10, 2013

Filed:

Mar 2, 2012

Appl. No.:

13/410960

Inventors:

Liangyin Yu - Fremont CA, US
Ming-Chang Liu - San Jose CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

G06K 9/00

US Classification:

382128

Abstract:

A method for automatically aligning images includes (a) determining initial correspondent point features between a first image and a second image, (b) creating a triangular meshes for the images from the initial correspondent point features within the images, and (c) refining point correspondence between the first and second images based on affine transformation estimation using the triangular meshes. The method may also include (d) creating refined triangular meshes for the images from the point correspondence refined in (c), and (e) determining coordinate alignment within the areas of pairs of correspondent triangles in the refined triangular meshes through interpolation of affine transformation on the pairs of correspondent triangles.

US Patent:

8620024, Dec 31, 2013

Filed:

Sep 17, 2010

Appl. No.:

12/885104

Inventors:

Ming-Chang Liu - San Jose CA, US
Liangyin Yu - Fremont CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

G06K 9/00

US Classification:

382103, 348169

Abstract:

A gesture recognition system and method that inputs videos of a moving hand and outputs the recognized gesture states for the input sequence. In each image, the hand area is segmented from the background and used to estimate parameters of all five fingers. The system further classifies the hand image as one of the postures in the pre-defined database and applies a geometric classification algorithm to recognize the gesture. The system combines a skin color model with motion information to achieve real-time hand segmentation performance, and considers each dynamic gesture as a multi-dimensional volume and uses a geometric algorithm to classify each volume.

US Patent:

20080291278, Nov 27, 2008

Filed:

Apr 5, 2006

Appl. No.:

11/397930

Inventors:

Zhong Zhang - Herndon VA, US
Li Yu - Herndon VA, US
Haiying Liu - Chantilly VA, US
Paul Brewer - Arlington VA, US
Andrew Chosak - Arlington VA, US
Himaanshu Gupta - Herndon VA, US
Niels Haering - Reston VA, US
Omar Javed - Herndon VA, US
Alan J. Lipton - Herndon VA, US
Zeeshan Rasheed - Reston VA, US
W. Andrew Scanlon - Fairfax VA, US
Steve Titus - Herndon VA, US
Peter Venetianer - McLean VA, US
Weihong Yin - Herndon VA, US
Liangyin Yu - Newbury Park CA, US

Assignee:

ObjectVideo, Inc. - Reston VA

International Classification:

H04N 7/18

US Classification:

348159, 348E07085

Abstract:

A computer-readable medium contains software that, when read by a computer, causes the computer to perform a method for wide-area site-based surveillance. The method includes receiving surveillance data, including view targets, from a plurality of sensors at a site; synchronizing the surveillance data to a single time source; maintaining a site model of the site, wherein the site model comprises a site map, a human size map, and a sensor network model; analyzing the synchronized data using the site model to determine if the view targets represent a same physical object in the site; creating a map target corresponding to a physical object in the site, wherein the map target includes at least one view target; receiving a user-defined global event of interest, wherein the user-defined global event of interest is based on the site map and based on a set of rules; detecting the user-defined global event of interest in real time based on a behavior of the map target; and responding to the detected event of interest according to a user-defined response to the user-defined global event of interest.

US Patent:

20120027252, Feb 2, 2012

Filed:

Aug 2, 2010

Appl. No.:

12/848913

Inventors:

Ming-Chang LIU - San Jose CA, US
Liangyin YU - Fremont CA, US
Quan YUAN - San Jose CA, US

International Classification:

G06K 9/00

US Classification:

382103, 348 77

Abstract:

A method for detecting presence of a hand gesture in video frames includes receiving video frames having an original resolution, downscaling the received video frames into video frames having a lower resolution, and detecting a motion corresponding to the predefined hand gesture in the downscaled video frames based on temporal motion information in the downscaled video frames. The method also includes detecting a hand shape corresponding to the predefined hand gesture in a candidate search window within one of the downscaled video frames using a binary classifier. The candidate search window corresponds to a motion region containing the detected motion. The method further includes determining whether the received video frames contain the predefined hand gesture based on the hand shape detection.

US Patent:

20120027263, Feb 2, 2012

Filed:

Sep 16, 2010

Appl. No.:

12/883708

Inventors:

Ming-Chang Liu - San Jose CA, US
Liangyin Yu - Fremont CA, US
Quan Yuan - San Jose CA, US

Assignee:

Sony Corporation - Tokyo

International Classification:

G06K 9/00

US Classification:

382107

Abstract:

A method for detecting presence of a hand gesture in video frames includes receiving video frames having an original resolution, downscaling the received video frames into video frames having a lower resolution, and detecting a motion corresponding to the predefined hand gesture in the downscaled video frames based on temporal motion information in the downscaled video frames. The method also includes detecting a hand shape corresponding to the predefined hand gesture in a candidate search window within one of the downscaled video frames using a binary classifier. The candidate search window corresponds to a motion region containing the detected motion. The method further includes determining whether the received video frames contain the predefined hand gesture based on the hand shape detection.