Xiang Yang Zhang

US Patent:

6587783, Jul 1, 2003

Filed:

Oct 5, 2001

Appl. No.:

09/971555

Inventors:

Nassir Navab - Plainsboro NJ
Xiang Zhang - Lawrenceville NJ
Vijay Kumar - Plainsboro NJ
Benedicte Bascle - Plainsboro NJ

Assignee:

Siemens Corporate Research, Inc. - Princeton NJ

International Classification:

G01C 2100

US Classification:

701200, 701211

Abstract:

A method and system for computer assisted site navigation includes capturing an image of a scene for providing real-time image data, calibrating a camera and localizing the image by utilizing the image data and retrieved marker registration and floor-map data for providing position and orientation data, transmitting the data to a web server, utilizing the image data and information on the scene retrieved from a database for deriving an augmented view, and displaying the augmented view.

US Patent:

7274380, Sep 25, 2007

Filed:

Oct 3, 2002

Appl. No.:

10/263578

Inventors:

Nassir Navab - Plainsboro NJ, US
Xiang Zhang - Lawrenceville NJ, US
Yakup Genc - Plainsboro NJ, US
Vijay Kumar - Plainsboro NJ, US

Assignee:

Siemens Corporate Research, Inc. - Princeton NJ

International Classification:

G09G 5/00

US Classification:

345633, 382181, 382190, 382205

Abstract:

An augmented reality system includes a video source, and a database. The video source resides at a location and produces an image. At least one encoded marker resides within the image. A marker detector is coupled to the video source and is adapted to derive encoded data from the marker residing within the image. A localization processor is adapted to receive data from the marker detector and to generate data regarding location and orientation of the marker. The localization processor retrieves information from the database that is related to the location and orientation of the marker. The localization processor makes the information retrieved from the database available to a user.

US Patent:

7374103, May 20, 2008

Filed:

Aug 2, 2005

Appl. No.:

11/195311

Inventors:

Yakup Genc - Princeton NJ, US
Xiang Zhang - Lawrenceville NJ, US

Assignee:

Siemens Corporate Research, Inc. - Princeton NJ

International Classification:

G06K 19/06

US Classification:

235492, 340 101, 340 1052

Abstract:

A computer-implemented method for object localization includes providing a plurality of tags having fixed positions within an environment and known identifications, and providing a reader, for detecting the tags and reading the identifications, wherein the reader detects a plurality of tags within a scanning volume having a known shape. The method further includes determining positions for the plurality of tags within the scanning volume, and determining a position of the reader according to the positions for the plurality of tags within the scanning volume and the known shape of the scanning volume.

US Patent:

7616807, Nov 10, 2009

Filed:

Feb 22, 2006

Appl. No.:

11/359673

Inventors:

Xiang Zhang - Lawrenceville NJ, US
Yakup Genc - Dayton NJ, US
Visvanathan Ramesh - Plainsboro NJ, US
Yanghai Tsin - Plainsboro NJ, US

Assignee:

Siemens Corporate Research, Inc. - Princeton NJ

International Classification:

G06K 9/00
G06K 9/32
G06T 15/00

US Classification:

382154, 382103, 382285, 345419

Abstract:

A method of tracking a pose of a moving camera includes receiving a first image from a camera, receiving a sequence of digitized images from said camera, recording, for each of said sequence of digitized images, the pose and 2D correspondences of landmarks, reconstructing a location and appearance of a 2-dimensional texture patch from 2D correspondences of the landmarks by triangulation and optimization, computing back-projection errors by comparing said reconstructed texture patch with said first received image; and reconstructing said location and appearance of said 2-dimensional texture patch from the 2D correspondences of the landmarks of said sequence of digitized images by triangulation and optimization after eliminating those landmarks with large back-projection errors.

US Patent:

7809194, Oct 5, 2010

Filed:

Feb 8, 2007

Appl. No.:

11/704137

Inventors:

Xiang Zhang - Lawrenceville NJ, US
Nassir Navab - Plainsboro NJ, US

Assignee:

Siemens Corporation - Iselin NJ

International Classification:

G06K 9/00

US Classification:

382181

Abstract:

A method for determining a pose of a user is provided including the steps of capturing a video image sequence of an environment including at least one coded marker; detecting if the coded marker is present in the video images; if the marker is present, extracting feature correspondences of the coded marker; determining a code of the coded marker using the feature correspondences; and comparing the determined code with a database of predetermined codes to determine the pose of the user. According to an embodiment, the coded marker includes four color blocks arranged in a square formation and the determining a code of the at least one marker further includes determining a color of each of the four blocks. According to another embodiment, the marker includes a coding matrix and a code of the marker being determined by numbered squares of the coding matrix being covered by a circle.

US Patent:

20020094189, Jul 18, 2002

Filed:

Jul 26, 2001

Appl. No.:

09/915650

Inventors:

Nassir Navab - Plainsboro NJ, US
Xiang Zhang - Lawrenceville NJ, US
Shih-Ping Liou - West Windsor NJ, US

International Classification:

H04N009/74
H04N009/79
H04N009/87
G11B027/00
H04N013/00
H04N015/00
H04N005/225
H04N009/04
H04N005/232

US Classification:

386/004000, 348/207000, 348/213000, 348/042000

Abstract:

A video editing system or tool for E-commerce utilizing augmented reality (AR) technology combines real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world. The AR video editing system is usable in conjunction with an ordinary desktop computer and a low-cost parallel port camera. A known camera calibration algorithm is utilized together with a set of specially designed markers for camera calibration and pose estimation of the markers. OpenGL and VRML (Virtual Reality Modeling Language) for 3D virtual model rendering and superimposition. are utilized. Marker-based calibration is utilized to calibrate the camera and estimate the pose of the markers in the AR video editing system. The system comprises video input/output, image feature extraction and marker recognition, camera calibration/pose estimation, and virtual reality (VR) model rendering/augmentation. This allows a sales person to create and edit customized AR video for product presentation and advertisement. In the video, the sales person can present different aspects of the product while keeping eye-to-eye contact with customers. The system is capable of providing a user with real-time augmented reality feedback while recording a video. The augmented videos can be made available on E-Commerce Web-sites or they can be emailed to customers. Because of the real-time editing capability, the AR video can be directly broadcast on the Internet, for example, for an E-commerce advertisement. Inserted virtual objects can be hyper-linked to product specification WebPages providing more detailed product and price information.

US Patent:

20030076980, Apr 24, 2003

Filed:

Oct 2, 2002

Appl. No.:

10/262693

Inventors:

Xiang Zhang - Lawrenceville NJ, US
Nassir Navab - Plainsboro NJ, US

Assignee:

Siemens Corporate Research, Inc..

International Classification:

G06K009/00

US Classification:

382/103000, 382/199000

Abstract:

A method for determining a pose of a user is provided including the steps of capturing a video image sequence of an environment including at least one coded marker; detecting if the coded marker is present in the video images; if the marker is present, extracting feature correspondences of the coded marker; determining a code of the coded marker using the feature correspondences; and comparing the determined code with a database of predetermined codes to determine the pose of the user. According to an embodiment, the coded marker includes four color blocks arranged in a square formation and the determining a code of the at least one marker further includes determining a color of each of the four blocks. According to another embodiment, the marker includes a coding matrix and a code of the marker being determined by numbered squares of the coding matrix being covered by a circle.

US Patent:

20030227542, Dec 11, 2003

Filed:

Dec 20, 2002

Appl. No.:

10/324191

Inventors:

Xiang Zhang - Lawrenceville NJ, US
Nassir Navab - Plainsboro NJ, US
Yakup Genc - Plainsboro NJ, US

International Classification:

H04N007/18
H04N009/47

US Classification:

348/061000

Abstract:

A single-computer real-time augmented reality system includes a computer having a processor coupled in signal communication with a PCI bus, a head-mounted display coupled with the computer, a first frame grabber disposed relative to the computer and coupled with the processor, the first frame grabber having a direct digital video output, a left video camera disposed relative to the head-mounted display and coupled with the first frame grabber, a left video display disposed relative to the head-mounted display and coupled with the direct video output of the first frame grabber, a second frame grabber disposed relative to the computer and coupled with the processor, the second frame grabber having a direct digital video output, a right video camera disposed relative to the head-mounted display and coupled with the second frame grabber, and a right video display disposed relative to the head-mounted display and coupled with the direct video output of the second frame grabber.