John A Mars

US Patent:

20180315243, Nov 1, 2018

Filed:

Apr 26, 2017

Appl. No.:

15/497439

Inventors:

- Burbank CA, US
John A. Mars - Pittsburgh PA, US
James L. McCann - Pittsburgh PA, US
Ali Israr - Monroeville PA, US
Shawn Lawson - Albany NY, US
Kyna P. McIntosh - Pittsburgh PA, US
Job T. Bedford - Baltimore MD, US

International Classification:

G06T 19/00
G06T 11/60
G06F 3/01
G06F 3/16
G06T 19/20

Abstract:

According to one aspect of the present disclosure, a method for providing a multisensory augmented reality environment is disclosed. The method includes receiving a real-time video stream of a physical environment, receiving depth information of one or more objects within the physical environment, generating real-time content depicting the physical environment based on the real-time video stream and the depth information, rendering augmented content, wherein the augmented content integrates original content and the real-time content, generating sensory feedback instructions to provide sensory feedback based on the augmented content, wherein the sensory feedback instructions are dynamically adjusted to changes in the augmented content, transmitting the augmented content for display and instructions to provide sensory feedback correlated to the augmented content.