Sebastien X Beysserie

US Patent:

20130342714, Dec 26, 2013

Filed:

Jun 22, 2012

Appl. No.:

13/530500

Inventors:

Jianping Zhou - Fremont CA, US
Sebastien X. Beysserie - Milpitas CA, US

Assignee:

APPLE INC. - Cupertino CA

International Classification:

H04N 5/228

US Classification:

3482082, 3482084, 348E05031

Abstract:

An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute instantaneous motion of the camera for a current frame of the video sequence. The controller may compare the instantaneous motion to a threshold value representing a still condition and reduce a video stabilization strength parameter for the current frame if the instantaneous motion is less than the threshold value. A video stabilization unit may perform video stabilization on the current frame according to the frame's strength parameter.

US Patent:

20130329062, Dec 12, 2013

Filed:

Jun 8, 2012

Appl. No.:

13/492769

Inventors:

Jianping Zhou - Fremont CA, US
Sebastien X. Beysserie - Milpitas CA, US
George E. Williams - Pleasanton CA, US
Rolf Toft - Palo Alto CA, US

Assignee:

APPLE INC. - Cupertino CA

International Classification:

H04N 5/228

US Classification:

3482081, 348E05024

Abstract:

An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute instantaneous motion of the camera for a current frame of the video sequence and accumulated motion of the camera corresponding to motion of a plurality of frames of the video sequence. The controller may compare the instantaneous motion to a first threshold value, compare the accumulated motion to a second threshold value, and set a video stabilization strength parameter for the current frame based on the results of the comparison. A video stabilization unit may perform video stabilization on the current frame according to the frame's strength parameter.

US Patent:

20220335579, Oct 20, 2022

Filed:

Mar 28, 2022

Appl. No.:

17/656734

Inventors:

- Cupertino CA, US
Sebastien X. Beysserie - Milpitas CA, US

International Classification:

G06T 5/00
G06V 10/25
G06T 3/00

Abstract:

Devices, methods, and non-transitory program storage devices are disclosed herein to provide for improved perspective distortion correction for wide field of view (FOV) video image streams. The techniques disclosed herein may be configured, such that the distortion correction applied to requested region of interest (ROI) portions taken from individual images of the wide FOV video image stream smoothly transitions between applying different distortion correction to ROIs, depending on their respective FOVs. In particular, the techniques disclosed herein may modify the types and/or amounts of perspective distortion correction applied, based on the FOVs of the ROIs, as well as their location within the original wide FOV video image stream. In some cases, additional perspective distortion correction may also be applied to account for tilt in an image capture device as the wide FOV video image stream is being captured and/or the unwanted inclusion of “invalid” pixels from the wide FOV image.

US Patent:

20200296270, Sep 17, 2020

Filed:

Jun 3, 2020

Appl. No.:

16/891434

Inventors:

- Cupertino CA, US
Sebastien Beysserie - Milpitas CA, US
Jozef Kruger - Fremont CA, US

International Classification:

H04N 5/225
H04N 5/232
H04N 5/247

Abstract:

Techniques are described for automatically selecting between multiple image capture subsystems with overlapping fields of view but different optical properties. A selection may be made by estimating a plurality of operational characteristics of an image capture event, and, based on those estimates, selecting a primary image capture subsystem for the image capture event. For example, in a device such as a cellphone comprising two capture subsystems, each subsystem including a lens system and sensor system where each subsystem has a different fixed optical zoom parameter, a subsystem can be chosen based on a combination of desired zoom value, estimated focus distance, and estimated scene brightness.

US Patent:

20170359494, Dec 14, 2017

Filed:

Jun 8, 2017

Appl. No.:

15/617918

Inventors:

- Cupertino CA, US
Sebastien Beysserie - Milpitas CA, US
Jozef Kruger - Fremont CA, US

International Classification:

H04N 5/225
H04N 5/232
H04N 5/235

Abstract:

Techniques are described for automatically selecting between multiple image capture subsystems with overlapping fields of view but different optical properties. A selection may be made by estimating a plurality of operational characteristics of an image capture event, and, based on those estimates, selecting a primary image capture subsystem for the image capture event. For example, in a device such as a cellphone comprising two capture subsystems, each subsystem including a lens system and sensor system where each subsystem has a different fixed optical zoom parameter, a subsystem can be chosen based on a combination of desired zoom value, estimated focus distance, and estimated scene brightness.

US Patent:

20170280059, Sep 28, 2017

Filed:

Mar 13, 2017

Appl. No.:

15/457377

Inventors:

- Cupertino CA, US
George E. Williams - Pleasanton CA, US
Jianping Zhou - Fremont CA, US
Richard L. Baer - Los Altos CA, US
Rolf Toft - Palo Alto CA, US
Sebastien X. Beysserie - Milpitas CA, US

International Classification:

H04N 5/232
G06T 5/20

Abstract:

Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.

US Patent:

20160360111, Dec 8, 2016

Filed:

Sep 24, 2015

Appl. No.:

14/864709

Inventors:

- Cupertino CA, US
George E. Williams - Pleasanton CA, US
Jianping Zhou - Fremont CA, US
Richard L. Baer - Los Altos CA, US
Rolf Toft - Palo Alto CA, US
Sebastien X. Beysserie - Milpitas CA, US

International Classification:

H04N 5/232
H04N 5/225

Abstract:

Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.

US Patent:

20160006935, Jan 7, 2016

Filed:

Aug 25, 2014

Appl. No.:

14/467998

Inventors:

- Cupertino CA, US
Sebastien X. Beysserie - Milpitas CA, US

International Classification:

H04N 5/232

Abstract:

Techniques to improve a digital image capture device's ability to stabilize a video stream in low light capture conditions are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use time stamped image capture device motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. The calculated adjustments to the strength of the stabilization metric value for a particular frame may be limited to a target max strength value that is determined based, at least in part, on an estimated amount of motion blur in the current frame.