James Clayton Corey

US Patent:

20200327114, Oct 15, 2020

Filed:

Jun 26, 2020

Appl. No.:

16/914075

Inventors:

- Seattle WA, US
Neal Fachan - Seattle WA, US
Samuel James McKelvie - Seattle WA, US
Laurion Darrell Burchall - Seattle WA, US
Christopher Richard Newcombe - Kirkland WA, US
Pradeep Jnana Madhavarapu - Mountain View CA, US
Benjamin Tobler - Seattle WA, US
James McClellan Corey - Bothell WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 16/23
G06F 11/14

Abstract:

A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

US Patent:

20180067662, Mar 8, 2018

Filed:

Nov 13, 2017

Appl. No.:

15/811583

Inventors:

- Seattle WA, US
James McCllelan Corey - Seattle WA, US
Mustafa Abrar - Issaquah WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 3/06
G06F 17/30

Abstract:

A data store maintaining data may implement memory-based on-demand data page generation. Log records may be maintained in system memory according to a version threshold for data pages of data stored in persistent storage. When a request for a version of a particular data page is received that is within the version threshold, the data page may be obtained from persistent storage and log records associated with the data page may be applied to the data page to generate the requested version of the data page. The version threshold for the data pages may change, and log records in system memory may be identified for coalesce operations. The coalesce operations may be efficiently performed (e.g., in the background), updating the data pages in persistent storage to include the changes of the identified log records and space in system memory for the identified log records may be reclaimed.

US Patent:

20170132091, May 11, 2017

Filed:

Jan 23, 2017

Appl. No.:

15/413331

Inventors:

- Seattle WA, US
James McClellan Corey - Seattle WA, US
Pradeep Jnana Madhavarapu - Mountain View CA, US
Anurag Windlass Gupta - Atherton CA, US
Benjamin Tobler - San Jose CA, US
Samuel James McKelvie - Seattle WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 11/14
G06F 3/06

Abstract:

A distributed database system may implement log-structured distributed storage using a single log sequence number space. A log for a data volume may be maintained in a log-structured distributed storage system. The log may be segmented across multiple protection groups according to a partitioning of user data for the data volume. Updates to the log may be assigned a log sequence number from a log sequence number space for the data volume. A protection group may be determined for an update according to which partition of user data space the update pertains. Metadata to be included with the log record may indicate a previous log sequence number of a log record maintained at the protection group. The log record may be sent to the protection group and identified as committed based on acknowledgments received from storage nodes implementing the protection group.

US Patent:

20170083565, Mar 23, 2017

Filed:

Dec 5, 2016

Appl. No.:

15/369681

Inventors:

- Seattle WA, US
NEAL FACHAN - SEATTLE WA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US
LAURION DARRELL BURCHALL - SEATTLE WA, US
CHRISTOPHER RICHARD NEWCOMBE - KIRKLAND WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US
BENJAMIN TOBLER - SEATTLE WA, US
JAMES MCCLELLAN COREY - BOTHELL WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 17/30
G06F 11/14

Abstract:

A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

US Patent:

20170031749, Feb 2, 2017

Filed:

Oct 10, 2016

Appl. No.:

15/289907

Inventors:

- Seattle WA, US
JAMES MCCLELLAN COREY - SEATTLE WA, US
YAN VALERIE LESHINSKY - KIRKLAND WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US

International Classification:

G06F 11/07
G06F 3/06

Abstract:

Self-describing data blocks of a minimum atomic write size may be stored for a data store. Data may be received for storage in a data block of a plurality of data blocks at a persistent storage device that are equivalent to a minimum atomic write size for the persistent storage device. Metadata may be generated for the data that includes an error detection code which is generated for the data and the metadata together. The data and the metadata are sent to the persistent storage to device to store together in the data block. An individual atomic write operation may write together the data and the metadata in the data block. When accessed, the error detection code is applicable to detect errors. The metadata may also be applicable to determine whether the data is stored for a currently assigned purpose or a previously assigned purpose of the data block.

US Patent:

20170024315, Jan 26, 2017

Filed:

Oct 3, 2016

Appl. No.:

15/284414

Inventors:

- Seattle WA, US
JAMES MCCLELLAN COREY - SEATTLE WA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US
OSCAR RICARDO MOLL THOMAE - SEATTLE WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 12/02
G06F 17/30

Abstract:

A log-structured data store may implement efficient garbage collection. Log records may be maintained in data blocks according to a log record sequence. Based, at least in part, on a log reclamation point, the log records may be evaluated to identify data blocks to reclaim that have log records in the log sequence prior to the log reclamation point. New versions of data pages updated by log records in the identified data blocks may be generated and stored in base page storage for the log structured data store. The identified data blocks may then be reclaimed for storing new data.

US Patent:

20160110408, Apr 21, 2016

Filed:

Dec 28, 2015

Appl. No.:

14/981540

Inventors:

- Seattle WA, US
RAMAN MITTAL - SEATTLE WA, US
BENJAMIN TOBLER - SEATTLE WA, US
JAMES MCCLELLAN COREY - BOTHELL WA, US
YAN VALERIE LESHINSKY - KIRKLAND WA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US
ANURAG WINDLASS GUPTA - ATHERTON CA, US

Assignee:

Amazon Technologies, Inc. - Reno NV

International Classification:

G06F 17/30

Abstract:

A log-structured data store may implement optimized log storage for asynchronous log updates. In some embodiments, log records may be received indicating updates to data stored for a storage client and indicating positions in a log record sequence. The log records themselves may not be guaranteed to be received according to the log record sequence. Received log records may be stored in a hot log portion of a block-based storage device according to an order in which they are received. Log records in the hot log portion may then be identified to be moved to a cold log portion of the block-based storage device in order to complete a next portion of the log record sequence. Log records may be modified, such as compressed, or coalesced, before being stored together in a data block of the cold log portion according to the log record sequence.

US Patent:

20150261610, Sep 17, 2015

Filed:

Jun 1, 2015

Appl. No.:

14/727644

Inventors:

- Seattle WA, US
JAMES MCCLELLAN COREY - SEATTLE WA, US
YAN VALERIE LESHINSKY - KIRKLAND WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US

International Classification:

G06F 11/10
G06F 3/06

Abstract:

Self-describing data blocks of a minimum atomic write size may be stored for a data store. Data may be received for storage in a data block of a plurality of data blocks at a persistent storage device that are equivalent to a minimum atomic write size for the persistent storage device. Metadata may be generated for the data that includes an error detection code which is generated for the data and the metadata together. The data and the metadata are sent to the persistent storage device to store together in the data block. An individual atomic write operation may write together the data and the metadata in the data block. When accessed, the error detection code is applicable to detect errors. The metadata may also be applicable to determine whether the data is stored for a currently assigned purpose or a previously assigned purpose of the data block.