James M Corey

US Patent:

20200327114, Oct 15, 2020

Filed:

Jun 26, 2020

Appl. No.:

16/914075

Inventors:

- Seattle WA, US
Neal Fachan - Seattle WA, US
Samuel James McKelvie - Seattle WA, US
Laurion Darrell Burchall - Seattle WA, US
Christopher Richard Newcombe - Kirkland WA, US
Pradeep Jnana Madhavarapu - Mountain View CA, US
Benjamin Tobler - Seattle WA, US
James McClellan Corey - Bothell WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 16/23
G06F 11/14

Abstract:

A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

US Patent:

20180067662, Mar 8, 2018

Filed:

Nov 13, 2017

Appl. No.:

15/811583

Inventors:

- Seattle WA, US
James McCllelan Corey - Seattle WA, US
Mustafa Abrar - Issaquah WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 3/06
G06F 17/30

Abstract:

A data store maintaining data may implement memory-based on-demand data page generation. Log records may be maintained in system memory according to a version threshold for data pages of data stored in persistent storage. When a request for a version of a particular data page is received that is within the version threshold, the data page may be obtained from persistent storage and log records associated with the data page may be applied to the data page to generate the requested version of the data page. The version threshold for the data pages may change, and log records in system memory may be identified for coalesce operations. The coalesce operations may be efficiently performed (e.g., in the background), updating the data pages in persistent storage to include the changes of the identified log records and space in system memory for the identified log records may be reclaimed.

US Patent:

20180046552, Feb 15, 2018

Filed:

Oct 9, 2017

Appl. No.:

15/728271

Inventors:

- Seattle WA, US
Anurag Windlass Gupta - Atherton CA, US
Yan Valerie Leshinsky - Kirkland WA, US
Samuel James McKelvie - Seattle WA, US
James McClellan Corey - Bothell WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 11/14
G06F 17/30

Abstract:

A log-structured data store implementing data backup may implement variable data replication. Write requests may be received at different storage nodes maintaining respective replicas of a portion of a log for data maintained in the log-structured data store. Log records indicating the write requests may be stored in the respective replicas of the log portions at the different storage nodes. The log records may be sent to a backup data store to be durability persisted as part of an archived version of the log. At some of the storage nodes, in response to determining that the log records have been durably persisted in the backup data store, storage space for the log records may be reclaimed. In other remaining storage nodes, the log records may be retained and made accessible for servicing read requests.

US Patent:

20170331883, Nov 16, 2017

Filed:

Jul 31, 2017

Appl. No.:

15/665080

Inventors:

- Seattle WA, US
Anurag Windlass Gupta - Atherton CA, US
Pradeep Jnana Madhavarapu - Mountain View CA, US
James McClellan Corey - Bothell WA, US
Yan Valerie Leshinsky - Kirkland WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

H04L 29/08
H04L 29/06

Abstract:

Hybrid quorum policies may be implemented for access requests to state maintained in a distributed system. An update to state maintained in a distributed system may be sent to multiple nodes in the distributed system maintain the state in order to satisfy a hybrid quorum policy for updating the state in the distributed system. The hybrid quorum policy may include individual quorum policies for multiple quorum sets including nodes of the distributed system. Acknowledgments received from nodes in the distributed system indicating that the update is performed may be evaluated according to the individual quorum policies to determine whether the hybrid quorum policy is satisfied. If the hybrid quorum policy is satisfied, then the update to the state may be considered durable.

US Patent:

20170132091, May 11, 2017

Filed:

Jan 23, 2017

Appl. No.:

15/413331

Inventors:

- Seattle WA, US
James McClellan Corey - Seattle WA, US
Pradeep Jnana Madhavarapu - Mountain View CA, US
Anurag Windlass Gupta - Atherton CA, US
Benjamin Tobler - San Jose CA, US
Samuel James McKelvie - Seattle WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 11/14
G06F 3/06

Abstract:

A distributed database system may implement log-structured distributed storage using a single log sequence number space. A log for a data volume may be maintained in a log-structured distributed storage system. The log may be segmented across multiple protection groups according to a partitioning of user data for the data volume. Updates to the log may be assigned a log sequence number from a log sequence number space for the data volume. A protection group may be determined for an update according to which partition of user data space the update pertains. Metadata to be included with the log record may indicate a previous log sequence number of a log record maintained at the protection group. The log record may be sent to the protection group and identified as committed based on acknowledgments received from storage nodes implementing the protection group.

US Patent:

20170083565, Mar 23, 2017

Filed:

Dec 5, 2016

Appl. No.:

15/369681

Inventors:

- Seattle WA, US
NEAL FACHAN - SEATTLE WA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US
LAURION DARRELL BURCHALL - SEATTLE WA, US
CHRISTOPHER RICHARD NEWCOMBE - KIRKLAND WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US
BENJAMIN TOBLER - SEATTLE WA, US
JAMES MCCLELLAN COREY - BOTHELL WA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 17/30
G06F 11/14

Abstract:

A database system may include a database service and a separate distributed storage service. The database service (or a database engine head node thereof) may be responsible for query parsing, optimization, and execution, transactionality, and consistency, while the storage service may be responsible for generating data pages from redo log records and for durability of those data pages. For example, in response to a write request directed to a particular data page, the database engine head node may generate a redo log record and send it, but not the data page, to a storage service node. The storage service node may store the redo log record and return a write acknowledgement to the database service prior to applying the redo log record. The server node may apply the redo log record and other redo log records to a previously stored version of the data page to create a current version.

US Patent:

20170031749, Feb 2, 2017

Filed:

Oct 10, 2016

Appl. No.:

15/289907

Inventors:

- Seattle WA, US
JAMES MCCLELLAN COREY - SEATTLE WA, US
YAN VALERIE LESHINSKY - KIRKLAND WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US

International Classification:

G06F 11/07
G06F 3/06

Abstract:

Self-describing data blocks of a minimum atomic write size may be stored for a data store. Data may be received for storage in a data block of a plurality of data blocks at a persistent storage device that are equivalent to a minimum atomic write size for the persistent storage device. Metadata may be generated for the data that includes an error detection code which is generated for the data and the metadata together. The data and the metadata are sent to the persistent storage to device to store together in the data block. An individual atomic write operation may write together the data and the metadata in the data block. When accessed, the error detection code is applicable to detect errors. The metadata may also be applicable to determine whether the data is stored for a currently assigned purpose or a previously assigned purpose of the data block.

US Patent:

20170024315, Jan 26, 2017

Filed:

Oct 3, 2016

Appl. No.:

15/284414

Inventors:

- Seattle WA, US
JAMES MCCLELLAN COREY - SEATTLE WA, US
SAMUEL JAMES MCKELVIE - SEATTLE WA, US
OSCAR RICARDO MOLL THOMAE - SEATTLE WA, US
PRADEEP JNANA MADHAVARAPU - MOUNTAIN VIEW CA, US

Assignee:

Amazon Technologies, Inc. - Seattle WA

International Classification:

G06F 12/02
G06F 17/30

Abstract:

A log-structured data store may implement efficient garbage collection. Log records may be maintained in data blocks according to a log record sequence. Based, at least in part, on a log reclamation point, the log records may be evaluated to identify data blocks to reclaim that have log records in the log sequence prior to the log reclamation point. New versions of data pages updated by log records in the identified data blocks may be generated and stored in base page storage for the log structured data store. The identified data blocks may then be reclaimed for storing new data.