- Seattle WA, US Rahul PATHAK - Mercer Island WA, US Mehul SHAH - Redmond WA, US Akila TENNAKOON - Brooklyn NY, US Jian FANG - Issaquah WA, US Seth Thomas DENNEY - New York NY, US Jason DENTON - Seattle WA, US
International Classification:
G06F 16/242 G06F 16/2455 G06F 16/248
Abstract:
Techniques are described for an interactive query service that enables users to query data stored at a federated collection of data sources. An interactive query service provides interfaces that enable users to configure the interactive query service to query any number of heterogeneous data sources pertinent to a user. In general, the configuration of a data source can include identification of: a data source type, access configurations related to accessing the data source, and in some cases metadata describing a structure of the data stored by the data source (for example, a data catalog describing schemas, tables, columns, partitions, datatypes, or other metadata associated with the stored data). Once configured, an interactive query service can receive and execute queries that involve data stored at any combination of a user's data sources, where the queries may be expressed using a standard query language such as the Structured Query Language (SQL).
- Seattle WA, US Jian Fang - Sammamish WA, US Xing Wu - Redmond WA, US Yuanyuan Yue - Bellevue WA, US Pratik Bhagwat Gawande - Seattle WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Yufeng Jiang - Sammamish WA, US
Queries may be received and executed by a managed query service. A query directed to data sets that are separately stored in a remote data store may be received. Computing resources to execute the query may be provisioned from a pool of computing resources that are configured to execute queries. The query may be routed to the provisioned computing resources to execute the query. Results may be obtained from the computing resource and provided to a submitter of the query.
Tracking Query Execution Status For Selectively Routing Queries
- Seattle WA, US Bhargava Ram Kalathuru - Seattle WA, US Jian Fang - Sammamish WA, US Yuanyuan Yue - Bellevue WA, US Pratik Bhagwat Gawande - Seattle WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Yufeng Jiang - Sammamish WA, US
Query execution status may be tracked to selectively route queries to resources for execution. The completion of queries executing at computing resources obtained from a pool of computing resources configured to execute queries may be detected. Instead of returning the computing resources to the pool, the computing resources may be identified as available in resource management data. When another query is received, the resource management data may be evaluated to select an available computing resource. The query may then be routed to the selected computing resource for execution.
Selecting Resource Configurations For Query Execution
- Seattle WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Bhargava Ram Kalathuru - Seattle WA, US Jian Fang - Sammamish WA, US Xing Wu - Redmond WA, US Yuanyuan Yue - Bellevue WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Yufeng Jiang - Sammamish WA, US Marc Howard Beitchman - Seattle WA, US Andrew Edward Caldwell - Santa Clara CA, US
The configuration of computing resources for executing queries may be selected. A comparison of the configuration of computing resources that executed previous queries may be made to select the configuration of computing resources for a received query. A historical query execution model maybe applied, in some embodiments, to determine a resource configuration for computing resources to execute a query. The computing resources may be selected from available computing resources according to the determined resource configuration.
Stateful Resource Pool Management For Job Execution
- Seattle WA, US Bhargava Ram Kalathuru - Seattle WA, US Jian Fang - Sammamish WA, US Xing Wu - Redmond WA, US Yuanyuan Yue - Bellevue WA, US Pratik Bhagwat Gawande - Seattle WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Yufeng Jiang - Sammamish WA, US
Assignee:
Amazon Technologies, Inc. - Seattle WA
International Classification:
G06F 9/50 H04L 29/08 G06F 17/30
Abstract:
Stateful resource pool management may be implemented for executing jobs. Metrics for pools of computing resources that are configured to execute jobs on behalf of network-based services may be collected. The metrics may be evaluated to detect a modification event for a pool of computing resources. The pool of computing resources may then be modified according to the detected modification event for the pool. Evaluation of metrics may be performed automatically as part of monitoring a resource pool, in some embodiments.
- Seattle WA, US Jian Fang - Sammamish WA, US Xing Wu - Redmond WA, US Yuanyuan Yue - Bellevue WA, US Pratik Bhagwat Gawande - Seattle WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Yufeng Jiang - Sammamish WA, US
Assignee:
Amazon Technologies, Inc. - Seattle WA
International Classification:
G06F 17/30
Abstract:
Queries may be received and executed by a managed query service. A query directed to data sets that are separately stored in a remote data store may be received. Computing resources to execute the query may be provisioned from a pool of computing resources that are configured to execute queries. The query may be routed to the provisioned computing resources to execute the query. Results may be obtained from the computing resource and provided to a submitter of the query.
Selecting Resource Configurations For Query Execution
- Seattle WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Bhargava Ram Kalathuru - Seattle WA, US Jian Fang - Sammamish WA, US Xing Wu - Redmond WA, US Yuanyuan Yue - Bellevue WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Yufeng Jiang - Sammamish WA, US Marc Howard Beitchman - Seattle WA, US Andrew Edward Caldwell - Santa Clara CA, US
Assignee:
Amazon Technologies, Inc. - Seattle WA
International Classification:
G06F 17/30
Abstract:
The configuration of computing resources for executing queries may be selected. A comparison of the configuration of computing resources that executed previous queries may be made to select the configuration of computing resources for a received query. A historical query execution model maybe applied, in some embodiments, to determine a resource configuration for computing resources to execute a query. The computing resources may be selected from available computing resources according to the determined resource configuration.
Tracking Query Execution Status For Selectively Routing Queries
- Seattle WA, US Bhargava Ram Kalathuru - Seattle WA, US Jian Fang - Sammamish WA, US Yuanyuan Yue - Bellevue WA, US Pratik Bhagwat Gawande - Seattle WA, US Turkay Mert Hocanin - New York NY, US Jason Douglas Denton - Seattle WA, US Luca Natali - Kenmore WA, US Rahul Sharma Pathak - Seattle WA, US Abhishek Rajnikant Sinha - Redmond WA, US Sumeetkumar Veniklal Maru - Redmond WA, US Yufeng Jiang - Sammamish WA, US
Assignee:
Amazon Technologies, Inc. - Seattle WA
International Classification:
G06F 17/30 H04L 29/08
Abstract:
Query execution status may be tracked to selectively route queries to resources for execution. The completion of queries executing at computing resources obtained from a pool of computing resources configured to execute queries may be detected. Instead of returning the computing resources to the pool, the computing resources may be identified as available in resource management data. When another query is received, the resource management data may be evaluated to select an available computing resource. The query may then be routed to the selected computing resource for execution.
Jian Fang Lay (born 6 March 1973), aka Jian Fang Lay-Hong (Chinese:), is a right-handed Australian ladies table tennis player. She plays penhold, with a ...