Kathleen T Sheehan

US Patent:

6484010, Nov 19, 2002

Filed:

Jul 31, 2000

Appl. No.:

09/629374

Inventors:

Kathleen M. Sheehan - Skillman NJ

Assignee:

Educational Testing Service - Princeton NJ

International Classification:

G09B 700

US Classification:

434362, 434118, 434322, 434350

Abstract:

A method for diagnostic assessment and proficiency scaling of test results is provided. The method uses as input a vector of item difficulty estimates for each of n items and a matrix of hypothesized skill classifications for each of said n items on each of skills. The method includes using a tree-based regression analysis based on the vector and matrix to model ways in which required skills interact with different item features to produce differences in item difficulty. This analysis identifies combinations of skills required to solve each item, and forms a plurality of clusters by grouping the items according to a predefined prediction rule based on skill classifications. A nonparametric smoothing technique is used to summarize student performance on the combinations of skills identified in the tree-based analysis. The smoothing technique results in cluster characteristic curves that provide a probability of responding correctly to items with specified skill requirements. The probability is expressed as a function of underlying test score.

US Patent:

8517738, Aug 27, 2013

Filed:

Jan 30, 2009

Appl. No.:

12/363243

Inventors:

Kathleen Marie Sheehan - Skillman NJ, US
Irene Kostin - Princeton NJ, US
Yoko Futagi - Lawrenceville NJ, US

Assignee:

Educational Testing Service - Princeton NJ

International Classification:

G09B 5/00

US Classification:

434169, 434156, 434167, 434178

Abstract:

A computer-implemented method, system, and computer program product for automatically assessing text difficulty. Text reading difficulty predictions are expressed on a scale that is aligned with published reading standards. Two distinct difficulty models are provided for informational and literary texts. A principal components analysis implemented on a large collection of texts is used to develop independent variables accounting for strong intercorrelations exhibited by many important linguistic features. Multiple dimensions of text variation are addressed, including new dimensions beyond syntactic complexity and semantic difficulty. Feedback about text difficulty is provided in a hierarchically structured format designed to support successful text adaptation efforts. The invention ensures that resulting text difficulty estimates are unbiased with respect to genre, are highly correlated with estimates provided by human experts, and are based on a more realistic model of the aspects of text variation that contribute to observed difficulty variation.

US Patent:

20120150534, Jun 14, 2012

Filed:

Dec 7, 2011

Appl. No.:

13/313372

Inventors:

Kathleen Marie Sheehan - Skillman NJ, US
Irene Kostin - Princeton NJ, US
Yoko Futagi - Lawrenceville NJ, US

Assignee:

EDUCATIONAL TESTING SERVICE - Princeton NJ

International Classification:

G06F 17/27

US Classification:

704 9, 704E11001

Abstract:

Systems and methods are provided for determining a difficulty level of a text. A determination is made as to a number of cohesive devices present in a text. A further determination is made as to a number of cohesive devices expected in the text. A cohesiveness metric is calculated based on the number of cohesive devices present in the text and the number of cohesive devices expected in the text, where the cohesiveness metric is used to identify a difficulty level of the text.

US Patent:

61448389, Nov 7, 2000

Filed:

Dec 18, 1998

Appl. No.:

9/215685

Inventors:

Kathleen M. Sheehan - Skillman NJ

Assignee:

Educational Testing Services - Princeton NJ

International Classification:

G09B 700

US Classification:

434362

Abstract:

A method for diagnostic assessment and proficiency scaling of test results is provided. The method uses as input a vector of item difficulty estimates for each of n items and a matrix of hypothesized skill classifications for each of said n items on each of k skills. The method includes using a tree-based regression analysis based on the vector and matrix to model ways in which required skills interact with different item features to produce differences in item difficulty. This analysis identifies combinations of skills required to solve each item, and forms a plurality of clusters by grouping the items according to a predefined prediction rule based on skill classifications. A nonparametric smoothing technique is used to summarize student performance on the combinations of skills identified in the tree-based analysis. The smoothing technique results in cluster characteristic curves that provide a probability of responding correctly to items with specified skill requirements. The probability is expressed as a function of underlying test score.

US Patent:

58033319, Sep 8, 1998

Filed:

Dec 26, 1996

Appl. No.:

8/773104

Inventors:

Jodi L. Thorne - Yardley PA
Kathleen M. Sheehan - Langhorne PA

International Classification:

A45F 500

US Classification:

224627

Abstract:

A carrier for doll-type toys is provided having a pocket like enclosure for carrying the doll-type toy in a partially displayed position. The enclosure includes a double wall section forming an envelope or bag, in which the doll-type toy is carried, and a single wall section, against which the doll-type toy is partially displayed. This single wall section extends beyond and above the double walled section. Carrying straps permit the enclosure to be carried on the back of a child, in back-pack fashion. The carrying straps are attached adjacent to the free end of the single wall section and at the side of the double wall section. A second and smaller pocket enclosure may be attached to the front face of the carrier.

US Patent:

50591274, Oct 22, 1991

Filed:

Oct 26, 1989

Appl. No.:

7/428383

Inventors:

Charles Lewis - Montgomery County, Somerset County NJ
Kathleen M. Sheehan - Lambertville NJ
Richard N. DeVore - Stockton NJ
Leonard C. Swanson - Hopewell NJ

Assignee:

Educational Testing Service - Princeton NJ

International Classification:

G09B 700

US Classification:

434353

Abstract:

A computerized mastery testing system providing for the computerized implementation of sequential testing in order to reduce test length without sacrificing mastery classification accuracy. The mastery testing system is based on Item Response Theory and Bayesian Decision Theory which are used to qualify collections of test items, administered as a unit, and determine the decision rules regarding examinee's responses thereto. The test item units are randomly and sequentially presented to the examinee by a computer test administrator. The administrator periodically determines, based on previous responses, whether the examinee may be classified as a nonmaster or master or whether more responses are necessary. If more responses are necessary it will present as many additional test item units as required for classification. The method provides for determining the test specifications, creating an item pool, obtaining IRT statistics for each item, determining ability values, assembling items into testlets, verifying the testlets, selecting loss functions and prior probability of mastery, estimating cutscores, packaging the test for administration, randomly and sequentially administering testlets to the examinee until a pass/fail decision can be made.