(controlled by PSELECT=, ISELECT=, PSUBTOTAL=)

 

AGREEFILE= reports the paired-person information underlying Table 35. Use PSELECT= and ISELECT= to choose subsets to compare for agreement. Sub-samples (groups of persons) can be specified with PSUBTOTAL=. Only pairs in the same groups are shown if AGREEGROUP=Yes.

 

AGREEFILE=? opens a Browse window.

 

When AGREEFILE= is launched from the Output Files menu, the AGREEFILE= dialog box displays.

 

Contents of AGREEFILE=

 

 

; AGREEMENT FILE FOR An MCQ Test: administration was Computer-Adaptive ISELECT=* PSELECT=* AGREEGROUP=Y

  TWOOBS TWOSAME TWOSCOR ONEHIGH TWOHIGH  ONELOW  TWOLOW ONEMISS TWOMISS MEASURE MEASURE AVERAGE T35.1 T35.2 T35.3 T35.4 T35.5 STUDEN1 STUDEN2 P-LABEL P-LABEL2

       9       7       8       5       4       5       3      60      33     .40     .44     .42  77.8  88.9  80.0  60.0  55.0       1       7 IM  CAT IH  JAN

       9       7       7       6       4       5       3      60      24     .40    -.96    -.28  77.8  77.8  66.7  60.0  40.0       1       8 IM  CAT IL  ROB

       7       3       4       5       2       5       1      62      35     .40    -.05     .18  42.9  57.1  40.0  20.0  56.5       1      14 IM  CAT IL  TAK

 

 

Field

Columns

Description

TWOOBS

1-8

count of items for which both persons have non-missing observations

TWOSAME

9-16

count of items for which both persons have the same non-missing observations

TWOSCORE

17-24

count of items for which both persons have non-missing observations scored the same

ONEHIGH

25-32

count of items for which one or both persons have non-missing observations scored in the highest (correct) category

TWOHIGH

33-40

count of items for which both persons have the same non-missing observations scored in the highest (correct) category

ONELOW

41-48

count of items for which one or both persons have non-missing observations scored in the lowest (wrong) category

TWOLOW

49-56

count of items for which both persons have the same non-missing observations scored in the lowest (wrong) category

ONEMISS

57-64

count of items for which one or both persons have a missing observation

TWOMISS

65-72

count of items for which both persons have missing observations

MEASURE(1)

73-80

person ability measure for first person

MEASURE(2)

81-88

person ability measure for second person

AVERAGE

89-96

average person ability of the two persons: Table 35 x-axis measure

T35.1

97-102

Table 35.1 y-axis percent = % Same (Paired Kid) Observed Responses

T35.2

103-108

Table 35.2 y-axis percent = % Same (Paired Kid) Scored Responses

T35.3

109-114

Table 35.3 y-axis percent = % Same (Paired Kid) Observed Highest (Right) Responses

T35.4

115-120

Table 35.4 y-axis percent = % Same (Paired Kid) Observed Lowest (Wrong) Responses

T35.5

121-126

Table 35.5 y-axis percent = % Same (Paired Kid) Missing Responses when either person has a Missing Response

PERSON(1)

127-134

person entry number for first person

PERSON(2)

135-142

person entry number for second person

P-LABEL(1)

143-....(length of longest person label)

person label for first person

P-LABEL(2)

(one blank, then) ...-....

person label for second person

 

Example 1: an MCQ test with 60 questions, scored 1, 0. One person answered questions 1-40 and the other answered 10-50. They were scored 1-1  on 10 items, 1-0 on 8 items, 0-1 on 5 items, 0-0 on 8 items = 31 items.

 

TWOOBS: both students must be observed on the item. They were both observed on items 10-40, so that 31 will appear here.

 

TWOSAME: counts of items to which both students made the same response. There was only one correct response to each item, so SAME = 10 (1-1) correct answers + 2 (out of 8 0-0) incorrect same choice of distractors = 12.

 

TWOSCORE: the count of items on which they scored the same (for a dichotomy, both correct or both incorrect). They made the SAME score on 10 (1-1) + 8 (0-0) = 18.

 

ONEHIGH: one or both persons scored in the highest category, "1", in 10+8+5 = 23 items. The "highest" category is the highest score possible on each item, for dichotomies usually scored 1. For Likert rating scales, the high category is usually scored 5.

 

TWOHIGH: 10 pairs of responses are in the highest category (1-1).

 

ONELOW: one or both persons score in the lowest category, "0", in 8+5+8 = 21 items. The "lowest" category is the lowest score possible on each item, for dichotomies usually scored 0. For Likert rating scales, the low category is usually scored 1.

 

TWOLOW: 8 pairs of responses are in the lowest category (0-0).

 

ONEMISS: there are 60 questions, the both responded to 31, so one or other or both students had missing data on ONEMISS = 60 - 31 = 29 items.

 

TWOMISS: items 51-60 were missing for both students. TWOMISS = 10.


Help for Winsteps Rasch Measurement and Rasch Analysis Software: www.winsteps.com. Author: John Michael Linacre

Facets Rasch measurement software. Buy for $149. & site licenses. Freeware student/evaluation Minifac download
Winsteps Rasch measurement software. Buy for $149. & site licenses. Freeware student/evaluation Ministep download

Rasch Books and Publications
Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, 2nd Edn, 2024 George Engelhard, Jr. & Jue Wang Applying the Rasch Model (Winsteps, Facets) 4th Ed., Bond, Yan, Heene Advances in Rasch Analyses in the Human Sciences (Winsteps, Facets) 1st Ed., Boone, Staver Advances in Applications of Rasch Measurement in Science Education, X. Liu & W. J. Boone Rasch Analysis in the Human Sciences (Winsteps) Boone, Staver, Yale
Introduction to Many-Facet Rasch Measurement (Facets), Thomas Eckes Statistical Analyses for Language Testers (Facets), Rita Green Invariant Measurement with Raters and Rating Scales: Rasch Models for Rater-Mediated Assessments (Facets), George Engelhard, Jr. & Stefanie Wind Aplicação do Modelo de Rasch (Português), de Bond, Trevor G., Fox, Christine M Appliquer le modèle de Rasch: Défis et pistes de solution (Winsteps) E. Dionne, S. Béland
Exploring Rating Scale Functioning for Survey Research (R, Facets), Stefanie Wind Rasch Measurement: Applications, Khine Winsteps Tutorials - free
Facets Tutorials - free
Many-Facet Rasch Measurement (Facets) - free, J.M. Linacre Fairness, Justice and Language Assessment (Winsteps, Facets), McNamara, Knoch, Fan
Other Rasch-Related Resources: Rasch Measurement YouTube Channel
Rasch Measurement Transactions & Rasch Measurement research papers - free An Introduction to the Rasch Model with Examples in R (eRm, etc.), Debelak, Strobl, Zeigenfuse Rasch Measurement Theory Analysis in R, Wind, Hua Applying the Rasch Model in Social Sciences Using R, Lamprianou El modelo métrico de Rasch: Fundamentación, implementación e interpretación de la medida en ciencias sociales (Spanish Edition), Manuel González-Montesinos M.
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Rasch Models for Measurement, David Andrich Constructing Measures, Mark Wilson Best Test Design - free, Wright & Stone
Rating Scale Analysis - free, Wright & Masters
Virtual Standard Setting: Setting Cut Scores, Charalambos Kollias Diseño de Mejores Pruebas - free, Spanish Best Test Design A Course in Rasch Measurement Theory, Andrich, Marais Rasch Models in Health, Christensen, Kreiner, Mesba Multivariate and Mixture Distribution Rasch Models, von Davier, Carstensen
As an Amazon Associate I earn from qualifying purchases. This does not change what you pay.

facebook Forum: Rasch Measurement Forum to discuss any Rasch-related topic

To receive News Emails about Winsteps and Facets by subscribing to the Winsteps.com email list,
enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Winsteps.com
The Winsteps.com email list is only used to email information about Winsteps, Facets and associated Rasch Measurement activities. Your email address is not shared with third-parties. Every email sent from the list includes the option to unsubscribe.

Questions, Suggestions? Want to update Winsteps or Facets? Please email Mike Linacre, author of Winsteps mike@winsteps.com


State-of-the-art : single-user and site licenses : free student/evaluation versions : download immediately : instructional PDFs : user forum : assistance by email : bugs fixed fast : free update eligibility : backwards compatible : money back if not satisfied
 
Rasch, Winsteps, Facets online Tutorials


 

 
Coming Rasch-related Events: Winsteps and Facets
Oct 21 - 22 2024, Mon.-Tues. In person workshop: Facets and Winsteps in expert judgement test validity - UNAM (México) y Universidad Católica de Colombia. capardo@ucatolica.edu.co, benildegar@gmail.com
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

 

Our current URL is www.winsteps.com

Winsteps® is a registered trademark