Trends in International Mathematics and Science Study 2007
ddi-int-datafirst-timss-2007-v1
DataFirst
2020-05-25
Nesstar Publisher
Version 2
Trends in International Mathematics and Science Study 2007
TIMSS 2007
int-iea-timss-2007-v1.1
TIMSS & PIRLS International Study Center
Copyright, International Association for the Evaluation of Educational Achievement (IEA)
Nesstar Publisher
National Center for Education Statistics, U.S. Department of Education
National Science Foundation, U.S.
World Bank
Government of South Africa
Manager, DataFirst
Education Survey [es]
TIMSS & PIRLS International Study Center. Trends in International Mathematics and Science Study 2003 [dataset]. Version 1. Chestnut Hill, MA: Boston College [producer], 2000. Cape Town, South Africa: DataFirst [distributor], 2012. DOI: https://doi.org/10.25828/p0t7-2405
v1.1: Edited, anonymised data for public distribution
basic skills education [6.1]
educational policy [6.3]
International
The survey had international coverage
Country
Individuals and institutions
Sample survey data
TIMSS 2007 collected detailed information about mathematics and science curriculum coverage and implementation, as well as teacher preparation, resource availability, and the use of technology.
A systematic, two-stage probability proportional-to-size (PPS) sampling technique was used, where schools are first sampled and then classes within sampled (and participating) schools. . Because of its large population sizes, it was necessary to include a preliminary sampling stage in the Russian Federation, where regions were sampled first and then schools. Singapore also had a third sampling stage, where students were sampled within classes
Participants could exclude schools from the sampling frame if they were in geographically remote regions, were extremely small, offered curriculum or structure different from the mainstream, or provided instruction only to students in the “within-school” exclusion categories. The general TIMSS rules for defining within-school exclusions can be found in the technical documents.
Face-to-face [f2f]
Each participating country was responsible for carrying out all aspects of the data collection, using standardized procedures developed for the study. Training manuals were created for school coordinators and test administrators that explained procedures for receipt and distribution of materials as well as for the activities related to the testing sessions. These manuals covered procedures for test security, standardized scripts to regulate directions and timing, rules for answering students’ questions, and steps to ensure that identifi cation on the test booklets and questionnaires corresponded to the information on the forms used to track students.
The students within each country were selected using probability sampling. A consequence of this is that each student had a known probability of selection. The inverse of this selection probability is the sampling weight. In a properly selected and weighted sample, the sum of the weights for the sample approximates the size of the population. In TIMSS, the sum of the sampling weights for a country sample is an estimate of the size of the population of students within the country in the sampled grade(s).
Weighted and unweighted response rates were computed for each participating country by grade, at the school level, and at the student level. Overall response rates (combined school and student response rates) also were computed.
TIMSS & PIRLS International Study Center
TIMSS & PIRLS International Study Center. Trends in International Mathematics and Science Study 2003 [dataset]. Version 1. Chestnut Hill, MA: Boston College [producer], 2000. Cape Town, South Africa: DataFirst [distributor], 2012. DOI: https://doi.org/10.25828/p0t7-2405
Public use files, available to all
TIMSS 2007 - Bridge Population 1 - Student Bg - All Countries v1.NSDstat
0
123
Nesstar 200801
TIMSS 2007 - Bridge Population 1 - Student Written Assessment - All Countries v1.NSDstat
0
297
Nesstar 200801
TIMSS 2007 - Bridge Population 1 - Student Written Assessment Reliability - All Countries v1.NSDstat
0
338
Nesstar 200801
TIMSS 2007 - Bridge Population 2 - Student Bg - All Countries v1.NSDstat
0
275
Nesstar 200801
TIMSS 2007 - Bridge Population 2 - Student Written Assessment - All Countries v1.NSDstat
0
346
Nesstar 200801
TIMSS 2007 - Bridge Population 2 - Student Written Assessment Reliability - All Countries v1.NSDstat
0
302
Nesstar 200801
TIMSS 2007 - Population 1 - School Bg - All Countries v1.NSDstat
0
116
Nesstar 200801
TIMSS 2007 - Population 1 - Student Bg - All Countries v1.NSDstat
0
202
Nesstar 200801
TIMSS 2007 - Population 1 - Student Written Assessment - All Countries v1.NSDstat
0
474
Nesstar 200801
TIMSS 2007 - Population 1 - Student Written Assessment Reliability - All Countries v1.NSDstat
0
521
Nesstar 200801
TIMSS 2007 - Population 1 - Student-Teacher Link File - All Countries v1.NSDstat
0
104
Nesstar 200801
TIMSS 2007 - Population 1 - Teacher Bg - All Countries v1.NSDstat
0
280
Nesstar 200801
TIMSS 2007 - Population 2 - Math Teacher Bg - All Countries v1.NSDstat
0
194
Nesstar 200801
TIMSS 2007 - Population 2 - School Bg - All Countries v1.NSDstat
0
124
Nesstar 200801
TIMSS 2007 - Population 2 - Sci Teacher Bg - All Countries v1.NSDstat
0
209
Nesstar 200801
TIMSS 2007 - Population 2 - Student Bg - All Countries v1.NSDstat
0
383
Nesstar 200801
TIMSS 2007 - Population 2 - Student Written Assessment - All Countries v1.NSDstat
0
562
Nesstar 200801
TIMSS 2007 - Population 2 - Student Written Assessment Reliability - All Countries v1.NSDstat
0
650
Nesstar 200801
TIMSS 2007 - Population 2 - Student-Teacher Link File - All Countries v1.NSDstat
0
114
Nesstar 200801
`
country id
0
0
4
Afghanistan
8
Albania
10
Antarctica
12
Algeria
16
American Samoa
20
Andorra
24
Angola
28
Antigua and Barbuda
31
Azerbaijan
32
Argentina
36
Australia
40
Austria
44
Bahamas
48
Bahrain
50
Bangladesh
51
Armenia
52
Barbados
56
Belgium
60
Bermuda
64
Bhutan
68
Bolivia, Plurinational State of
70
Bosnia and Herzegovina
72
Botswana
74
Bouvet Island
76
Brazil
80
British Antarctic Territory
84
Belize
86
British Indian Ocean Territory
90
Solomon Islands
92
Virgin Islands, British
96
Brunei Darussalam
100
Bulgaria
104
Myanmar
108
Burundi
112
Belarus
116
Cambodia
120
Cameroon
124
Canada
128
Canton and Enderbury Islands
132
Cape Verde
136
Cayman Islands
140
Central African Republic
144
Sri Lanka
148
Chad
152
Chile
156
China
158
Taiwan, Province of China
162
Christmas Island
166
Cocos (Keeling) Islands
170
Colombia
174
Comoros
175
Mayotte
178
Congo
180
Congo, the Democratic Republic of the
184
Cook Islands
188
Costa Rica
191
Croatia
192
Cuba
196
Cyprus
200
Czechoslovakia
203
Czech Republic
204
Benin
208
Denmark
212
Dominica
214
Dominican Republic
216
Dronning Maud Land
218
Ecuador
222
El Salvador
226
Equatorial Guinea
230
Ethiopia (before Eritrea split away in 1993)
231
Ethiopia
232
Eritrea
233
Estonia
234
Faroe Islands
238
Falkland Islands (Malvinas)
239
South Georgia and the South Sandwich Islands
242
Fiji
246
Finland
248
Åland Islands
249
France, Metropolitan
250
France
254
French Guiana
258
French Polynesia
260
French Southern Territories
262
Djibouti
266
Gabon
268
Georgia
270
Gambia
275
Palestinian Territory, Occupied
276
Germany
278
German Democratic Republic (i.e., East Germany)
280
Germany, Federal Republic of (i.e., West Germany)
288
Ghana
292
Gibraltar
296
Kiribati
300
Greece
304
Greenland
308
Grenada
312
Guadeloupe
316
Guam
320
Guatemala
324
Guinea
328
Guyana
332
Haiti
334
Heard Island and McDonald Islands
336
Holy See (Vatican City State)
340
Honduras
344
Hong Kong
348
Hungary
352
Iceland
356
India
360
Indonesia
364
Iran, Islamic Republic of
368
Iraq
372
Ireland
376
Israel
380
Italy
384
Côte d'Ivoire
388
Jamaica
392
Japan
396
Johnston Island
398
Kazakhstan
400
Jordan
404
Kenya
408
Korea, Democratic People's Republic of
410
Korea, Republic of
414
Kuwait
417
Kyrgyzstan
418
Lao People's Democratic Republic
422
Lebanon
426
Lesotho
428
Latvia
430
Liberia
434
Libya
438
Liechtenstein
440
Lithuania
442
Luxembourg
446
Macao
450
Madagascar
454
Malawi
458
Malaysia
462
Maldives
466
Mali
470
Malta
474
Martinique
478
Mauritania
480
Mauritius
484
Mexico
488
Midway Islands
492
Monaco
496
Mongolia
498
Moldova, Republic of
499
Montenegro
500
Montserrat
504
Morocco
508
Mozambique
512
Oman
516
Namibia
520
Nauru
524
Nepal
528
Netherlands
530
Netherlands Antilles (after Aruba split away in 1986)
531
Curaçao
532
Netherlands Antilles (before Aruba split away in 1986)
533
Aruba
534
Sint Maarten (Dutch part)
535
Bonaire, Sint Eustatius and Saba
536
Neutral Zone
540
New Caledonia
548
Vanuatu
554
New Zealand
558
Nicaragua
562
Niger
566
Nigeria
570
Niue
574
Norfolk Island
578
Norway
580
Northern Mariana Islands
581
United States Minor Outlying Islands
582
Pacific Islands, Trust Territory of the
583
Micronesia, Federated States of
584
Marshall Islands
585
Palau
586
Pakistan
590
Panama (before adding Panama Canal Zone in 1979)
591
Panama
594
Panama Canal Zone
598
Papua New Guinea
600
Paraguay
604
Peru
608
Philippines
612
Pitcairn
616
Poland
620
Portugal
624
Guinea-Bissau
626
Timor-Leste
630
Puerto Rico
634
Qatar
638
Réunion
642
Romania
643
Russian Federation
646
Rwanda
652
Saint Barthélemy
654
Saint Helena, Ascension and Tristan da Cunha
658
Saint Kitts-Nevis-Anguilla
659
Saint Kitts and Nevis
660
Anguilla
662
Saint Lucia
663
Saint Martin (French part)
666
Saint Pierre and Miquelon
670
Saint Vincent and the Grenadines
674
San Marino
678
Sao Tome and Principe
682
Saudi Arabia
686
Senegal
688
Serbia
690
Seychelles
694
Sierra Leone
698
Sikkim
702
Singapore
703
Slovakia
704
Viet Nam
705
Slovenia
706
Somalia
710
South Africa
714
Viet-Nam, Republic of (i.e., South Vietnam)
716
Zimbabwe
720
Yemen, Democratic (i.e., South Yemen)
724
Spain
728
South Sudan
729
Sudan
732
Western Sahara
736
Sudan (before South Sudan split away in 2011)
740
Suriname
744
Svalbard and Jan Mayen
748
Swaziland
752
Sweden
756
Switzerland
760
Syrian Arab Republic
762
Tajikistan
764
Thailand
768
Togo
772
Tokelau
776
Tonga
780
Trinidad and Tobago
784
United Arab Emirates
788
Tunisia
792
Turkey
795
Turkmenistan
796
Turks and Caicos Islands
798
Tuvalu
800
Uganda
804
Ukraine
807
Macedonia, the former Yugoslav Republic of
810
USSR
818
Egypt
826
United Kingdom
827
Scotland
831
Guernsey
832
Jersey
833
Isle of Man
834
Tanzania, United Republic of
840
United States
849
U.S. Miscellaneous Pacific Islands
850
Virgin Islands, U.S.
854
Burkina Faso
858
Uruguay
860
Uzbekistan
862
Venezuela, Bolivarian Republic of
872
Wake Island
876
Wallis and Futuna
882
Samoa
886
Yemen Arab Republic (North Yemen)
887
Yemen
890
Yugoslavia, Socialist Federal Republic of
891
Serbia and Montenegro (original name: Yugoslavia, Federal Republic of)
894
Zambia
926
England
927
Scotland
956
Belgium (FL)
957
Belgium (FR)
3724
Basque Country, Spain
7841
Dubai, UAE
9132
Ontario Province, Canada
9133
Quebec Province, Canada
9135
British Columbia, Canada
11800
Indiana State, US
12500
Massachusetts, US
12700
Minnesota, US
`
`
school id
0
0
`
`
class id
0
0
`
`
grade id
0
0
3
grade 3
4
grade 4
5
grade 5
99
omitted
`
`
student id
0
0
`
`
date of birth\month
0
0
99
omitted
`
`
date of birth\year
0
0
9999
omitted
`
`
sex of student
0
0
1
girl
2
boy
9
omitted
`
`
achievement test booklet
0
0
`
`
test administrators position
0
0
1
national center staff
2
tch from sch,but not tch of selected cls
3
other
9
omitted
`
`
date of testing/month
0
0
99
omitted
`
`
date of testing/year
0
0
9999
omitted
`
`
language of testing
0
0
1
<test language>
2
<cntry-spec>
9
omitted
`
`
gen\date of birth\year
0
0
1
1994
2
1995
3
1996
4
1997
5
1998
6
1999
7
2000
8
other
99
omitted
`
`
gen\date of birth\month
0
0
1
january
2
february
3
march
4
april
5
may
6
june
7
july
8
august
9
september
10
october
11
november
12
december
99
omitted
`
`
gen\sex of student
0
0
1
girl
2
boy
9
omitted
`
`
gen\often speak <langua of test> at home
0
0
1
always
2
almost always
3
sometimes
4
never
9
omitted
`
`
gen\nr of books in your home
0
0
1
none or very few (0 to 10 books)
2
one shelf (11 to 25 books)
3
one bookcase (26 to 100 books)
4
two bookcases (101 to 200 books)
5
three or more bookcases (over 200 books)
9
omitted
`
`
gen\home possess\calculator
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\computer
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\study desk
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\dictionary
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\internet connection
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\<country specific>
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\<country specific>
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\<country specific>
0
0
1
yes
2
no
9
omitted
`
`
gen\home possess\<country specific>
0
0
1
yes
2
no
9
omitted
`
`
mat\agree\usually do well in maths
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\would like to do more math
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\math is harder for me
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\i enjoy learning mathematics
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\just not good at mathematics
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\i learn things quickly in math
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\math is boring
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\agree\i like math
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
mat\how often\pract without calculator
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i work fractions and decim
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i measure things in classr
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\make tables charts graphs
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i learn about shapes
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\memorize hw to wk problems
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i work in groups
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i explain my answers
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i work problems
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i use calculator
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
mat\how often\i use computer
0
0
1
every or almost every lesson
2
about half the lessons
3
some lessons
4
never
9
omitted
`
`
sci\agree\usually do well in sci
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\would like to do more science
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\science is harder for me
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\i enjoy learning science
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\i am just not good at science
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\learn things quickly in sci
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\science is boring
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\agree\i like science
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
sci\how often\look and write what i see
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\watch teacher do sci exp
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\plan sci exp or invest
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\do sci exp or invest
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\work in group exp or inves
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\read books about sci
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\memorize science facts
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\give explan studying sci
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\work sci problems on own
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
sci\how often\use a comptr in sci lesson
0
0
1
at least once a week
2
once or twice a month
3
a few times a year
4
never
9
omitted
`
`
gen\do you ever use a computer
0
0
1
yes
2
no
9
omitted
`
`
gen\use a computer\at home
0
0
1
yes
2
no
6
logically not applicable
9
omitted
`
`
gen\use a computer\at school
0
0
1
yes
2
no
6
logically not applicable
9
omitted
`
`
gen\use a computer\elsewhere
0
0
1
yes
2
no
6
logically not applicable
9
omitted
`
`
mat\hw often use comptr for schwork\math
0
0
1
every day
2
at least once a week
3
once or twice a month
4
a few times a year
5
never
6
logically not applicable
9
omitted
`
`
sci\hw often use comptr for schwork\sci
0
0
1
every day
2
at least once a week
3
once or twice a month
4
a few times a year
5
never
6
logically not applicable
9
omitted
`
`
gen\agree\i like being in school
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
gen\agree\std try their best
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
gen\agree\tch want std to do best
0
0
1
agree a lot
2
agree a little
3
disagree a little
4
disagree a lot
9
omitted
`
`
gen\in sch\sth of mine was stolen
0
0
1
yes
2
no
9
omitted
`
`
gen\in sch\hit or hurt by other std
0
0
1
yes
2
no
9
omitted
`
`
gen\in sch\made to do things by oth std
0
0
1
yes
2
no
9
omitted
`
`
gen\in sch\made fun of or called names
0
0
1
yes
2
no
9
omitted
`
`
gen\in sch\was left out of activities
0
0
1
yes
2
no
9
omitted
`
`
gen\spend time\watch tv or videos
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\play computer games
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\play talk with friends
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\do jobs at home
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\i play sports
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\read book for enjoyment
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\use internet
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
gen\spend time\do homework
0
0
1
no time
2
less than 1 hour
3
1 to 2 hours
4
more than 2 but less than 4 hours
5
4 or more hours
9
omitted
`
`
mat\how often homework in maths is given
0
0
1
every day
2
3 or 4 times a week
3
1 or 2 times a week
4
less than once a week
5
never
9
omitted
`
`
mat\how many minutes maths homework
0
0
1
zero minutes
2
1 to 15 minutes
3
16 to 30 minutes
4
31 to 60 minutes
5
61 to 90 minutes
6
more than 90 minutes
96
logically not applicable
99
omitted
`
`
sci\how often hmwork in science is given
0
0
1
every day
2
3 or 4 times a week
3
1 or 2 times a week
4
less than once a week
5
never
9
omitted
`
`
sci\how many minutes science homework
0
0
1
zero minutes
2
1 to 15 minutes
3
16 to 30 minutes
4
31 to 60 minutes
5
61 to 90 minutes
6
more than 90 minutes
96
logically not applicable
99
omitted
`
`
gen\mother born in <country>
0
0
1
yes
2
no
9
omitted
`
`
gen\father born in <country>
0
0
1
yes
2
no
9
omitted
`
`
gen\born in <country>
0
0
1
yes
2
no
9
omitted
`
`
gen\born in <country>\age of coming
0
0
1
older than 5 years old
2
1 to 5 years old
3
younger than 1 year old
6
logically not applicable
9
omitted
`
`
system id student background file
0
0
99999
omitted
`
`
population id
0
0
1
timss pop 1
2
timss pop 2
3
timss pop 3
9
omitted
`
`
standardized grade id
0
0
1
lower grade
2
upper grade
9
omitted
`
`
age of student
0
0
99
omitted
`
`
conditioning variable
0
0
9
omitted
`
`
explicit stratum code
0
0
999
omitted
`
`
implicit stratum code
0
0
999
omitted
`
`
school weight adjustment
0
0
999999
omitted
`
`
class weight adjustment
0
0
999999
omitted
`
`
student weight adjustment
0
0
999999
omitted
`
`
school weight factor
0
0
999999
omitted
`
`
class weight factor
0
0
999999
omitted
`
`
student weight factor
0
0
999999
omitted
`
`
jackknife zone
0
0
99
omitted
`
`
jackknife replicate code
0
0
9
omitted
`
`
total student weight
0
0
999999
omitted
`
`
house weight
0
0
999999
omitted
`
`
senate weight
0
0
999999
omitted
`
`
1st plausible value mathematics
0
0
`
`
2nd plausible value mathematics
0
0
`
`
3rd plausible value mathematics
0
0
`
`
4th plausible value mathematics
0
0
`
`
5th plausible value mathematics
0
0
`
`
1st plausible value science
0
0
`
`
2nd plausible value science
0
0
`
`
3rd plausible value science
0
0
`
`
4th plausible value science
0
0
`
`
5th plausible value science
0
0
`
`
file creation date at dpc hamburg
0
0
99999999
omitted
`
`
booklet id
0
0
`
`
achievement scorer id
0
0
999
omitted
`
`
country id
0
0
4
Afghanistan
8
Albania
10
Antarctica
12
Algeria
16
American Samoa
20
Andorra
24
Angola
28
Antigua and Barbuda
31
Azerbaijan
32
Argentina
36
Australia
40
Austria
44
Bahamas
48
Bahrain
50
Bangladesh
51
Armenia
52
Barbados
56
Belgium
60
Bermuda
64
Bhutan
68
Bolivia, Plurinational State of
70
Bosnia and Herzegovina
72
Botswana
74
Bouvet Island
76
Brazil
80
British Antarctic Territory
84
Belize
86
British Indian Ocean Territory
90
Solomon Islands
92
Virgin Islands, British
96
Brunei Darussalam
100
Bulgaria
104
Myanmar
108
Burundi
112
Belarus
116
Cambodia
120
Cameroon
124
Canada
128
Canton and Enderbury Islands
132
Cape Verde
136
Cayman Islands
140
Central African Republic
144
Sri Lanka
148
Chad
152
Chile
156
China
158
Taiwan, Province of China
162
Christmas Island
166
Cocos (Keeling) Islands
170
Colombia
174
Comoros
175
Mayotte
178
Congo
180
Congo, the Democratic Republic of the
184
Cook Islands
188
Costa Rica
191
Croatia
192
Cuba
196
Cyprus
200
Czechoslovakia
203
Czech Republic
204
Benin
208
Denmark
212
Dominica
214
Dominican Republic
216
Dronning Maud Land
218
Ecuador
222
El Salvador
226
Equatorial Guinea
230
Ethiopia (before Eritrea split away in 1993)
231
Ethiopia
232
Eritrea
233
Estonia
234
Faroe Islands
238
Falkland Islands (Malvinas)
239
South Georgia and the South Sandwich Islands
242
Fiji
246
Finland
248
Åland Islands
249
France, Metropolitan
250
France
254
French Guiana
258
French Polynesia
260
French Southern Territories
262
Djibouti
266
Gabon
268
Georgia
270
Gambia
275
Palestinian Territory, Occupied
276
Germany
278
German Democratic Republic (i.e., East Germany)
280
Germany, Federal Republic of (i.e., West Germany)
288
Ghana
292
Gibraltar
296
Kiribati
300
Greece
304
Greenland
308
Grenada
312
Guadeloupe
316
Guam
320
Guatemala
324
Guinea
328
Guyana
332
Haiti
334
Heard Island and McDonald Islands
336
Holy See (Vatican City State)
340
Honduras
344
Hong Kong
348
Hungary
352
Iceland
356
India
360
Indonesia
364
Iran, Islamic Republic of
368
Iraq
372
Ireland
376
Israel
380
Italy
384
Côte d'Ivoire
388
Jamaica
392
Japan
396
Johnston Island
398
Kazakhstan
400
Jordan
404
Kenya
408
Korea, Democratic People's Republic of
410
Korea, Republic of
414
Kuwait
417
Kyrgyzstan
418
Lao People's Democratic Republic
422
Lebanon
426
Lesotho
428
Latvia
430
Liberia
434
Libya
438
Liechtenstein
440
Lithuania
442
Luxembourg
446
Macao
450
Madagascar
454
Malawi
458
Malaysia
462
Maldives
466
Mali
470
Malta
474
Martinique
478
Mauritania
480
Mauritius
484
Mexico
488
Midway Islands
492
Monaco
496
Mongolia
498
Moldova, Republic of
499
Montenegro
500
Montserrat
504
Morocco
508
Mozambique
512
Oman
516
Namibia
520
Nauru
524
Nepal
528
Netherlands
530
Netherlands Antilles (after Aruba split away in 1986)
531
Curaçao
532
Netherlands Antilles (before Aruba split away in 1986)
533
Aruba
534
Sint Maarten (Dutch part)
535
Bonaire, Sint Eustatius and Saba
536
Neutral Zone
540
New Caledonia
548
Vanuatu
554
New Zealand
558
Nicaragua
562
Niger
566
Nigeria
570
Niue
574
Norfolk Island
578
Norway
580
Northern Mariana Islands
581
United States Minor Outlying Islands
582
Pacific Islands, Trust Territory of the
583
Micronesia, Federated States of
584
Marshall Islands
585
Palau
586
Pakistan
590
Panama (before adding Panama Canal Zone in 1979)
591
Panama
594
Panama Canal Zone
598
Papua New Guinea
600
Paraguay
604
Peru
608
Philippines
612
Pitcairn
616
Poland
620
Portugal
624
Guinea-Bissau
626
Timor-Leste
630
Puerto Rico
634
Qatar
638
Réunion
642
Romania
643
Russian Federation
646
Rwanda
652
Saint Barthélemy
654
Saint Helena, Ascension and Tristan da Cunha
658
Saint Kitts-Nevis-Anguilla
659
Saint Kitts and Nevis
660
Anguilla
662
Saint Lucia
663
Saint Martin (French part)
666
Saint Pierre and Miquelon
670
Saint Vincent and the Grenadines
674
San Marino
678
Sao Tome and Principe
682
Saudi Arabia
686
Senegal
688
Serbia
690
Seychelles
694
Sierra Leone
698
Sikkim
702
Singapore
703
Slovakia
704
Viet Nam
705
Slovenia
706
Somalia
710
South Africa
714
Viet-Nam, Republic of (i.e., South Vietnam)
716
Zimbabwe
720
Yemen, Democratic (i.e., South Yemen)
724
Spain
728
South Sudan
729
Sudan
732
Western Sahara
736
Sudan (before South Sudan split away in 2011)
740
Suriname
744
Svalbard and Jan Mayen
748
Swaziland
752
Sweden
756
Switzerland
760
Syrian Arab Republic
762
Tajikistan
764
Thailand
768
Togo
772
Tokelau
776
Tonga
780
Trinidad and Tobago
784
United Arab Emirates
788
Tunisia
792
Turkey
795
Turkmenistan
796
Turks and Caicos Islands
798
Tuvalu
800
Uganda
804
Ukraine
807
Macedonia, the former Yugoslav Republic of
810
USSR
818
Egypt
826
United Kingdom
827
Scotland
831
Guernsey
832
Jersey
833
Isle of Man
834
Tanzania, United Republic of
840
United States
849
U.S. Miscellaneous Pacific Islands
850
Virgin Islands, U.S.
854
Burkina Faso
858
Uruguay
860
Uzbekistan
862
Venezuela, Bolivarian Republic of
872
Wake Island
876
Wallis and Futuna
882
Samoa
886
Yemen Arab Republic (North Yemen)
887
Yemen
890
Yugoslavia, Socialist Federal Republic of
891
Serbia and Montenegro (original name: Yugoslavia, Federal Republic of)
894
Zambia
926
England
927
Scotland
956
Belgium (FL)
957
Belgium (FR)
3724
Basque Country, Spain
7841
Dubai, UAE
9132
Ontario Province, Canada
9133
Quebec Province, Canada
9135
British Columbia, Canada
11800
Indiana State, US
12500
Massachusetts, US
12700
Minnesota, US
`
`
school id
0
0
`
`
class id
0
0
`
`
student id
0
0
`
`
bar graph: which shows 45 bottles? (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
volume of stack of cubes (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
figure show fraction of shaded square(e)
0
0
1
a
2
b
3
c
4
d
5
e*
6
not reached
9
omitted
`
`
how long to wash windows? (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
when is marys trip? (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
digit in hundreds place (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
number rounded to 600 (d)
0
0
1
a
2
b
3
c
4
d*
5
e
6
not reached
9
omitted
`
`
fraction to decimal (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
distance on map (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
weight of an adult (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
express number in words (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
symbolic linear equation of magazines(b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
762 cars parked in 6 equal rows (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
manos missing digit (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number of boys and girls in a school (2)
0
0
10
partial response
11
partial response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
seans rule to transform numbers (1)
0
0
10
correct response
19
correct response
79
incorrect response
96
not reached
99
omitted
`
`
temperature increase at 9am (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
time don, rob, lynn to leave school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
water in bottle after pouring 250 ml (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
al wanted to weigh his cat (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the square is cut into 7 pieces (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
jasmins tally chart (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
types of trees in pie charts (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
children share sweets equally (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
alan and fred went running (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
ken measured length of a blackboard (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
the rule ann uses to get her number (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the rule for 2,5,11,23 (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
64 divided by box equals box (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
triangular tiles to cover the figure (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a park (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a library (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw the reflection of the shape (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
complete table by gender with hats (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number going in the number line box (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
1279 plus 243 by mistake (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
what fraction of cake john ate (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
the value of 37 times box plus 6 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black triangle (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black square (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_fraction shaded (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_1/2 black (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_5/8 black (2)
0
0
10
partially correct response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
output of the number machine (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
204 divided by 4 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
maria collected soft drink bottles (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
notebooks for 115 students (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
9 rows of 15 chairs/total (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the number to go in the center (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
the length of the films (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
which could equal 150 milliliters (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
draw line on rectangle/2 triangles (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/2 rectangles (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/1rectangle, 2 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
shade in two triangles of diff size (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the favorite ice creams of 30 stud (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
5631 plus 286 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
what is the prize winning number (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
recipe for 3 people (2)
0
0
10
partially correct response
11
partially correct response
12
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
number pattern using rule add 4 (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
kim gave pete 3 more pencils (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
ebrus rule to get number in box (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
how much the apples weigh in grams (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
shaded area in square centimeters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
600 books to be packed into boxes (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
the angles ordered by size (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
rotate the shape 1/4 turn clockwise (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
favorite colors of darins friends (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
select a fraction larger than 1/2 (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
georgia needs pages to send letters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
if the patter 3,6,9,12 continued (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
4 times box equals 28 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
3 + 8 = box plus 6 (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
pattern of circles/figure 5 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
pattern of circles/figure 10 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
length of string pulled straight (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
a train from redville to bedford (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
draw angle between 90 and 180 degree (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
jamie is playing a board game (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
which dotted line is of symmetry (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
teachers pens on the graph (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
bar graph: which shows 45 bottles? (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
volume of stack of cubes (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
figure show fraction of shaded square(e)
0
0
1
a
2
b
3
c
4
d
5
e*
6
not reached
9
omitted
`
`
how long to wash windows? (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
when is marys trip? (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
digit in hundreds place (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
number rounded to 600 (d)
0
0
1
a
2
b
3
c
4
d*
5
e
6
not reached
9
omitted
`
`
fraction to decimal (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
distance on map (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
weight of an adult (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
express number in words (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
symbolic linear equation of magazines(b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
bar graph: which two show 80 bottles?(a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
how much did temperature rise? (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
congruent figures (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
subtraction with decimals (e)
0
0
1
a
2
b
3
c
4
d
5
e*
6
not reached
9
omitted
`
`
3 of 4 squares shaded (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
highest temperature on chart (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
fraction of cake left (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
which number is it? (b)
0
0
1
a
2
b*
3
c
4
d
5
e
6
not reached
9
omitted
`
`
units to measure mass of egg (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
statements about triangle (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
total number of pencils (c)
0
0
1
a
2
b
3
c*
4
d
5
e
6
not reached
9
omitted
`
`
number represented by squares (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
which has largest area? (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
number tiles_get to 20 using 2,7,9 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,3,6 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,4,6 (2)
0
0
10
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (+) (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (-) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (x) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the number lia should add to 142 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
bettys average driving speed (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
george practiced soccer 6 days a week(d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
high and low temperatures for a week (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
trading cards_cartoon cards (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_max number of cards (2)
0
0
10
partial response
11
partial response
12
partial response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading cartoon cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
pirate ship chasing treasure ship (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
total number of people on a ship (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
6 pieces of cardboard to make shape (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
position of shape after a half turn (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
distance between towns from map info (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
what strong magnets separate (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
saltiest water (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
which decays fastest (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
interpretation of senses (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
objects floating in water (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
earths surface (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
bodys use of excess food (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
where are fossils found (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
plant grown for food (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
earths movement (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
terrys rocks (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
which group of animals are mammals (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
can oak tree and sunflower reproduce (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
skulls of plant-eater/animal-eater (2)
0
0
10
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
energy to heal a cut (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
uses of water as ice (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
uses of water as liquid (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
beans and heated metal ruler (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
bubbles rise in water (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
main reason we see the moon (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
two seasons/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two seasons/ difference (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal that sheds its outer covering (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
bird likely to eat small mammals (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
feature of fish and mammals/ fish (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
feature of fish and mammals/ mammals (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
sugar dissolved in water (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
turn a liquid into a gas (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
turn a liquid into a solid (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
people should not drink sea water (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
one way sun and moon differ (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
which are insects (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
protection from the sun (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
group that consists only of living (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect response
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect response
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
which bulb will light (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
organisms that give birth or lay eggs(2)
0
0
10
partial response
11
partial response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ property(1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
town where it is most likely to snow (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
best location to grow crops (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
how much time to next full moon (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
explain yellow color of a plant (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
phys feature to get rid of body heat (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
where tadpole gets its food (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
water vapor when it gets cold (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
are plants living or nonliving (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
larvae found in a bag of rice (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
substances that dissolve in water (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
activity that results in new material(a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
difference between solids and liquids(1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
which can make objects repel (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
animal with young and adult forms (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
only siberian tigers left are female (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
main features of four animals shown (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
coarse and fine salt added to water (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
metal spoon and wooden spoon (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
sunlight made up of colors (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
79
incorrect response
96
not reached
99
omitted
`
`
why birds sit on their eggs (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
object in circuit for bulb to glow (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
force that causes object to fall (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
soil change due to natural causes (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
which animal is a predator (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
what walrus has to keep it warm (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
birds/bats/butterflies share (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
manuels temperature rise (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marias experiment with salt/water (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
position of a piece of ice in water (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
heat needed to change state of water (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
best soil for plants to grow in (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
label earth, moon, and sun (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (2)
0
0
10
correct response
20
correct response
70
incorrect response
79
partially correct response
96
not reached
99
omitted
`
`
what strong magnets separate (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
saltiest water (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
which decays fastest (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
interpretation of senses (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
objects floating in water (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
earths surface (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
bodys use of excess food (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
where are fossils found (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
plant grown for food (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
earths movement (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
terrys rocks (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
boiling water (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
washing hands (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
direction of water (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
effect on adult height (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
air when a person breathes (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
plants and water absorption (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
which diagram shows shadow (c)
0
0
1
a
2
b
3
c*
4
d
5
e
6
not reached
9
omitted
`
`
iceberg in sea water (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
which could cause rainbow (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
which doesnt lay eggs (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
layers of earth (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
true statement for all objects (d)
0
0
1
a
2
b
3
c
4
d*
6
not reached
9
omitted
`
`
where we get minerals to make things (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
two things wrong with the shadow (2)
0
0
10
partial response
11
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
candle flame last to go out (b)
0
0
1
a
2
b*
3
c
4
d
6
not reached
9
omitted
`
`
garden_why plants need light to grow (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_one other thing plants need (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
garden_which side of the house gets (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why roses will not grow under (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_plants that grow well in four (2)
0
0
10
partial response
20
correct response
21
correct response
79
incorrect response
96
not reached
99
omitted
`
`
garden_how seeds get into garden (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why insects are important (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ results (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ wrong shirt or not (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ color of light bulb (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
white shirt/ results (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
white shirt/ color under blue light (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
color of blue shirt under blue light (2)
0
0
10
partial response
11
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal with teeth most like humans (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
curly hair or straight hair (a)
0
0
1
a*
2
b
3
c
4
d
6
not reached
9
omitted
`
`
true statement about food chain (c)
0
0
1
a
2
b
3
c*
4
d
6
not reached
9
omitted
`
`
nutrients from fruit (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
ribbon tied to pole (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
sex of student
0
0
1
girl
2
boy
9
omitted
`
`
language of testing
0
0
1
test language
2
country specific
9
omitted
`
`
record number student general file
0
0
99999
omitted
`
`
reliability scoring status
0
0
0
students booklet not used for r-scoring
1
students booklet was used for r-scoring
9
omitted
`
`
population id
0
0
1
timss pop 1
2
timss pop 2
3
timss pop 3
9
omitted
`
`
grade id
0
0
3
grade 3
4
grade 4
5
grade 5
99
omitted
`
`
standardized grade id
0
0
1
lower grade
2
upper grade
9
omitted
`
`
age of student
0
0
99
omitted
`
`
explicit stratum code
0
0
999
omitted
`
`
implicit stratum code
0
0
999
omitted
`
`
jackknife replicate code
0
0
9
omitted
`
`
jackknife zone
0
0
99
omitted
`
`
house weight
0
0
999999
omitted
`
`
senate weight
0
0
999999
omitted
`
`
total student weight
0
0
999999
omitted
`
`
raw score on math items
0
0
99
omitted
`
`
standardized math raw score (50,10)
0
0
9999
omitted
`
`
raw score on science items
0
0
99
omitted
`
`
standardized science raw score (50,10)
0
0
9999
omitted
`
`
national math rasch score (150,10)
0
0
9999
omitted
`
`
national science rasch score (150,10)
0
0
9999
omitted
`
`
1st plausible value mathematics
0
0
`
`
2nd plausible value mathematics
0
0
`
`
3rd plausible value mathematics
0
0
`
`
4th plausible value mathematics
0
0
`
`
5th plausible value mathematics
0
0
`
`
1st plausible value science
0
0
`
`
2nd plausible value science
0
0
`
`
3rd plausible value science
0
0
`
`
4th plausible value science
0
0
`
`
5th plausible value science
0
0
`
`
file creation date at dpc hamburg
0
0
99999999
omitted
`
`
booklet id
0
0
`
`
reliability scorer id
0
0
999
omitted
`
`
country id
0
0
4
Afghanistan
8
Albania
10
Antarctica
12
Algeria
16
American Samoa
20
Andorra
24
Angola
28
Antigua and Barbuda
31
Azerbaijan
32
Argentina
36
Australia
40
Austria
44
Bahamas
48
Bahrain
50
Bangladesh
51
Armenia
52
Barbados
56
Belgium
60
Bermuda
64
Bhutan
68
Bolivia, Plurinational State of
70
Bosnia and Herzegovina
72
Botswana
74
Bouvet Island
76
Brazil
80
British Antarctic Territory
84
Belize
86
British Indian Ocean Territory
90
Solomon Islands
92
Virgin Islands, British
96
Brunei Darussalam
100
Bulgaria
104
Myanmar
108
Burundi
112
Belarus
116
Cambodia
120
Cameroon
124
Canada
128
Canton and Enderbury Islands
132
Cape Verde
136
Cayman Islands
140
Central African Republic
144
Sri Lanka
148
Chad
152
Chile
156
China
158
Taiwan, Province of China
162
Christmas Island
166
Cocos (Keeling) Islands
170
Colombia
174
Comoros
175
Mayotte
178
Congo
180
Congo, the Democratic Republic of the
184
Cook Islands
188
Costa Rica
191
Croatia
192
Cuba
196
Cyprus
200
Czechoslovakia
203
Czech Republic
204
Benin
208
Denmark
212
Dominica
214
Dominican Republic
216
Dronning Maud Land
218
Ecuador
222
El Salvador
226
Equatorial Guinea
230
Ethiopia (before Eritrea split away in 1993)
231
Ethiopia
232
Eritrea
233
Estonia
234
Faroe Islands
238
Falkland Islands (Malvinas)
239
South Georgia and the South Sandwich Islands
242
Fiji
246
Finland
248
Åland Islands
249
France, Metropolitan
250
France
254
French Guiana
258
French Polynesia
260
French Southern Territories
262
Djibouti
266
Gabon
268
Georgia
270
Gambia
275
Palestinian Territory, Occupied
276
Germany
278
German Democratic Republic (i.e., East Germany)
280
Germany, Federal Republic of (i.e., West Germany)
288
Ghana
292
Gibraltar
296
Kiribati
300
Greece
304
Greenland
308
Grenada
312
Guadeloupe
316
Guam
320
Guatemala
324
Guinea
328
Guyana
332
Haiti
334
Heard Island and McDonald Islands
336
Holy See (Vatican City State)
340
Honduras
344
Hong Kong
348
Hungary
352
Iceland
356
India
360
Indonesia
364
Iran, Islamic Republic of
368
Iraq
372
Ireland
376
Israel
380
Italy
384
Côte d'Ivoire
388
Jamaica
392
Japan
396
Johnston Island
398
Kazakhstan
400
Jordan
404
Kenya
408
Korea, Democratic People's Republic of
410
Korea, Republic of
414
Kuwait
417
Kyrgyzstan
418
Lao People's Democratic Republic
422
Lebanon
426
Lesotho
428
Latvia
430
Liberia
434
Libya
438
Liechtenstein
440
Lithuania
442
Luxembourg
446
Macao
450
Madagascar
454
Malawi
458
Malaysia
462
Maldives
466
Mali
470
Malta
474
Martinique
478
Mauritania
480
Mauritius
484
Mexico
488
Midway Islands
492
Monaco
496
Mongolia
498
Moldova, Republic of
499
Montenegro
500
Montserrat
504
Morocco
508
Mozambique
512
Oman
516
Namibia
520
Nauru
524
Nepal
528
Netherlands
530
Netherlands Antilles (after Aruba split away in 1986)
531
Curaçao
532
Netherlands Antilles (before Aruba split away in 1986)
533
Aruba
534
Sint Maarten (Dutch part)
535
Bonaire, Sint Eustatius and Saba
536
Neutral Zone
540
New Caledonia
548
Vanuatu
554
New Zealand
558
Nicaragua
562
Niger
566
Nigeria
570
Niue
574
Norfolk Island
578
Norway
580
Northern Mariana Islands
581
United States Minor Outlying Islands
582
Pacific Islands, Trust Territory of the
583
Micronesia, Federated States of
584
Marshall Islands
585
Palau
586
Pakistan
590
Panama (before adding Panama Canal Zone in 1979)
591
Panama
594
Panama Canal Zone
598
Papua New Guinea
600
Paraguay
604
Peru
608
Philippines
612
Pitcairn
616
Poland
620
Portugal
624
Guinea-Bissau
626
Timor-Leste
630
Puerto Rico
634
Qatar
638
Réunion
642
Romania
643
Russian Federation
646
Rwanda
652
Saint Barthélemy
654
Saint Helena, Ascension and Tristan da Cunha
658
Saint Kitts-Nevis-Anguilla
659
Saint Kitts and Nevis
660
Anguilla
662
Saint Lucia
663
Saint Martin (French part)
666
Saint Pierre and Miquelon
670
Saint Vincent and the Grenadines
674
San Marino
678
Sao Tome and Principe
682
Saudi Arabia
686
Senegal
688
Serbia
690
Seychelles
694
Sierra Leone
698
Sikkim
702
Singapore
703
Slovakia
704
Viet Nam
705
Slovenia
706
Somalia
710
South Africa
714
Viet-Nam, Republic of (i.e., South Vietnam)
716
Zimbabwe
720
Yemen, Democratic (i.e., South Yemen)
724
Spain
728
South Sudan
729
Sudan
732
Western Sahara
736
Sudan (before South Sudan split away in 2011)
740
Suriname
744
Svalbard and Jan Mayen
748
Swaziland
752
Sweden
756
Switzerland
760
Syrian Arab Republic
762
Tajikistan
764
Thailand
768
Togo
772
Tokelau
776
Tonga
780
Trinidad and Tobago
784
United Arab Emirates
788
Tunisia
792
Turkey
795
Turkmenistan
796
Turks and Caicos Islands
798
Tuvalu
800
Uganda
804
Ukraine
807
Macedonia, the former Yugoslav Republic of
810
USSR
818
Egypt
826
United Kingdom
827
Scotland
831
Guernsey
832
Jersey
833
Isle of Man
834
Tanzania, United Republic of
840
United States
849
U.S. Miscellaneous Pacific Islands
850
Virgin Islands, U.S.
854
Burkina Faso
858
Uruguay
860
Uzbekistan
862
Venezuela, Bolivarian Republic of
872
Wake Island
876
Wallis and Futuna
882
Samoa
886
Yemen Arab Republic (North Yemen)
887
Yemen
890
Yugoslavia, Socialist Federal Republic of
891
Serbia and Montenegro (original name: Yugoslavia, Federal Republic of)
894
Zambia
926
England
927
Scotland
956
Belgium (FL)
957
Belgium (FR)
3724
Basque Country, Spain
7841
Dubai, UAE
9132
Ontario Province, Canada
9133
Quebec Province, Canada
9135
British Columbia, Canada
11800
Indiana State, US
12500
Massachusetts, US
12700
Minnesota, US
`
`
school id
0
0
`
`
class id
0
0
`
`
student id
0
0
`
`
762 cars parked in 6 equal rows (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
762 cars parked in 6 equal rows (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
762 cars parked in 6 equal rows (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
manos missing digit (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
manos missing digit (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
manos missing digit (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number of boys and girls in a school (2)
0
0
10
partial response
11
partial response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number of boys and girls in a school (2)
0
0
10
partial response
11
partial response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number of boys and girls in a school (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
seans rule to transform numbers (1)
0
0
10
correct response
19
correct response
79
incorrect response
96
not reached
99
omitted
`
`
seans rule to transform numbers (1)
0
0
10
correct response
19
correct response
79
incorrect response
96
not reached
99
omitted
`
`
seans rule to transform numbers (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
time don, rob, lynn to leave school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
time don, rob, lynn to leave school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
time don, rob, lynn to leave school (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
water in bottle after pouring 250 ml (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
water in bottle after pouring 250 ml (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
water in bottle after pouring 250 ml (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
al wanted to weigh his cat (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
al wanted to weigh his cat (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
al wanted to weigh his cat (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
the square is cut into 7 pieces (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the square is cut into 7 pieces (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the square is cut into 7 pieces (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
jasmins tally chart (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
jasmins tally chart (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
jasmins tally chart (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
children share sweets equally (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
children share sweets equally (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
children share sweets equally (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
alan and fred went running (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
alan and fred went running (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
alan and fred went running (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
the rule ann uses to get her number (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the rule ann uses to get her number (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
the rule ann uses to get her number (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
triangular tiles to cover the figure (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
triangular tiles to cover the figure (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
triangular tiles to cover the figure (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
marytown_add a park (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a park (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a park (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
marytown_add a library (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a library (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a library (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
marytown_add a school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a school (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
marytown_add a school (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
draw the reflection of the shape (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw the reflection of the shape (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw the reflection of the shape (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
complete table by gender with hats (1)
0
0
10
correct response
11
correct response
79
incorrect response
96
not reached
99
omitted
`
`
complete table by gender with hats (1)
0
0
10
correct response
11
correct response
79
incorrect response
96
not reached
99
omitted
`
`
complete table by gender with hats (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number going in the number line box (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number going in the number line box (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number going in the number line box (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
the value of 37 times box plus 6 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the value of 37 times box plus 6 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the value of 37 times box plus 6 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
geometry tiles_black triangle (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black triangle (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black triangle (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
geometry tiles_black square (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black square (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_black square (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
geometry tiles_fraction shaded (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_fraction shaded (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_fraction shaded (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
geometry tiles_1/2 black (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_1/2 black (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_1/2 black (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
geometry tiles_5/8 black (2)
0
0
10
partially correct response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_5/8 black (2)
0
0
10
partially correct response
20
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
geometry tiles_5/8 black (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
204 divided by 4 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
204 divided by 4 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
204 divided by 4 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
notebooks for 115 students (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
notebooks for 115 students (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
notebooks for 115 students (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
9 rows of 15 chairs/total (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
9 rows of 15 chairs/total (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
9 rows of 15 chairs/total (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
draw line on rectangle/2 triangles (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/2 triangles (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/2 triangles (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
draw line on rectangle/2 rectangles (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/2 rectangles (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/2 rectangles (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
draw line on rectangle/1rectangle, 2 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/1rectangle, 2 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw line on rectangle/1rectangle, 2 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
shade in two triangles of diff size (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
shade in two triangles of diff size (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
shade in two triangles of diff size (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
5631 plus 286 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
5631 plus 286 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
5631 plus 286 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
what is the prize winning number (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
what is the prize winning number (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
what is the prize winning number (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
recipe for 3 people (2)
0
0
10
partially correct response
11
partially correct response
12
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
recipe for 3 people (2)
0
0
10
partially correct response
11
partially correct response
12
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
recipe for 3 people (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
shaded area in square centimeters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
shaded area in square centimeters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
shaded area in square centimeters (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
favorite colors of darins friends (2)
0
0
10
partially correct response
20
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
favorite colors of darins friends (2)
0
0
10
partially correct response
20
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
favorite colors of darins friends (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
georgia needs pages to send letters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
georgia needs pages to send letters (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
georgia needs pages to send letters (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
4 times box equals 28 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
4 times box equals 28 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
4 times box equals 28 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
pattern of circles/figure 5 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
pattern of circles/figure 5 (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
pattern of circles/figure 5 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
pattern of circles/figure 10 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
pattern of circles/figure 10 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
pattern of circles/figure 10 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
draw angle between 90 and 180 degree (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw angle between 90 and 180 degree (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
draw angle between 90 and 180 degree (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_get to 20 using 2,7,9 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 2,7,9 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 2,7,9 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_get to 20 using 1,3,6 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,3,6 (1)
0
0
10
correct response
11
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,3,6 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_get to 20 using 1,4,6 (2)
0
0
10
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,4,6 (2)
0
0
10
partially correct response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_get to 20 using 1,4,6 (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_largest number (+) (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (+) (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (+) (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_largest number (-) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (-) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (-) (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
number tiles_largest number (x) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (x) (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
number tiles_largest number (x) (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
the number lia should add to 142 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the number lia should add to 142 (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
the number lia should add to 142 (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
trading cards_cartoon cards (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_cartoon cards (1)
0
0
10
correct response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_cartoon cards (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
trading cards_sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_sports cards (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
trading cards_max number of cards (2)
0
0
10
partial response
11
partial response
12
partial response
20
correct response
21
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_max number of cards (2)
0
0
10
partial response
11
partial response
12
partial response
20
correct response
21
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_max number of cards (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
trading cards_trading sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading sports cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading sports cards (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
trading cards_trading cartoon cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading cartoon cards (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
trading cards_trading cartoon cards (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
total number of people on a ship (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
total number of people on a ship (1)
0
0
10
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
total number of people on a ship (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
direction of water (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
direction of water (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
direction of water (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
can oak tree and sunflower reproduce (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
can oak tree and sunflower reproduce (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
can oak tree and sunflower reproduce (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
skulls of plant-eater/animal-eater (2)
0
0
10
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
skulls of plant-eater/animal-eater (2)
0
0
10
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
skulls of plant-eater/animal-eater (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
uses of water as ice (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
uses of water as ice (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
uses of water as ice (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
uses of water as liquid (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
uses of water as liquid (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
uses of water as liquid (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
bubbles rise in water (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
bubbles rise in water (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
bubbles rise in water (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two seasons/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two seasons/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two seasons/ name (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two seasons/ difference (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two seasons/ difference (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two seasons/ difference (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
functions of human skeleton (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
feature of fish and mammals/ fish (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
feature of fish and mammals/ fish (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
feature of fish and mammals/ fish (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
feature of fish and mammals/ mammals (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
feature of fish and mammals/ mammals (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
feature of fish and mammals/ mammals (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
turn a liquid into a gas (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
turn a liquid into a gas (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
turn a liquid into a gas (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
turn a liquid into a solid (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
turn a liquid into a solid (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
turn a liquid into a solid (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
people should not drink sea water (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
people should not drink sea water (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
people should not drink sea water (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
one way sun and moon differ (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
one way sun and moon differ (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
one way sun and moon differ (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
protection from the sun (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
protection from the sun (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
protection from the sun (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two functions of skin (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
organisms that give birth or lay eggs(2)
0
0
10
partial response
11
partial response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
organisms that give birth or lay eggs(2)
0
0
10
partial response
11
partial response
20
correct response
79
incorrect response
96
not reached
99
omitted
`
`
organisms that give birth or lay eggs(2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
objects made of metals/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ name (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ name (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
objects made of metals/ property(1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ property(1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
objects made of metals/ property(1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
water vapor when it gets cold (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
water vapor when it gets cold (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
water vapor when it gets cold (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
are plants living or nonliving (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
are plants living or nonliving (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
are plants living or nonliving (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
14
correct resp
19
correct resp
70
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways kevin passed his cold (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
difference between solids and liquids(1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
difference between solids and liquids(1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
difference between solids and liquids(1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
main features of four animals shown (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
main features of four animals shown (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
main features of four animals shown (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
coarse and fine salt added to water (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
coarse and fine salt added to water (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
coarse and fine salt added to water (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
sunlight made up of colors (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
sunlight made up of colors (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
sunlight made up of colors (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
two ways to use air (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
manuels temperature rise (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
manuels temperature rise (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
manuels temperature rise (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (1)
0
0
10
correct response
11
correct response
12
correct response
13
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two uses of electricity (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
label earth, moon, and sun (1)
0
0
10
correct response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
label earth, moon, and sun (1)
0
0
10
correct response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
label earth, moon, and sun (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
10
correct response
11
correct response
12
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
animal extinction (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
two things wrong with the shadow (2)
0
0
10
partial response
11
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two things wrong with the shadow (2)
0
0
10
partial response
11
partial response
19
partial response
20
correct response
29
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
two things wrong with the shadow (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_why plants need light to grow (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why plants need light to grow (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why plants need light to grow (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_one other thing plants need (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
garden_one other thing plants need (1)
0
0
10
correct resp
11
correct resp
12
correct resp
13
correct resp
19
correct resp
70
incorrect resp
71
incorrect resp
79
incorrect resp
96
not reached
99
omitted
`
`
garden_one other thing plants need (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_which side of the house gets (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_which side of the house gets (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_which side of the house gets (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_why roses will not grow under (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why roses will not grow under (1)
0
0
10
correct response
19
correct response
70
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why roses will not grow under (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_plants that grow well in four (2)
0
0
10
partial response
20
correct response
21
correct response
79
incorrect response
96
not reached
99
omitted
`
`
garden_plants that grow well in four (2)
0
0
10
partial response
20
correct response
21
correct response
79
incorrect response
96
not reached
99
omitted
`
`
garden_plants that grow well in four (2)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_how seeds get into garden (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_how seeds get into garden (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_how seeds get into garden (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
garden_why insects are important (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why insects are important (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
72
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
garden_why insects are important (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
new shirt/ results (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ results (1)
0
0
10
correct response
11
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ results (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
new shirt/ wrong shirt or not (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ wrong shirt or not (1)
0
0
10
correct response
19
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ wrong shirt or not (1)
0
0
0
identical codes
1
identical score, but different reasoning
2
different score
9
omitted
`
`
new shirt/ color of light bulb (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ color of light bulb (1)
0
0
10
correct response
70
incorrect response
71
incorrect response
79
incorrect response
96
not reached
99
omitted
`
`
new shirt/ color of light bulb (1)
0
0
0
identical codes
`