Programme for International Student Assessment 2015 (PISA 2015)

You requested data for this study based on a deprecated DOI-key. The following information is about the newest version. If you would like to get information about the old version or to apply for data of the deprecated version of this study, please contact the Research Data Centre referring the DOI "10.5159/IQB_PISA_2015_v2"!

 

Table of contents

Project description

Blank data sets

Documentation

Further information

Notes on the use of the data

Literature

 

> Link to application form (Scientific Use Files)

Data Set Published on 05.02.2019
Version v3
Current Version Available Since 25.01.2021
Survey Period 2015
Sample Students (15-year old) (N=circa 6,500) and in grade 9 (N=circa 4,100) in General Education Schools (N=255); Teachers (N=5,600)
Survey Unit Parents
Principals
Students
Teachers
Measured Competencies Mathematics, German - Reading Comprehension, Natural Sciences, Problem Solving Competence
Region Germany, Baden-Wuerttemberg, Bavaria, Berlin, Brandenburg, Bremen, Hamburg, Hesse, Mecklenburg-Western Pomerania, Lower Saxony, North Rhine-Westphalia, Rhineland-Palatinate, Saarland, Saxony, Saxony-Anhalt, Schleswig-Holstein, Thuringia
Data Producers Konferenz der Kultusminister (KMK)
Reiss, Prof. Dr. Kristina
Funded by Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal Republic of Germany, Organization for Economic Cooperation and Development (OECD)
Link https://www.pisa.tum.de/pisa/pisa-2000-2018/pisa-2015/
Related Studies PISA 2000 (DOI: 10.5159/IQB_PISA_2000_v1), PISA 2003 (DOI: 10.5159/IQB_PISA_2003_v1), PISA 2006 (DOI: 10.5159/IQB_PISA_2006_v1), PISA 2009 (DOI: 10.5159/IQB_PISA_2009_v1), PISA 2012 (DOI: 10.5159/IQB_PISA_2012_v5), PISA 2018 (DOI: 10.5159/IQB_PISA_2018_v1), PISA-I-Plus 2003-4 (DOI: 10.5159/IQB_PISA_I_Plus_v1), PISA Plus 2012-13 (DOI: 10.5159/IQB_PISA_Plus_2012-13_v2)
Suggested Citation Reiss, K., Sälzer, C., Schiepe-Tiska, A., Mang, J., Heine, J.-H., Weis, M., Klieme, E., & Köller O. (2019). Programme for International Student Assessment 2015 (PISA 2015) (Version 3) [Data set]. Berlin: IQB – Institut zur Qualitätsentwicklung im Bildungswesen. http://doi.org/10.5159/IQB_PISA_2015_v3
Restriction Notice Cognitive abilities must not be used as a dependent variable in the analyses.

 

Project description

With the conduction of the Programme for International Student Assessment (PISA) 2015, the results of the sixth round are now available, this time focusing on the natural sciences. This completes the second cycle of the study (2000-2006, 2009-2015) where each of the three basic educational domains reading, mathematics and science, have been the major domain twice. The students were tested in the fields of science, mathematics, reading and collaborative problem solving. Additionally, the students answered a questionnaire on demographic characteristics and topics about lessons and their school. The school principals, teachers and parents were also interviewed. In Germany, the PISA 2015 study was conducted by a team at the Centre for International Student Assessment (ZIB e.V.) under the direction of Prof. Dr. Kristina Reiss at the School of Education of the Technical University of Munich (TUM). The main innovation was the implementation of computer-based testing. In addition, PISA 2015 used a refined model for scaling the data. This approach includes both the test item difficulty and a discrimination parameter for estimating the students’ competence. (IQB)

Please note:
Germany's national supplementary surveys independent since 2009

Successful applicants for the data of PISA 2000, 2003 or 2006, respectively, will receive the German data from both the international survey (PISA-I) and the national supplementary survey (PISA-E). Starting with PISA 2009, however, the national supplementary surveys (PISA-E) have since been replaced by the IQB Ländervergleiche (National Assessment Studies), which are carried out parallel to the international PISA surveys. Therefore, the data from the IQB National Assessment Studies since 2009 are not provided automatically together with the German data of the corresponding international PISA surveys. Nevertheless, they, too, are available from the Research Data Centre (FDZ) at the Institute for Educational Quality Improvement (IQB) upon application. Further information on the IQB National Assessment Studies is to be found here and here.

 back to overview 

Blank data sets

For a first overview of the data set and its variables, dummy data sets containing the variables used and the value labels relating to them are provided for download here.

back to overview 

Documentation

Here you can find further documentation:

back to overview

Further information

back to overview

Notes on the use of the data

Are the competence estimators of the PISA, IGLU and IQB studies comparable with each other?

In principle, the tests from PISA and the IQB studies correlate highly, but the underlying competency models differ. The IQB tests are based on the educational standards of the The Standing Conference of the Ministers of Education and Cultural Affairs of the Länder in the Federal Republic of Germany and thus more closely aligned with the schools´ curriculum than the PISA tests. Comparability can be tested using IRT methods based on studies in which both PISA and IQB items were used. Some studies for comparison are for example

The extent of comparability must be considered separately for reading and mathematical literacy and for secondary and primary education. Although it can be assumed that federal state differences can be well mapped using both measures, it is unfortunately not possible to analyse absolute trends on a common metric.

The data sets of PISA 2012 and IQB National Assessment Study 2012 studies can be linked with each other using the ID variable [idstud_FDZ]. This allows you to compare correlations between the scaled test values of both studies.

Please note additionally:

1.) In contrast to the PISA surveys, reading and mathematical literacy are only tested together in the IQB study in primary school: Reading literacy was recorded in the IQB National Assessment Study 2009 (lower secondary level) and in the IQB National Assessment Study 2011 (primary school) as well as in the IQB Trends in Student Achievement 2015 (lower secondary level) and in the IQB Trends in Student Achievement 2016 (primary school). Mathematics competencies can be found in the IQB National Assessment Study 2012 (secondary level) and IQB National Assessment Study 2011 (primary level) as well as in the IQB Trends in Student Achievement 2016 (primary level) and the IQB Trends in Student Achievement 2018 (secondary level).

2.) If you wish to conduct analyses that include unpublished, novel comparisons between single federal states, our Rules of Procedure state that an extended application procedure with a review process applies.

Is it possible to record the age of students (to the day) in the IQB National Assessment Studies/IQB Trends in Student Achievement Studies and in PISA?

Information on the year and age of birth of students is collected as standard in the IQB National Assessment Studies and PISA studies and is available for re- and secondary analyses of the data. For reasons of data protection, however, the exact date of birth was not recorded and is not available in the data sets. The exact test date is also not included in most data sets (in PISA 2009 this information is available). Frequently, however, the data sets contain an age variable that was formed using the year and month of birth in relation to the test date (e.g. in the IQB National Assessment Studies 2011, 2012 and in PISA 2012, 2009, 2006).

Which PISA data can be linked to which IQB National Assessment Studies/IQB Trends in Student Achievement Studies?

The PISA 2012 data sets can be combined with the IQB National Assessment Study 2012. The students IDs have already been recoded in the data sets available at the FDZ at IQB in such a way that a linkage of both data sources is possible. Unfortunately, it is not possible to link the other PISA waves with the data from the IQB IQB National Assessment Studies /IQB Trends in Student Achievement Studies because the ID variables cannot be recoded uniformly.

At what levels was the Germany PISA data collected?

In the German PISA studies, information is only available at the federal state level. Please note that special conditions of use must be observed when analysing data from the federal states. You can read them here:

What is the number of classes drawn per school in PISA surveys?

Information on sampling in the studies can be found in the results reports or scale manuals.

Here is a brief summary of sampling in PISA:

PISA 2000:
random selection of 28 15-year-olds and 10 non-15-year-old ninth graders per school; thus, full classes were not drawn, analyses can only be done at the school level

PISA 2003:
random selection of 15-year-olds per school; in addition, two complete 9th graders were drawn per school for the national expansion; in the PISA-E data, however, no class-based sampling was realised.

PISA 2006:
school-based sampling, then random selection of 15-year-olds per school; at the schools in the international sample (PISA_I), students from two complete 9th grades were additionally tested

PISA 2009:
school-based sampling, additionally students from two complete 9th grades per school were tested

PISA 2012:
school-based sampling, additionally students from two complete 9th grades per school were tested

PISA 2015:
school-based sampling, additionally random selection of 15 ninth graders per school

PISA 2018:
school-based sampling, additionally random selection of 15 ninth graders per school

How many students in special and vocational schools are included in the PISA data?

Special needs and vocational students were covered separately in the above PISA surveys. The sample sizes for these subgroups are given below. They are based on the data in the German PISA Extended Samples (PISA-E) in the student and school management data sets. Where appropriate, there may be slight differences from the reported sample sizes in the results reports.

PISA 2000 E:
- 9th grade: n= 11 students in vocational schools, n= 22 students in special schools out of a total of n= 34,754 students
- 15-year-olds: n= 241 students at vocational schools, n= 799 students at special schools out of a total of n= 35,584 students
- School data set: n= 18 vocational schools, n= 4 special schools out of a total of n= 1,342 schools

PISA 2003 E (here no differentiation between data sets for 9th grade & 15-year-olds possible):
- 9th grade: n= 654 students at vocational schools, n= 1,712 students at special schools out of a total of n= 46,185 students
- School data set: n= 43 vocational schools, no special schools out of a total of n= 1,411 schools

PISA 2006 E:
- 9th grade: no students at vocational schools or special schools in the data set
- 15-year-olds: n= 625 students at vocational schools, n= 2,560 students at special schools out of a total of n= 39,573 students
- School data set: n= 42 vocational schools, no special schools out of a total of n= 1,496 schools

PISA 2009 E:
- 9th grade: no students at vocational schools or special schools in the data set out of a total of n= 9,461 students
- School data set: n= 9 vocational schools, n= 13 special schools out of a total of n= 226 schools

PISA 2012 E:
- 9th grade: no students at vocational schools, n= 153 at special schools out of a total of n= 9,998 students
- 15-year-olds: n= 99 students at vocational schools, n= 139 at special schools out of a total of n= 5,001 students
- School data set: n= 7 vocational schools, n= 12 special schools out of a total of n= 230 schools

PISA 2015 E:
- 9th grade:no students at vocational schools, n= 165 at special schools out of a total of n= 4,149 students
- 15-year-olds: n= 160 students at vocational schools, n= 134 at special schools out of a total of n= 6,504 students
- School data set: n= 8 vocational schools, n= 12special schools out of a total of n= 205 schools

PISA 2018 E:
- 9th grade: no students at vocational schools, n= 115 at special schools out of a total of n= 3,567 students
- 15-year-olds: n= 184 students at vocational schools, n= 98 at special schools out of a total of n= 5,451 students
- School data set: n= 10 vocational schools, n= 7 special schools out of a total of n= 191 schools

Can teacher and student data be linked in PISA?

Unfortunately, linking is only possible for the partial data sets of 9th graders (the data sets of 15-year-olds include cross-school samples). In most PISA waves, two 9th graders were drawn, but the partial data sets often lack a unique class ID.

Here is an overview in bullet points of the individual PISA waves:

- PISA 2000: no teacher questionnaire was used here.

- PISA 2003: partial data set "PISA-I-9th grade": teacher questionnaires contain questions at school level, not at class level; a link via the variable [idclass_FDZ] is possible, but in the teacher data set there is a high proportion of missing values on this variable (presumably because many teachers were surveyed per school); partial data set "PISA-E": no teacher questionnaires available

- PISA Plus 2003-2004: a linkage is possible in principle, but teacher data would have to be imported from PISA 2003 data and are only available at the first measurement point.

- PISA 2006: partial data set "PISA-E": no teacher data set for 9th grades available, linkage only possible at school level; partial data set "PISA-I": no clear linkage possible, as the teacher data set does not contain a class ID.

- PISA 2009: also no class ID in the teacher data set, but linking via idsch and variable [LF39M01] (German taught in PISA class: yes vs. no) partially possible; however, two 9th grades were drawn from each school.

- PISA 2012: Linking is possible in principle via class name variables (teacher data set: class_FDZ; student data set: ClassName_FDZ) but difficult to achieve in practice, as the metric of the school ID does not correspond between the two sub-data sets and there is a high proportion of missing values on class name variables (I interpret reports from PISA staff that linking is not successful in the majority of cases).

- PISA 2015: Linkage is not directly possible, as all teachers in the drawn schools were surveyed.

- PISA 2018: A link between teachers and students via the variable "TEACHCLASS_ID" is not possible until the end of 2022 due to a blocking notice. However, this variable also only contains the information whether the teacher has taught a ninth grade or not. This is because almost all teachers in the drawn school were surveyed. Alternatively, the variable "TEACHERID" can be used, but this variable also does not allow a clear assignment between students and the corresponding teacher.

For which PISA data is a repeated measures data set available?

A repeated measures data set is available for PISA-2003 (PISA-Plus 2003, 2004) and PISA-2012 (PISA-Plus 2012, 2013).

How were the science literacy tests developed in PISA?

In contrast to the IQB National Assessment Studies, the science tests in PISA are not curricularly anchored or subject-specifically designed. Therefore, there are no subtests for biology, physics and chemistry in PISA. Instead, PISA tests scientific literacy (see e.g. OECD, 2006). This involves skills that are significant in situations in which one is confronted with science and technology. These situations relate to physical systems, living systems, earth and space systems and technological systems. Specifically, the following competencies are tested:

(a) recognise scientific issues

b) describe, explain and predict scientific phenomena

c) use scientific evidence to make decisions.

More information on the concept and the test (including sample items) can be found here:

What do the endings "TA" and "NA" in the variable names of the student questionnaire in PISA 2015 stand for?

The endings in the student questionnaire indicate the following:

    "TA": This is a trend analysis item that has already run in this form at least once in a previous PISA wave.

    "NA": This suffix indicates that this item has never been used in a previous PISA cycle.

More information on item naming can be found PDF here (e.g. footnote 4) and in the PISA 2015 Technical Report.

Can the teacher and student data sets be linked in PISA 2015?

Unfortunately, it is not possible to link exactly which teacher teaches which student. However, a link at school level is possible.

back to overview

Literature

Selected literature is listed PDF here (as of March 2023).

2019

Mang, J., Ustjanzew, N. & Leßke, I. (2019). PISA 2015 Skalenhandbuch. Dokumentation der Erhebungsinstrumente. Münster: Waxmann. Verfügbar unter https://www.iqb.hu-berlin.de/fdz/studies/PISA_2015/Skalenhandbuch_P.pdf

Reiss, K., Sälzer, C., Schiepe-Tiska, A., Mang, J., Heine, J.-H., Weis, M., Klieme, E., & Köller, O. (2019). Programme for International Student Assessment 2015 (PISA 2015) (Version 3) [Datensatz]. Berlin: IQB - Institut zur Qualitätsentwicklung im Bildungswesen. https://doi.org/10.5159/IQB_PISA_2015_v3

Zehner, F., Weis, M., Vogel, F., Leutner, D. & Reiss, K. (2019). Kollaboratives Problemlösen in PISA 2015: Deutschland im Fokus. Zeitschrift für Erziehungswissenschaft, 22(3), 617–646. https://doi.org/10.1007/s11618-019-00874-4

2017

OECD. (2017). PISA 2015 assessment and analytical framework. Science, reading, mathematic, financial literacy and collaborative problem solving. Revised edition (PISA). Paris: OECD Publishing. https://doi.org/10.1787/9789264281820-en

OECD. (2017). PISA 2015 Technical Report. Paris: OECD Publishing. Retrieved from http://www.oecd.org/pisa/data/2015-technical-report/

Zehner, F., Weis, M., Vogel, F., Leutner, D. & Reiss, K. (2017). Kollaboratives Problemlösen in PISA 2015: Befundhöhepunkte rund um Deutschland. München: Technische Universität München. https://doi.org/10.14459/2017md1401788

2016

Reiss, K., Sälzer, C., Schiepe-Tiska, A., Klieme, E. & Köller, O. (Hrsg.). (2016). PISA 2015. Eine Studie zwischen Kontinuität und Innovation. Münster: Waxmann. Verfügbar unter http://www.content-select.com/index.php?id=bib_view&ean=9783830985556

back to overview