TKS included an assessment of teachers’ general pedagogical knowledge (GPK) and an accompanying contextual questionnaire. While GPK scores can be considered an “objective” measure of teachers’ proficiency in GPK, all other variables analysed in this report are based on self-reports from teachers and principals. They often represent their opinions, perceptions, beliefs and accounts of their activities. As with any self-reported data, this information is subjective and may, therefore, differ from data collected through other means (e.g. administrative data or video observations). The same is true of principals’ reports about school characteristics and practices, which may differ from descriptions provided by administrative data at a national or local government level.
While self-reported data allow respondents to share their beliefs and perceptions, there are also limitations when interpreting findings based on self-reported information.
Cultural response patterns: Social and cultural backgrounds might systematically affect how individuals respond to questions (e.g. tending to respond in moderate or extreme ways) (van de Vijver and Leung, 1997[2]).
Social desirability bias: Individuals respond in ways that they think are viewed favourably but do not represent their true beliefs or actions (Krumpal, 2011[3]).
Validity concerns: Respondents might have to remember something that occurred a long time in the past, or their interpretation of a question is not consistent (e.g. what one person believes to be “critical thinking” could be different from another person’s opinion).
As a result, direct comparisons across countries using self-reported measures warrant caution as they can be misleading.
Cultural or contextual factors can in principle also influence answers to the GPK assessment question. The answers to the GPK assessment items were thoroughly analysed to ensure comparability across countries. More details on this analysis can be found in Annex A and in OECD (forthcoming[4]).