PISA › PISA products › PISA 2003 › PISA Country Profiles
PISA Country Profiles
Introduction, Quality of learning outcomes, Equity and distribution,
Learner characteristics, Learning climate, School resources, School policies and practices, Test subjects, OECD average and OECD total
Click here to consult the PISA country profiles
Introduction
The PISA 2003 and PISA 2006 survey cycles collected information on the performance of 15-year-olds in mathematics, science, reading and problem solving through paper-and-pencil tests. A background questionnaire was also completed by students asking them about their approaches to learning and their family. Information on the way schools are managed was collected through a questionnaire completed by school principals.
The PISA country profiles tool allows the user to obtain specific information from the PISA 2003 and PISA 2006 databases for a particular country or set of countries. The system can provide the data in Excel and also generate graphs in either html or pdf formats.
If the user generates several graphs the site keeps a record of these and lists them on the home page so that the user can go back to them easily.
Example: A user wants to find out how the performance in mathematics of students in his/her native country Austria compares to the four countries Japan, New Zealand, Spain and the United States. He/she also wants to look at the distribution of performance in each country and compare it with that of the OECD average and OECD total. He/she wants to sort the information according to the highest level of achievement of students (level 6)The user selects:
- Austria for the host country/region
- The four comparison countries Japan, New Zealand, Spain and the United States by double clicking on them from the list ‘comparison countries’
- ‘Quality of learning outcomes’ from the six indicators available (quality of learning outcomes; equity and distribution; learner characteristics; learning climate; school resources; school policies and practices)
- One of four indicators available in the ‘Indicator field’ e.g. proficiency levels
- The domain (in this case the only choice is mathematics)
- A statistic (or several statistics) in options. In this case all the boxes are checked
- Level 6 in the sort box at the bottom of the options category
The user then clicks on either 'spreadsheet', 'graph (html)' or 'graph (pdf)'. In this case a bar chart graph is created with the country with the least amount of students achieving level 6 on the left hand side through to the country with the highest number of students achieving level 6 on the right hand side.
Quality of learning outcomes gives an indication of the level of countries’ student performance in the subjects mathematics, reading, science and problem solving
It is possible to look at this in several ways:
-
Mean and distribution of student performance: i.e. the average score as well as the range of lowest and highest scores achieved by students.
-
Proficiency levels: PISA established a range of levels associated with the scores which explain what a student can typically be expected to achieve at each level. For mathematics, reading and problem solving there are 6, 5 and 3 levels respectively.
-
Range of rank: It is possible to rank countries according to the level of student performance. However given there is always a possibility of error, PISA has established a range of rank for each country e.g. amongst the 41 countries, country X could lie between 1st and 5th position.
-
Variation in student performance: for each country it is possible to look at how student performance varies within a school and between schools. This is expressed as a percentage of the average variance of student performance in OECD countries e.g. the OECD average of total variance in student performance is 8 593. If the variation in performance for a given country is stated as 40% this means it is 40% of 8 593.
Equity and distribution measures how fair the chances of student success are by measuring their performance against their socio-economic background. Socio-economic background is established through a questionnaire where students are asked about their parents’ level of education and occupation, what they have access to at home (e.g. books, computers), whether they have an immigrant background and what language they speak at home.
Learner characteristics gives an indication of students approaches to learning. They are asked whether they enjoy school and specifically whether they enjoy mathematics.
Learning climate examines students’ and school principals’ perceptions of the atmosphere at school. Students are asked to indicate how much support they feel they get from their teachers. School principals are asked to evaluate teacher and student morale in the school.
School resources are approached in terms of physical and human resources and cover topics such as teacher shortages, the physical infrastructure and how schools are funded. This information is provided through a questionnaire completed by school principals.
School policies and practices provides information on policies for admitting and testing students and how schools are managed. This information is provided through a questionnaire completed by school principals.
Mathematical problems that are based on real-world contexts. Students are required to identify features of a problem that might involve thinking in terms of mathematics. In turn they use their knowledge of mathematics to solve the particular problem.
In PISA 2003 and PISA 2006 four different aspects of mathematics were tested.
- Space and shape: space and geometry and the properties of objects
- Change and relationships: relationships between variables (i.e. any finding that can change e.g. height and weight are variables) and understanding how they can be represented including equations.
- Quantity: relationships and patterns involving numbers
- Uncertainty: probability and statistics.
Reading
Written information provided in a real-life context. Students are shown different kinds of written text, ranging from prose to lists, graphs and diagrams. They are set a series of tasks, requiring them to retrieve specific information, to interpret the text and to reflect on and evaluate what they read. These texts are set in a variety of reading situations, including reading for private use, occupational purposes, education and public use.
Scientific knowledge and skills applied to real-life situations, as opposed to science linked to particular curricular components. Students are required to show a range of scientific skills, involving the recognition and explanation of scientific phenomena, the understanding of scientific investigation and the interpretation of scientific evidence. Tasks are set in a variety of contexts relevant to people’s lives, related to life and health, technology and the Earth and environment.
The process of solving problems set in unfamiliar situations by thinking flexibly and pragmatically. This involves understanding a situation, identifying relevant information or constraints, representing possible alternatives or solution paths, selecting a solution strategy, solving the problem, checking or reflecting on the solution and communicating the result.
The OECD average is the unweighted mean of the data values of the OECD countries. Regardless of sample size each country is treated as if it carried equal weight.
The OECD total is the weighted mean of the data values of the OECD countries i.e. it is calculated giving more weight to a country that has more students than another country, e.g. if we take 2 countries X and Y.
| Number of students enrolled in school | Mean score |
|
| Country X | 10 000 | 438 |
| Country Y | 15 000 | 500 |
The weighted mean for these two countries is calculated by multiplying the mean score for each group by the number of students enrolled in school, adding these totals together and dividing by the total number of students enrolled in school i.e. (438x10 000 + 500x15 000)/25 000 = 475.2
The unweighted mean for these two countries is calculated as the sum of the mean score for each country divided by the number of countries i.e. (438 +500)/2 = 469