The estimated time needed to take the core modules is 65 minutes. The core modules consists of the background questionnaire and the literacy and numeracy assessment. All of the other modules are optional. The entire test is expected to take 120 minutes (this includes the core literacy and numeracy assessments, reading components and problem solving in technology-rich environments, and the non-cognitive assessments). The test taker should take the literacy and numeracy assessments in one sitting, but the other assessment do not need to be taken at the same time as the literacy and numeracy assessment.  The test taker may use the test authorisation code to log into the test system and complete additional modules at a later time.

Education & Skills Online is available to purchase by institutional customers such as education providers, public or private sector organisations, non-government organisations or by individuals affiliated with such institutions such as researchers.

To purchase the assessment, a Purchase order must be completed and sent to: cbt-support@etsglobal.org. The delivery of and user support for the assessment is provided by Education Testing Services (ETS) on behalf of the OECD.

Customers may purchase a cognitive or a non-cognitive assessment package, or a bundled package that includes both packages.

• The cognitive assessment package contains:
  • the background questionnaire
  • literacy and numeracy assessment (core modules)
  • problem solving and reading components assessment (optional modules)
• The non-cognitive assessment package contains the following modules:
  • the background questionnaire
  • skill use
  • subjective well-being and health
  • career interest and intentionality
• The bundled package contains:
  • the background questionnaire
  • literacy and numeracy assessment (core modules)
  • problem solving and reading components assessment (optional modules)
  • skill use module
  • subjective well-being and health module
  • career interest and intentionality module

By purchasing the cognitive assessments together with the non-cognitive assessments, the customer is able to generate authorisation codes that will be used by test takers across the modules. That is, the test administration and results for each module for an individual will be linked through the unique authorisation code.  In a bundled package, the test taker will first complete the core background questionnaire and the core literacy and numeracy assessments, followed by, either or both of the optional problem solving and reading components measures (depending on the individual’s skill level), and then will be able to take each non-cognitive module either immediately following the core cognitive assessment or at a later date. Once the test taker begins the test he or she will have 60 days before the code expires.

Alternatively, customers may purchase the cognitive and non-cognitive packages separately; however, the authorisation codes will not be unique across the packages. In other words, should the decision be made at a later time to purchase the non-cognitive package, the institution will need to assign separate authorisation codes for the cognitive and non-cognitive packages to a test taker. It will then be the responsibility of the institution to devise and maintain a system for linking the codes for an individual test taker and later for merging the results for the two codes in order to conduct analyses using both cognitive and non-cognitive results.

Cost of the assessment

Purchases may be made in Euros or US Dollars (at the Euro exchange rate).

Education & Skills Online will provide score reports that include the following:

• Descriptive reports that characterise strengths and weaknesses in the skill areas assessed
• Scores that will be reported in terms of described proficiency levels that capture the progression of task complexity and difficulty for the cognitive domains
• Summary information for each of the non-cognitive areas
• Comparative information for both the cognitive and non-cognitive areas that will benchmark results against selected national and international PIAAC results

Purchasers of the test can download the individual records of test-takers (background information and assessment results) in spreadsheet format for analysis.

Education & Skills Online is designed to provide reliable and valid estimates of the proficiency of individual test-takers in literacy, numeracy and problem solving in technology-rich environments on the relevant PIAAC scales.

Some users may wish to use Education & Skills online to estimate the proficiency of particular groups through the conduct of research and evaluation studies. The extent to which the results from Education & Skills Online provide reliable estimates of the proficiency of groups will depend on a range of factors in addition to the reliability and validity of the Education & Skills Online instruments. These include sample design and selection, the level and pattern of non-response and the level of standardisation of the testing situation. It is the responsibility of users to ensure that good research practice is followed in the design, implementation and reporting of any research based on the use of Education & Skills Online.

The OECD takes no responsibility for the results and conclusions of studies that use data derived from Education & Skills Online. In reporting the results of any studies using results from Education & Skills Online, users should not claim or imply that the OECD endorses the findings and conclusions in any way or that the OECD is the source of these results. 

Users should acknowledge that Education & Skills Online is a product of the OECD and that its development has been supported by the European Commission in any publications that report results from studies using the tool.

Core Cognitive Assessments

Scores will be provided in an easy-to-read score report after test takers complete each assessment in the test. The score reports provide the test taker with a numerical score on the PIAAC scale, a description of their strengths and weaknesses in the area tested, and a comparison to scores of similar test takers in their country or internationally.

• How the Scales Are Divided into Levels

The proficiency scales range from 0 to 500 and are designed so the scores represent degrees of proficiency in a particular aspect of literacy, numeracy or problem solving in technology-rich environments. There are easier and harder tasks for each proficiency scale. Each scale is divided into proficiency levels based on the knowledge and skills required to complete the tasks within those levels.

Respondents at a particular level not only demonstrate knowledge and skills associated with that level but also the proficiencies required at lower levels. Thus, respondents scoring at Level 2 are also proficient at Level 1.

• What the Levels Mean

Scores on each of the three scales are characterised in terms of levels that capture the progression of complexity and difficulty of the tasks in the tests. Below Level 1 represents the lowest level of proficiency, while each succeeding Level represents higher proficiency.

• How the Levels Are Determined

To create the scales, expert groups in literacy, numeracy and problem solving in technology-rich environments met with psychometricians and test developers and reviewed data, looked at the tasks along the 500-point scales, and determined the requisite skills and knowledge to complete those tasks progressively increased along the scale.

Score Range

• For literacy and numeracy, scores will be given in 10-point increments ranging from 0 to 500 for each of the scales measured. Each score will fall into one of five levels based on the knowledge and skills required to complete the tasks within those levels.
  • Below Level 1 – 0 to 175
  • Level 1 – 176 to 225
  • Level 2 – 226 to 275
  • Level 3 – 276 to 325
  • Level 4/5 – 326 and above
• For problem solving in technology-rich environments, your score will be given in 10-point increments from 0 to 500. Each score will fall into one of four levels:
  • Below Level 1 – 0 to 240
  • Level 1 – 241 to 290
  • Level 2 – 291 to 340
  • Level 3 – 341 and above

Scores for Non-cognitive Assessments

After each non-cognitive module, scores and an explanation of what they mean will be provided in a score report.

• Skill Use

The Skill Use module assesses how often adults use the skills associated with reading, writing, numeracy, and information and communication technology (ICT) in their home and work lives, for a total of eight scores. The score report for this module will tell adults whether their use of skills in each of the eight skill use areas is low, moderate, or high. Test takers who report never using any of the skills in an area will receive a score of not applicable. The results for this assessment are linked to the PIAAC skill use scales.

The scores reported in the score have the following definitions:

• Not Applicable: The test taker reported that he or she never engaged in any of the activities involving this skill.
• Low: The test taker reported that he or she rarely engaged in most of the activities involving this skill.
• Moderate: The test taker reported that his or her engagement in activities varied in terms of how many activities you did and how often you did them.
• High: The test taker reported that he or she engaged in most activities most days or every day.

• Career Interest and Intentionality

The Career Interest and Intentionality module measures adults’ preferences for different types of work activities and environments, how well their interests match their current or intended job and the level of their intention to seek out new job opportunities and career- and job-related training.  Test takers receive scores in three areas:

• Career Interest helps test takers identify the type of work they like to do by giving them an interest score in six areas: Realistic, Investigative, Artistic, Social, Enterprising, and Conventional.
• Career Fit uses the test taker’s interests identified during the test to determine how well their interests align with their current job or desired job.  It also provides a list of 20 careers that are the best match for the individual’s interests and the 10 careers that are the worst match for the individual’s interests.
• Career Intentionality compares test takers’ intention to seek a new job and/or additional training, confidence in seeking a new job, and intention to seek a new job to other Education & Skills Online test takers and assigns a score of high, moderate, or low.

• Subjective Well-Being and Health
  

Subjective Well-Being refers to how people think and feel about their lives. In general, people who have a positive view of their own lives are hopeful for the future and have more positive experiences. They are likely to have higher Subjective Well-Being.  Researchers have found that people with higher subjective well-being are usually more productive and more successful in their personal and professional lives. They are more likely to live longer, healthier lives. The questions in this test have been used in many research studies worldwide. The score report describes test takers’ results in three major areas of Subjective Well-Being: Life Satisfaction, Positive Affect, and Negative Affect.

The Life Satisfaction aspect of Subjective Well-Being refers to how people think about their lives overall. How people feel about their lives is shown by such things as moods and emotions experienced day to day. The experience of positive emotions, such as joy or excitement, is called Positive Affect. The experience of negative emotions, such as anger, distress, or shame, is called Negative Affect.  The test taker receives a high, moderate, or low score for life satisfaction, positive affect, and negative affect.

Leading a healthy lifestyle is important for adults to reach their best physical and mental health and well-being. A healthy lifestyle includes having a positive outlook on health, maintaining a healthy weight, and adopting healthy behaviours and habits. This module summarises health attitudes and behaviours of the test taker, including health outlook, body mass index, diet and nutrition, smoking, exercise, and sleep.