The Log Files from the PIAAC study contain a record of the interactions between respondents and the PIAAC computer testing application during the course of the PIAAC assessment. Respondents’ actions (e.g. starting a unit, opening a web page, inputting an answer) within the tool were recorded and stored with time stamps. The PIAAC log file data is of potential relevance to researchers and others interested in better understanding a range of issues relating to test-taking behaviour and the strategies and processes followed by respondents in responding to test items.
Public use files containing log data from the PIAAC cognitive assessments can be downloaded from the GESIS Data Catalogue. The files have been anonymised – i.e. all information that could potentially identify and individual respondents has been removed. Otherwise, the files contain the complete log data for individual respondents. Individual records can be matched with corresponding background and cognitive response data available in the PIAAC PUFs using the SEQID variable.
PIAAC log file data is available for 18 countries that participated in the first round of the PIAAC study (PIAAC 2012).
|Countries for which log-file data are available||Austria, Belgium (Flanders), Denmark, Estonia, Finland, France, Germany, Ireland, Italy, Netherlands, Norway, Poland, Slovak Republic, Spain, United Kingdom (England and Northern Ireland), United States|
The PIAAC log files are made available in their raw .xml format. To help researchers understand the contents of the log file data and analyse the information contained in them, full documentation of the contents of the files is also available as is a customised analysis tool, the PIAAC LogDataAnalyzer.
What is the LogDataAnalyzer?
The PIAAC LogDataAnalyzer is a tool that facilitates analysis of the log data by undertaking tasks such as data extraction, data cleaning, and visualisation of the log data files. The tool can be used for some data analysis tasks as well as for the export of selected data to data files that can be used by other tools. A number of variables have been predefined within the tool.
Users can select variablees for export.
The following predefined variables can be generated by users:
• Number of Using Cancel Button
• Number of Using Help Menu
• Time on Task
• Time till the 1st interaction
• Final Response
• Number of Switching Environment
• Sequence of Switching Environment
• Number of Highlight events
• Time Since Last Answer Interaction
• Number of Created Emails
• Sequence of Viewed Emails
• Number of Different Email Views
• Number of Revisited Emails
• Number of Email Views
• Sequence of Visited Webpages
• Time-Sequence of spent time on Webpages
• Number of Different Page Visits
• Number of Page Visits
• Number of Page Revisits
How can I access the PIAAC Log File Data, the LogDataAnalyzer and the PIAAC Log File documentation?
To assist researchers wishing to analyse the PIAAC Log Files, the content of the log-files has been documented. As the full documentation contains information regarding non-released items, individuals who wish to access the documentation must apply to the OECD and sign a confidentiality agreement before being granted access. Documentation that relates only to released items can be accessed here.
In addition to documentation of the content of the PIAAC log-files, information concerning the methodology, design and implementation of PIAAC can be found in the Technical Report on the study and the Survey of Adult Skills: Reader’s Companion.