AI and the Future of Skills, Volume 1

Capabilities and Assessments

Artificial intelligence (AI) and robotics are major breakthrough technologies that are transforming the economy and society. The OECD’s Artificial Intelligence and the Future of Skills (AIFS) project is developing a programme to assess the capabilities of AI and robotics, and their impact on education and work. This volume reports on the first step of the project: identifying which capabilities to assess and which tests to use in the assessment. It builds on an online expert workshop that explored this question from the perspectives of both psychology and computer science. The volume consists of expert contributions that review skills taxonomies and tests in different domains of psychology, and efforts in computer science to assess AI and robotics. It provides extensive discussion on the strengths and weaknesses of different approaches, and outlines directions for the project. The report can therefore be a resource for the research community of multiple fields and policy makers who wish to obtain deeper insight into the complexity of machine capabilities.

Published on November 18, 2021

In series:Educational Research and Innovationview more titles


Abbreviations and acronyms
Executive summary
List of contributors
Setting the scene2 chapters available
New approaches to understanding the impact of computers on work and education
Evaluating revolutions in artificial intelligence from a human perspective
Taxonomies and tests of human skills8 chapters available
Taxonomy of cognitive abilities and measures for assessing artificial intelligence and robotics capabilities
Testing cognitive functions in children: A clinical perspective
Understanding and testing social‑emotional skills
Assessing collective intelligence in human groups
Skills assessments in education
Abilities and skills: Assessing humans and artificial intelligence/robotics systems
Competence assessment in German vocational education and training
An occupational taxonomic approach to assessing AI capabilities
Artificial intelligence capabilities and their measures7 chapters available
Identifying artificial intelligence capabilities: What and how to test
Using human skills taxonomies and tests as measures of artificial intelligence
The encroachment of artificial intelligence: Timing and prospects
On evaluating artificial intelligence systems: Competitions and benchmarks
Assessing artificial intelligence capabilities
Assessing Natural Language Processing
Common sense skills: Artificial intelligence and the workplace
Reflections and a pragmatic way forward3 chapters available
Tasks and tests for assessing artificial intelligence and robotics in comparison with humans
Questions to guide assessment of artificial intelligence systems against human performance
Building an assessment of artificial intelligence capabilities
Powered by OECD iLibrary