Reports

This paper reviews a number of previous studies that have investigated how measure of non-cognitive skills predict important life outcomes such as educational attainment, employment, earnings, and self-reported health and life satisfaction. All reviewed studies analyse data from large-scale surveys from multiple countries and rely on the Big-Five framework to assess non-cognitive skills. The paper finds that measures of non-cognitive skills are robustly and consistently associated to indicators of life success in youth and adulthood, and have incremental predictive power over traditional measures of cognitive ability.

Generative artificial intelligence (AI) presents myriad opportunities for integrity actors—anti-corruption agencies, supreme audit institutions, internal audit bodies and others—to enhance the impact of their work, particularly through the use of large language models (LLMS). As this type of AI becomes increasingly mainstream, it is critical for integrity actors to understand both where generative AI and LLMs can add the most value and the risks they pose. To advance this understanding, this paper draws on input from the OECD integrity and anti-corruption communities and provides a snapshot of the ways these bodies are using generative AI and LLMs, the challenges they face, and the insights these experiences offer to similar bodies in other countries. The paper also explores key considerations for integrity actors to ensure trustworthy AI systems and responsible use of AI as their capacities in this area develop.

Young people from low socio-economic status (SES) backgrounds face additional barriers as they seek to convert their qualifications and experience into successful employment. They encounter particular challenges in seeking to enter high status jobs. The barriers they face can be productively conceptualised in terms of economic, human, social and cultural capital accumulation. Schools can help to build these resources through programmes of career guidance, but to be successful they must actively respond to predictable barriers relating to access to trusted information and useful experiences. PISA shows a need for socially focused interventions. Career uncertainty and confusion is shaped by SES. Low SES students are also less likely to engage in most commonplace career development activities. Equitable guidance systems will target greater provision at low SES students and aim ultimately to provide personalise provision to all students, encouraging and enabling understanding of and progression towards careers promising greatest personal fulfilment. Insights from longitudinal data provide new opportunities for more scientific and strategic approaches to delivering effective provision.

This paper explores enhancements to international large-scale assessments (ILSAs). It advocates for diversification, targeting specific groups or individuals for more precise diagnoses, and flexibilisation, refining the item bank for assessments' relevance and adaptability. The paper also introduces prototypes for new assessment tools, representing a significant evolution in ILSAs' design and application, aiming for broader impact and increased adaptability in ILSAs.

This report presents the conceptual foundations of the OECD Programme for International Student Assessment (PISA) Vocational Education and Training (VET), currently in the Development Phase of implementation which aims to provide a comprehensive and rigorous international survey of student knowledge and skills that are essential for success in selected occupational areas. The PISA-VET assessment covers professional knowledge and skills in five occupational areas (automotive technician, business and administration, electrician, nursing/healthcare assistant and hotel receptionist), plus an evaluation of learners’ employability skills, including literacy, problem solving, task performance (conscientiousness) and collaboration with others. This publication includes the frameworks for assessing all the knowledge and skills included in the assessment. These chapters outline the content knowledge and skills that learners need to acquire in each domain, how each domain is assessed, and the contexts in which this knowledge and these skills are applied. The publication also presents the frameworks for the various questionnaires distributed to students, principals of VET institutions, teachers and trainers, including a questionnaire for trainers in work-based learning environments and a system level data questionnaire for participating countries. The questionnaires are also included as an annex to the publication.

In the 2023 Survey of Adult Skills (PIAAC), the Big Five personality traits were assessed using the BFI-2-XS, the 15-item extra-short form of the Big Five Inventory-2 (BFI-2). For this purpose, the instrument was translated into 24 languages and adapted to 29 countries, resulting in 39 language versions. This translation and adaptation process followed state-of-the-art procedures to generate language versions of the BFI-2-XS that are maximally comparable across countries and regions. In the present paper, we describe this general translation procedure from a methodological point of view. We also document each resulting language version and report in detail the decisions taken during the translation process and the adaptations made to preexisting national versions of the BFI-2-XS. Our aim is to share with researchers the resulting BFI-2-XS language versions developed with high quality standards to allow maximal cross-cultural comparability. Our intention in so doing is to enable their wider usage beyond PIAAC.

This analytical report, the third in a series of four, was prepared by the OECD Higher Education Policy Team as part of the Education and Innovation Practice Community (EIPC) initiative, an action of the European Union’s New European Innovation Agenda, flagship 4 on 'Fostering, attracting and retaining deep tech talent'. The EIPC initiative seeks to bring together policymakers and practitioners to advance understanding of the competencies that can trigger and shape innovation for the digital and green transitions. This report provides analysis and case studies examining how traditional higher education programmes, like bachelor’s degrees, can effectively cultivate competencies crucial for green and digital innovation. It highlights four key action areas: tracking and assessing competencies; developing curricula; boosting student engagement; and enhancing partnerships with the private sector.

The Scottish Government and the OECD co-facilitated an international peer learning event in May 2023 to explore ways and approaches for clarifying the roles and responsibilities of school improvement support provided at different levels of the education system. The event brought together Scottish stakeholders and international experts from Ireland, Norway and Wales (United Kingdom) to collectively reflect on the country’s school improvement system. This report, written between May and September 2023, captures and summarises the peer learning event discussions and proposes policy options to help advance Scotland’s education reform agenda. This report will be valuable not only for Scotland, but also to the many countries that are looking to strengthen their school improvement support systems.

Despite numerous measures, gender stereotypes about abilities in mathematics and reading persist in schools, affecting both boys' and girls' schooling and educational choices. Inequalities also persist outside the classroom, where women, despite greater educational attainment, experience lower employment rates and often receive lower salaries than men with similar levels of education. Nonetheless, the many measures taken by countries have brought some encouraging signs of progress. However, more work is needed to ensure that improvements in education are also reflected in improvements once boys and girls transition into the world of work.

This paper presents a profile of the agency responsible for education evaluation and assessment in the Kingdom of Saudi Arabia: the Education and Training Evaluation Commission (ETEC). It draws on research conducted by the OECD as part of a three-year project to develop the technical capacity of ETEC and benchmark its policies and practices with those of similar agencies in OECD countries. The paper describes ETEC’s mission and structure; its remit, activities and instruments; and the resources it has to fulfil its mandate. In doing so, the paper traces the Commission’s trajectory from its establishment to the present day. It aims to be of interest to education policymakers and researchers in OECD and partner countries, providing information on both the Saudi education system and evaluation and assessment agencies internationally – topics that have received relatively little attention in education literature.