2023年成人技术技能调查_499页_16mb

Summary of the Survey of Adult Skills 2023 Technical Report

Core Content

The Survey of Adult Skills 2023 Technical Report is part of the OECD Skills Studies and provides a comprehensive overview of the methodology, design, and implementation of the Programme for International Assessment of Adult Competencies (PIAAC). The report focuses on the second cycle of the PIAAC survey, which took place in 2022-23, and outlines the technical aspects of the survey, including data collection, weighting, scaling, and quality control.

The survey evaluates three key domains of cognitive skills: literacy, numeracy, and adaptive problem solving (APS). These domains are designed to measure the foundational skills necessary for individuals to function effectively in society and the workforce.

Main Domains and Key Features

Literacy

• Definition: Literacy is defined as the ability to "access, understand, evaluate and reflect on written texts in order to achieve one's goals, to develop one's knowledge and potential, and to participate in society."
• Cognitive Processes:
  • Accessing texts: Identifying relevant texts and locating information within them.
  • Understanding: Constructing meaning from texts, both literal and inferential.
  • Evaluating: Assessing the accuracy, credibility, and relevance of information, as well as reflecting on the author's intent.
• Reading Components: The literacy assessment includes a test of "reading component" skills, which are the basic decoding skills needed to gain meaning from written text. These include:
  • Sentence comprehension: Determining if a sentence makes sense.
  • Passage comprehension: Reading a short passage sentence by sentence and identifying key words that give meaning to the sentence.

Numeracy

• Focus: The numeracy assessment evaluates the ability to interpret and use mathematical information in both dynamic and structured formats, such as interactive websites and infographics.
• Key Tasks: Respondents are asked to make judgments based on critical evaluation of mathematical information.

Adaptive Problem Solving (APS)

• Introduction: APS is a new domain introduced in the 2023 cycle.
• Definition: It refers to the ability to solve problems in technology-rich environments, which reflects the growing demands of modern life and work.
• Note: Results from the second cycle cannot be directly compared to the first cycle due to differences in the underlying constructs.

Main Components of the Survey

Survey Design

• PIAAC Cycle 2: The second cycle of the survey includes one round of data collection.
• Sampling Design: The report outlines the sampling methods used, including population registry-based and screener-based approaches.
• Field Trial: A field trial was conducted to test the assessment design, including rotated clusters and item testing across different formats (tablet-based and paper-based).

Survey Instruments

• Cognitive Instruments: Developed by panels of subject-matter experts, these instruments are designed to measure the three domains of skills.
• Proficiency Scales: These scales are used to classify respondents' performance in literacy, numeracy, and APS.
• Background Questionnaires (BQs): The BQs include both core and national extensions, and are used to collect demographic and socioeconomic data.

Translation and Adaptation

• The test and survey materials were translated and adapted for different languages and cultural contexts.
• The report provides details on the translation process, including verification and adaptation procedures.

Data Collection and Implementation

Survey Implementation

• The PIAAC Portal and International Case Management System (iCMS) are key tools used in the implementation of the survey.
• The PIAAC Delivery System and Dashboard are used to manage and monitor data collection and results.

Field Operations

• The report outlines the timeline for data collection, the training of interviewers and supervisors, and the logistics of the field staff.
• It also includes information on non-response strategies, incentives, and contact modes used to reach sampled individuals and households.

Quality Control and Data Analysis

Quality Control

• The report details the quality control (QC) monitoring activities, including compliance with the QC programme.
• It also discusses the data management and cleaning procedures to ensure the accuracy and reliability of the data.

Weighting and Scaling

• Survey Weighting: Adjustment factors and weights are applied to ensure representativeness of the sample.
• Scaling: The report describes methodologies and outcomes of scaling the direct assessment, including the use of plausible values to account for measurement and sampling errors.

Data Analysis Tools

• The international data and analysis tools are provided to facilitate cross-country comparisons.
• The derived variables and validation of background questionnaire data are also discussed.

Key Tables and Figures

The report includes numerous tables and figures that provide detailed insights into:

• Sampling and weighting across countries.
• Item response curves, proficiency distributions, and response rates.
• Quality control metrics, non-coverage rates, and non-response error susceptibility.
• Cognitive and metacognitive processes, item distribution, and response modes.

Conclusion

The Survey of Adult Skills 2023 represents a significant advancement in the measurement of adult competencies, incorporating new domains and technologies to reflect contemporary realities. It provides policymakers with essential data to understand the distribution of skills, their impact on economic and social outcomes, and the effectiveness of education and training systems. The technical report serves as a critical resource for ensuring the accuracy, reliability, and comparability of the data collected across participating countries.