U.S. Department of Labor DOL Workplace Literacy Survey National Adult Literacy Survey NALS

materials encountered in various adult contexts associated with work, home, and community. These tasks included: • reading and interpreting prose, as in newspaper articles, magazines, and books; • identifying and using information located in documents such as forms, tables, charts, and indexes; and • applying arithmetic operations to information contained in printed material such as a menu, checkbook, or advertisement ibid.. The proficiency scales of each literacy domain were designed to range from 0 to 500 with a mean of 250. The assessment model described by Kirsch et al. was used in the YALS and has been applied to other large-scale surveys such as the U.S. Department of Labor DOL Workplace Literacy Survey, the National Adult Literacy Survey NALS, the International Adult Literacy Survey IALS, and the National Assessment of Adult Literacy NAAL National Research Council, 2005.

2.3.2 U.S. Department of Labor DOL Workplace Literacy Survey

The U.S. DOL Literacy Survey was the second large-scale literacy survey conducted by ETS in 1989-1990 to assess the literacy skills of the Job Training Partnership Act JTPA and Employment ServicesUnemployment Insurance ESUI program participants. It adopted the definition of literacy, the three literacy scales prose, document, and quantitative scales, and the expanded theoretical framework of YALS Murray et al. eds., 1998:113. However, DOL researchers identified the cut scores 19 and refined the definition of the five literacy levels for their own purposes. These performance-level descriptions of DOL assessment were replicated with minor adjustments in the NALS. The five literacy performance-level descriptions of NALS in comparison with those of YALS are shown in Table 6.

2.3.3 National Adult Literacy Survey NALS

The National Adult Literacy Survey NALS was conducted by ETS as well in 1992 for the U.S. Department of Education to assess the literacy skills of a nationally representative sample of individuals aged 16 and above. The NALS adopted the same definition of literacy employed by the prior surveys ―to link the results of the NALS to those from the young adult and DOL assessments ‖ ibid.:129. The pool of NALS tasks consisted of 41 prose tasks including 26 newly developed, 81 document tasks 33 new, and 42 quantitative tasks 27 new ibid.. Table 6: Performance –level descriptions of YALS and NALS YALS NALS Level Description Level Prose Document Quantitative Rudi- mentary 150 Performance at this level suggests the ability to carry out simple, discrete reading Level 1 0- 225 Most of the tasks in this level require the reader to read relatively short text to locate a single piece of information which is identical to or synonymous with the information given in the Tasks in this level tend to require the reader either to locate a piece of information based on a literal match or to enter information from personal knowledge onto a Tasks in this level require readers to perform single, relatively simple arithmetic operations, such as addition. The numbers to 19 The cut score refers to ―the score that separates one performance level from another performance level‖ National Research Council, 2005:17. YALS NALS tasks. question or directive. If plausible but incorrect information is present in the text, it tends not to be located near the correct information. document. Little, if any, distracting information is present. be used are provided and the arithmetic operation to be performed is specified. Basic 200 Performance at this level suggests the ability to understand specific or sequentially related information. Level 2 226- 275 Some tasks in this level require readers to locate a single piece of information in the text; however, several distractors or plausible but incorrect pieces of information may be present, or low-level inferences may be required. Other tasks require the reader to integrate two or more pieces of information or to integrate two or more pieces of information or to compare and contrast easily identifiable information based on a criterion provided in the question or directive. Tasks in this level are more varied than those in Level 1. Some require the readers to match a single piece of information; however, several distractors may be present, or the match may require low- level inferences. Tasks in this level may also ask the reader to cycle through information in a document or to integrate information from various parts of a document. Tasks in this level typically require readers to perform a single operation using numbers that are either stated in the task or easily located in the material. The operation to be performed may be stated in the question or easily determined from the format of the material for example, an order form. Inter- mediate 250 Performance at this level suggests the ability to search for specific information, interrelated ideas, and make generaliza- tions. Level 3 276- 325 Tasks in this level tend to require readers to make literal or synonymous matches between the text and information given in the task, or to make matches that require low- level inferences. Other tasks ask readers to integrate information from dense or lengthy text that contains no organizational aids such as headings. Readers may also be asked to generate a response based on information that can be easily identified in the text. Distracting information is present, but is not located near the correct information. Some tasks in this level require the reader to integrate multiple pieces of information from one or more documents. Others ask readers to cycle through rather complex tables or graphs which contain information that is irrelative or inappropriate to the task. In tasks in this level, two or more numbers are typically needed to solve the problem, and these must be found in the material. The operations needed can be determined from the arithmetic relation terms used in the question or directive. YALS NALS Adept 300 Performance at this level suggests the ability to find, understand, summarize, and explain relatively complicated information. Level 4 326- 375 These tasks require readers to perform multiple-feature matches and to integrate or synthesize information from complex or lengthy passages. More complex inferences are needed to perform successfully. Conditional information is frequently present in tasks at this level and must be taken into consideration by the reader. Tasks in this level, like those at the previous levels, ask readers to perform multiple-feature matches, cycle through documents, and integrate information; however, they require a greater degree of inferencing. Many of these tasks require readers to provide numerous responses but do not designate how many responses are needed. Conditional information is also present in the document tasks at this level and must be taken into account by the reader. These tasks tend to require readers to perform two or more sequential operations or a single operation in which the quantities are found in different types of displays, or the operations must be inferred from semantic information given or drawn from prior knowledge. Advanced 350 Performance at this level suggests the ability to synthesize and learn from specialized reading materials. Level 5 376- 500 Some tasks in this level require the reader to search for information in dense text which contains a number of plausible distractors. Others ask readers to make high- level inferences or use specialized background knowledge. Some tasks ask readers to contrast complex information. Tasks in this level require the reader to search through complex displays that contain multiple distractors, to make high-level text-based inferences, and to use specialized knowledge. These tasks require readers to perform multiple operations sequentially. They must disembed the features of the problem from text or rely on background knowledge to determine the quantities or operations needed. Source: Kirsch Jungeblut, 1986:38-39; Murray et al. eds., 1998:133

2.3.4 International Adult Literacy Survey IALS