语言项目中的测试与评价（体验英语教学系列）

导读

Preface

Chaspter1 Types and Uses of Language Tests

Two Families of Language Tests

Norm-Referenced Tests

Criterion-Referenced Tests

Type of Interpretation

Type of Measurement

Purpose of the Testing

Distributions of Scores

Test Structure

Matching Tests to Decision Purposes

Program-Level Proficiency Decisions

Program-Level Placement Decisions

Classroom-Level Achievement Decisions

Classroom-Level Diagnostic Decisions

Why a Single Test Cannot Fulfill All Four Functions

Differences in Ranges of Ability

Differences in Variety of Content

Using Spreadsheet Programs in Language Testing

What Is a Spreadsheet Program?

How Will You Personally Benefit from Using a Spreadsheet Program in This Book?

Review Questions

Application Exercises

Chapter 2 Adopting, Adapting, and Developing Language Tests

Theoretical Issues

Language Teaching Methodology Issues

An Exceptionally Short History of Language Testing

Why Knowing about These Movements Is Important

The Competence/Performance Issue

The Discrete-Point/Integrative Issue

Practical Issues

The Fairness Issue

The Cost Issues

Ease of Test Construction

Ease of Test Administration

Ease of Test Scoring

Interactions of Theoretical Issues

Adopt, Adapt, or Develop?

Adopting Language Tests

Adapting Language Tests

Developing Language Tests

Putting Sound Tests in Place

Getting Started with Your Spreadsheet Program

Moving Around the Spreadsheet

Creating a Sample Spreadsheet

Entering Test Score Data to Create a Spreadsheet

Review Questions

Application Exercises

Chapter 3 Developing Good Quality Language Test Items

What is a Test Item?

Guidelines for Item Format Analysis

General Guidelines

Receptive Response Items

Productive Response Items

Personal Response Items

Why Bother with Item Format Analysis?

Review Questions

Application Exercises

Item Analysis in Language Testing

Norm-Referenced Item Analysis

Item Facility Analysis

Item Discrimination Analysis

Calculating Item Facility and Discrimination with Your Spreadsheet

NRT Development and Improvement Projects

Criterion-Referenced Item Analysis

Item Quality Analysis

CRT Development and Improvement Projects

Role of Item Facility

Difference Index

The B-Index

CRT Item Selection

Review Questions

Application Exercises

Chapter 5 Describing Language Test Results

Displaying Data

Graphic Display of Frequencies

Creating Graphs in ExcelTM

Scales of Measurement

Nominal Scales

Ordinal Scales

Continuous Scales

Descriptive Statistics

Central Tendency

Mean

Mode

Median

Midpoint

Dispersion

Range

High and Low

Standard Deviation

Variance

The Spreadsheet Approach to Descriptive Statistics

Reporting Descriptive Statistics

What Should Be Included?

How Should Descriptive Test Statistics be Displayed?

Review Questions

Application Exercises

Chapter 6 Interpreting Language Test Scores

Probability Distributions

Normal Distribution

CharacteristiCs of Normal Distributions

Central Tendency

Dispersion

Percents/Percentages

Learning from Distributions

Using Percents/Percentages

Percentiles

Standardized Scores

z Scores

T Scores

CEEB Scores

Computer-based TOEFL Scores

Standardized and Percentile Scores

The Importance of Standardized Scores

Skewed Distributions

Skewedness

Peaked Distributions

NRT and CRT Distributions

The Spreadsheet Approach to Standardized Scores

Review Questions

Application Exercises

Chapter 7 Correlation in Language Testing

Preliminary Definitions

Calculating the Pearson Product-Moment Correlation Coefficient

Assumptions of the Pearson-Moment Correlation Coefficient

Calculating the Pearson Correlation Coefficient with a Spreadsheet

Interpreting Correlation Coefficients

Statistical Significance

Meaningfulness

Correlation Matrixes

Potential Problems with Correlational Analysis

Restriction of Range

Skewedness

Causality

Another Useful Type of Correlational Analysis

Point-Biserial Correlation Coefficient

Calculating the Point-Biserial Correlation Coefficient with a Spreadsheet

Review Questions

Application Exercises

Chapter 8 Language Test Reliability

Sources of Variance

Measurement Error

Variance Due to Environment

Variance Due to Adminstration Procedures

Variance Attributable to Examinees

Variance Due to Scoring Procedures

Variance Attributable to the Test and Test Items

Reliability of NRTs

Test-Retest Reliability

Equivalent-Forms Reliability

Internal-Consistency Reliability

Split-Half Reliability

Cronbach Alpha

Kuder-Richardson Formulas

Reliability of Rater Judgments

Interpreting Reliability Estimates

Standard Error of Measurement

Using a Spreadsheet to Calculate NRT Reliability

Split-Half (Adjusted) and Cronbach Alpha

Kuder-Richardson Formulas 20 and 21, and the SEM

Factors Affecting the Reliability of NRTs

Review Questions

Application Exercises

Chapter 9 Language Test Dependability

Threshold Loss Agreement Approaches

Agreement Coefficient

Kappa Coefficient

Estimating Threshold Loss Agreement from a Single Test Administration

Squared-Error Loss Agreement Approaches

Domain Score Dependability

Relationships

Cautions

Confidence Intervals

Using a Spreadsheet to Calculate CRT Reliability

Agreement and Kappa Estimates (Using the Subkoviak Method)

The Phi(lambda) Coefficient

The Phi Coefficient and Confidence Interval

Factors Affecting the Consistency of CRTs

Review Questions

Application Exercises

Chapter 10 Language Test Validity

Traditional Validity Strategies of Both NRTs and CRTs

Content Validity

Overall Strategy for Establishing Content Validity

An Example of the Importance of Item Planning in Regards to Content Validity

Content Validity and Other Types of Validity

Construct Validity

Differential-Groups Studies

Intervention Studies

Criterion-Related Validity: A Traditional Strategy for NRTs

Restrictions of Range and NRT Validity

Standard Setting

Reliability, Validity, and Standard Setting

Standards and Test Consistency

Standards and Test Validity

Other Issues Related to Validity

The Washback Effect

Factors Affecting the Impact of Washback

Negative Effects of Washback

Promoting Positive Washback

Testing Bias

Review Questions

Application Exercises

Chapter 11 Language Testing in Reality

The Place of Tests in Curriculum Planning

The ELI Language Program

Four Decision-Making Steps

Initial Screening Procedures

Placement Procedures

Second-Week Diagnostic Procedures

Achievement Procedures

Testing as an Integrated System

Review Questions

Application Exercises

Review Questions Answer Key

Glossary

Index

References