Chapter 8 - Assessing Achievement and Aptitude: Applications for Counseling
Aptitude Tests
Predict future performance/ability to learn new tasks
Best predictor of graduate school success
combination of GRE scores and undergraduate GPA
Best predictor of college success
combination of high school grades and all 3 SAT section scores
Education
domain or area is covered more broadly, with intent of helping test taker learn content or information
Test sophistication
individual's level of knowledge in test-taking skills
Coaching
training or practice on questions that are the same or similar to items on test
Achievement Tests
Tests what individual has learned/acquired
Survey achievement batteries
1000's of students in multiple districts throughout nation Subtests that measure achievement in academic areas (reading, math, arts, etc) Provides information on strengths, limits, and year-to-year progress Often co-normed with tests of general ability or academic intelligence
Criterion-Referenced Instruments Examples
Criterion-referenced assessments in Indiana: ISTEP+, IMAST, ISTAR
Minimum-level skills tests
Criterion-referenced tests where the minimum level is the "criterion" for passing Great controversy over the institution of minimum competency examinations as prerequisite to earning high school diploma
Criterion-Referenced Instruments
Designed to determine if a certain academic standard is met Becoming more common with increasing focus on standards and accountability in education
Issues in Achievement Testing
Increase in standardized achievement testing in all 50 states ("high stakes testing") No Child Left Behind Focus on educational accountability, examining individual student progress Blueprint for revising Elementary and Secondary Education Act released in March 2010, not yet reauthorized National Assessment of Educational Progress ("the nation's report card") AERA's conditions for high-stakes achievement testing programs in education
Examples or Survey Achievement
Iowa Tests, Metropolitan Achievement Tests Also available for adults
Predicting performance of job duties is difficult because:
Job duties within an occupation vary depending on organization and setting What constitutes "successfully performing"? Job performance can rarely be measured unidimensionally Difficult to recruit large norming groups
Individual Achievement Tests and Diagnostic Achievement Tests
Often used in psychoeducatonal evaluations
Contrasting Achievement and Aptitude
One of purpose more than of content
Response to Intervention Model
Replaced SLD Data used to identify students at risk for poor learning outcomes Provided student at primary, secondary, or third level Progress monitored and intervention adjusted as needed
Coaching (expanded)
Research investigating effects of coaching on test results has mixed and inconsistent results Closer the resemblance between the coaching material and test content greater improvement in scores "Teaching to the test" approach General conclusions: coaching programs may increase scores slightly; significant changes occur only if programs are longer and content is closely aligned with test material
Aptitude Assessment Examples
Scholastic Aptitude Tests (SAT, ACT, GRE) Vocational/Career Aptitude Tests (ASVAB, WorkKeys, DAT)
Subject Area Tests
Single subject tests developed by teachers make up largest area of achievement tests Advocates of authentic assessment and performance assessment have had major influence on teacher-developed subject area tests
Assessment of Achievement
Survey achievement batteries Individual achievement tests and diagnostic achievement tests Criterion-referenced tests and minimum-level skills assessments Subject area tests
Test Sophistication
Test scores improve when individuals retake alternate form of test Individuals with extensive experience taking standardized tests have advantage Some test publishers are trying to provide free test preparation materials to create "more level playing field"
Test Preparation and Performance
Test sophistication Coaching Education
Vocational/Career Aptitude Tests
Used in career counseling to predict job or occupational performance
Discrepancy Model
Used to identify specific learning disabilities
Validity of Scholastic Aptitude Tests
Validity for SAT and ACT are almost the same Correlation with freshman GPA ranges from .30 to .50