Intro to Psy testing Quizzes

What was the first published tests of mental ability? 1)Wechsler-Bellevue Intelligence Scale 2)The Rorschach Inkblot Test 3)Binet-Simon Scale 4)The Personal Data Sheet

Binet-Simon Scale

When experts meet to rate how essential each test question is to the test, their data can be used to provide evidence of validity by calculating a 1) content validity ratio 2) correlation coefficient 3) mean rating 4) frequency table of ratings

Content validity ratio

According to the text, how many steps are involved in demonstrating evidence of validity based on test content during test development? 1) 6 2) 4 3) 3 4) 5

4

Most measurement experts think in terms of how many levels of measurement? 1) 1 2) 4 3) 2 4) 3

4

What is a sample? 1) A group of respondents who may receive the survey 2) All respondents in the target audience 3) A representative subset of the population 4) Those respondents who return the survey

A representative subset of the population

If you were to categorize demographic data (such as grouping people by gender, race, or place of residence), what level of measurement was used? 1) Ordinal scales 2) Ratio scales 3) Nominal scales 4) Equal interval scales

Nominal scales

What is a method for defining a construct by illustrating its relation to as many other constructs and behaviors are possible? 1) Nomological network 2) Construct explication 3) Multitrait-multimethod design 4) Correlation matrix

Nomological network

What provides us with a standard against which we can compare individual test scores? 1) Norms 2) Descriptive statistics 3) z scores 4) Percentiles

Norms

Which one of the following criteria in an organizational setting is objective? 1) Number of excused absences 2) Sales judgments 3) Supervisor ratings 4) Customer satisfaction surveys

Number of excused absences

Which of the following is observable and measurable, such as the number of accidents on the job, days absent, or disciplinary problems in a month? 1) Objective criterion 2) Internal criterion 3) Validity criterion 4) Subjective criterion

Objective criterion

What do we call changes in test scores resulting from the sequence in which the tests were taken? 1) Practice effects 2) Alternate effects 3) Order effects 4) Fatigue effects

Order effects

A time interval must elapse between the test administration and the criterion measurement when using which method for establishing evidence of validity? 1) Predictive 2) Test-retest 3) Concurrent 4) Content

Predictive

Which of these are smaller-scale assessments in which candidates complete a job-related task such as building a sawhorse or designing a doghouse? 1) Assessment center 2) Work sample 3) Integrity test 4) Behavioral interview

Work sample

Both Walter Dill Scott and Hugo Münsterberg proposed methods for validating tests prior to which war? 1) World War II 2) Vietnam War 3) World War I 4) Korean War

World War I

The slope (b) of the regression line is the expected 1) change in a for each unit of b 2) reliability 3) change in X for every one unit change in Y 4) change in Y for every one unit change in X

change in Y for every one unit change in x

If there was the formula: GPA= 1.4856 +.0014SATV + .0002SATM + .0084HS, what type of equation is this? 1) Cross-validation regression 2) Logistic regression 3) Multiple regression 4) Linear regression

chapter 11

If we administer a test at another time following a validation study to confirm the results of the validation study, what are we trying to do to the test? 1) Confirm differential validity 2) Confirm single group validity 3) Acculturate the test 4) Cross-validate the test

chapter 11

Which of these groups is NOT included in 360˚ feedback? 1) Managers 2) Peers 3) Direct reports 4) None. All of these are included in 360˚ feedback.

chapter 14

In the equation Y' = a + bX, what does "X" represent? 1) Predicted criterion score 2) Slope 3) individual's score 4) Intercept

individual's score

Specific requirements for the test administration location such as privacy, quiet, and comfortable chairs, tables, or desks should be part of the instructions for 1) test takers 2) test administrators 3) test developers 4) scorers

test administrators

Content validity ratios can range from 1) 10 to +10 2) 1 to 0 3) 0 to +1 4) -1 to 1

-1 to 1

A content validity ratio can range between: 1) -.75 to .75 2) -1.25 to 1.25 3) -.50 to .50 4) -1.00 to 1.00

-1.00 to 1.00

If a correlation between a test and criterion is .30, when what would be the coefficient of determination? 1) 9 2) .03 3) 3 4) .09

.09

The Standards describe how many sources of validity evidence? 1) 3 2) 9 3) 5 4) 7

5

Who coined the term "dragnet empiricism"? 1) Sherer 2) Cronbach 3) Campbell 4) Binet

Cronbach

Which of these is not a part of the Five-Factor Theory of Personality? 1) Openness 2) Neuroticism 3) Conscientiousness 4) Depression

Depression

What mathematical operation, when applied to the reliability of the test, will set the upper limit of the validity coefficient of the test? 1) Square root 2) Cube root 3) Square 4) Cube

Square root

Specific requirements for the test administration location such as privacy, quiet, and comfortable chairs, tables, or desks should be part of the instructions for 1) test takers 2) test administrators 3) test developers 4) scorers

Test Administrators

The person who responds to test questions or whose behavior is being measured is called a: 1) Psychologist 2) Test Taker 3) Test purchaser 4) Test user

Test Taker

When psychological tests are used in clinical and counseling settings, the results 1) are combined with information that is gathered in other ways 2) can be interpreted without additional information from other sources 3) my be freely shared with others because the tests are commercially available 4) can only be reviewed by personnel who have a MD degree

are combined with information that is gathered in other ways

Certification and licensure are credentials individuals obtain to demonstrate they 1) have met the requirements for earning an advanced degree 2) are qualified to administer psychological tests and assessments 3) are qualified to practice in their field 4) are certified to protect the health and safety of the public

are qualified to practice in their field

In survey research, survey validity refers to the degree to which the survey 1) assesses the concept a researcher is measuring 2) correlates with another similar measure 3) has convergent evidence of validity 4) results predict an expected outcome

assesses the concept a researcher is measuring

The criterion of success in college is most often students' 1) classroom test scores 2) grade point average 3) community service activities 4) professors' ratings

grade point average

Items for which the p value falls in the range of .90 to 1.00 are usually considered 1) too difficult 2) somewhat difficult 3) somewhat easy 4) too easy

too easy

A multi-trait multi-method correlation matrix is shown below. What is the correlation of Test of Trait 2/Essay with Test of Trait 3 /Interview and what is its type? 1) .08; heterotrait-heteromethod 2) .40; heterotrait-monomethod 3) .40; heterotrait-heteromethod 4) .08; heterotrait-monomethod

.08; heterotrait-heteromethod

The mean of a distribution of test scores will always have a z score of: 1) 1 2) 2 3) 3 4) 0

0

If the correlation (r) between a test and a criterion is .04, then the coefficient of determination (r2) is 1) 2 2) 0.02 3) 0.0016 4) 0.16

0.0016

When assessing item difficulty, which p value would yield distributions of test scores with the most variation? Question options: 1) 0.5 2) 0.2 3) 0.9 4) 0.7

0.5

In what year did Walter Dill Scott publish "The Scientific Selection of Salesmen?" 1) 1915 2) 1920 3) 1925 4) 1918

1915

When was the Polygraph Protection Act passed? 1) 1988 2) 1998 3) 2008 4) 1978

1988

During what period of time did portfolios start to become a popular assessment tool in education? 1) 2000s 2) 1990s 3) 1980s 4) 1970s

1990s

According to the text, how many important differences are there between a survey and psychological test? 1) 6 2) 4 3) 8 4) 2

2

Some scholars believe that psychological tests can be traced back to: 1) 500 AD 2) 1000 AD 3) 1000 BCE 4) 2200BCE

2200 BCE

According to the text, how many steps are involved in construct explication? 1) 5 2) 3 3) 6 4) 4

3

How many major types of factor analysis procedures are presented in your text? 1) 4 2) 3 3) 2 4) 1

3) 2

T scores always have a mean of: 1) 150 2)50 3) 100 4) 200

50

If a content validity ratio has a number of 0.00, then what percentage of experts agree that the item is essential? 1) 100% 2) 50% 3) 25% 4) 75%

50%

The mean of a normal distribution always has a percentile of 1) 50. 2) 0. 3) 10. 4) 100.

50.

According to the text, how many primary differences are there among psychological tests? 1) 8 2) 2 3) 4 4) 6

6

The text lists what they consider to be the most important assumptions for psychological tests. How many are there? 1) 8 2) 2 3) 6 4) 4

6

How much variance do a test and criterion share if the coefficient of determination is .09? Question 1) 81% 2) .09% 3) 3% 4) 9%

9%

If you wanted an expert to look at your test related to 5th grade level math, who might be the best pick? 1) An I/O psychologist with two children in the 5th grade 2) The principal of the school 3) A 12th grade teacher with 20 years of experience 4) A 5th grade teacher with 10 years of experience

A 5th grade teacher with 10 years of experience

The reliability of a test derives from which factors? 1) A. Reliability within the test 2) B. Reliability across time 3) C. The validity of the test 4) A and B

A and B

When calculating a test of significance, what may be challenging when looking for statistically significant results? Question options: 1) A. Small sample sizes 2) B. Criterion contamination 3) C. A and B 4) D. None of the above

A and B

Which of these is a step involved in gathering theoretical evidence for construct validity? 1) Establish a nomological network 2) Propose experimental hypotheses 3) A and B 4) None of the above

A and B

Which of the following is a benefit of developing competency models? 1) A competency model is most useful for developing high stakes selection programs for police and firefighters 2) A competency model can often be used for multiple different jobs within an organization 3) A competency model will describe the specific tasks that are performed on a job 4) A competency model will focus on the technical skills necessary to perform a job

A competency model can often be used for multiple different jobs within an organization

What is the MMPI-2? 1) A comprehensive, clinically oriented self-report test used for diagnosis and making treatment plans 2) A symptom checklist used for self-diagnosis of minor mental health concerns 3) A pre-employment test used to identify which potential employees have the best mental health functioning 4) A projective, clinically oriented personality test used in residential treatment centers for adolescents

A comprehensive, clinically oriented self-report test used for diagnosis and making treatment plans

What is the SCID-I? 1) A semi-structured clinical interview that covers a wide range of disorders 2) A semi-structured clinical interview that covers a single disorder 3) A structured interview for diagnosing obsessive compulsive disorder 4) A structured interview used to evaluate candidates for jobs

A semi-structured clinical interview that covers a wide range of disorders

If a clinical practitioner used a tool where all of the questions that had to be answered were predetermined, which kind of tool would it be? A) A prognosis B) A structured clinical interview C) A semistructured clinical interview D) A nondirective clinical interview

A structured clinical interview

Which one of the following research studies could yield information about evidence of validity based on the content of a test? 1) A study that involves performing a series of systematic steps during test development 2) A study that involves correlating test scores with another previously identified test 3) A study where test takers provide their opinion on how well test questions relate to the test topic 4) A study that involves correlating test scores with a previously identified performance measure

A study that involves performing a series of systematic steps during test development

What rating scale would be most appropriate for responding to a survey question that asks, "How much time should a student study each week for an undergraduate college course?" 1) A: Not much; B: A little; C: An average amount; D: A lot; E: Almost always 2) A: 0 to 30 minutes; B: 31 minutes to 60 minutes; C: 61 minutes to 120 minutes; D: More than 120 minutes 3) A: 0 to 1 hours; B: 1 to 2 hours; C: 2 to 3 hours; D: More than three hours 4) A: Below average; B: Average; C: Above average; D: No opinion

A: 0 to 30 minutes; B: 31 minutes to 60 minutes; C: 61 minutes to 120 minutes; D: More than 120 minutes

The degree to which an immigrant or a minority member has adapted to a mainstream culture is called: 1) Generalizability 2) Acculturation 3) Differential validity 4)Cultural assimilation

Acculturation

Evidence of validity based on content is most appropriate for what types of tests? 1) Comparative tests that measure personality characteristics 2) Concrete tests that measure aptitude and achievement 3) Achievement tests that measure concrete attributes 4) Personality tests that measure absolute attributes

Achievement tests that measure concrete attributes

Test and survey developers should balance items for which the correct response would be positive with an equal number of items for which the correct response would be negative to control for which bias? 1) Social desirability 2) Faking 3) Random responding 4) Acquiescence

Acquiescence

Which response set is a problem when the test taker has a tendency to agree with any ideas or behaviors presented? 1) Random responding 2) Faking 3) Social desirability 4) Acquiescence

Acquiescence

What could a test developer do to increase internal consistency of a test? 1) Add questions that measure the same concept 2) Adjust the reliability coefficient using the KR-20 formula 3) Accurately measure the test-retest reliability of the test 4) Add well-written questions to each test form

Add questions that measure the same concept

If specialists or administrators use the results of tests to determine where money should be spent and what programs should be implemented to improve the achievement scores of a school, district, state, or nation, what kind of decision has been made? 1) Instructional 2) Program and curriculum 3) Diagnostic 4) Administrative policy

Administrative policy

A child is brought to a clinician because of concerns that the child might be suffering from an autism spectrum disorder. Which one of the following tests might the clinician give the child to aid in the diagnosis? 1) House-Tree-Person 2) Draw a Person 3) Ages and Stages Questionnaire 4) Beck Depression Inventory

Ages and Stages Questionnaire

According to the text, which of these is NOT a "Mode of Induction" according to Albert Bandura's theory? 1) Aggressiveness 2) Live Modeling 3) Participant Modeling 4) Attribution

Aggressiveness

A test manual should include which kinds of information? 1) Information that the test purchaser can use to evaluate the psychometric characteristics of the test 2) Detailed information about proper administration and scoring procedures 3) Information about how to compare test scores with those of norm groups 4) All of the above

All of the above

Generally speaking, which of these could be considered a criterion? Question options: 1) Accidents on the job 2) Absenteeism 3) Disciplinary problems 4) All of the above

All of the above

In a multitrait-multimethod design, which of these is a way that the design collects evidence for construct validity? Question options: 1) Establish evidence for reliability 2) Convergent evidence of validity 3) Divergent evidence for validity 4) All of the above

All of the above

People from multicultural backgrounds could belong to various minority groups based on: 1) Race 2) Family unit 3) Primary language 4) All of the above

All of the above

People from multicultural backgrounds could belong to various minority groups based on: Question options: 1) Race 2)Family unit 3) Primary language 4) All of the above

All of the above

To calculate a 95% confidence interval, what components are needed? 1) An individuals observed test score 2) Plus and minus 1.96 3) The standard error of measurement for the test 4) All of the above

All of the above

What are some reasons why people believe that integrity tests should not be used? 1) They believe that they are not reliable or valid 2) They believe that they are an invasion of privacy 3) They believe that they have a different and more inhibiting effect on minorities 4) All of the above

All of the above

What is a way to help reduce scoring errors? 1) Providing training to raters 2) Checking questions with unusually high numbers of correct or incorrect answers for mistakes in scoring 3) Frequent checking of computations 4) All of the above

All of the above

What kind of educational settings would use tests? 1) Middle schools 2) High schools 3) Universities 4) All of the above

All of the above

When defining the target audience, what is a factor that needs to be considered? 1) The reading level of the audience 2) Whether the audience has any characteristics that would require special test administration or interpretation 3) Whether test takers will be motivated enough to answer test questions honestly 4) All of the above

All of the above

Which of these actions is the ethical responsibility of test publishers? 1) Make test manuals available before tests users purchase their tests 2) Make validity information available before test users purchase their tests 3) Refuse to provide test materials to persons who do not have proper testing credentials 4) All of the above

All of the above

Which of these is a benefit of an assessment center? 1) Research suggests that they are one of the best predictors of job performance 2) There is a relative lack of sex bias 3) There is a relative lack of race bias 4) All of the above

All of the above

Which of these is a way to gather psychometric evidence for construct validity? 1) Experimental interventions 2) Evidence of validity based on content 3) Evidence of validity based on external criteria 4) All of the above

All of the above

Which of these is an abstract construct? 1) Intelligence 2) Beauty 3) Self-Esteem 4) All of the above

All of the above

Which of these is an exercise that you may find in an assessment center? 1) In-basket exercise 2) Role-play exercise 3) Leaderless group discussion 4) All of the above

All of the above

Which of these methods can be used to determine internal-consistency reliability? 1) Spearman-brown formula 2) KR-20 formula 3) Coefficient alpha 4) All of the above

All of the above

Which of these statements related to expectations of self-efficacy is true: 1) Expectations personal efficacy determine whether coping behavior will be initiated 2) Expectations of personal efficacy determine how much effort will be expanded 3) Expectations of personal efficacy determine how long effort will be sustained in the face of obstacles and aversive experiences 4) All of the above

All of the above

Which one of the following test required test takers to follow directions and perform a series of ballet movements that were confusing and distracting? 1) Army's assessment center 2) Stanford-Binet test 3) Wechsler Intelligence Test 4) Alpha and Beta tests

Alpha and Beta tests

What type of reliability is being estimated when someone administers two forms of the test to the same people? 1) Alternate or Parallel forms 2) Internal consistency 3) Interrater reliability 4) Test-retest

Alternate or Parallel forms

The State Board of Education where Joy went to college decided to give every graduate student in a science program with a combined GRE score more than 1400 a $5,000 education grant. What type of decision was this? 1) An absolute individual decision 2) A comparative institutional decision 3) A comparative individual decision 4) An absolute institutional decision

An absolute institutional decision

What is a portfolio? 1) Letters of reference and other external judgments about an individual's work 2) A compilation of an individual's test scores and other performance data for a specific purpose 3) An assortment of an individual's work completed for a specific time period 4) An objective catalog of information about an individual

An assortment of an individual's work completed for a specific time period

Which of the following should scoring instructions include? 1) A test key 2) Scoring procedures 3) An explanation of how the test scores relate to the construct the test measures 4) All of the above

An explanation of how the test scores relate to the construct the test measures

Which of these is NOT a stage involved in the psychological testing process: 1) An individual reports the reliability and validity of the test to the test taker 2) An individual administers a test to the test taker 3) An individual scores the test 4) An individual or group determines a need for psychological testing

An individual reports the reliability and validity of the test to the test taker

What does X stand for in a regression equation? 1) An individual's score on the predictor 2) The intercept on the Y axis 3) The correlation coefficient 4) The number on the Y axis that the linear regression coefficient predicts

An individual's score on the predictor

Which of these statements is true? 1) Reliability and validity are not related 2) An instrument can be valid, but not reliable 3) An instrument that is reliable is always valid 4) An instrument can be reliable, but not valid

An instrument can be reliable, but not valid

Which one of the following characteristics of a test is included in the test plan? 1) The planned date of publication 2) The content of each question on the test 3) An operational definition of the construct 4) A plan for validation

An operational definition of the construct

What is the fourth step in a scientific approach to survey design? 1) Construct the survey 2) Communicate the survey findings 3) Analyze the survey data 4) Administer the survey

Analyze the survey data

Julio conducted a research survey that involved asking students about their academic standards and integrity. He asked the students to not put their name or any other identifying information on the survey. What was he providing the students? 1) Confidentiality 2) Obscurity 3) Reliability 4) Anonymity

Anonymity

Which one of the following statements about the characteristics of a normal probability distribution is FALSE? 1) The curve can continue to infinity, and therefore the right and left tails of the curve will never touch the baseline. 2) Approximately 68.2% of the population will score between the mean and 1 standard deviation. 3) Most people will score near the middle of the distribution, making the center of the distribution the highest point. 4) Most test scores cluster or fall near the middle of the distribution, forming what we refer to as the average or the central tendency.

Approximately 68.2% of the population will score between the mean and 1 standard deviation.

Which test is currently primarily used by the armed forces to help qualify people for certain military branches and certain jobs? 1) Army Alpha 2) Armed Services Vocational Aptitude Battery 3) General Aptitude Test Battery 4) Army Beta

Armed Services Vocational Aptitude Battery

What mental test designed for group testing was developed for test takers who were unable to read, write, or speak English? 1) Army Omega test 2) Army Alpha test 3) Army Beta test 4) Army Alpha-Beta test

Army Beta test

Which of these would have large-scale simulations of the job that would require a test taker to solve typical job problems by role-playing or to demonstrate proficiency at job functions such as making presentations and fulfilling administrative duties? 1) Integrity tests 2) Behavioral interviews 3) Assessment centers 4) Work samples

Assessment centers

Which developmental disability affects communication and social interaction often involving restricted interests and stereotyped, repetitive patterns of behavior? A) Alzheimer's Disease B) Comorbid Disorders C) Autism Spectrum Disorders D) Obsessive Compulsive Disorder

Autism Spectrum Disorders

The Ages and Stages questionnaire is used to diagnose which of the following conditions? 1) Depression 2) Obsessive compulsive disorder 3) Autism spectrum disorders 4) Alzheimer's disease

Autism spectrum disorders

If is test is administered the same way to all people, this demonstrates which characteristic of psychological tests? 1) Behaviors thought to measure an attribute or thought to predict an outcome are representatively sampled 2) Behavior samples are obtained under standardized conditions 3) There are rules for scoring 4) None of the above

Behavior samples are obtained under standardized conditions

Which of these methods would use on-the-job behaviors as anchors for ratings scales that represent job dimensions? 1) Forced ranking 2) Behaviorally anchored rating scales 3) Forced distribution 4) Graphic rating scales

Behaviorally anchored rating scales

Which one of the following is NOT a consequence a test user might experience by violating an ethical standard? 1) Negative consequences to individuals 2) Negative consequences to organizations 3) Expulsion of a member from an association/organization 4) Being tried or sued in a court of law

Being tried or sued in a court of law

Which test scoring model places test takers in a particular group or class? 1) Ipsative model of scoring 2) Categorical model of scoring 3) Cumulative model of scoring 4) Projective model of scoring

Categorical model of scoring

When raters only use the middle of the rating scale and ignore the highest and lowest scale categories, this is called: 1) Halo effect 2) Severity error 3) Central tendency error 4) Leniency error

Central tendency error

Which of these validity methods is used to determine whether a test indeed predicts what it was designed to predict? 1) Construct validity 2) Face validity 3) Content validity 4) Criterion-related validity

Chapter 6

Which one of the following is a difference between clinical and counseling psychologists? 1) Clinical psychologists must have an MD degree, while counseling psychologists have a PhD degree 2) Clinical psychologists usually treat more serious problems, while counseling psychologists usually treat everyday problems 3) Clinical psychologists can prescribe medications, but counseling psychologists cannot 4) Clinical psychologists are covered by a different set licensing requirements than counseling psychologists

Clinical psychologists usually treat more serious problems, while counseling psychologists usually treat everyday problems

In which of these settings would one use psychological tests to help diagnose psychological disorders, plan treatment programs, and determine the effectiveness of treatment programs? 1) Educational settings 2) Clinical settings 3) Organizational settings 4) All of the above

Clinical settings

According to the text, Walter Dill Scott's selection system provided the basis for what type of salespeople? 1) Car 2) Clothing 3) Life insurance 4) Weapons

Clothing

Judy wants to estimate the internal consistency of a survey on which the respondent marks (1) Not at all, (2) Sometimes, (3) Most of the time, or (4) Always. Which one of the following is most appropriate for her to use? 1) KR-20 2) Spearman Brown 3) Coefficient alpha 4) Cohen's kappa

Coefficient alpha

Which method has seen the strongest increase over time? 1) Spearman-brown formula 2) KR-20 formula 3) Coefficient alpha 4) None. They are all used in equal amounts by researchers.

Coefficient alpha

Mental retardation, learning disabilities, and traumatic brain injuries are considered to be: 1) Sensory impairments 2) Motor Impairments 3) Cognitive impairments 4) None of the above

Cognitive impairments

Which of these types of tests measure the test taker's mental capabilities, such as general mental ability tests, intelligence tests, and academic skills tests? 1) Mentality tests 2) Cognitive tests 3) Personality tests 4) Polygraph tests

Cognitive tests

Which one of the following are assessments that measure the test taker's mental capabilities such as general mental ability tests, intelligence tests, and academic skills tests. 1) General pre-employment tests 2) Cognitive tests 3) Personality tests 4) Skills tests

Cognitive tests

According to the text, a typical job analysis would NOT include which of the following job factors? 1) Skills 2) Competencies 3) Knowledge 4) Abilities

Competencies

What is a powerful test that clinical psychologists can use if they want to gather information about the personality and emotional functioning of their patient? A) Projected Clinically Oriented Personality Tests B) Structured Interviews C) Comprehensive Clinically Oriented Self-Report Tests D) Behavior Rating Scales

Comprehensive Clinically Oriented Self-Report Tests

When pretesting a survey, you ask respondents to describe their thoughts when answering survey questions. What method are you using? 1) Retrospective "think aloud" interview 2) Confidence ratings 3) Paraphrasing 4) Concurrent "think aloud" interview

Concurrent "think aloud" interview

What is a method for establishing evidence of validity based on a test's relationships with other variables in which test administration and criterion measurement happen at roughly the same time? 1) Divergent evidence of validity 2) Concurrent evidence of validity 3) Predictive evidence of validity 4) Convergent evidence of validity

Concurrent evidence of validity

What is the method for establishing evidence of validity based on a test's relationships with other variables in which test administration and criterion measurement happen at roughly the same time? 1) Concurrent evidence of validity 2) Divergent evidence of validity 3) Convergent evidence of validity 4) Predictive evidence of validity

Concurrent evidence of validity

Which method of demonstrating evidence of validity do test developers use when the test scores and criterion scores are collected at approximately the same time? 1) Predictive method 2) Concurrent method 3) Convergent method 4) Content method

Concurrent method

What is the statistical procedure that would be used when researchers consider a theory associated with a test and propose a set of underlying factors that they expect the test will contain? 1) Multitrait-multimethod design 2) Confirmatory factor analysis 3) Exploratory factor analysis 4) Dragnet empiricism

Confirmatory factor analysis

Which one of the following processes requires researchers to first specify a hypothesis? 1) Content validity study 2) Exploratory factor analysis 3) Multitrait-multimethod study 4) Confirmatory factor analysis

Confirmatory factor analysis

Which of these validity methods refers to evidence that demonstrates that a test is measuring the underlying hypothetical (not directly observable) concept that the test was designed to measure? 1) Construct validity 2) Content validity 3) Criterion-related validity 4) Face validity

Construct validity

Which of the following are considered "traditional" terms that are no longer used in the most recent version of the Standards for Educational and Psychological Testing? 1) Content and criterion-related validity 2) Reliability and precision 3) Internal consistency and test-retest reliability 4) Test developer and test publisher

Content and criterion-related validity

Evidence of validity that reflects the extent to which the questions of a test are representative of the attribute being measured is called: 1) Criteria 2) Criterion-related validity 3) Construct validity 4) Content validity

Content validity

Which type of validity is carried out as the test is developed? 1) Construct validity 2) Content validity 3) Criterion-related validity 4) External validity

Content validity

What is a method for establishing evidence of validity based on a test's relationships with other variables in which test administration and criterion measurement happen at roughly the same time? 1) Predictive evidence of validity 2) Divergent evidence of validity 3) Concurrent evidence of validity 4) Convergent evidence of validity

Convergent evidence of validity

What is the method for establishing evidence of validity that show that other or similar constructs that theoretically should be related to the construct measured by a test in question are indeed related? 1) Predictive evidence of validity 2) Concurrent evidence of validity 3) Convergent evidence of validity 4) Divergent evidence of validity

Convergent evidence of validity

When the scores on a test correlate strongly with scores on other tests that measure the same construct, we say the test has 1) Discriminant evidence of validity 2) Evidence of validity based on relations with external criteria 3) Convergent evidence of validity 4) Evidence of validity based on content

Convergent evidence of validity

Which two validation strategies below help us to establish evidence of construct validity? 1) Construct explication and nomological networks 2) Coefficient alpha and test-retest reliability 3) Convergent evidence of validity and discriminant evidence of validity 4) Analysis of variance and multi-trait, multi-method analysis

Convergent evidence of validity and discriminant evidence of validity

When calculating the slope of a regression line, the letter r represents the: 1) Beta 2) Mean distribution of X 3) Intercept 4) Correlation coefficient

Correlation coefficient

What is the table in which the same tests and measures are listed in the horizontal and vertical headings and correlations of the tests are shown in the body of the table? 1) Correlation matrix 2) Nomological network 3) Factor analysis table 4) None of the above

Correlation matrix

Which of these is NOT considered to be a concrete attribute? 1) Creativity 2) Playing the piano 3) Writing a paper 4) Kicking a ball

Creativity

Outcomes that a test has been designed to predict (such as job performance or success in a training program) are called: 1) Criteria 2) Reliability 3) Constructs 4) Validity

Criteria

The measure of performance that is correlated with test scores is called the: 1) Predictor 2) Validity coefficient 3) Reliability coefficient 4) Criterion

Criterion

If a criterion measures more dimensions than those measured by the test, what is probably present? 1) Criterion contamination 2) Criterion deficiency 3) Restriction of range 4) None of the above

Criterion contamination

What do we call an evaluative standard that researchers use to measure performance, attitude, or motivation? 1) Utility measure 2) Criterion measure 3) Reliability measure 4) Validity measure

Criterion measure

Which one of the following types of tests will you take to obtain your driver's license? 1) Norm-referenced 2) Criterion-referenced 3) Objective 4) Subjective

Criterion-referenced

If a statement said "Zachary has learned 50% of the material he needs to know to demonstrate proficiency in third-grade mathematics," this test is an/a: 1) Norm-referenced test 2) Authentic test 3) Difference test 4) Criterion-referenced test

Criterion-referenced test

Which test-scoring model assumes that the more the test taker responds in a particular fashion, the more the test taker exhibits the attribute being measured? 1)Cumulative model of scoring 2) Ipsative model of scoring 3) Projective model of scoring 4) Categorical model of scoring

Cumulative model of scoring

According to the text, when a test developer makes a list of the characteristics of persons who will take the test, particularly those characteristics that affect how test takers will respond to the test questions, they are helping to: 1) Define the target audience 2) Define the test purpose 3) Define the testing universe 4) Develop a test plan

Define the target audience

According to the text, when a test developer is preparing a working definition of the construct that the test will measure, they are helping to: 1) Develop a test plan 2) Define the test purpose 3) Define the target audience 4) Define the testing universe

Define the testing universe

What is the first step in test development? 1) Defining the testing universe, audience, and purpose 2) Writing the administration instructions 3) Developing a test plan 4) Composing the test items

Defining the testing universe, audience, and purpose

Which test measures the four developmental areas of: personal-social, fine motor, language, and gross motor skills? A) Denver Developmental Screening Test B) Gesell Developmental Schedules C) Ages and Stages Questionnaire D) Bayley Scales of Infant and Toddler Development

Denver Developmental Screening Test

Two 1st-year college students, Carlos and Carl, are used to taking different types of academic tests. Carlos has mostly taken essay tests, and Carl has mostly taken multiple choice tests. What problem may arise when they take the same tests in college? 1) Depending on the type of tests given, there may be construct bias present in the test scores 2) Depending on the type of tests given, there may be method bias present in the test scores 3) Depending on the type of tests given, there may be method bias present in the test scores 4) Depending on the type of tests given, there may be reliability bias present in the test scores

Depending on the type of tests given, there may be method bias present in the test scores

Which one of the following is most likely to be the criterion measure for establishing evidence of validity based on relations with external criteria for a clinical psychological test? 1) Academic ability 2) Job performance ratings 3) Diagnoses made by two or more clinicians 4) Intelligence quotient

Diagnoses made by two or more clinicians

If a teacher has used a test and determines that a student can write a sentence but only a simple sentence, then the teacher has made what kind of decision? 1) Instructional 2) Counseling and guidance 3) Placement 4) Diagnostic

Diagnostic

What is a challenge with diagnosing autism disorders? A) Finding licensed psychologists who have certification in diagnosing autism B) Determining whether the child's parent has anything to do with their child's slow developmental progression C) Finding a test that evaluates autism while still being valid and reliable D) Differentiating between normal and abnormal development in social interaction, communication, and interests

Differentiating between normal and abnormal development in social interaction, communication, and interests

If you correlate scores on one test that that measures a particular construct with scores from another test thought to measure a different construct, what type of construct validity evidence have you tried to demonstrate? 1) Evidence of validity based on content 2) Establish evidence for reliability 3) Discriminant evidence of validity 4) Convergent evidence of validity

Discriminant evidence of validity

What is the method for establishing evidence of validity that shows that constructs that should not be related to the construct measured by the test in question are in fact not related? 1) Convergent evidence of validity 2) Concurrent evidence of validity 3) Discriminant evidence of validity 4) Predictive evidence of validity

Discriminant evidence of validity

In a multiple-choice question, what is another name for the incorrect responses that are listed? 1) Distractors 2) Stems 3) Erroneous responses 4) All of the above

Distractors

The scores on Dr. Katz's tests always had a mean of 50 and a standard deviation of 10. What statement best explains this phenomenon? 1) Dr. Katz converts his students' raw scores to T scores. 2) The same descriptive statistics for each test is a coincidence. 3) Dr. Katz grades his tests using a normal curve. 4) Dr. Katz converts his students' raw scores to z scores.

Dr. Katz converts his students' raw scores to T scores.

Which of these is NOT an effective way to gather evidence for construct validity? 1) Establishing reliability 2) Using a multimethod-multitrait design 3) Establishing a nomological network 4) Dragnet empiricism

Dragnet empiricism

Which of these learning disabilities is related to math? 1) Dyslexia 2) Dysgraphia 3) Dyscalculia 4) None of these

Dyscalculia

One's ability to understand one's own feelings and the feelings of others and to manage one's emotions is called: 1) Behavior 2) Emotional intelligence 3) Feelings intelligence 4) Psychological intelligence

Emotional intelligence

A Likert scale is often assumed to be representative of what level of measurement? 1) Ordinal scales 2) Equal interval scales 3) Nominal scales 4) Ratio scales

Equal interval scales

According to your textbook, which one of the following test formats do students prefer because it allows them to focus on demonstrating what they have learned rather than limiting them to answering specific questions? 1) True/false 2) Multiple choice 3) Essay 4) Forced choice

Essay

If a test developer wanted to develop a question that assesses a higher-order skill such as analysis, synthesis, or evaluation, what might be the best type of test question to use? 1) True/False 2) Interview 3) Essay 4) Multiple choice

Essay

Which one of the following types of questions provides a freedom of response that facilitates assessing higher cognitive behaviors such as analysis, synthesis, and evaluation? 1) Essay 2) Forced choice 3) Multiple choice 4) True/false

Essay

Which of these is NOT an objective test format? 1) Fill-in-the blank 2) Multiple choice 3) Essay question 4) True/False questions

Essay question

Problems for which there are no clear or agreed-on moral solutions are called: 1) Ethical principles 2) Ethical standards 3) Ethical dilemmas 4) Ethical values

Ethical dilemmas

The American Psychological Association has a set of professional practice guidelines or codes know as: 1) Ethical standards 2) Ethical dilemmas 3) APA rules and regulations 4) APA values

Ethical standards

What refers to issues or practices that influence the decision-making process in terms of "doing the right thing?" 1) Anonymity 2) Certification 3) Confidentiality 4) Ethics

Ethics

The 2014 Standards for Educational and Psychological Testing recognize five sources of evidence of validity. Which one of the following is NOT one of those sources? 1) Evidence based on relations to other variables 2) Evidence based on test content 3) Evidence based on face validity 4) Evidence based on response processes

Evidence based on face validity

Which one of the following types of evidence of validity can be gathered without using correlations? 1) Concurrent evidence of validity 2) Evidence based on test content 3) Predictive evidence of validity 4) Evidence based on relations with a construct

Evidence based on test content

If a test's questions are a representative sample of a well-defined domain, what type of evidence for construct validity has been demonstrated? 1) multitrait-multimethod design 2) Evidence for validity based on content 3) Evidence of validity based on relationships with external criteria 4) Establish evidence for reliability

Evidence for validity based on content

Which one of the following statements about validity is FALSE? 1) Evidence of validity based on content involves examining the questions on the test to see if they represent the domain being measured 2) Evidence of validity based on a test's relations with a criterion can be gathered via the concurrent and predictive methods 3) Evidence of validity based on a test's relations with other variables involves correlating test scores to a measure of performance or another test 4) Evidence of validity based on content involves correlating test scores to a criterion

Evidence of validity based on content involves correlating test scores to a criterion

What is statistical procedure that would be used when researchers do not propose a formal hypothesis, but instead use the procedure to broadly identify underlying components? 1) Dragnet empiricism 2) Exploratory factor analysis 3) Multitrait-multimethod design 4) Confirmatory factor analysis

Exploratory factor analysis

Which of the following is concerned with how test takers perceive the attractiveness and appropriateness of a test? 1) Content validity 2) Construct validity 3) Face validity 4) Concurrent validity

Face validity

Which of the following is not an acceptable means of determining the TRUE validity of a test? 1) Criterion-related validity 2) Construct validity 3) Face validity 4) Content validity

Face validity

What are the underlying concepts or constructs that the tests or groups of test questions are measuring? 1) Factors 2) Predictors 3) Criteria 4) None of the above

Factors

Which of these is a method that is NOT recommended by management consultants because an employee may be placed in a category that does not accurately describe his or her performance? 1) Forced distribution 2) Behavioral anchored rating scale 3) 360˚ feedback 4) Graphic rating scales

Forced distribution

Which of these is a method that is NOT recommended by management consultants because an employee may be placed in a category that does not accurately describe his or her performance? 1) Forced distribution 2) Graphic rating scales 3) Behavioral anchored rating scale 4) 360˚ feedback

Forced distribution

1 in 5 Fortune 500 companies use: 1) Forced distribution 2) Forced ranking 3) Behaviorally anchored rating scales 4) Graphic rating scales

Forced ranking

Professor Washington asks the students in his class to take a short quiz at the end of every two-week period during the semester. He assures the students that the quiz results are for him to better understand what they are and are not learning-not for grading purposes. He is using the test results as what type of assessment? 1) Diagnostic 2) Formative 3) Placement 4) Summative

Formative

Assessments that help teachers determine what information students are and are not learning during the instructional process are called? 1) Summative assessments 2) Formative assessments 3) Diagnostic assessments 4) Placement assessments

Formative assessments

When conducting a job analysis, what area group of activities that allow the incumbent to accomplish one of the primary objectives of the job? 1) Other characteristics 2) Functions 3) Abilities 4) Skills

Functions

We can divide the process of establishing evidence of construct validity into two parts. Name them. 1) Collecting data and analyzing the data 2) Proposing a hypothesis and proving that 3) Gathering theoretical evidence and gathering psychometric evidence 4) Interviewing study participants and testing those participants

Gathering theoretical evidence and gathering psychometric evidence

When a test can be expected to produce similar results even though it has been administered at different locations, we can now say that the test is: 1) Generalizable 2) Acculturated 3) Cross-validated 4) Repeatable

Generalizable

Jane is considering using two different tests of mechanical aptitude, both of which have good evidence of validity, to help select her auto mechanics. From prior research she knows that the two tests are correlated at .93. Which of the following recommendations would be best to make to Jane? 1) Find another test that has a higher correlation than .93 with either of the other two tests 2) Give one test or the other, but not both 3) Use neither test because testing is not a good way to select mechanics 4) Give both tests to all applicants

Give one test or the other, but not both

Which of these is NOT considered to be a subjective criterion? 1) Self-reports 2) Grade point average 3) Ratings of performance 4) Teacher's recommendations

Grade point average

If a teacher uses the results of a test to assign points to students, what kind of decision is being made? 1) Administrative policy 2) Selection 3) Instructional 4) Grading

Grading

According to the text, the most popular method for rating employee performance is using: 1) Behavioral anchored rating scales 2) Graphic rating scales 3) Forced distribution 4) Forced ranking

Graphic rating scales

Which one of the following was developed by a psychologist in the years prior to World War I? 1) Performance appraisals 2) Group tests for personnel selection 3) Assessment centers 4) Job analyses

Group tests for personnel selection

What occurs when raters let their judgment on one dimension influence judgments on another dimension? 1) Halo effect 2) Severity error 3) Leniency error 4) Central tendency error

Halo effect

Which one of the following rater errors occurs when raters let their judgment on one dimension influence judgments on other dimensions? 1) Leniency error 2) Halo effect 3) Central tendency error 4) Severity error

Halo effect

Imagine you were a testing professional delivering a presentation on test taker responsibilities to a group of students preparing to take the SAT. Which one of the following would you NOT include as a test taker responsibility in your presentation? 1) Carefully read or listen to, as well as follow, test administrator instructions 2) Request testing accommodations if they have a physical condition 3) Protect test security and copyrights by not sharing test content with others 4) Have your test scored and results delivered within a reasonable period of time

Have your test scored and results delivered within a reasonable period of time

Which type of test replicates job settings as realistically as possible? 1) Integrity tests 2) Low-fidelity tests 3) Polygraph tests 4) High-fidelity tests

High-fidelity tests

A bar graph used to represent frequency data in statistics is called a: 1) Histogram 2) Normal probability distribution 3) Frequency distribution 4) Frequency graph

Histogram

If a teacher uses the results of a test to determine the pace of courses, what kind of decision is being made? 1) Instructional 2) Administrative policy 3) Selection 4) Grading

Instructional

Relating to positive practices when providing instructions to test takers, which of these statements is false? 1)Instructions on where to respond should be given 2) Instructions on how to respond should be given 3) Instructions should be written at a high reading level 4) None. All of these aspects of providing instructions should be in effect.

Instructions should be written at a high reading level

Which one of the following criteria used in educational settings is subjective? 1) Instructors' letters of recommendation 2) Number of courses completed 3) Grade point average 4) Number of dismissals or withdrawals

Instructors' letters of recommendation

Which type of test is used to measure individual attitudes and experiences toward concepts such as honesty and dependability? 1) Integrity tests 2) Intelligence tests 3) Achievement tests 4) Aptitude tests

Integrity tests

In a regression equation, the letter a represents the: 1) Intercept 2) Slope of the regression line 3) Mean distribution of Y 4) Correlation coefficient

Intercept

The place where the regression line crosses the y-axis is called the: 1) Correlation coefficient 2) Slope of the regression line 3) Intercept 4) Mean distribution of Y

Intercept

Cohen's kappa is an index of what? 1) Internal consistency 2) Interrater reliability 3) Test-retest reliability 4) Interrater agreement

Interrater agreement

Which one of the following levels of measurement involves assigning numbers to rank-order data, the distance between the numbers is judged to be equal, and there is no absolute zero point? 1) Ratio scale 2) Nominal scale 3) Interval scale 4) Ordinal scale

Interval scale

What is the line in this graph called? 1) Normal curve 2) Regression line 3) Item characteristic curve 4) Probability curve

Item characteristic curve

What is the name of the line that results when one graphs the probability of answering an item correctly with the level of ability on the construct being measured? 1) Item discrimination curve 2) Item characteristic curve 3) Item probability curve 4) Item difficulty curve

Item characteristic curve

Which one of the following statistics can be used to make decisions about retaining or discarding an item based on how well the item discriminates between high- and low-scoring test takers? 1) Item-total correlation 2) Inter-item correlation 3) Difficulty level 4) Discrimination index

Item-total correlation

The Psychological Corporation, an organization that continues today under the name Harcourt Assessment as a unit of Pearson, was organized by who? 1) Alfred Binet 2) Millicent Pond 3) J. McKeen Cattell 4) Walt Dill Scott

J. McKeen Cattell

Which one of the following is an abstract construct? 1) Job turnover 2) Job satisfaction 3) Number of customer complaints in one week 4) Days absent in a 30-day period

Job satisfaction

Jonathan wanted to estimate the internal consistency of a multiple choice test. Which one of the following would be most appropriate for him to use? 1) Spearman Brown 2) KR-20 3) Coefficient alpha 4) Cohen's kappa

KR-20

Which one of the following is used for calculating internal consistency for tests whose questions can be scored as either right or wrong? 1) Coefficient alpha 2) KR-20 formula 3) Split halves method 4) Test-retest method

KR-20 formula

Which of these is an exercise where the test taker is placed in a small group with the goal of discussing or solving a job-related issue? 1) Role-play exercise 2) In-basket exercise 3) Leaderless group discussion 4) Interviews

Leaderless group discussion

When raters give all employees better ratings than they deserve, this is called: 1) Severity error 2) Central tendency error 3) Halo effect 4) Leniency error

Leniency error

When we are interested in predicting criterion (Y') from a set of test scores, we can use what statistical procedure? 1) Linear regression 2) Predictive validity 3) Correlation 4) Multiple regression

Linear Regression

Which one of the following procedures would be best to use to answer the question, "If a student scores 85 on the academic abilities test, what course grade would we expect the student to receive?" 1) Linear regression 2) Multiple regression 3) Test of significance 4) Correlation

Linear Regression

What is the statistical process called when we use one set of test scores to predict one set of criterion scores? 1) Linear regression 2) Multiple regression 3) A test of significance 4) None of the above

Linear regression

Which of these is NOT specified in a test plan: 1) Scoring procedures 2) The operational definition of a construct 3) Literature review procedures 4) The format for the questions

Literature review procedures

What type of test simulates tasks using a written, verbal, or visual description? 1) High-fidelity tests 2) Polygraph tests 3) Low-fidelity tests 4) Integrity tests

Low-fidelity tests

Which one of the followings test is a comprehensive clinically oriented self-report test used for diagnosis and making treatment plans? 1) MMPI-2 2) Beck Depression Inventory 3) Symptom Checklist 90 4) TAT

MMPI-2

If a test developer wants to "make all items independent," then they should try to : 1) Make sure that cues for the correct response in one time are not found anywhere else on the test 2) Make sure all items are reliable and valid 3) Make sure that each item has its own factor 4) Make sure that items are homogeneous

Make sure that cues for the correct response in one time are not found anywhere else on the test

Variations or inconsistencies in the measurements yielded by a test or survey are called: Question options: 1) Variation error 2) Inconsistency error 3) Measurement error 4) None of the above

Measurement error

How do professional societies and associations decide what to put in their standards? 1) Members propose their codes and agree to abide by them only after the codes are accepted by consensus 2) The members form a committee that adapts their codes from those of other professional organizations 3) Members vote on and adopt the standards after extensive discussion and debate 4) Organizations derive their ethical codes from governmental agencies and guidelines

Members vote on and adopt the standards after extensive discussion and debate

Which of these is NOT a source of self-efficacy in Albert Bandura's theory? 1) Mental experience 2) Performance accomplishments 3) Verbal persuasion 4) Vicarious experience

Mental experience

If you were a testing professional, which one of the following would you NOT do when testing individuals with disabilities? 1) Provide special accommodations, if necessary, to individuals with disabilities 2) Modify test scores to take into account a test taker's disability 3) Rely on more than test scores when testing individuals for diagnostic purposes 4) Ensure the intended test outcomes indicate the intended attributes

Modify test scores to take into account a test taker's disability

If we wanted to predict job performance using the results of a personality test and an intelligence test, which of the following statistical techniques would be best to use? 1) Linear regression 2) Correlation 3) Coefficient of determination 4) Multiple regression

Multiple Regression

Jane is putting together a battery of tests to select employees for her company. She is already using a test of cognitive ability and a test of numerical reasoning. She is now considering adding a personality test as well. Which one of the following would be the best statistical procedure to help make a decision about whether to add the personality test? 1) Multiple regression 2) Cohen's kappa 3) Simple linear regression 4) Correlation

Multiple regression

What is the statistical process called when we use more than one set of tests scores to predict one set of criterion scores? 1) Linear regression 2) Multiple regression 3) A test of significance 4) None of the above

Multiple regression

Which one of the following would we use in the denominator of the standard deviation formula when calculating the standard deviation of a population of test scores? 1) n - 1 2) N -1 3) n + 1 4) N

N

When choosing which items to put in the final draft of the test, which of the following should NOT be considered? 1) Evidence of the item's validity 2)Interritem correlation 3) Item difficulty 4) None. All of these should be considered

None. All of these should be considered

Which of these is NOT considered to be a step in helping to demonstrate evidence of validity based on test content during test development? 1) Defining the testing universe 2) Developing test specifications 3) Constructing test questions 4) None. They all are steps involved in the process.

None. They all are steps involved in the process.

If you were to receive the results of a test and you saw that you were in the 85th percentile, what kind of test did you take? 1) Criterion-referenced 2) Percentile test 3) Authentic test 4) Norm-referenced

Norm-referenced

What type of test would you design if the items were constructed to distinguish high from low performers? 1) Norm-referenced 2) Criterion-referenced 3) Portfolio assessment 4) Authentic assessment

Norm-referenced

For which test are test takers more likely to earn the "average" score, no matter how well they perform? 1) Authentic test 2) Criterion-referenced test 3) Average test 4) Norm-referenced test

Norm-referenced test

An academic achievement test where the test taker who achieves the highest score will receive a scholarship is an example of which approach to test interpretation? 1) Normative 2) Criterion-related 3) Construct 4) Predictive

Normative

Which one of the following was a criterion for the validity study for the Suicide Probability Scale conducted at Father Flanagan's Boys Home in Nebraska? 1) Number of self-destructive behaviors 2) Test scores on the Suicide Probability Scale 3) Number of prior attempts of suicides 4) Number of suicides

Number of self-destructive behaviors

Psychological assessment involves what two types of components? 1) Group and individual 2) Strong and weak 3) objective and subjective 4) Structured and unstructured

Objective and subjective

Juanita asks children to line up in order of their height, placing the shortest child first and the tallest child last. She then assigns the first child "1," the second a "2," and so on. What type of scale is Juanita using? 1) Equal interval scale 2) Ratio scale 3) Ordinal scale 4) Nominal scale

Ordinal scale

If a teacher asked 20 children to line up in order of height, then assigned numbers to the children based on how tall they were (e.g., the shortest child receives a "1" all the way up to the tallest child, who receives a "20"), what level of measurement was used? 1) Ordinal scales 2) Equal interval scales 3) Ratio scales 4) Nominal scales

Ordinal scales

A human resource professional would most likely use a psychological test in a/an: 1) Organizational setting 2) Educational setting 3) Clinical setting 4) None of the above

Organizational setting

In which setting do Industrial/Organizational practitioners use tests to measure applicants' knowledge, skills, abilities, and personalities? 1) Educational settings 2) Clinical settings 3) Organizational settings 4) None of the above

Organizational settings

If you are rated by your colleagues or equals, then you are being rated by your: 1) Supervisors 2) Direct reports 3) Peers 4) Customers

Peers

Which of these is NOT a linear transformation? 1) Standard deviation units 2) Percentiles 3) Percentages 4) Z-scores

Percentiles

An interitem correlation matrix would be comprised of what type of coefficients? 1) Phi coefficients 2) Point-biserial coefficient 3) Pearson product-moment correlation coefficient 4) None of the above

Phi coefficients

Which one of the following two general categories do assessments for integrity fall into? 1) Polygraphs and interviews 2) Assessment centers and interviews 3) Physiological measures and paper-and-pencil tests 4) Simulations and polygraphs

Physiological measures and paper-and-pencil tests

Assessments that are used to determine whether students have the skills or knowledge necessary to understand new material and to determine how much information students already know about new material are called? 1) Placement assessments 2) Diagnostic assessments 3) Formative assessments 4) Summative assessments

Placement assessments

What do we call tests used to determine whether students have the skills or knowledge necessary to understand new material and how much of the new material students already know? 1) Formative assessments 2) Diagnostic assessments 3) Placement assessments 4) Summative assessments

Placement assessments

In the equation Y' = a + bX, what does "Y'" represent? 1) Slope 2) Intercept 3) Individual's score 4) Predicted criterion score

Predicted criterion score

What is a method for establishing evidence of validity based on a test's relationships with other variables that shows a relationship between test scores obtained at one point in time and a criterion measured at a later point in time? 1) Convergent evidence of validity 2) Concurrent evidence of validity 3) Divergent evidence of validity 4) Predictive evidence of validity

Predictive evidence of validity

What is the method for establishing evidence of validity based on a test's relationships with other variables that shows a relationship between the test scores at one point in time and a criterion measured at a later point in time? 1) Divergent evidence of validity 2) Convergent evidence of validity 3) Predictive evidence of validity 4) Concurrent evidence of validity

Predictive evidence of validity

Which one of the following is evidence that a test can predict future behavior? 1) Content-based evidence of validity 2) Predictive evidence of validity 3) Concurrent evidence of validity 4) Face evidence of validity

Predictive evidence of validity

When it is important to show a relationship between test scores and a future behavior, researchers establish evidence of validity using what method? 1) Predictive method 2) Content method 3) Test-retest method 4) Concurrent method

Predictive method

What is it referred to as when a patient is displaying signs of dementia or Alzheimer's disease, but actually only has depression? A) Major depressive disorder B) A stroke C) Pseudodementia D) Parkinson's disease

Pseudodementia

Which of these methods can be used to establish face validity? 1) Qualitative Analysis 2) Acculturation 3) Quantitative Analysis 4) Cross-Validation

Qualitative Analysis

When test developers ask test takers to complete a questionnaire about how they viewed the test and how they answered the question, this is called: 1) Acculturation 2) Quantitative analysis 3) Qualitative analysis 4) Cross-validation

Qualitative analysis

The coefficient of multiple determination is also known as: 1) The square root of r 2) r2 3) r3 4) R2

R2

Imagine you were a testing professional delivering a presentation on test taker rights to a group of students preparing to take the SAT. Which one of the following would you NOT indicate as a test taker right? 1) Have your test administered and your test results interpreted by appropriately trained individuals who follow professional codes of ethics 2) Receive a written or oral explanation of your test results within a reasonable amount of time after testing and in commonly understood terms 3) Respectfully request a change in the testing environment or conditions if you believe the conditions will negatively affect your results 4) Be treated with courtesy, respect, and impartiality, regardless of your age, disability, ethnicity, gender, national origin, religion, sexual orientation, or other personal characteristics

Respectfully request a change in the testing environment or conditions if you believe the conditions will negatively affect your results

When a validity coefficient is lowered because some people are dropped from a validity study, it may be possible that what has occurred? 1) Restriction of range 2) Predictive evidence of validity 3) Concurrent evidence of validity 4) None of the above

Restriction of range

What right includes the concept that individuals are entitled to full explanations of why they are being tested, how the test data will be used, and what the test results mean? 1) Right to know and understand test results 2) Right to privacy 3) Right to informed consent 4) Right to confidentiality

Right to informed consent

What is the right that a participant is entitled to a nontechnical explanation of the scores of all tests? 1) Right to protection from stigma 2) Right to know and understand results 3) Right to privacy 4) Right to informed consent

Right to know and understand results

If you wanted to learn more about the personal and legal responsibilities of test takers, what two resources would you benefit most from reading? 1) Standards for Educational and Psychological Testing and Code of Fair Testing Practices in Education 2) Rights and Responsibilities of Test Takers and Code of Fair Testing Practices in Education 3) Standards for Educational and Psychological Testing and Ethical Principles of Psychologists and Code of Conduct 4) Rights and Responsibilities of Test Takers and Standards for Educational and Psychological Testing

Rights and Responsibilities of Test Takers and Standards for Educational and Psychological Testing

In an effort to improve the credibility of psychological testing and establish psychology as a true scientific movement, who promoted the use of mental testing during World War I? 1) Walter Lippman 2) Robert Yerkes 3) Thomas Thorndike 4) Sigmund Freud

Robert Yerkes

Who developed the Army Alpha and Beta tests? 1) Asa Hilliard 2) Robert Yerkes 3) Walter Lippmann 4) Arthur Jensen

Robert Yerkes

Which exercise is one where the test taker interacts with one or more persons (trained professionals) to solve problems encountered on the job? 1) Leaderless group discussion 2) In-basket exercise 3) Interviews 4) Role-play exercise

Role-play exercise

Which one of the following tests measures personality by exploring the unconscious? 1) Rorschach Inkblot Test 2) Hogan Personality Inventory 3) Minnesota Multiphasic Personality Inventory 4) Myers-Briggs Type Indicator

Rorschach Inkblot Test

Today, what is the most widely used standardized college admission test? Question options: 1) SAT 2) ACT 3) DAT 4) LSAT

SAT

Scorer reliability and agreement concerns the consistency of what? 1) Test scores 2) Different test forms 3) Scorer judgments 4) Test takers' performance

Scorer judgments

Albert Bandura suggested the construct that is called: 1) Beauty 2) Intelligence 3) Self-efficacy 4) Self-esteem

Self-efficacy

What type of question is the following: Please circle the number that best represents how you are currently feeling? Happy 1 2 3 4 5 Sad 1) Ranking 2) Semantic differential 3) Free choice 4) Forced choice

Semantic differential

What type of question is the following: Please circle the number that best represents how you are currently feeling? Happy 1 2 3 4 5 Sad 1) Ranking 2) Semantic differential 3) Free choice 4) Forced choice

Semantic differential

When raters give all employees worse ratings than they deserve, this is called: 1) Central tendency error 2) Leniency error 3) Halo effect 4) Severity error

Severity error

In cross-validation, what is the phenomenon when the correlation decreases due to chance factors? 1) Curtailment 2) Attrition 3) Shrinkage 4) Reduction

Shrinkage

Which one of the following guidelines did your textbook authors NOT suggest when printing a survey? 1) Stapling in the upper left corner for longer surveys 2) Spiral binding or printing in booklet format for extremely long surveys 3) Single spacing, eliminating the cover page 4) Printing on two sides of a sheet of paper for surveys less than three pages

Single spacing, eliminating the cover page

In the equation Y' = a + bX, what does "b" represent? 1) Slope 2) Predicted criterion score 3) Intercept 4) Individual's score

Slope

In a regression equation, the letter b represents the: 1) Correlation coefficient 2) Intercept 3) Mean distribution of Y 4) Slope of the regression line

Slope of the regression line

The expected change in one unity of Y for every change in X is called the: 1) Slope of the regression line 2) Correlation coefficient 3) Intercept 4) Mean distribution of Y

Slope of the regression line

What is the tendency of some test takers to provide or choose answers that are perceived to be most acceptable or that present the test taker in a favorable light called? 1) Social desirability 2) Social acquiescence 3) Social faking 4) Social responding

Social desirability

Which response set is a problem where some test takers want to choose answers that present themselves in a favorable light? 1) Random responding 2) Social desirability 3) Acquiescence 4) Faking

Social desirability

What type of tests' primary purpose concerns the intersection between mental health and the law? A) Specialized Forensic Tests B) Neuropsychological Tests C) Projective Personality Tests D) Cognitive Tests

Specialized Forensic Tests

As the reliability/precision of a test decreases, which one of the following items increases? 1) Difficulty 2) Standard deviation 3) Standard error of measurement 4) Internal consistency

Standard error of measurement

What is an index of how much an individual's test score is likely to differ from the individual's true score? 1) Confidence interval 2) Reliability index 3) Standard error of measurement 4) Cohen's kappa

Standard error of measurement

Which one of the following resources with professional practice standards would you need to purchase because the resource is not freely available on the Internet? 1) Principles for the Validation and Use of Personnel Selection Procedures 2) Ethical Principles of Psychologists and Code of Conduct 3) Standards for Educational and Psychological Testing 4) Code of Fair Testing Practices in Education

Standards for Educational and Psychological Testing

Most people make distinctions between objective and subjective tests based on their: 1) Content 2) Scoring procedures 3) Administration and format 4) Structure

Structure

Race, sex, and age could be considered to be what type of norms? 1) Biased norms 2) Differential norms 3) Discrimination norms 4) Subgroup norms

Subgroup norms

Questions that have no apparent relation to the test purpose or criterion are called: 1) Questionable items 2) Unrelated items 3) Subtle questions 4) Empirical questions

Subtle questions

How is the range of a distribution calculated? Question options: 1) Substract the lowest score in the distribution from the highest score 2) Average all of the scores in a distribution and multiply it by the number of scores in the distribution 3) Average all of the scores in a distribution 4) Subtract the highest score in the distribution from the lowest score

Subtract the lowest score in the distribution from the highest score

When conducting a job analysis, actions taken by the job incumbent that accomplish a job function are called: 1) Other characteristics 2) Functions 3) Skills 4) Tasks

Tasks

When conducting a job analysis, actions taken by the job incumbent that accomplish a job function are called: 1)Tasks 2)Skills 3) Other characteristics 4) Functions

Tasks

If a room is too hot, this may introduce error because of what kind of factor: 1) Test administration 2) Homogeneity 3) Scoring 4) Test length

Test administration

What test is designed to distinguish between legitimate memory impairment and memory impairment that is being faked? A) Test of Memory Malingering B) MMPI-2 C) Thematic Apperception Test (TAT) D) WISC-IV

Test of Memory Malingering

Lack of which one of the following can contribute to invalidating test results and result in psychological injury to individuals? 1) Confidentiality 2) Self-determination 3) Anonymity 4) Test security

Test security

What do we call a documented plan containing details about a test's content? 1) Content area 2) Test specifications 3) Testing universe 4) Test format

Test specifications

What is a documented plan containing details about a test's content? 1) Practical test 2) Content validity 3) Test specifications 4) Testing universe

Test specifications

The person who responds to test questions or whose behavior is being measured is called a: 1) Psychologist 2) Test taker 3) Test purchaser 4) Test user

Test taker

If a test developer gives the same test to the same group of test takers on two different occasions, then correlates the scores from the first and second administrations, what kind of reliability is the test developer trying to estimate? 1) Intrascorer reliability 2) Test-retest 3) Internal consistency 4) Scorer reliability

Test-retest

The increasing diversity of the population in the United States makes which one of the following processes important? 1) Using established norms to interpret test scores of minority test takers 2) Increasing the number of questions that require specific knowledge of various cultural minorities 3) Declining to test those who do not speak Standard English 4) Testing assessment tools to ensure they are valid for the minority population who will be the test takers

Testing assessment tools to ensure they are valid for the minority population who will be the test takers

The circumstances under which the test is administered is called the: 1) Testing surroundings 2) Testing location 3) Testing setting 4) Testing environment

Testing environment

If a test administrator uses the results of a test designed to measure student learning to assess teaching quality, which one of the following American Psychological Association recommendations for ensuring meaningful assessment is the test administrator violating? 1) No subgroup of students should be disadvantaged by the test or test-taking conditions 2) No important decisions should be made based on one test score 3) Tests used should have evidence of validity or provide useful information for the intended purpose 4) Students must have a fair opportunity to learn the curriculum they will be tested on

Tests used should have evidence of validity or provide useful information for the intended purpose

What are criterion-referenced tests? 1) Tests with evidence of validity based on relations with other variables 2) Tests where scores are interpreted by comparing a score with an objectively stated standard of achievement 3) Tests where scores are interpreted by comparing a score with a large group of test takers 4) Tests that distinguish between high and low achievers

Tests where scores are interpreted by comparing a score with an objectively stated standard of achievement

If you wanted to contact the publisher of the Uniform Guidelines on Employee Selection Procedures, whom would you contact? 1) The U.S. Human Testing Rights Association 2) The U.S. Equal Employment Opportunity Commission 3) The U.S. Department of Labor 4) The U.S. Bureau of Labor Statistics

The U.S. Equal Employment Opportunity Commission

The coefficient of determination indicates what? 1) How valid the test is 2) The amount of variance that the test and the criterion share 3) How confident we can be about the validity coefficient 4) The amount of test variance that is reliable

The amount of variance that the test and the criterion share

What is a polygraph? 1) The best-known physiological measure associated with evaluating truthfulness 2) The graph that shows the plots of multiple personality assessments for one test taker 3) A valid measure of truthfulness and honesty used for choosing job applicants for hire 4) A valid neuropsychological measure of truthfulness and honesty

The best-known physiological measure associated with evaluating truthfulness

Commonly, test practitioners use item-total correlations as an alternative to what? 1) Qualitative analysis 2) Acculturation 3) The discrimination index 4) Phi-coefficients

The discrimination index

How did the APA traditionally define construct validity? 1) The extent to which the test measures a theoretical construct 2) The extent to which the test represents all parts of the test domain 3) The strength of the relationship between a test and a criterion 4) The strength of the relationship between the test and itself

The extent to which the test measures a theoretical construct

The percentage of test takers who respond correctly is known as: 1) The discrimination index 2) The phi coefficient 3) The item difficulty 4) Acculturation

The item difficulty

What are raw scores? 1) Points on an interval or ratio scale. 2) Numbers assigned to a norm group. 3) The correct answer to a test question. 4) The most basic scores calculated from a test.

The most basic scores calculated from a test.

According to the text, which of these is NOT a myth about pre-employment testing? 1) Pre-employment testing is too time-consuming 2) Pre-employment tests cost too much 3) Pre-employment testing does not work 4) The organization will not be sued

The organization will not be sued

A large group of people takes a test at one point in time, waits for a period of time, and then their scores are correlated with some aspect of performance. What is the original test called that the large group of people took 1) The criterion 2) The reliability coefficient 3) The predictor 4) The validity coefficient

The predictor

Why is the following survey question inappropriate? "Did you enjoy watching and listening to the CD of the concert?" 1) The question is not in context 2) The question is not in correct syntax 3) The question is not specific about which concert 4) The question is a double-barreled question

The question is a double-barreled question

Which of these provides a quantitative estimate of a test's consistency of measurement? 1) The predictor 2) The reliability coefficient 3) The criterion 4) The validity coefficient

The reliability coefficient

If you were delivering a presentation about the American Psychological Association (APA)'s Code of Fair Testing Practices in Education, which one of the following facts would you NOT include in your presentation? 1) The standards directly apply to all types of tests in education, including teacher-made tests 2) The standards in the Code make clear the obligations of educational test developers and users 3) While consistent with the 1999 Standards, it is not consistent with the 2014 Standards 4) The APA originally published the Code in 1988 and revised it in 2004

The standards directly apply to all types of tests in education, including teacher-made tests

Why might some psychological tests not require strict procedures for test security? 1) The tests are developed by instructors to use in the classroom 2) The test developer intends the tests to be used for research purposes only 3) The tests are exempt from the APA's ethical principles 4) The tests are projective tests and do not have one correct answer

The test developer intends the tests to be used for research purposes only

Which of these does NOT need to be included in a test manual? 1) Validity information 2) The test itself 3) Norm information 4) Reliability information

The test itself

According to the Standards for Educational and Psychological Testing, who should provide test users, before purchasing a psychological test, the information needed to evaluate the psychometric characteristics of the test? 1) The test publisher 2) The American Psychological Association 3) The test developer 4) The test taker

The test publisher

Which statement regarding the testing environment is false? 1) The environment should be standardized 2) The testing environment has no effect on test takers 3) A proper test environment decreases variation 4) Instructions for administering the test should be specific and concise

The testing environment has no effect on test takers

According to Ghiselli, which of the following is NOT a condition that must be met to claim that two forms of the same test are comparable? 1) The tests should yield different distributions of scores 2) The scores from each test must correlate equally well with the external criteria 3) The individual rank-ordering of scores should be identical 4) The tests must yield identical scores

The tests should yield different distributions of scores

Which of the following is TRUE about objective criteria? 1) They are often based on a person's judgment 2) Their scope is often quite narrow 3) They are often expressed as ratings 4) They are often based on personal experience

Their scope is often quite narrow

Relating to objective criteria, which of these statements is false? Question options: 1) They often contain a narrow scope 2) They are observable and measureable 3) They are based on a person's judgment 4) If well-defined, these criteria usually contain less error

They are based on a person's judgment

Which one of the following is TRUE about authentic assessments? 1) They focus more on selecting a response than traditional assessment 2) They are more contrived than traditional assessment 3) They are more student-structured than traditional assessment 4) They are more focused on recall and recognition than traditional assessment

They are more student-structured than traditional assessment

Relating to subjective criteria, which of these statements is false? 1) They are observable and measurable 2) Ratings may be biased 3) They may take into account non-measureable factors, such as motivation 4) They are based on a person's judgment

They are observable and measurable

Which one of the following statements is TRUE about nonstandardized tests? 1) They provide more detailed test administration and test taking instructions than standardized tests 2) They have multiple standardization samples and norms 3) They are usually constructed by a teacher or trainer in a less formal manner for a single administration 4) They are projective tests administered in a less formal manner for multiple administrations

They are usually constructed by a teacher or trainer in a less formal manner for a single administration

Which of these statements related to behaviorally anchored rating scales is false? 1) They are difficult to develop 2) They require concentrated rater training due to their complexity 3) They do not provide more accurate ratings of employee behavior than do traditionally anchored rating scales 4) They are time consuming to develop

They do not provide more accurate ratings of employee behavior than do traditionally anchored rating scales

Which one of the following statements is FALSE about aptitude tests? 1) They assess an individual's potential for performing a new job or task 2) They measure the product of cumulative life experiences 3) They measure an individual's progress in learning a skill or task 4) They measure the maximum performance we can expect from individuals

They measure an individual's progress in learning a skill or task

All test users have the ethical responsibility to abide by what professional practice standards? 1) Those that apply to all professions and at their discretion those within their profession 2) Those that apply to all professions 3) Those within their profession and those that apply to all professions 4) Those within their profession and at their discretion those that apply to all professions

Those within their profession and those that apply to all professions

In 1964, which act that was passed by Congress stimulated great interest in fair employment practices? 1) Title VII of the Civil Rights Act 2) Age Discrimination and Employment Act 3) American Disabilities Act 4) None of the above

Title VII of the Civil Rights Act

What is the purpose of behavior coding? 1) To improve communication among multiple researchers when they interview groups 2) To classify respondents based on their behaviors 3) To inform respondents of their rights and responsibilities 4) To identify the types and frequencies of interviewer and respondent behaviors

To identify the types and frequencies of interviewer and respondent behaviors

According to the text, the Hogan Personality Inventory uses what kind of test item format? 1) Forced choice 2) True/False 3) Multiple choice 4) Essay

True/False

Which one of the following types of questions provides a freedom of response that facilitates assessing higher cognitive behaviors such as analysis, synthesis, and evaluation? 1) Essay 2) Forced choice 3) Multiple choice 4) True/false

True/False

If you were delivering a presentation about the Standards for Educational and Psychological Testing, which one of the following facts would you NOT include in your presentation? 1) Two organizations, the American Educational Research Association and the American Psychological Association, collaborate to publish the Standards 2) The Standards are available as a 230-page book, organized into three parts: Foundations, Operations, and Testing Applications 3) Unless there is a very sound professional reason, anyone who develops and/or uses standardized psychological tests and assessments should follow the Standards 4) The Standards provide those who develop and use standardized psychological tests and assessments with criteria for evaluating tests and testing practices

Two organizations, the American Educational Research Association and the American Psychological Association, collaborate to publish the Standards.

Which government entity developed the General Aptitude Test Battery? 1) U.S. Employment Service 2) Equal Employment Opportunity Commission 3) The United States Test Development Service 4) Office of Personnel Management

U.S. Employment Service

Which one of the following is NOT a test taker right? 1) Be informed of your rights and responsibilities as a test taker 2) Have your test results kept confidential to the extent allowed by law 3) Be treated with courtesy, respect, and impartiality 4) Understand and accept the consequences of not taking a test

Understand and accept the consequences of not taking a test

When test developers work at all stages of test development to ensure that the only factor that will influence a test score is the individual's standing on the construct that the test is designed to measure, they are demonstrating concern for what? 1) Reliability/precision 2) Criterion contamination 3) Content validity 4) Universal design

Universal Design

Which one of the following statements is FALSE? 1) Criteria must be representative of the events they are supposed to measure 2) Unlike tests, reliability or consistency is unimportant for criteria 3) Evidence for validity of a criterion can be gathered using a similar process to that used when establishing evidence of validity of a test based on content 4) A criterion is valid to the extent that it matches or represents the events in question

Unlike tests, reliability or consistency is unimportant for criteria

Regarding test development, which of these is NOT a suggested best practice based on the test development literature: 1) Be sure that each item is based on an important learning objective or topic 2) Use colloquial language 3) Make all items independent 4) Write each item in a clear and direct manner

Use colloquial language

In order to detect and decrease rater bias in essays, and also create scorer reliability, it may be wise to: 1) Prepare and answer key 2) Consider the time necessary to generate a response 3) Use one person to score the essay 4) Use multiple independent scorers

Use multiple independent scorers

Why was Florida's IQ cutoff score of 70 ruled unconstitutional for determining intellectual disability? A) Using IQ scores is not a valid measure to use when determining intellectual disabilities B) IQ should not be considered in the death penalty process C) Using a fixed IQ score of 70 is too rigid D) Cutoff scores are never appropriate to use with any test

Using a fixed IQ score of 70 is too rigid

Evidence that the interpretations that are being made from the scores on a test are appropriate for their intended purpose is called: 1) Validity 2) Reliability 3) A construct 4) Criteria

Validity

A statistic used to infer the strength of the evidence of validity that the test scores might demonstrate in predicting job performance is called the: 1) Reliability coefficient 2) Validity coefficient 3) Predictor 4) Criterion

Validity coefficient

Which tells us whether individual scores tend to be similar to or substantially different from the mean? 1) Variance 2) Correlation coefficient 3) Mode 4) Range

Variance

What was one reason the Educational Testing Service gave for the decline in SAT scores of graduating high school seniors during the 1960s and 1970s? 1) Changing attitudes of parents leading to lack of confidence in education 2) Increasing numbers of minority students taking the SAT 3) Student perceptions that scoring well on standardized tests was not "cool." 4) Weaker academic records and increased diversity of student backgrounds

Weaker academic records and increased diversity of student backgrounds

Which test was developed because of the dispute over the definition of intelligence? 1) Stanford-Binet Intelligence Scales 2) Binet-Simon Scale 3) Wechsler-Bellevue Intelligence Scale 4) Personal Data Sheet

Wechsler-Bellevue Intelligence Scale

Which of the following statements is FALSE? 1) It is inappropriate for a publisher to simply state that their test is valid 2) A psychological test can be reliable, but not valid 3) When a test is reliable, it is automatically valid as well 4) Reliability is a characteristic of the test itself; validity depends on how the test is used

When a test is reliable, it is automatically valid as well

Relating to pilot testing, which of these statements is false? 1) During a pilot test, one should choose a sample of people who resemble or are a part of the test's target audience 2) The purpose of a pilot test is to study how well the test performs 3) When setting up pilot studies, developers follow the Standards for Educational and Pilot Testing 4) The pilot test setting should mirror the planned test setting

When setting up pilot studies, developers follow the Standards for Educational and Pilot Testing

R2 Change is a statistic from a multiple regression which is useful in determining what? 1) The place where a regression line crosses the Y axis in a regression 2) Whether adding an additional test to a test battery is justified 3) The correlation coefficient between two tests 4) The amount of measurement error present in a test score

Whether adding an additional test to a test battery is justified

Which one of the following is TRUE about certification and licensure? 1) Certification and licensure do not require passing an exam 2) Certification and licensure are credentials related to protecting the health and safety of the public 3) While state-level governments establish licensure, certification is not regulated 4) While licensure is mandatory for some professions, certification is voluntary

While licensure is mandatory for some professions, certification is voluntary

What practice is being used if a test user administers the same test to every test taker, but scores the test differently according to the race of the test taker? 1) Individual norming 2) Independent group norming 3) Within-group norming 4) Non-discriminatory norming

Within-group norming

When a calculated correlation is greater than the critical value shown in the table, we can infer that the probability of finding our correlation by chance is less than five chances out of 100. Therefore, we assume that there is 1) no relationship, and we refer to the correlation coefficient as "significant." 2) a true relationship, and we refer to the correlation coefficient as "significant." 3) no relationship, and we refer to the correlation coefficient as "not significant." 4) a true relationship, and we refer to the correlation coefficient as "not significant."

a true relationship, and we refer to the correlation coefficient as "significant."

Incremental validity addresses the question of whether 1) adding another test to a test battery already in use would improve its predictive capability 2) the reliability of the combined test battery would be improved by the addition of another test 3) the client would believe that the additional expense of another test would be justified 4) the addition of another test would make the client feel that his condition was getting worse

adding another test to a test battery already in use would improve its predictive capability

Which of these is an assumption about psychological tests? 1) Individuals understand test items similarly 2) Individuals will report their thoughts and feelings honestly 3) Individuals will report accurately about themselves 4) All of the above

all of the above

When psychological tests are used in clinical settings the results are to diagnose patients A) used in future research projects that help B) always combined with information that is gathered in other ways C) solely relied upon D) distributed to other psychologists who help

always combined with information that is gathered in other ways

The U.S. Department of Defense uses ASVAB scores to determine 1) an individual's qualifications for certain military occupations 2) enlisted personnel's developmental coaching needs 3) enlisted personnel's promotion potential 4) an individual's likelihood to succeed in the military

an individual's qualifications for certain military occupations

If you administered a test without obtaining information on the identity of the test takers, you would be following the practice of 1) anonymity 2) protection from stigma 3) confidentiality 4) informed consent

anonymity

Which one of the following indicates the expected change in Y for every one unit change in Xi, when all the other predictors in the equation do not vary or remain constant? 1) df 2) R 3) X 4) b

b

A subjective criterion is 1) observable and measurable 2) easily calculated leaving little chance of disagreement 3) based on a person's judgment 4) the number of days of absence from work in a year

based on a person's judgment

A test user is anyone who participates in 1) administering, interpreting, or using test results 2) using test results to make important decisions 3) buying, administering, interpreting, or using test results 4) designing a test or piloting the test

buying, administering, interpreting, or using test results

During World War II, who was the chief psychologist of the War Department, and supervised the development of the Army General Classification Test used to place U.S. Army recruits? 1) Hugo Münsterberg 2) Walter Dill Scott 3) Walter Bingham 4) Millicent Pond

chapter 14

Which of these methods is a graph for rating employees' performance that represents a dimension, such as quality or quantity of work, divided into categories defined by numbers, words, or both? 1) Behaviorally anchored rating scales 2) Forced distribution 3) Graphic rating scales 4) Forced ranking

chapter 14

Evidence that a test relates to other tests and behaviors as predicted by a theory is referred to as: Question options: 1) Face validity 2) Criterion-related validity 3) Content validity 4) Construct validity

chapter 8

Meta-analysis is a statistical technique used to 1) estimate the reliability of a test 2) determine the proper cut score of a test 3) combine the results of multiple studies into a single result 4) reduce the amount of data necessary to conduct a validation study

combine the results of multiple studies into a single result

Watson, Detra, Fox, Ewing, Gearhart, and DeMotts (1996) administered two self-report alcoholism measures to 118 volunteers recruited from a Veterans Administration Medical Center. At approximately the same time, they asked the volunteers to complete the Diagnostic Interview Schedule. The study is an example of 1) multiple regression study 2) predictive evidence of validity study 3) restriction-of-range study 4) concurrent evidence of validity study

concurrent evidence of validity study

In organizational settings, researchers often use _____ studies as alternatives to _____ studies, because employers do not want to hire applicants with low test scores. 1) predictive; content 2) concurrent; predictive 3) predictive; concurrent 4) concurrent; content

concurrent; predictive

If you assure individuals that all personal information they disclose will be kept private, you are ensuring their 1) anonymity 2) confidentiality 3) informed consent 4) protection from stigma

confidentiality

When individuals are promised that all personal information they disclose will be kept private and will not be disclosed without their explicit permission, they are being assured of 1) confidentiality 2) anonymity 3) ethics 4) integrity

confidentiality

Defining the testing universe is an important step for ensuring a test has evidence of validity based on its 1) constructs 2) content 3) reliability 4) relations with variables

content

The process of competency modeling would most likely be used during test development to gather evidence for validity based on a test's 1) response processes 2) relations with a criteria 3) constructs 4) content

content

If test scores correlate with measures of constructs that an underlying theory says are related, then we say the test has 1) convergent evidence of validity 2) evidence of validity based on content 3) discriminant evidence of validity 4) concurrent evidence of validity

convergent evidence of validity

If the criterion measures more dimensions than those measured by the test, we say there is 1) criterion enhancement 2) criterion contamination 3) criterion failure 4) criterion success

criterion contamination

When subjective test formats are used and the test universe covers a wide range of topics, evidence of validity based on the test's content usually 1) increases significantly 2) increases somewhat 3) remains stable 4) decreases

decreases

When educational administrators use test scores for accountability purposes, they are using test scores to 1) inform public policy and evaluation programs 2) determine positive or negative consequences for individuals 3) substantiate initiating, continuing, modifying, terminating, or expanding programs 4) provide benchmark data and monitor student progress over time

determine positive or negative consequences for individuals

Dividing the number of persons who answered correctly by the total number of persons who responded to the question is a measure of an item's 1) discrimination index 2) phi coefficient 3) difficulty 4) bias

difficulty

The percentage of test takers who respond correctly to a test item is a measure of the item's 1) difficulty 2) bias 3) ability to discriminate 4) item-total correlation

difficulty

If the correlation between social studies test scores and statistics test scores is zero (or not statistically significant), then the social studies test has demonstrated 1) discriminant evidence of validity 2) convergent evidence of validity 3) evidence of face validity 4) concurrent evidence of validity

discriminant evidence of validity

When test scores do not correlate with unrelated constructs, there is 1) evidence of face validity 2) convergent evidence of validity 3) evidence of validity based on relations with external criteria 4) discriminant evidence of validity

discriminant evidence of validity

According to your textbook, one of the largest and most deeply rooted controversies about psychological testing pertains to 1) educating the public 2) errors and bias in scoring 3) use of projective testing 4) discrimination against protected classes

discrimination against protected classes

Norm-referenced tests allow test users to 1) assume evidence of reliability and validity for the test scores 2) distinguish low performers from high performers 3) assess students who match the norm group 4) hold all students to high standards of achievement

distinguish low performers from high performers

According to your textbook, activists who believe that intelligence is determined primarily by environment have worked for years to _____ what they consider to be the unfair use of such tests. 1) enhance 2) eliminate 3) protest 4) encourage

eliminate

When psychologists use the predictive method to establish evidence of validity for a pre-employment test, they ask the employer to Question 1) hire all the applicants who pass the test 2) hire all the applicants who take the test 3) postpone hiring until the criterion is measured 4) use the test on all people employed by the company in a similar job

hire all the applicants who take the test

Estimating reliability/precision using methods of internal consistency is appropriate only for tests that are 1) unstandardized 2) standardized 3) heterogeneous 4) homogeneous

homogeneous

A test's purpose includes not only what the test will measure but also 1) the test's reliability and validity 2) the type of setting in which the test will be used 3) the theory the test relies on 4) how the test users will use the test scores

how the test users will use the test scores

Symptom checklists and self-report tests which clients complete themselves are most likely to be used 1) when a person wants to make a diagnosis about their own condition 2) in the early stages of mental health treatment to evaluate the level of distress 3) by legal authorities as part of a court proceeding 4) during a person's visit to an emergency room for a mental health complaint

in the early stages of mental health treatment to evaluate the level of distress

When someone is interested in determining whether adding an additional test to an existing battery of tests makes good sense, we can say they are most likely interested in the 1) reliability/precision of the test 2) incremental validity of the test 3) face validity of the test 4) content validity of the test

incremental validity of the test

In the equation Y' = a + bX, what does "a" represent? 1) Predicted criterion score 2) Intercept 3) Individual's score 4) Slope

intercept

The Fahrenheit and Celsius temperature scales are both 1) ordinal scales. 2) ratio scales. 3) interval scales. 4) nominal scales.

interval scales.

One advantage of empirically based tests is that 1) they have strong validity coefficients 2) their internal reliability is high 3) test takers prefer them to other types of tests 4) it is more difficult for test takers to fake responses

it is more difficult for test takers to fake responses

Evidence of validity for the structured interview is established by developing questions using 1) information from professional organizations 2) tests that measure skills required by the job 3) standardized tests 4) job analysis or competency modeling

job analysis or competency modeling

A "p" value < .01 tells the test user that the likelihood that the relationship being measured was found by chance was 1) less than 5 chances out of 100 2) significant 3) not significant 4) less than 1 chance out of 100

less than 1 chance out of 100

The item characteristic curve can provide a picture of an item's 1) distribution of responses 2) inter-item and item-total correlation 3) level of difficulty and discrimination 4) reliability and validity

level of difficulty and discrimination

Y' = a + bX is the 1) predictive validity equation 2) correlation equation 3) multiple regression equation 4) linear regression equation

linear regression equation

Having a restricted range of test scores means that the observed validity coefficient is likely to be 1) higher 2) lower 3) unaffected 4) unpredictable

lower

The validity coefficients that result when a test is cross-validated are usually expected to be 1) the same as the validity coefficients found in the original validation study 2) lower than the validity coefficients found in the original validation study 3) higher than the validity coefficients found in the original validation study 4) unrelated to the validity coefficients found in the original validation study

lower than the validity coefficients found in the original validation study

Evidence of construct validity is most appropriate when a test measures an abstract construct such as 1) marital satisfaction 2) English grammar 3) mathematical computation 4) the IRS tax code

marital satisfaction

Studies of the PREParation for Marriage Questionnaire (PREP-M) described in your text suggest that the questionnaire predicts marital satisfaction and stability 1) poorly 2) weakly to moderately 3) nearly perfectly 4) moderately to strongly

moderately to strongly

Whereas _____ tests measure broad knowledge and skills that come from academic textbooks and teacher syllabi and that are based on the judgments of curriculum subject matter experts, _____ tests measure narrow knowledge and skills taught in a specific educational curriculum or unit of instruction, as defined by specific instructional objectives. 1) norm-referenced; portfolio 2) portfolio; criterion-referenced 3) norm-referenced; criterion-referenced 4) criterion-referenced; norm-referenced

norm-referenced; criterion-referenced

When researchers want to measure test-retest reliability/precision, they must assume test takers' ability will 1) not change between the first administration and the second administration 2) decrease between the first administration and the second administration 3) increase between the first administration and the second administration 4) be affected by the order they took the tests

not change between the first administration and the second administration

Anonymity is important because researchers believe that people who complete surveys or tests anonymously 1) often provide more honest information about themselves 2) are more likely to follow directions and cooperate with the test administrator 3) will be more likely to follow recommendations based on the test results 4) often speak more positively about psychological testing

often provide more honest information about themselves

The Uniform Guidelines apply to tests used by 1) classroom teachers to measure student learning 2) organizations to make hiring decisions 3) educational institutions for screening applicants for educational programs 4) clinical psychologists and psychiatrists to make diagnoses

organizations to make hiring decisions

According to the National Institute of Neurological Disorders and Strokes, learning disabilities are disorders that affect a person's ability to do all EXCEPT which one of the following? 1) understand or use spoken or written language 2) do mathematical calculations 3) coordinate movements 4) perceive movement

perceive movement

All psychological tests require a person to 1) answer all test questions 2) correctly answer as many questions as possible 3) complete a written test 4) perform an observable and measurable action

perform an observable and measurable action

Upon completing psychological testing of a person referred from another source, a written report is prepared for the 1) person who made the referral 2) client who received treatment 3) client's family 4) psychologist who provided the treatment

person who made the referral

Tests in which the test taker is required to make up stories about a set of ambiguous pictures would be considered to be 1) objective tests 2) subjective tests 3) projective tests 4) essay tests

projective tests

Ethical standards are 1) laws and doctrines established by governmental bodies 2) published guidelines that guide the work of those who practice in a field 3) regulations established by one or persons more a community authorizes 4) rules of conduct or procedures recognized by a city or state

published guidelines that guide the work of those who practice in a field

A behavior validation survey is most likely to be used when developing 1) a personality test 2) an intelligence test 3) an aptitude test 4) questions to use on a job interview

questions to use on a job interview

Which one of the following symbols is used to indicate a validity coefficient? 1) a 2) R 3) b 4) r

r

The correlation coefficient is represented by 1) c. 2) sd. 3) r. 4) x.

r.

The coefficient of determination is also known as: 1) r2 2) r3 3) square root of r 4) R2

r2

In a regression equation, the intercept is the place where the 1) regression line crosses the y axis 2) x and y axes cross 3) slope is zero 4) regression line crosses the x axis

regression line crosses the y axis

When test scores correlate with independent behaviors, attitudes, or events, we say the test's scores have evidence of validity based on the test's 1) content 2) calculated reliability 3) relations with an external criteria 4) face validity

relations with an external criteria

Researchers must be careful to include participants in their studies who represent the entire possible distribution of performance on both the test and the criterion to avoid 1) practice effects 2) multicultural bias 3) restriction of range 4) criterion contamination

restriction of range

The Principles for the Validation and Use of Personnel Selection Procedures reflects the official statement from the Society of Industrial and Organizational Psychology regarding professionally accepted practices for 1) selecting, developing, and using test instruments to make employment-related decisions 2) training new test developers how to develop testing instruments using commonly accepted best practices 3) using test instruments in clinical, educational, and organizational settings 4) developing test instruments to make selection and development-related decisions

selecting, developing, and using test instruments to make employment-related decisions

If you explained to a group of test takers why they were being tested and the purpose of the test, you would be ensuring the test takers had the right to 1) anonymity 2) self-determination 3) privacy 4) confidentiality

self-determination

Squaring the validity coefficient between a test and a criterion will tell us about the amount of 1) shared variance 2) validity 3) homogeneity 4) reliability

shared variance

People who have minority status in terms of disabilities or ethnicity are referred to as 1) norm groups 2) test users 3) special populations 4) test takers

special populations

Many shortcomings of the traditional interview, including its low reliability and validity, can be overcome by 1) asking different questions to each candidate 2) preparing the applicant for the interview 3) interviewing only one applicant for each job 4) structuring the interview and the interviewing procedure

structuring the interview and the interviewing procedure

Joe designs and conducts surveys and analyzes survey results. According to your text, Joe is a 1) survey specialist 2) project analyst 3) scientific method researcher 4) survey researcher

survey researcher

The concept of accessibility in testing is most associated with 1) test fairness 2) test reliability 3) test quality 4) test length

test fairness

When a test developer gives the same test to the same group of test takers on two different occasions, the developer is gathering evidence of 1) scorer reliability 2) internal consistency 3) internal reliability 4) test-retest reliability

test-retest reliability

What do we call the measure of performance that we expect to correlate with test scores? 1) An intercept 2) The criterion 3) The predictor 4) A standardized test

the criterion

Evidence that the interview or test is job-related is especially important when 1) choosing candidates for upper management positions 2) seeking to hire honest and motivated employees 3) the hiring employer is sued for adverse impact of their selection system 4) employees of the hiring organization belong to a union

the hiring employer is sued for adverse impact of their selection system

When we ask, "Are the inferences being made from a set of test scores appropriate?" we are referring to 1) validity 2) internal consistency 3) reliability 4) face validity

validity

If a test includes questions that are a representative sample of the material covered in a training course, the test demonstrates evidence of 1) reliability 2) validity based on a relation with other variables 3) validity based on content 4) face validity

validity based on content

The predictive and concurrent methods provide two types of evidence for 1) validity based on relations with a construct 2) face validity 3) validity based on relations with a criteria 4) validity based on content

validity based on relations with a criteria

When test developers correlate test scores with the criterion scores, the resulting number is called the 1) validity coefficient 2) reliability coefficient 3) content coefficient 4) criterion coefficient

validity coefficient

According to the American Psychological Association, what are "ethics"? 1) Practices that influence the decision-making process to do the right thing 2) Values members of a profession must follow 3) A community's laws that govern "right" or "wrong" practices 4) A person's moral conscience based on his or her background and upbringing

values members of a profession must follow