COMPS

Ms. Winter is a third grade teacher who allows her two students with ADHD to take their spelling tests in a private cubicle to minimize their distractions. This is an example of a(n) ____

accommodation

Demarco decides to study the relationship between caffeine and symptoms of anxiety. He asks people who drink two or more cups of caffeinated beverage a day to rate their symptoms of anxiety. He comes up with a correlation coefficient that describes the relationship between caffeine intake and anxiety symptoms. Which correlational coefficient suggests the smallest relationship between caffeine intake and anxiety symptoms?

0.01

According to the Individuals with Disabilities Education Act of 2004, how many days do school personnel have to conduct an evaluation once the parents have consented to the evaluation?

60

If Kelsey were to take the GRE (Revised General Test) multiple times, we would expect that _____ of the time her true scores would fall between 1 SEM below her original score and 1 SEM above her original score.

68%

In the two-dimensional model of _____, the individual is in the process of retaining parts of the culture of origin while simultaneously adapting to the new or host culture

Acculturation

What term refers to the dynamic process of change that individuals undergo as a result of contact with members of different cultures?

Acculturation

Dr. Blackwell has constructed an item that she believes will measure empathy in adults. She gave the item to a group of counselors and therapists because she believes that they have more empathy than people in other professions. When she constructs her item characteristic curve, what shape is Dr. Blackwell hoping for to support her hypothesis and confirm her test item as a measure of empathy?

An S shape

Which instrument would be most appropriate to use in establishing test-retest reliability?

An intelligence test

Janice is a career counselor who has every new client take a career interest test before his or her first session. Because she administers so many of these assessments, she finds it easier just to make copies of the original answer sheets and distribute those to her new clients. Which ethical code is Janice violating?

Assessment security

The Civil Rights Act of 1991 requires that employment tests _____.

Be connected to the duties of the job

In order to compute a measure of internal consistency, you consider which specific measure to use. Because the scoring is not dichotomous, you would be well advised to use _____.

Coefficient alpha

Which method of estimating reliability would you use when the assessment instrument uses scales that have a range, such as strongly agree, agree, neutral, disagree, and strongly disagree?

Coefficient alpha

Which statement about computer scoring of assessments is accurate?

Computers can be programmed to complete complex scoring procedures

The degree to which scores or results are affected by factors that are extraneous to instrument's intended purpose

Construct-irrelevance

The degree to which the evidence indicated that the items, questions, or tasks adequately represent the intended behavior domain

Content-related validity

Quinn is a graduate student who wants to know if mental health clients who score high on depression inventories are diagnosed as depressed by their therapists. She plans to gather the data herself and then compare the results from the depression inventories with the individuals' diagnoses. However, Quinn learns that some of the mental health clients have shared their test results (which Quinn gave them) with their therapists and, in turn, influenced the therapists' diagnoses of these clients. This is an example of _____

Criterion contamination

The extent to which an instrument was systematically related to an outcome

Criterion-related validity

Suppose that in the self-ratings of your interpersonal aggressiveness scale, you ask how likely the individual thinks he or she would be to respond in certain ways. For example, you might have an item like: You have been waiting in line at a "fast" food restaurant for 15 minutes and your lunch break only lasts 30 minutes. Someone cuts in line in front of you. How likely are you to tell them to go to the end of the line? Not at all likely, somewhat likely, moderately likely, very likely or extremely likely?

Cronbach's Alpha

The concept of _____ asserts that all examinees should have an unobstructed opportunity to demonstrate their capabilities on the construct(s) being assessed

accessibility

Counselors can expect to see a section called _____ in a written psychological report.

Diagnostic Impressions and Summary

Dr. Pym has created an instrument to measure processing speed in adolescents. However, on one of the test items, he finds that 95% of Caucasians get the item correct while only 50% of Asian Americans of similar ability get the item right. Dr. Pym realizes that he needs to examine whether there might be something within the item that results in this ______.

Differential item functioning

You also wonder about the day of the week question, which has frankly always bothered you. For someone who goes to school works outside of the home, the day of the week is obviously very relevant, but for someone whose schedule is more flexible, as, for example, a retired person, the day of the week is a bit less important. What does the ACA Code of Ethics say about taking such individual factors into consideration?

Ethical standards recommend that counselors recognize the effects of factors including age in administering, scoring and interpreting results

Which individual should be referred by a counselor for neuropsychological testing?

Gary, who displays abrupt behavioral changes

Which model takes into account that reliability varies depending on the purpose, setting, conditions, and use of the instrument?

Generalizability theory

Dr. Selvig has created an assessment instrument designed to detect the presence of "hero syndrome" in young children. What is one method he could use to gain content-oriented evidence of his instrument?

He could have experts review the instrument.

Where would you look to find information about a particular instrument's reliability?

In the instrument's manual

Which model is frequently used in developing items to measure achievement levels and requires both psychometric and technical sophistication?

Item response theory

Which resource for assessment instruments contains critiques of many of the commercially available, psychological, educational, and career instruments?

Mental Measurements Yearbooks

Given that personality inventories often ask people about their emotions and how they experience and express them, those who develop such instruments have sought to understand how culture might influence responding. For example, researchers have found that the five personality factors assessed in the _____ apply across diverse cultures

NEO-PI-3

When evaluating an instrument's reliability, what would you expect to find?

Reliability can be estimated in different ways using different methods.

The question of whether individuals perform or react in a manner that corresponds to the construct being measured can be answered by looking at evidence based on _____.

Response processes

Dempsey wants to find information about the appropriate use of assessment instruments. Which publication would you suggest he read?

Standards for Educational and Psychological Testing

As you read through the checklists, you find that, in creating the forms used in your school system, a clerical error was made and both the means (having the means to follow through on the threat) and focus (the identification of specific individuals, locations or events as the target of the threat) ratings for the threat were omitted. In terms of classical test theory, this will add to _____.

Systematic errors

Which resource for ethical and legal guidelines serves as a technical guide for testing practices and concerns the appropriate uses of tests and has been used in court as an indicator of standards of practice related to assessment in counseling?

The Standards for Educational and Psychological Testing

To find the percentage of shared variance between two variables, you would look at _____.

The coefficient of determination

You suspect that the EMTs asked the questions they did as a part of a standardized protocol for assessing apparently confused individuals. According to the ACA Ethical Standards, what should counselors consider when selecting an assessment instrument

The instrument's reliability, validation evidence, psychometric limitation, and appropriate use

Which statement is one of the guidelines for communicating assessment results to clients presented in the text?

The results should be discussed in context with other client information

You also suspect that the protocol the EMTs use has been in place for many years. What is the position of the ACA regarding using old assessments

The use of an outdated or obsolete version of an instrument is simply not appropriate

Informs a counselor when it is appropriate to use an instrument and what can be 3. Inferred from the results

Validation information

Ricardo has applied for a promotion at his company and is taking a test that has been used at the company for many years and is supposed to evaluate leadership traits. However, he has difficulty understanding many of the questions because English is not his first language. This is an example of a problem concerning ____

accessibility

Changes to the original instrument in terms of design or administration to increase the likelihood that all individuals will have an unobstructed opportunity to perform are called ____

adaptations

Although assessments of the Big Five Factors of personality do seem to be stable across cultures, there is significantly less research with _____, and clinicians are advised to be cautious in using Big Five assessments with them

adolescents

In Quinn's model of therapeutic assessment, Level 3 findings ___

are different from how clients view themselves

The Standards stipulate that informed consent should be obtained from either the client or their legal representative before the assessment process begins. An exception to this practice occurs when _____.

assessment without consent is mandated by law

Ms. Wright is a teacher who uses portfolio assessment, gathering multiple assignments from students, to evaluate her students' knowledge of the material being taught. Portfolio assessment is a type of _____ assessment

authentic

Suppose your measure of interpersonal aggressiveness involves having trained observers watch the person being assessed in a variety of situations that might be expected to elicit interpersonal aggression. You would want to make sure that you assessment yielded similar results regardless of which observer completed the ratings. That is, you would want to ensure your instrument had acceptable _____ reliability.

inter-rater

Creda is taking a test to determine the level of her fluency in the French language. Her results will determine which college French class she will be placed in. Based on the information provided, you would classify this test as which type of assessment

cognitive

The Mini-Mental State Exam is a brief questionnaire that screens for __

cognitive functioning

Dr. Sharp is a therapist who specializes in working with people who have bipolar disorder. She has received extensive training in working with people who have bipolar disorder and believes that it is much more prevalent in our society than most people recognize. Dr. Sharp seems to find a way to attribute many symptoms that might characterize other disorders to bipolar disorder and almost all of her clients receive a diagnosis of bipolar disorder. Dr. Sharp displays a tendency toward _____ bias

confirmatory

Jack is a graduate student conducting a research study on whether the results of a pre-employment test taken by individuals interviewing for a particular job leads to different hiring rates for different groups of people. Jack is best described as being interested in evidence based on _____.

consequences of testing

As a result of the American with Disabilities Act Amendment Acts of 2008, more Americans are likely to be ____

considered disabled

The first part of this video covers the topic of reliability (validity will be covered in the next chapter). Reliability is best described as _____.

consistency

Suppose that your approach to conflict resolution is based on Roger Fisher and William Ury's model of principled negotiation. As a result, you want to make sure that your assessment instrument covers all of the components of the model: separation of people from the problem; focus on interest rather than position; identification and exploration of a variety of options; and the use of objective criteria in reaching a decision. By doing so, you are seeking to maximize _____ validity.

construct

Suppose you have developed an instrument to assess conflict resolution style. People taking the test are asked to indicate whether each statement describes them or does not describe them. You have statements like "When a friend and I disagree, I usually give in to keep the peace," and "I prefer to avoid conflict whenever possible." One item, however, has raised a few eyebrows: "I enjoy heavy metal music." Others, however, question whether the item really assesses conflict resolution style. That is, they wonder whether that item presents a problem for _____ validity.

content

Many intelligence tests ask questions about general knowledge - information that people are expected to learn in the course of everyday life. Suppose a question on an intelligence test asks about Juneteenth and its significance. Because some demographic groups are more likely to be familiar with Juneteenth than others, this question has a problem with _____

content bias

A politician known for extremist views on immigration proposes that all individuals applying to immigrate to the United States be required to take a standardized intelligence test. He bases his proposal dissertation of a Harvard PhD candidate (Richwine, 2009), which claims that the average IQ of more recent immigrants is lower than that of European Americans and that the difference is likely to persist for several generations, creating a "lack of socioeconomic assimilation." Although the dissertation's methodology has been criticized as lacking on a number of levels, the author's ideas continue to periodically appear in discussions of immigration, with his critics dismissing it as "political correctness" run amok.Suppose a friend asks you about intelligence, aptitude, and achievement testing among diverse populations. What could you tell him or her? In assessment, there is the assumption that _____

everyone has an equal opportunity to perform

The degree to which the SAT predicts academic performance in college is an example of which type of validity?

criterion -related

What is the first step in selecting an assessment instrument or strategy?

determine what information is needed

Current universally accepted standards for evaluating the translation of instruments to another language ___

do not exist - there are no universally accepted procedures or standards for evaluating translations

According to classical test theory, every score has two hypothetical components: a true score and a(n) _____ component.

error

The statistical method differential item functioning (DIF) attempts to examine differences in ___

performance among individuals who are equal in ability but from different racial or ethnic groups

Adherence to a time schedule during testing is part of the student's responsibilities, not the administrator's.

false

While the EMT just plunged in with questions, a counselor is ethically required to satisfy the requirements of _____ and explain to clients the nature and purposes of the assessment and the specific use of results.

informed consent

Dr. Zorga is a medical professional who is updating his office procedures in order to be in compliance with the Health Insurance Portability and Accountability Act of 1996. What is one procedure that must now be implemented in his office by his office staff?

he will need to provide patients with information about office privacy practices

Parents often struggle with the news that their child has a disorder and progress through five stages, starting with ___

impact

A family's reaction to the diagnosis of a disability, as may be presented during the communication of test results, tends to go through five stages: _____

impact, denial, grief, focusing outward, and closure

The Standards for Multicultural Assessment provides guidelines regarding the proper use of psychological and assessment techniques by counselors and by ___

individuals under their supervision

The case of Larry P. v. Riles, the judge ruled that _____ discriminated against African American children

intelligence tests

You are pleased to find that the school system has a requirement that, when more than one staff member witnesses an incident, each staff member must independently complete a checklist. Although you recognize that the conditions for doing so are not ideal, you notice that this will give you a chance to estimate _____ reliability.

inter rater

Whenever possible, the interpretation of assessment results presented to clients should ___

involve descriptive terms rather than numerical scores

the Standards for Educational and Psychological Testing recommends that assessment should be administered in the language that __

is most relevant and appropriate to the purpose of the assessment

On the Parenting Stress Index, there is an item that separates the very stressed parents from the non-stressed parents. Parents who report high stress levels respond one way to the item, while parents who report low parenting stress levels respond in the opposite way. This is an example of ____

item discrimination

As a school counselor at a middle school, you are responsible for administering the yearly state achievement tests. During the test administration, a female student approaches you and asks to use the restroom. Next, thirty minutes into the testing, a male student enters the room and wants to know if he should take the test. The major responsibility of a test administrator is to ____

know the administration materials and be prepared

According to positive psychology theorists, psychological assessment is currently slanted toward identifying an individual's ___

limitations

Reporting the results is an important aspect of the assessment process and is sometimes made more complex by the need to inform different audiences including the individual and his or her family, insurance companies, state agencies paying for treatment and other third-party payers, other professionals and, in some cases, the courts and their designees. Quinn proposed a model of therapeutic assessment in which Level 1 findings ____

map into how clients already view themselves

When assessing a client, a counselor is attempting to get a(n) _____ of some behavior or characteristic of the client

measurement

The first method for calculating intelligence was called an intelligence quotient (IQ) and used a ratio of _____ age and chronological age

mental

What statistical procedure can be used to examine whether an instrument's validity can be generalized?

meta-analysis

This quiz would be considered a(n) _____ instrument while an essay test would typically be an example of a(n) _____ instrument

objective; subjective

Which of the following is an example of an authentic assessment?

observing a student complete a lab experiment

Suppose your university asked you to develop your conflict resolution style assessment because of several situations in which disagreements among roommates turned violent. None of the students had any history of violence and your university is hopeful that your instrument can be used to identify students who are likely to have difficulty resolving conflicts appropriately. That is, they want your instrument to have high _____ validity.

predictive

When probability information is available, counselors should explain the results in terms of ____

probabilities rather than certainties

You are out running errands with a friend one afternoon when an elderly woman approaches you, obviously confused and wanting directions to a nearby suburb. She tells that she just drove to the store but she has gotten turned around and cannot find her way home. It seems to you that she is more than slightly confused, and disoriented, as you talk to her, changing her story about where she has been and where she is going. She is not dressed warmly for the snowy day and she is somewhat disheveled. The idea of her driving anywhere is frightening. You tell her that you are not really sure and offer to call someone for directions, intending to call for emergency medical assistance. Your friend, who appears to share your concern, keeps her occupied while you make the call. Emergency medical technicians (EMTs) arrive shortly thereafter. To your shock, they do a brief mental status evaluation, asking her name (which they have no way of verifying), where she is (accepting the answer of being "in town") and the day of the week (she is off by one day). They also ask her if she would like to go to the hospital (she would not) and inform you that there is nothing more that they can do. After packing up, they leave and the woman, ignoring you, gets back into her car. Although she struggles for several minutes, she is eventually able to start it and drives away.You and your friend stop at a deli and talk about the experience. You certainly know that the ethical standards that apply to you, as licensed counselors, do not apply to EMTs, but you cannot help but think of the issues that were raised by what you observed.You know that different qualifications in terms of training, academic degree and credentialing, are required for different tests. Mental status examinations, which, even when administered in totality, are brief and easy to administer, and have no restrictions. That is, they are _____ tests

qualification level A

Polly is taking the SAT today. She is very anxious about the test and only slept for two hours last night. Test anxiety and lack of sleep are likely to contribute to _____ and affect Polly's scores.

random error

When you review the situations in which the protocol has been implemented, you find that the checklist is often initially completed by a teacher or administrator who has recently been the focus of a student's verbal aggression and includes at least threats of and sometimes actual physical aggression. As a result, the person completing the checklist may be very stressed at the time it is completed. Moreover, the extent to which the stress impacts their ratings is likely to vary from person to person, depending on their individual training and personal history. In terms of classical test theory, you would expect this to affect _____.

random errors

A brief summary of the symptoms, behaviors, or circumstances that led to the assessment should be included in the _____ section of a well-written psychological report.

reason for referral

In order to determine an instrument's internal structure, you can look at an instrument's _____ for different groups

reliability coefficients

Helms (2004) defined fairness in terms of ___

removal of systematic variance from scores

since there are multiple items for each of the components (the threat itself; the student's current behavior; personal factors; and home/community factors), you decide to look at a measure of internal consistency: _____.

split half

When a test has fixed instructions for administration, uses the same content for all administrations, and has a developed system for scoring, it is considered a(n) _____ assessment

standardized

Sera is a school counselor working in a school with students of diverse language backgrounds. She speaks multiple languages and has found herself able to communicate successfully with the student population. The school has one instrument for evaluating social skills problems and it is in English. The school principal asks her to begin several social skills groups and to use this instrument to identify students who might benefit from improved social skills. Sera's next step is to ____

research instruments that have been studied on groups similar to her student population

One thing to keep in mind when evaluating the relationship between an instrument and the criterion for different groups is that statistical significance of validity coefficients is influenced by ___

sample size

Suppose you have developed an instrument to assess interpersonal aggressiveness. If you want to determine the reliability of the test over time, you would most likely assess its _____ reliability.

test-retest

The validity of an instrument tells us _____.

that the instrument measures what it is intended to measure

Benziman and Toder found that children in mental health settings prefer to receive assessment results from _____.

their parents

What is the purpose of the Family Educational Rights and Privacy Act of 1974

to protect student privacy

instruments vary in terms of what is considered an appropriate relationship and the degree of rapport the administrator is to have with the examinee(s)

true

Evidence related to _____ tells the clinician how the instrument can be used and what the results mean

validity

The degree to which 1. evidence and 2. theory support the interpretations of test scores entailed by proposed uses of tests

validity

Miller is a counselor in an elementary school and is frequently asked by teachers to assess students for attention-deficit/hyperactivity disorder (ADHD). After obtaining consent from parents, Miller will administer a relatively unknown ADHD instrument to these students and provide feedback to both teachers and parents. One day, he is asked to assess a student who has recently enrolled in the school after moving to the area from Palau (a small island in Micronesia). After reviewing the examiner's manual, Miller finds that the instrument was normed on American children living in the Midwest who were predominantly European American. If Miller goes ahead and administers this instrument to the new student the way that he does for other students at his school, he is ignoring his responsibility with regard to _____.

validity of interpretation