Quiz Questions for Final
Reliability coefficients range from ______. .00 to +1.00 +1.00 to +10.00 -10.00 to +10.00 -1.00 to +1.00
.00 to +1.00
A commonly used cutoff to determine if a variable belongs to a particular factor is when its factor loading is beyond an absolute value of: 0.4 0.8 0.6 0.2
0.4
What is an acceptable reliability coefficient? 0.1 0.3 -.83 0.7
0.7
In what year did the Lancet retract a paper for fraud that linked autism to the vaccine for measles, mumps, and rubella? 2005 2000 1998 2010
2010
The process of test development is complete using IRT when what can be said? All items have been assessed using the ICC. All items are easy enough for the least able to answer correctly. All items are above the ability of the most able. All items fit the author's desired difficulty and discrimination level.
All items fit the author's desired difficulty and discrimination level.
Which career assessment focuses on the importance of self-reported interests and skills? Armed Services-Civilian Vocational Interest Survey Self-Directed Search Campbell Interest and Skill Survey Kuder Occupational Interest Survey
Campbell Interest and Skill Survey
Career testing started nearly 3,000 years ago in ______. China Russia the United States Britain
China
What is the fundamental logic behind the multitrait-multimethod technique? Correlations between two methods measuring the same trait will be high. Correlations will be higher when the same method is used. Correlations between different traits will be high if same method is used. Correlations between methods measuring different traits will be high.
Correlations between two methods measuring the same trait will be high.
T/F Achievement tests assess the functioning of the brain.
F
T/F Unique factor variance refers to measurement error.
F
Which of the following is also known as the Buckley Amendment? PL 94-142 IDEA NCLB FERPA
FERPA
T/F Factor analysis is used only to validate theories of intelligence.
False
If a indicates discrimination, and b indicates the difficulty level of an item on the item characteristic curve, then an a value of 0.72 and a b value of -0.08 indicates what about the item? It is very difficult. It discriminates well and is of about average difficulty. It does not discriminate well. It discriminates well and is very easy.
It discriminates well and is of about average difficulty.
What is item response theory's greatest advantage in the field of tests and measurements? It gives different results than classical test theory. It needs only one test administration. It examines item responses instead of people responses. It is less complex than classical test theory.
It examines item responses instead of people responses.
How does the Every Student Succeeds Act differ from No Child Left Behind? It assigns national standards for measurement. It provides more flexibility to create standards. There has been no significant change. Tests are administered in all grades.
It provides more flexibility to create standards.
Which of the following tests assesses the reading comprehension, analytical reasoning, and logical reasoning of test takers? Law School Admissions Test SAT Metropolitan Readiness Test Graduate Record Exam
Law School Admissions Test
Who extended the work of Alfred Binet in the United States? Theodore Simon Lewis Terman John Stanford Stanley Kaplan
Lewis Terman
What format of attitude survey would have answer options "Strongly Disagree," "Disagree," "Agree," "Strongly Agree?" emotional format Likert format Thurstone format symmetrical format
Likert format
The first rule of thumb when conducting research is which of the following? Incentives should be reasonable and appropriate. Nothing should be done to harm the participants. Determine whether subjects remain anonymous Tests should be reliable.
Nothing should be done to harm the participants.
Which of the following is considered a projective personality test? NEO 4 test Minnesota Multiphasic Personality Inventory 16PF Rorschach ink blot test
Rorschach ink blot test
T/F An eigenvalue is useful in determining how much of the variance in a correlation matrix is accounted for by each common factor.
T
T/F Factor analysis can be used to determine whether the items on a newly designed measure of "sociability" are better represented by two smaller constructs of "friendliness" and "disinhibition."
T
T/F Factor analysis is used to identify whether and how variables relate to one another.
T
T/F Factor loadings refer to the correlations between items and common factors.
T
T/F Nominal-level data allow for only categorization of data.
T
T/F The color of a bird's egg would be an example of nominal data.
T
WWII created a huge demand for tests to classify individuals joining the armed forces. True False
T
According to general ethical guidelines for testing, what should be done when behavior is being assessed? Specific behavior information should not be revealed. Incentives should be offered. Test takers should provide consent. No one under the age of 16 should be assessed.
Test takers should provide consent.
A steep curve on an item characteristic curve indicates what about the test item? The item is too easy for all test takers. The item is inappropriate for the content. The item should not be included in subsequent test sessions. The item discriminates between those who know the material and those who don't.
The item discriminates between those who know the material and those who don't.
Which of the following is true about orthogonal factors that emerge from factor analysis? Items are used in more than one factor. The items in each factor correlate highly with each other. Only one factor is found. The items in different factors correlate highly with each other.
The items in each factor correlate highly with each other.
Which personality test requires the test taker to describe events based on pictures? Rorschach ink blot test Edwards Personal Preference Schedule NEO 4 test Thematic Apperception Test
Thematic Apperception Test
What can be said of a test taker scoring a zero on the ability scale of the ICC? Their ability cannot be determined. They have average ability. They have below average ability. They have above average ability.
They have average ability.
What can be said about the SAT and the ACT regarding college success? They predict college graduation rates. Results are unreliable. They are unreliable. They moderately predict first year success.
They moderately predict first year success.
Which of the following might be considered part of a portfolio? a student's poetry vocabulary words definition of terms list of U.S. presidents
a student's poetry
Which level of Bloom's taxonomy requires students to identify patterns and/or meaning? synthesis evaluation analysis application
analysis
The definition of a variable is ______.
anything that can take on more than one value
Which of the following measures an individual's potential to succeed in an activity requiring a particular skill or set of skills? neuropsychological vocational aptitude intelligence
aptitude
Short-answer questions are used for tapping what kind of information? higher order thinking skills basic information a wide scope of cognitive skills analysis of information
basic information
How can the Flynn Effect impact the costs of standardized testing? by eliminating bias It has no effect. by reducing demand by requiring frequent revision
by requiring frequent revision
Leading vocational psychologist Dr. Thomas Kreishok said that the last thing about career counseling is the what? training career job person
career
Which aptitude test measures speed and accuracy through the use of a 200-item test consisting of pairs of names or numbers? readiness artistic mechanical clerical
clerical
If you want to know that a test measures some underlying psychological concept, what type of validity evidence would you want to collect? predictive validity content validity construct validity criterion validity
construct validity
If I can say that my weekly statistics quiz fairly assesses the material covered, what source of validity evidence should I have collected? construct validity criterion validity concurrent validity content validity
content validity
Instead of developing or using an optimal measure, sometimes a test is used that is ______. convenient relevant cheap unorthodox
convenient
If someone were to choose a job as a paralegal, on what occupational theme would you expect them to score highest? conventional investigative artistic social
conventional
What method for examining test bias looks at differences in group scores? item by item difference-difference face validity cleary model
difference-difference
There are two characteristics of test items that help us determine good ones from bad ones. They are ______. reliability and validity theoretical basis and analytical basis difficulty level and discrimination level ability level and difficulty level
difficulty level and discrimination level
Using the item characteristic curve, one can observe that the probability of answering correctly, given two individuals with the same ability, varies as a function of the ______. number of test-retest occurrences hours spent studying difficulty level of the item content area
difficulty level of the item
The slope of the item characteristic curve tells us what about the item? margin of error discrimination level difficulty level ability level
discrimination level
Which of the following is considered a plausible but wrong answer? distracter stem detractor attracter
distracter
Which occupational theme is defined by individuals who prefer activities that include self-management, selling, and leadership? artistic investigative enterprising conventional
enterprising
When ______ decreases, reliability increases. performance saturation time error
error
What does the statistical procedure "factor analysis" allow a researcher to do? examine relationships make predictions test difference explain variables
examine relationships
What does the statistical procedure "factor analysis" allow a researcher to do? make predictions explain variables test difference examine relationships
examine relationships
The item "I often crave excitement" taps into which of the following NEO 4 personality test domains? neuroticism extraversion openness agreeableness
extraversion
Which of the following is a benefit of short-answer and completion items? measures higher level thinking subjective scoring guessing is minimized difficult to write
guessing is minimized
Communality refers to: how much the variance in an item is captured by the combination of factors. how much the variance in an item is captured by a single factor. an item's factor loading. an item's eignenvalue.
how much the variance in an item is captured by the combination of factors.
Which MMPI factor is defined as "converting mental conflicts into physical attributes?" hypomania hysteria depression paranoia
hysteria
Tests should always be interpreted ______. in the context they were collected by experts by computer analysis by using a rubric
in the context they were collected
Which of the following assess one's level of skill or competence in a wide variety of areas? achievement intelligence aptitude personality
intelligence
With what level of data can you compare position along a continuum? ratio interval ordinal nominal
internal
Measurement scientists find that validity is truly about how a person ______ a score. assigns personalizes compares interprets
interprets
If you like to solve problems, you would most likely score highest on which occupational theme? artistic conventional investigative social
investigative
A basic function of human behavior that is critical to assess when diagnosing brain damage is ______. language memory spatial orientation cognition
language
Vocational assessment helps the test taker do which of the following? determine content area knowledge make career decisions determine their IQ score make relationship choices
make career decisions
Categories in a nominal scale are ______. easily defined mutually exclusive inherently controversial well designed
mutually exclusive
The study of the relationship between the brain and behavior is known as ______. personality projection neuropsychology psychoanalysis forensic psychology
neuropsychology
What is the level of measurement that is used to identify different categories but not used as quantities?
nominal
When an assessment compares the performance of a child against other children of the same age it is called a(n) ______. criterion-referenced test standardized test achievement test norm-referenced test
norm-referenced test
What is the formula for calculating survey response rate? number of people asked to do survey / total intended population number of people who did the survey / number of people asked to do the survey number of people who did the survey / target number of participants number of people asked to do survey / number of people who did the survey
number of people who did the survey / number of people asked to do the survey
If a student gets an 89% on a test, this would be what type of score? error score observed score false score true score
observed score
What practice can be helpful in organizing one's thoughts in preparation for essay writing? outlining your response before you write studying the night before the test reviewing your notes right before the test visualizing the answer in your mind as you read the item
outlining your response before you write
Although test scores are important in advising people about career choice, what other factors must also be considered? IQ and educational attainment personality, values, and desires history of employment parents' education and occupation
personality, values, and desires
High school class rank is highly correlated with college GPA. This is an example of what type of validity? content validity concurrent validity predictive validity construct validity
predictive validity
Location along the y-axis on the item characteristic curve represents ______. test taker ability item discrimination test taker preparation probability of a correct response
probability of a correct response
Which dimension of the MMPI is defined as a "history of antisocial behavior?" social introversion schizophrenia psychopathic deviate hysteria
psychopathic deviate
What would be an application of ordinal measurement? a stress test analysis of blood pressure changes from stress description of stress causes ranking of stress causes
ranking of stress causes
Rainfall is an example of what type of measurement?
ratio
The ability to have a complete absence of a characteristic is related to what level of measurement?
ratio
What is the least likely level of measurement to be used in social sciences?
ratio
Which occupational theme is defined by individuals who prefer activities that are practical and hands on? investigative artistic realistic social
realistic
In the process of creating an unbiased test, what is the first step? recognize your own biases and stereotypes generate biased questions, and then edit them disguise the characteristics of your test population administer sample test questions orally to test subjects
recognize your own biases and stereotypes
Finding relationships among variables in the social sciences is a sample of what purpose of testing? placement selection research diagnosis
research
A test can be used for selection, placement, diagnosis, classification, and for measuring ______. hypotheses research variables validation reports definitive response
research variables
What tool is used to grade performance-based assessments? excel function Scantron (fill in the answer bubbles) rubric syllabus
rubric
What scoring technique groups together similar questions for surveys that measure abstract concepts? gradient rubric scales portfolio
scales
The Theory of emotional intelligence posits that which trait(s) is/are more important than IQ in determining intelligence? self-awareness and persistence ability to adapt to environment mental calculating skills good memorization techniques
self-awareness and persistence
Holland's hexagonal model is designed so that adjacent themes are those ______ to one another. similar dissimilar opposite identical
similar
If someone were to choose a job as a social worker, on what occupational theme would you expect them to score highest? social investigative artistic conventional
social
Intelligence is considered a ______ trait that doesn't change much as children grow older, so test-retest reliability is critical. codependent stable inconsistent common
stable
Employers can use aptitude tests with current employees to predict ______. employee compatibility salary potential attrition subsequent job performance
subsequent job performance
When individuals are concerned with the social values that underlie the usage of a test, what is this called? adaptive testing fair test movement test bias test fairness
test fairness
What type of reliability is sometimes called time sampling? internal consistency test-retest interrater parallel forms
test-retest
The introduction of what tool led to the increased usage of item response theory? the multitrait-multimethod matrix the computer the bell curve the calculator
the computer
Piaget and Simon worked together to develop a test that would distinguish between which groups of children? those with and without school age siblings those who do well in school and those who do not those with and without school avoidance those with and without preschool experiences
those who do well in school and those who do not
What type of question may lead the test taker to lie about their answer? threatening questions scholastic questions nonthreatening questions factual questions
threatening questions
The main purpose of the No Child Left Behind Act is which of the following? to increase the use of standardized tests to close the achievement gap to hold teachers more accountable to hold parents more accountable
to close the achievement gap
The assessment of intelligence is for what purpose to the neuropsychologist? to compare an individual's score from before and after a brain injury to rule out educational influences to determine base line experimental data to predict partner compatibility
to compare an individual's score from before and after a brain injury
What does a personality test attempt to measure? traits goals achievement aptitude
traits
What is the major distinction made between aptitude and achievement tests? focus on validity use of the test number of items used age of administration
use of the test
