Exam One - Psychological Assessment
Who is from Kent and is the leading authority for the MMPI
Ben Porath
__started testing civil service in 1855 followed by other European governments and then followed by the US in 1883
British
The current environment for testing could be best characterized by:
Despite some criticisms (e.g., overselection or bias), the wide use of tests is popular particularly with the development of applied specialties such as health and forensic psychology.
Who has relations to the early civil service testing in China?
DuBois (1970,1972)
__(1832) used tests for overseas civil service testing for employee selection that mirrored the early Chinese symptoms
English East India Company
Psychologists with behavioral orientations usually prefer not to use psychological tests. Instead, they favor the direct observation of behavior. True/False?
True
The KR20 formula requires that you find the proportion of people who got each item correct and it is not always appropriate for evaluating internal consistency in some cases. True/False?
True
parallel forms reliability
compares two equivalent forms of a test that measure the same attribute
Kappa coefficient are used to evaluate
the agreement between judges
Regarding the relationship between reliability and validity of a test,
you can have high reliability for a test but no validity
When studying the positive effects of the economy, one researcher found higher household income was slightly correlated with having fewer stressful life events. The most likely correlation coefficient for the study was:
-.15
For a test used to make decisions about someone's future evaluations must be certain to minimize any error in classification. Thus a reliability score of what is needed?
.90 or .95 (attempt to find a test with a reliability greater than .95)
developed the basic notion of sampling error in 1733
Abraham De Moivre
The wide use of group tests was associated with
After World War I as the result of the use of groups test being instituted to assess large numbers of recruits.
Spearman published what book
American Journal of Psychology
Edward L. Thorndike followed under Spearmans work as it became known in the United States he published what book
An introduction to the theory of mental and social measurements (1904)
What happens when there's shrinkage in test prediction when using regression statistics?
Beta weights are often smaller in a cross-validation or second samples
According the text and notes, standardized administration and the importance of a representative sample are ideas first associated
Binet's development of the intelligence test
Who were among the earliest to develop conceptual and statistical models to estimate test reliability?
C. Spearman and K. Pearson
__evolutionary ideas applied to humans by Sir Francis Galton ( a relative to __) Argued for selective mating to improve species, focused on intelligence, mental traits are inherited just as physical characteristics
Charles Darwin
Which sequence of people reflects an accurate description of influence and time (earliest to most recent)
Charles Darwin--Francis Galton—James Cattell
Psychology owes the advanced development of reliability assessment to the early work of British psychologist___
Charles Spearman
The __ had a relatively sophisticated civil service testing program more than 4000 years ago. Every third year in __ oral exams were given to help determine work evaluations and promotion decisions
Chinese, China
Which is used to identify the underlying dimensions that are measured by test items?
Factor analysis
Tests that measure some constantly changing characteristic is appropriate for test-retest evaluation True/False
False! It is NOT appropriate
World War 1 promoted the need for ___to determine skills and abilities (intelligence) for military service
Group tests
When did the use of tests for civil service selection begin
In China nearly 4000 years ago
The __ of a test refers to the intercorrelations among items within the same test. This __is evaluated using split-half reliability, the KR-20 method, or coefficient alpha
Internal Consistency
The problem of error associated with different observers presents unique difficulties. To asses these problems one needs to estimate the reliability of the observers those reliability estimates are what?
Interrater, interscorer, interobserver, interjudge, reliability
Define Interview
Is a method of gathering information through verbal interactions such as direct questions. Data from interviews provide an important complement to test results
After Ph.D with Wundt (1866) spent 2 years with Galton. He was the 1st psych professor at Pennsylvania where he developed testing lab. Developed many of measures (tests) and coined term "mental test" Focused on perceptual processes that were considered characteristics of intelligence and tried to predict college success but measure not valid
James McKeen Cattell
__indicates the actual agreement as a proportion of the potential agreement following correction for chance agreement. May vary between 1 (perfect agreement) and -1 (less agreement than can be expected on the basis of chance alone)
Kappa
Different judges observing the same event may record different numbers. To determine the extent of this type of error, researchers can use an adjusted index of agreement, such as the __
Kappa Statistic
The __ is the best method for assessing the level of agreement among several observers. This statistic was introduced by J. Cohen (1960) as a measure of agreement between two judges who rate a set of objects using nominal scales.
Kappa Statistic
developed the product moment correlation in 1896
Karl Pearson
This formula is used when calculating the reliability of a test in which the items are dicho-mous, scored 0 or 1 (usually for right or wrong) In addition to the split-half technique this is another method for estimating internal consistency
Kuder-Richardson formula (KR20)
1st mental measurements yearbook for test reviews published
Osar Buros (1938)
Who developed the Army Alpha (reading) and Army Beta (illiterate) intelligence tests in 1917
Otis and Yerkes
Personality tests look at __and__ dispositions of an individual
Overt, covert
Compares two equivalent forms of a test that measure the same attribute. The two forms used different items. However, the rules used to select items of a particular difficulty level are the same.
Parallel forms reliability
Characteristic ways of responding to ones environment stable and enduring constellation of traits and behaviors is
Personality
What personality test has reactions/ responses to ambiguous stimuli noted and interpreted? The assumption that response reflects individual characteristics
Projective
__refers to all the possible uses, applications, and underlying concepts of psychological and educational tests. The main use of these tests though is to evaluate individual differences or variations among individuals.
Psychological testing
What is reliability
Refers to the consistency, dependability, accuracy, repeatability of test results
Define validity
Refers to the meaning and usefulness of test results. Refers to the degree to which certain inference or interpretation based on a test is appropriate
There are several ways to assess this, degree to which you are measuring without error
Reliability
Who published MMPI empirically keyed test with validity scales and 8 clinical scales for DX. Currently most widely used research and used personality test in the world.
S. Hathaway and J.C. McKinley (1943)
Define the factor analysis technique
Seeks the minimum number of factors or dimensions that can be used to describe a data set. Now a part of virtually all major test consutruction
Jerry is a research assistant for Dr. Bob. Dr. Bob asks Jerry to compute the 90% confidence intervals for the tests used in Dr. Bob's research study. Jerry has a normal distribution table that includes percentages and z-scores. What else does Jerry need from Dr. Bob to compute the confidence interval for the tests in the study?
Standard deviation of each test and the reliability of each test
What personality test require a person to endorse or reject statements about themselves? Typically self-report
Structured (objective)
The act of giving a test is know as __
Test administration
Practice or carryover affects are the greatest concern to which reliability estimate?
Test-retest
What was the first intelligence test by Alfred Binet? What was the purpose?
The Binet-Simon Scale (1905) later by L.M. Terman Stanford-Binet Scales Purpose: identify children in French public schools. Emphasized standardized administration (explicit instructions on how a test should be administered) and a standardization sample (norms compare others to)
The larger a sample the more likely that the test will represent true characteristics True/False
True
What two things are done to fix for low reliability?
Two common approaches are to increase the length of the test and to throw out items that run down the reliability. Another procedure is to estimate what the true correlation would have been if the test did not have a measurement error
What is IRT (inter-response time) recording?
Using IRT the computer is used to focus on the range of item difficulty that helps assess an individuals ability level. The method requires a bank of items that have been systematically evaluated for level of difficulty. Considerable effort must go into test development, and complex computer software is required.
standard error of measurement means
We usually assume that the distribution of random errors will be the same for all people, classical test theory uses the standard deviation of errors as the basic measure of error usually this is called the standard error of measurement
Who studied the interface of our outer world and "us" sensation and perception. Manipulated stimuli (sensory input) and measured individual perception
Weber, Fechner
What is discrimation anaylsis
When the correlation between the performance on a single item and the total test score is low the item is probably measuring something different from the other items on the test. It also might mean that the item is so easy or so hard that people do not differ in their response to it
Test-retest is only when..
When we measure "traits" or characteristics that do not change over time
Who is the father of European Psych? Established 1st dedicated lab at University of Leipzig (1879)
Willhelm Wundt
1st personality test, standardized psychiatric interview
Woodsworth Personal Data Sheet (1920)
Which statement about psychological tests is true: a) they are considered a sample of behavior. b) they are error free. c) they are infrequently used in society d) they are frequently used in academic and forensic settings but not others
a) they are considered a sample of behavior
One difference between aptitude and achievement is
achievement is what one has learned and aptitude measures one's potential for learning.
Spearman-Brown formula
allows a test developer or user to estimate internal consistency reliability from a correlation of two halves of a test. An estimate of reliability based on two-half tests would be deflated because each half would be less reliable than the whole test.
In terms of reliability, the advantage of item response theory is it
assesses a specific ability level more intensely
All are potential ways to increase the reliability of a test EXCEPT: a) use factor analysis to determine the dimensionality of the scale b)obtain a more representative standardization sample c) add items to the test d) identify "bad items" based on item analysis
b) obtain a more representative standardization sample.
Which statement(s) Cronbach's alpha are true: a) It was one of the first methods developed to estimate reliability b) It is an infrequently used method to estimate reliability c) It can be used when they are correct and incorrect answers as well as when items do not have a "correct" response d) It is another way to conduct a parallel forms estimate of reliability.
c) It can be used when they are correct and incorrect answers as well as when items do not have a "correct" response
All are true of factor analysis EXCEPT: a) It is a statistical technique. b) It identifies the underlining or latent (i.e., unobserved) dimensions of a scale. c) It is only used in the construction of personality tests because of standards in other fields . D) All statements are true—there are no exceptions—and thus this is the best answer.
c) It is only used in the construction of personality tests because of standards in other fields
The advantage of the Kuder-Richardson-20 (KR-20) compared to an odd-even split half approach to estimate reliability is the KR-20
calculates all potential split half forms of a test to determine reliability
Cronbach developed a formula that estimates the internal consistency of tests in which the items are not scored as 0 or 1 (right or wrong) In doing so, Cronbach developed a more general reliability estimate which he called ____
coefficient alpha
All of the below answers are a type of standard score that can be related to a percentile score EXCEPT: a) z-score b) (McCall's) t-score c) IQ scores d)There are no exceptions, making this the best answer.
d) There are no exceptions, making this the best answer.
what does a beta weight do in multiple regression?
describes the importance or significance of a predictor.
Some applicants of psychological testing require a ___ which is created by subtracting one test score from another. This might be the difference between performances at two points in time
difference score
The concern regarding how well test items measure the underlying characteristic reflects the concern of
domain sampling
The __ sampling model is another central concept in classical test theory. This model considers the problems created by using a limited number of test items to represent a larger and more complicated construct
domain sampling model
A primary criticism that contributed to the decline in the use of structured personality tests 1930s & 1940s was
given the disagreement in defining and measuring personality, court rulings prohibited the use of such test in academic and employment settings
The ability to benefit from experience, think abstractly, adapt to the environment, and problem solve are characteristics that define
intelligence
When comparing how frequently an interview is used in an assessment to the frequency that tests are used in an assessment, one would conclude that
interviews are almost always used and test are used sometimes.
psychological tests
may assess either overt or covert behavior.
With skewed distributions, which measure of central tendency or typicality is most affected?
mean
Examples of descriptive statistics include
mean, variance, z-score
Historically. testing has been widely used for college admission. Most recently
more schools have dropped the requirement to take a standardized test for admission.
Structured or "objective" personality tests
often involves self-report, which while a strength is also a source of criticism.
If a researcher developed an ordinal scale to measure depression, it would have which scale properties:
only magnitude
Having people respond to ambiguous stimuli (e.g., inkblot) and assuming those responses reflect meaningful aspects of the person is associated with
projective personality testing.
The norms used for a test are important because they
provide a basis to interpret a score
Projective tests assume
responses to ambiguous stimuli reveal aspects of one's personality
We may be concerned about errors that arise because we have selected a small sample of items to represent a larger conceptual domain. To evaluate this type of measurement error, we could use a method that assesses the internal consistency.
split-half method
In ____ a test is given and divided into two halves that are scored separately. The results of one half of the test are then compared with the results of the other. If the test is long the best method is to divide items randomly into two halves
split-half reliability
The most useful index of reliability for the interpretation of individual scores is the___This index is used to create an interval around an observed score. The wider the interval, the lower the reliability of the score
standard error of measurement
By the Han Dynasty (206-220 B.C.E) the use of __ (two or more tests used in conjunction) was quite common. These tests related to such diverse topics as civil law, military affairs, agriculture, revenue, and geography
test batteries
If we are concerned about errors that result from tests being given at different times, than we might consider the ___in which scores obtained at two different points in time or correlated.
test-retest method
Reliability can be viewed as
the amount of error in a test
Sources of error introduced by __ are similar to those with sampling items from a large domain.
time sampling
Norms that chart changes over time, often used by developmental psychologists and pediatricians, are referred to
tracking norms
A scatterplot is an x and y axis plot of participants scores on
two measures that helps identify nonlinear relationships and is way to conceptualize correlational relationships
Two innovations associated with the development of the Minnesota Multiphasic Personality Inventory (MMPI) are
using data-driven approach for item selection instead of a rational approach and the inclusion of scales that detect attempts of misrepresentation (e.g., lying, exaggeration)
What psychometric construct refers to the usefulness of a measure, measuring what is intended?
validity
The meaning or usefulness of a measure, several types of __, reliability sets a limit on __ one can have a reliable test but it may not be __
validity, valid
