Module 7.03
The degree to which different versions of an instrument result in the same or a similar result. Involves comparing the results of 2 different but equivalent versions of a test (version A vs. B) given to the same subjects and if a strong positive correlation is found between the scores on the 2 versions it is alternate forms reliable. Also called equivalent forms reliability. This method eliminates the variable of practice effects.
Alternate Form
The degree to which an assessment accurately measures a given hypothetical or theoretical idea (construct). Examples include personality traits such as shyness or extraversion. Intelligence is also considered to be a theoretical idea or construct. Construct validity may also be used when evaluating skills such as dancing or musical ability. Tip: constructs are ideas that are difficult to define operationally.
Construct
In many parts of the world, people's scores on IQ tests have generally increased over the past few decades. This phenomenon is known as the _______ effect.
Flynn
Sir Francis _________ was the cousin of Charles Darwin. He was the first to apply statistical methods to study intelligence, and the first to use surveys and questionnaires to gather data. He was particularly interested in how genetics and environment played roles in determining human intelligence. He coined the term eugenics and believed that society should encourage couples "of merit" to have children.
Galton
The degree to which the same assessment given by multiple individuals achieves the same results. Involves comparing scores given by 2 different examiners of the same participants. If both examiners give the same participants the same score the testing instrument has inter-rater reliability. This is important in determining if subjective data collected through observation is consistent regardless of who is recording behavior of participants.
Inter-Rater reliability
Pooja has just taken the AP Psychology exam; two psychology instructors grade her exam, each gives her the same grade for the Free-Response portion of her exam. This is an example of what type of reliability?
Inter-rater reliability
The Stanford psychologist Lewis ________ combined the work of Binet, Simon, and Sterns. He adapted the Binet intelligence test to calculate IQ, based on Stern's definition.
Terman
The degree to which the same outcome is achieved on at least two occasions. Comparing the results when the same individuals take the same test 2Xs. One major problem is the variable of practice effects.
Test-Retest
Today, the Stanford-Binet Test is a popular IQ test--even though it was originally designed for children. As an alternative to this test, David _________ designed a series of different tests for different age groups.
Wechsler
Can a test fail in validity but still be reliable.
Yes
Does practical intelligence predict success in life.
Yes
is practical intelligence negatively correlated with success in academics.
Yes
Critics of Garner's theory argue that having so many difference types of intelligence makes it difficult to measure. They also suggest that some of Gardner's "intelligences" are really just different _________, and that they are not what we typically mean by intelligence.
abilities
In 1904, Charles Spearman published his theory that intelligence consisted of two different __________
abilities
Intelligence is a tough term to define, because there are differing opinions of the specific knowledge and abilities that make up this concept. Psychologists define it as the _________ to learn from experience, acquire knowledge, and use resources effectively to adapt to new situations and solve problems.
ability
For example, test ________ must be the same for anyone who takes it. All test subjects must take the test under the same conditions. (This is like how all AP Psychology students have to take the AP exam on the same day, in the same amount of time.)
administration
All Juniors at X High School sat for the ACT in April. Some of the juniors took form E while others took form G or K; all of these versions of the exam were of equal difficulty. Because the average scores nationwide on each version will all very similar, ACT can claim their exams had __________ _________ reliability.
alternate form
Jaclyn has been feeling down for a few weeks. Her psychologist gave her the Beck Depression Inventory and the Schneider Grief Depression Inventory. Both assessments indicated that Jaclyn was in the normal range and was not suffering from a depressive episode. What type of reliability was Jaclyn's therapist utilizing?
alternate form
Ms. Steiger wants to be sure that her students are not tempted to look at their neighbors' papers during an exam; as a result she creates multiple versions of each unit exam all of which have the same level of difficulty. If each of the different versions are equally difficult, what type of reliability is demonstrated on Ms. Steiger's unit exams?
alternate form
Match Sternberg's three types of intelligence: ability to break down problems, analyze, problem solve; measured by intelligence tests and academic achievement tests; "book smarts"
analytical intelligence
Gardner believes there are many different _______ of intelligence. Unlike Spearman, Gardner argued that intelligence in one aspect did not predict intelligence in others.
aspects
Henry, a cognitive psychologist, is trying to measure the factors that make up intelligence. This is a difficult task because intelligence is a hypothetical idea to which many factors can be related. He believes that he has created an exam that captures the essence of Intelligence. If he is successful at measuring this idea, which type of validity could Henry's exam be said to have?
construct
Professor Lazarus is known for giving fair exams in her Algebra course that include only test items for which the students should have been prepared through both reading and attending lectures. Her exams include questions that relate to the learning targets given to the students. These exams can be said to have high _________ validity
content
Reema is at the DMV taking her written driving exam. She has studied hard for the exam, as she wants to be a registered driver. As she takes the exam, she realizes that she knows most of the answers because it has the same type of questions she saw on the practice exam provided to her in advance to study from. In addition, the questions all relate to daily issues one might face driving on the streets of Illinois. Because the questions cover all of the material that it was designed to cover this driver's exam could be said to have _________ validity.
content
The degree to which an assessment accurately measures what it claims to test. Is it a fair and representative measurement of the total breadth of the material it is designed to cover? In content validity, the individuals doing the evaluation are either experts or members of the target population. In either case, content validity requires careful examination of the assessment devise.
content
Match Sternberg's three types of intelligence: ability to solve problems in new ways, handle new information, process information automatically
creative intelligence
An experimental psychologist has created a new test to measure the trait of extraversion and gives the test to 100 participants. These participants also take another personality test that measures extraversion which has been used successfully for 20 years. If the individuals score the same for levels of extraversion on both tests it can be said that the new assessment has __________ validity.
criterion
Mr. Lee wanted to know if he was an extrovert or an introvert. He took a number of scientifically sound personality inventories to provide him with an answer. He took five inventories, and four of the five determined that Mr. Lee was extroverted; the fifth suggested that he was introverted. Which type of validity was lacking in the fifth inventory?
criterion
The degree to which scores on a particular assessment are positively correlated with scores on another preexisting and well-established assessment tool (the criterion) for a particular skill, trait, or ability. Do the scores on the test being considered correlate with another already established test?
criterion
_____________ intelligence accumulates as we age.
crystallized
IQ tests tend to reflect, in language, dialect, and content, the culture of those who design them. This is called _______ ________. While we can attempt to avoid this problem, it might not be entirely possible.
cultural bias
____________ IQ scores assume that IQ is normally distributed around a mean of 100 with a standard deviation of about 15.
deviation
Gardner's Theory; one of the nine different types of intelligence: think about the "big picture," reflect on the nature of existence
existentialist
As Greta skims her midterm physics exam, it does not initially seem to reflect what has occurred in class. As she scans the exam for questions that seem familiar to those which she practiced, none seem to stand out. What type of validity is this exam seemingly missing?
face
The degree to which the material on an assessment appears on the surface (at "face value") to accurately measure what it intends to measure. Face validity may be determined either by a non-expert, or an expert who gives only a quick evaluation of the test. The decision in face validity is either being made by an expert or member of the target population without serious evaluation (someone merely glances at it), or by a non-expert.
face
Cosmo is taking a test to determine his level of creativity and is surprised by the questions because they are mostly about sports. Just looking at the test quickly, Cosmo is skeptical that it will actually measure creativity. Cosmo is questioning the _______ validity of the test. If in fact this test is an accurate measurement of the abstract idea of creativity it would be said to have __________ validity.
face; construct
This measure superficially examines a test for what it is supposed to measure: ______. Whereas this type of validity measures what is actually contained in the exam: ________.
face; content
Spearman is often criticized for oversimplifying intelligence. Many more contemporary theories tend to view intelligence as being composed of numerous ________.
factors
_________ intelligence, our ability to problem solve, learn new skills, and reason abstractly, tends to diminish as we age.
fluid
When he noticed that schoolchildren who scored well in one subject often tended to score well in other, unrelated subjects, as well, Spearman developed the idea that the ability to reason and solve problems should be called ____________ intelligence, or "g factor."
general
Kathy felt a strong pain in her lower back and went to see her physician; she was given a full physical and was told that it was attributed to her lifting too much in her role as a child care provider. Kathy had worked for years in this profession without a problem and went to get a second opinion, after another full physical, she was told the same thing by a second physician; these physicians have high __________ reliability.
inter-rater
Saffron was diagnosed by her psychologist as having a rare mental illness known as dissociative identity disorder. The diagnosis was made based on the criteria in the diagnostic guide used by medical professionals (the DSM-V). Saffron then seeks a second opinion and another psychiatrist who also uses the DSM-V gives her the same diagnosis. Based on this information Saffron can conclude that the DSM-IV-TR has ________ reliability.
inter-rater
Gardner's Theory; one of the nine different types of intelligence: sensitivity to others and their motivations
interpersonal
Gardner's Theory; one of the nine different types of intelligence: understanding of one's own emotions and motivations
intrapersonal
Gardner's Theory; one of the nine different types of intelligence: think logically, solve mathematical problems
logical/mathematical
On a normal curve, the most frequent score is the _______, or average.
mean
Along with his colleague Theodore Simon, Alfred Binet came up with a test for children that determined ________ age, or the age at which children could successfully answer a particular level of questions.
mental
Gardner's Theory; one of the nine different types of intelligence: control one's own body
movement/bodily-kinesthetic
Over the 1990s, Howard Gardner developed his notion of __________ intelligences.
multiple
Gardner's Theory; one of the nine different types of intelligence: compose, read, perform music
musical
Gardner's Theory; one of the nine different types of intelligence: recognize patterns found in nature
naturalist
Stern's IQ was helpful, in that it allowed researchers to compare the intelligence levels of children of different ages, but it was less informative about adults. Modern intelligence tests used age-group comparison ___________ instead.
norm
The standardization group's scores would produce ________, the standards against which all others who take the test would be compared.
norm
Most intelligence tests follow a _________ curve.
normal
Wechsler's domain: arranging patterns, completing series, visual puzzles
perceptual reasoning
Match Sternberg's three types of intelligence: ability to use information in everyday life, be tactful, manipulate situations, apply outside knowledge to one's benefit; "street smarts"
practical intelligence
Emily took the ACT exam. Her score was very high, indicating that she was very likely to succeed in college. She was accepted to a good college but flunked out after her first semester. What type of validity was faulty on her ACT?
predictive
High school grades seem to have a close association to college grades. It could be stated that high school grades have high ___________ validity for college GPA.
predictive
If a strong positive correlation is found between high scores on a particular IQ test and college graduation the IQ test is said to have high __________ validity.
predictive
If one wanted to assess her future success as an aeronautical engineer, she could take an exam to compare her score to those who are already in the field. This type of assessment would be measuring _________ validity.
predictive
The degree to which a particular assessment forecasts or anticipates (predicts) success on some future measure.
predictive
Spearman believed that superiority in one type of intelligence ________ superiority overall.
predicts
Wechser's adult IQ test, the WAIS-IV, uses both verbal and nonverbal items organized across four domains: verbal comprehension, perceptual reasoning, working memory, and _______ speed.
processing
Wechsler's domain: scan for symbols, learn new symbols
processing speed
In 1912, William Stern expanded on Binet and Simon's work by dividing the mental age by the chronological age, then multiplying by 100. He called the resulting score an intelligence ___________ (IQ).
quotient
The scores of a standardized test must also be compared against a large, representative sample group's. As you might expect, this sample group must be ___________ selected.
randomly
Janice read an article online about a test that determined intelligence by measuring the size and shape of an individual's skull which it claims to achieve consistent results. Because she has taken psychology Janice states that although the test may have ____________ (reliability or validity), it lacks ___________ (reliability or validity).
reliability; validity
A good IQ test must be ________, meaning it should produce consistent results each time it is administered to the same individual or group of people.
reliable
The first intelligence tests were used to identify students who might need extra help in school, so that they could be given __________ education.
remedial
Spearman labeled more task-oriented abilities--such as for business, art, or music-- ___________ intelligence, or "s factor."
specific
A measure of consistency, which compares the results of the half of a test with the results of the other half of the test to be sure that the assessment device has internal consistency. This involves comparing scores on one ½ of the test to the scores on the other ½ of the test OR comparing the scores on odd vs. even questions. involves giving the test only one time.
split-half
Dr. Alfonzo is examining the data from a new test she created for measuring the capacity of episodic memory and finds that participants were 86% accurate on odd numbered questions, but only 14% accurate on even numbered questions. The data suggest that Dr. Alfonzo's test lacks ____________ reliability.
split-half
Lucy took a test to become a police officer in Washington, D.C. The test assessed the skills necessary to be a competent police officer in a city with a very high crime rate (as specified by the American Police Association). When she was shown the results, she noticed that she did very well on the second half of the exam but extremely poorly on the first half. If this were true for many applicants, this test might lack ______________ reliability.
split-half
One important consideration in designing an intelligence test is __________. This ensures that the test is the same for a large group of individuals.
standardization
Joe took a test to become an aerobics instructor at the local gym. He did poorly on the exam and was not accepted as an instructor. Six months later he took the same test again. This time he did very well and became a successful aerobics instructor. Assuming that Joe did not practice or train for the second test he might question the ___________ reliability of the exam. If this test does not actually measure the hypothetical ideas involved in aerobics instruction, it could be said to lack ________ validity
test-retest; construct
According to Robert Sternberg's _________ theory of intelligence, there are three kinds of intelligence.
triarchic
A good IQ test must also be _________, meaning the scores that it yields must accurately reflect intelligence in real-life situations.
valid
Wechsler's domain: vocabulary, similarities between objects
verbal comprehension
Gardner's Theory; one of the nine different types of intelligence: use and learn language
verbal/linguistic
Gardner's Theory; one of the nine different types of intelligence: understand how objects are oriented in space
visual/spatial
Wechsler's domain: recall a digit span, arithmetic
working memory
Are IQ test generally valid for predicting academic success and job performance and not for predicting those who score in the average range?
yes
Is the effect of high IQ scores on academic and job success relatively small?
yes