Quiz 1

Wilhelm Wundt (1831-1920)

"Father of Experimental Psychology" •1st psych lab!!!! - Univ. of Liepzig •Brought a mathematical & experimental approach to psychology - Big into testing to better understand human abilities Something that came out was the need for standardization •What were they testing? •"What is normal?" •Largely concerned with sensitivity to various stimuli (sensory discrimination). •Developments: •Understanding of the need for experimental control (standardization). •Mathematical & statistical procedures. • • •Students included: J.M. Cattell, G. Stanley Hall, Charles Hubbard Judd, Walter Dill Scott, E.B. Titchener, Lightner Witmer, and Charles Spearman

Define Trait

"any distinguishable, relatively enduring way in which one individual varies from another Traits cannot directly be testes but instead observed

Sir Francis Galton (1822-1911)

("Sir" means important) - Trained as a biologist: Interested in human variation & heredity. - Coined the phrase "nature v. nurture". - Interested in sensory discrimination: - Theorized that keen perception = keen intellect. - Gathered large amounts of data from educational institutions in Europe during 1880's. -Early use of rating scales, free association, and questionnaires. - Introduced statistical concepts of correlation, standard deviation, and regression toward the mean.

Interviewing is a method of?

- gathering info through direct communication involving reciprocal exchange. Interviews vary as to their purpose, length and nature The quality of information obtained in an interview often depends on the skills of the interviewer (e.g. their pacing, rapport, and their ability to convey genuineness, empathy, and humor). Interviewing is a skill!

Define Error variance

- the component of a test score attributable to sources other than the trait or ability measured.

Binet-Simon in U.S.

-1908 - H.H. Goddard (1866-1957) revises and translates Binet-Simon scale. -Becomes accepted mental test by U.S. medical profession. -Goddard wrote: The Kallikak Family: A Study in the Heridity of Feeble-Mindedness (mostly known for this book) -1916 - Lewis Terman (1877-1956) developed first Stanford-Binet. -IQ = mental age / chronological age. -More sophisticated psychometrically. Renorms it with american kids in the U.S.

David Wechsler (1896-1981)

-Born to a Jewish family in Romania. Immigrated to US as a child. -Studied at Columbia University under Robert Woodworth. -Worked with Woodworth on ways to screen new draftees for the US Army during WWI. -Became chief psychologist at Bellevue Psychiatric Hospital in 1932. -There, he developed Wechsler Adult Intelligence Scale (1939), from which he derived the Wechsler Intelligence Scale for Children (1949). Widely used test!

James M. Cattell (1860-1944)

-Department head of Psych, Anthropology, & Philosophy at Columbia University -First to describe "mental tests" -Tests included muscular strength, reaction time, speed, sensory discrimination, sensitivity to pain, and memory. -Means to gauge intellectual level. -Tests easy to quantify and measure with precision. Well? -Poor reliability and poor correlations with actual performance.

1895- vBinet & Henri publish a paper criticizing the mental tests. Because?

-Poor predictive validity. -Too largely sensory -Precision is not as essential in measuring more complex functions.

Advantages of Internet testing

1)Greater access to potential test-users. 2)Scoring and interpretation tends to be quicker. 3)Costs tend to be lower. 4)Facilitates testing otherwise isolated populations and people with disabilities.

Identify the 4 steps in General Problem-Solving Model

1.Identifying a Problem (this step can be easy to skip over, because we want to fix the problem right away and might skip first 2 steps) we need to know what we are actually going to work on (needs to be specific) 2.Analyzing a Problem (asking why is this a problem? ) 3.Implementing an Intervention (evidence based intervention) 4.Evaluating an Intervention - can be relevant to any problem/ situation - early 90s - good way in seeing if what we are doing is working

List some different types of tests

ACT, GRE, common school tests

Other Tools of Psychological Assessment

Case History Data The Portfolio Behavioral Observations Role-Play Tests Computers

Assumptions about Psychological Testing #5 Tests Have Strengths and Weaknesses

Competent test users understand and appreciate the limitations of the tests they use as well as how those limitations might be compensated for by data from other sources. Will be able to design specific tests for the best results which is answering your question

Issues from Army Alpha & Beta:

Data from Army Alpha & Beta: -Avg. mental age = 13 (18and up were drafted, average age being 20) -Scores higher for descendants of Western and Northern Europe . Lower for descendants of Eastern and Southern Europe. Lowest for Blacks. -Results (mis)guided U.S. immigration policy for years to come. -Tests would be critiqued later for cultural bias. 1920s - Western world becomes test crazy!! (testing was seen as a huge way to benefit society)

Assumptions about Psychological Testing #6 Multiple Sources of Info Should Be Included in the Assessment Process

Don't base a big decision on the results of a single measure

Dynamic Assessment

Dynamic assessment is typically employed in educational settings but also may be used in correctional, corporate, neuropsychological, clinical, and other settings. Helps students not to fall behind Evaluation --> Intervention ---> Evaluation We do not just test one time but instead multiple times

The first systematic tests were developed in?

East China as early as 2200 BC as a means of selecting people for government jobs -Individuals passing the tests were entitled to a number of privileges, which varied depending on the current dynasty. The Ancient Egyptian and Greco-Roman cultures also had specific ideas relating to mental health and personality but no formal means of psychological assessment.

Assumptions about Psychological Testing #3 Various Sources of Error are Part of Assessment

Error refers to a long-standing assumption that factors other than what a test attempts to measure will influence performance on the test. Error variance - the component of a test score attributable to sources other than the trait or ability measured.

Assumptions about Psychological Testing #8 Assessment Helps Us Make Better Decisions

Much criticism has been levied against tests. But on what other basis should decisions be made?

Assumptions about Psychological Testing #4 There are Different Ways to Measure Any Given Construct...

Multiple approaches exist and sometimes using multiple methods gives us a better picture than any single method

Assumptions about Psychological Testing #9 Assessments can be Conducted in a Fair Manner

Problems arise if the test is used with people for whom it was not intended. Some problems are more political than psychometric in nature. Example: giving am English test to someone does not speak English

Generally assessment starts by a _______?

Referral question Typically from a teacher, parent/guardian

Assumptions about Psychological Testing #7 Test-Related Behavior Predicts Non-Test-Related Behavior

Responses on tests are thought to predict real-world behavior. The obtained sample of behavior is expected to predict future behavior

What does RIOT stand for?

Review (see what we know, what data we have) Interview Observe Test Tests is not the only thing just one part!

Test is a?

Sample of behavior, because no way to measure a trait directly Behavior can be measured but not a trait Diagnostic or predictive value... assumes correlation between test performance and "real life" performance

Where to go for info on a test?

Test catalogues Test manuals Reference volumes Journal articles Online databases - The American Psychological Association (APA) has a number of databases including PsycINFO, ClinPSYC, PsycARTICLES, and PsycSCAN. •

Define Assessment

The gathering and integration of psychology-related data for the purpose of making a psychological evaluation through tools such as tests, interviews, case studies, behavioral observation, and other methods

Whose job is testing?

The test developer - tests are created for research studies, publication (as commercially available instruments), or as modifications of existing tests. (APA estimates that up to 20,000 new psych tests are developed each year.) •The Standards for Educational and Psychological Testing covers issues related to test construction and evaluation, test administration and use, special applications of tests and considerations for linguistic minorities. The test user - Tests are used by a wide range of professionals •The Standards contains guidelines for who should be administering psychological tests but many countries have no ethical or legal guidelines for test use The test-taker - Anyone who is the subject of an assessment or evaluation is a test-taker. •Test-takers may differ on a number of variables at the time of testing (e.g. test anxiety, emotional distress, physical discomfort, alertness, etc.) Society at large - Test developers create tests to meet the needs of an evolving society. •Laws and court decisions may play a major role in test development, administration, and interpretation. Other parties - Organizations, companies, and governmental agencies sponsor the development of tests. •Companies may offer test scoring and interpretation. •Researchers may review tests and evaluate their psychometric soundness.

Assumptions about Psychological Testing #10 Testing and Assessment Benefit Society

There is a great need for good tests, considering the many areas of our lives that they benefit. When done fairly!

Assumptions about Psychological Testing #1 Psychological constructs are?

Traits and states We are all different We can't see, hear, or touch constructs, but we can infer their existence from overt behavior

Assessment needs to start with _________?

a question and use assessment to find answer. Needs a higher level of experience to do assessments correctly. Also they do not all look the same!

Define States

also distinguish one person from another but are relatively less enduring States can be measured

Standardized meaning?

making sure all have the same, time, length Typically a normed test (compared to others)

Traits and States Can Be Quantified and Measured such as ?

reading, personality there are different ways to measure these

Define Error

refers to a long-standing assumption that factors other than what a test attempts to measure will influence performance on the test Every test score has a level of error (always keep this in mind)

The difference between testing and assessments?

testing is a tool of assessment

Define testing

the process of measuring by a mean of device or procedures designed to obtain a sample of behavior

Confirmation Biases

thinking some are better then others

Define maragtosity?

those that were given permission based on marriage. Those with marriage potential, intelligence

Assumptions about Psychological Testing #2 Traits and States Can Be Quantified and Measured

•"If a thing exists, it exists in some amount. If it exists in some amount, it can be measured." •Different test developers may define and measure constructs in different ways. •Once a construct is defined, test developers turn to item content and item weighting. A scoring system and a way to interpret results need to be devised

Alfred Binet

•1899 - joins "Free Society for the Psychological Study of the Child" (interests) •Appointed to "Commission of the Retarded" •1903 - publishes Experimental Studies of Intelligence •1904 - appointed by Ministry of Public Instruction.

Group Testing

•1917 - US enters WWI (with immediate drafts). We need to rapidly classify and assign recruits. •APA volunteers to help! •Robert Yerkes, president of the APA begins development of 2 group-administered tests: •Army Alpha - verbal test for English-speakers •Army Beta - non-language test •Seeking a measure of "native intellectual ability" (looking for what you were born with) Group administered testing Army Alpha -Written test for literate recruits -8 parts, including: sentence completion, analogies, and missing number (* not decided in blood line anymore) Alpha Beta -Pictorial test for those who were illiterate or failed the Alpha -7 parts: picture completion, number work, etc. Both served as models for future group tests -Based on earlier work of Arthur S. Otis -Multiple choice for quick, objective scoring (making it more efficient when scoring ) To be able to score quickly and move people to assigned spots.

How to evaluate a test? How do we know if a test is a "good" test?

•Assess the value of each of the above. •Note alignment with the Standards for Educational & Psych Testing. •Test manuals (should say why it works) •Educational or Psychology journals •BUROS Mental Measurement Yearbooks •Is the test appropriate for the individual? (or can something else be done) •Is the behavior worth testing?

Binet-Simon Scale (history)

•Binet & his research assistant (Simon) begin work on their mental scale. •1905 Binet-Simon scale: 1st prototype •30 problems - ascending order of difficulty (easy-hard) •Sensory as well as verbal comprehension and reasoning •No precise and objective scoring method. (no clear scoring) •1908 Binet-Simon scale (2nd version) (big step up) •Problems were refined and # increased. •Normed on 300 children ages 3-13. •Problems grouped into age levels •80-90% of that age group could correctly solve. •Score expressed as mental level or mental age. Common question 1) follow match (easier question) to describe differences between elbow and knee (harder question) As well as short-term and long term memory •1911 Binet-Simon scale (updated version) •Further revised, but unfinished •Normed up to adult level. •Year of Binet's death. •Binet tests became widely translated and publicized. •Helped to popularize intelligence testing. •

Purpose of testing in history?

•Binet? Wechsler? (identifying who should be in) •Goddard? Galton? Terman? •"Eugenics" •Stanford-Binet manual: •Intelligence testing will ultimately result in "curtailing the reproduction of feeble-mindedness and in the elimination of an enormous amount of crime, pauperism, and industrial inefficiency (p.7)".

Test Variables

•Content •Format (computer, time limits, paper) •Administration procedures (individual, whole class) •Scoring procedures •Interpretation procedures

Roots of Psych Testing

•Modern academic discipline in mid-1800s. •Emerged from both philosophy & physiology •Sought to understand human abilities •"How are we the same?" (started of trying to figure with testing) •What is "normal"? Modernity: 1800---> ww1-ww2 - Believed science would be our solution! Post modernity: lived experiences valued more over data

Hermann Ebbinghaus (1850-1909)

•Pioneered experimental testing of memory. (best known for) •Described the "learning curve" and "forgetting curve". •Also tested math calculation, memory span, and sentence completion. •Of these, sentence completion seemed to correlate best with achievement. Ex: When it is cold outside I wear a _______

What are some problems with interviewing?

•Reliability/validity •Often so flexible that there is a lack of comparability across interviews. •Inter-interviewer differences (even with same people). •May fail to elicit important information. •May fail to interpret information accurately. •Interviewees may provide inaccurate information. not 2 interviews are the same Biases, people will only share what they want to share •Interviewees may be limited in language abilities. •Interviewees may feel threatened, inadequate, etc. and not respond accurately or adequately. •Interviewees may be susceptible to subtle unintended cues for the interviewer that may influence their replies. •Personal biases may impact everything. •Variables that may affect the accuracy of the information obtained in an interview: •Lack of trust •Role conflicts •Poor communication •Misunderstanding regarding motives •

Using computers as tools

•Scoring may be done on-site (local processing) or at a central location (central processing). •Reports may come in the form of a simple scoring report, extended scoring report, interpretive report, consultative report, or integrative report. -Computer Assisted Psychological Assessment (CAPA) and Computer Adaptive Testing (CAT) have allowed for tailor-made tests with built-in scoring and interpretive capabilities

The process of assessment some steps:

•Selection of appropriate tools to address the question. •Determination of assessment roles. •Formal assessment. •Integration and interpretation of results. •Report writing. •Presentation of results.

What are Semi-structured Interviews?

•Standard format that allows for some flexibility •Format provides a framework or guide that the interviewer can follow •Interviewer must be well trained! Examples of Semi-Structured Interviews include: •Schedule for Affective Disorders and Schizophrenia (K-SADS) •Teacher Interview Form for Academic Problems •The Instructional Environment Systems-II •BASC Structured Developmental History •

What are Unstructured Interviews?

•The interviewer "goes with the flow" •Not structured at all •Often, more psychodynamic approach •Very flexible •Can tailor the interview to each situation •Obvious psychometric problems

What are structured Interviews?

•Uses a standardized form and follows standardized procedures •Typically used to obtain DSM Diagnosis •Reliability and Validity usually high •Minimizes interviewer biases •Examples of Structured Interviews: Scales of Independent Behavior - Revised Diagnostic Interview for Children and Adolescents - Revised Diagnostic Interview Schedule for Children

Define Psychometrics

•the science of psychological measurement. •Tests vary in the ways and degree to which the demonstrate psychometric soundness or technical adequacy. •A test may be said to demonstrate psychometric soundness if it is shown to consistently and accurately measure what it purports to measure.