EXER-432 Research Methods Midterm

Validity is determined by finding the correlation between scores on

a test and some independent criterion

Comparing test items with the course objectives (course topics) checks which type of validity?

content

A researcher finds a correlation of .70 between popularity ratings and self-concept scores. What percentage of common association can be inferred between the two variables?

49%

The part of the methods section of the research paper that describes the activities of each treatment group is titled

Procedures

When a researcher decides that an appropriate analysis for a research model is to evaluate how several variables might influence two other variables that in turn influence the outcome variable of interest, the appropriate statistical analysis is

Structural Equation Modeling

Which of these statements is/are true concerning the "significance of the study" section in the introduction of a thesis?

The section should have continuity with the introduction. The section should point out conflicts with previous research. The section should describe gaps in previous knowledge relative to the study. ****All of the above****

In describing participants in the methods section of a research report, which of the following should be included?

a and c (number of participants and pertinent descriptive characteristics of participants)

A researcher conducts a study on the effectiveness of computer-assisted instruction (CAI) by comparing classes that use this method with classes that do not. The researcher expects the CAI classes to show higher gains in achievement. This expectation is

a hypothesis

A null hypothesis is

a statistical hypothesis that assumes that there is no difference among the effects of treatments

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The independent variable is

adventure summer camp

The use of intraclass correlation to estimate reliability in motor performance instead of Pearson r has the advantage(s) of

allowing analysis of trial-to-trial change estimating reliability for more than two trials

To determine which of two methods for learning a motor skill is more effective, the correct statistical analysis is

an independent t test

References to journal articles should include

author, date, article title, journal name, volume, inclusive pages, doi

References to books should include

author, date, title, city of publication, publisher's name

Which of the following is a technique for providing information about the reliability of an instrument?

coefficient alpha

When we say that research is empirical, we mean that the researcher

collects data on which to base decisions solves the problems through rationalization controls all extraneous variables

A physical education teacher develops a skill test in volleyball. After administering the test to 50 students, she asks the volleyball coach to rate the students on volleyball skills. She then correlates the students' test scores with the coach's rating. This is an example of what type of validity?

criterion validity

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The number of participants, the selection of the self-concept inventory, and the length of the study are all examples of

delimitations

The generalizability of the results pertains to what kind of validity?

external

A correlational technique frequently used in the construction of an instrument (such as an attitude inventory) that statistically groups test items that seem to be measuring a particular dimension or trait is called

factor analysis

Which of the following is not an important purpose for reviewing the literature?

formulating the null hypothesis

In discriminant function analysis, one is able to predict

group membership

The extent to which the results of a study can be attributed to the treatments used in the study is the definition of what kind of validity?

internal

A teacher wishes to determine the reliability of three trials on a performance test. He uses ANOVA to obtain the reliability coefficient. This technique is called

intraclass correlation

A research hypothesis

is directly testable

The property of a distribution of scores that relates to how peaked or flat the curve is called

kurtosis

Recognizing that grade point average may not completely reflect success in school is an example of a

limitation

If two measures have a high positive correlation, and a person has a low score on one measure, her score on the other measure is most likely to be

low

Discriminant analysis differs from simple ANOVA such that discriminant analysis has

one independent variable and two or more dependent variables

Defining volleyball skill as a score on the AAHPERD Volleyball Test is a(n):

operational definition

The term that denotes using ideas, writings, or drawings of others as your own is

plagiarism

In which part of the methods section should you expect to find information about when the participants were tested?

procedures

To calculate L for a correlation of two sets of ranked scores, the degrees of freedom (N - 1) are multiplied by

r square

A researcher predicts that there will be a positive relationship between attitude scores and grade point average. This is an example of a

research hypothesis

The researcher's statement that "the boys in the adventure program will make significantly greater gains in self-concept than the boys in the control group" is an example of a(n)

research hypothesis

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The dependent variable is

self-concept

After receiving approval from the university committee on the use of humans as research participants (Institutional Review Board), the researcher

should include a description of this compliance in the methods section of the thesis or dissertation.

The term that describes the position of the hump in the curve of a distribution is

skewness

Which of the following terms least belongs with the others?

standard deviation

At the end of a well-written introduction, the reader should be able to predict the

statement of the problem (purpose of study)

With regard to capitalization only in APA style, which of these references is/are correct?

(Book) Plagenhoef, S. C. Patterns of human motion (Journal) Cassell, J. Ethical patterns in fieldwork. American Educational Research Journal

In an item analysis, 14 of the 20 high-ability students answered an item correctly, whereas only 8 of the 20 low-ability students did. What is the discrimination index for this item?

.30

The maximum value of item discrimination in norm-referenced test items occurs when the item difficulty is

.50

For a predicted score of 30 and a standard error of estimate of 6, the chances are 95 out of 100 that the true score will be between

18 and 42

A researcher wishes to know whether there is a significant difference in the number of knee injuries reported among four sports. How many degrees of freedom are there for this chi-square analysis?

3

The researcher obtained a significant F from the ANOVA. Omega squared was found to be .30. This is interpreted to mean that

30% of the total variance is accounted for by the treatments

What is the median score for the following set of numbers? (3, 11, 8, 13, 5, 3, 6)

6

Which of the following is information that should be found in the section on design and analysis of the data?

An ANOVA was used to compare the three groups.

The primary sources of a literature review are

Research journal articles

A predictive validity technique involving the construction of a two-way grid of percentages of students at different levels of an aptitude test who achieved different grades is called

an expectancy table

When the purpose of the research is to evaluate the effects of an independent variable on a dependent variable while controlling the influence of another characteristic, the best choice of a statistical analysis is

analysis of covariance

Another term for the mean is the

average

The premise that the scores from the Minnesota Attitude Inventory are a valid measure of attitude toward school is an example of a

basic assumption

The single score that best represents all the scores in a distribution is the definition of

central tendency

The accuracy with which a 12-min run estimates maximal oxygen consumption in a group of male high school seniors represents

concurrent validity

A study that has one independent variable with three levels and three dependent variables should be analyzed by

discriminant analysis

A measure of meaningfulness that expresses the difference between the experimental and control group in standard deviation units is the

effect size

A researcher decides to use an alpha of .01 and a power of .80. To determine the needed sample size the researcher must ascertain the expected

effect size

An important principle set forth by the American Psychological Association is the right of informed consent, which states that the researcher is obligated to

explain the major features of the study to the participants before the beginning of the study so that they have the opportunity to decline to take part

A threat to the validity of rating scales is that the rater may tend to let her previous knowledge of the student in another capacity (e.g., another course) influence the rating. This threat is called the

halo effect

When a tester divides the number of students who answered a test item correctly by the number of students who attempted the item, the result is called

index of difficultly

For confidentiality, the researcher should

make certain no unauthorized individuals have access to the research data inform the participants about the people who will have access to the data remove names from data-collection instruments and replace them with a code ****all of the above****

The term coined by Kuhn to denote the scientific approach that is used widely in the natural sciences is

normal science

In multiple regression, one is able to predict

one criterion from two or more predictors

If a thermometer measured the temperature in an oven as 400° five days in a row when the temperature was actually 337°, this measuring instrument would be considered

reliable but not valid

The standard deviation represents the

spread of scores about the mean

Another term that describes the unscientific method of tenacity is

superstition

Four skills tests are tried as predictors of success in a tennis class. Each test correlates with later success as follows: test A, r = .27; test B, r = -.90; test C, r = -.40; test D, r = .65. The test that will most accurately predict success is

test B

In logistic regression, one is able to predict

the probability of an occurrence

When a researcher states that a result is significant, this means that

the result is unlikely to be a chance occurrence

Which of the following statements would appear in the procedures part of the methods section of a research report?

Participants in the experimental group exercised three days per week for 30 minutes per day for 10 weeks.

A report of a research study submitted for a four-chapter thesis and the same study prepared for a journal differ with respect to the length of the

a and b (introduction and review of the literature and description of the methods)

Reliability of a measure may be established by

giving the test to the same people on two different occasions and correlating the two sets of scores correlating scores from alternate forms of the same test

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The researcher states that self-concept is represented by scores on the Tennessee Self Concept Scale. This is an example of a(n)

operational definition

After a population of 1,000 high school seniors is divided by sex and size of school attended, the random selection of a sample to represent these proportions of the population is called

stratified random sampling

The t test is used to

test whether two groups differ significantly

According to the American Psychological Association, when a graduate student submits her thesis or dissertation for publication jointly with the major professor, the first author should be

the student

Use of a one-tailed versus a two-tailed test of significance of the difference between two sample means depends on

whether the difference is expected to be in one direction only

In a study designed to assess the comparative effectiveness of two workbooks used in teaching students about laboratory procedures, the independent variable of the study would be

workbooks

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The researcher is proceeding on the belief that self-concept can be changed in a summer (three months). This is an example of a(n)

basic assumption

Of the following, which is a nonparametric statistical test?

contingency coefficient

Prediction studies use which of the following as the basic analysis technique?

correlation

A good beginning point in a literature search for the student with a very limited knowledge about a topic is

encyclopedias, textbooks, and literature reviews

A correlation of .00 between two variables indicates

independence (no association) between the variables

When a researcher claims that there is a difference between treatments (i.e., rejects the null hypothesis) when there really is no difference, what type of error is this?

type I error

If the researcher fails to reject the null hypothesis when there really is a difference, this is an example of a

type II error

Three levels of a treatment variable were evaluated for males and females on three dependent variables. A significant F is reported for the interaction of treatment and gender on a linear composite of the three dependent variables. Which statistical analysis was used?

MANOVA

The type of scale that uses items such as "Worthless-Valuable" is called a

semantic differential scale

In the instruments part of the methods section, the author should include a description of the

test characteristics of validity and reliability

A researcher sought to find out which of two exercises was more effective in building endurance. One group used exercise A, and another group used exercise B. At the end of study, the researcher should compare the two groups' scores by

an independent t test

Compared to applied research, basic research

usually offers more control, such as that done in a laboratory questions cannot be easily answered

If ANOVA has found a significant difference among four treatment groups, a follow-up test such as the Scheffé is needed to determine

which of the groups differ significantly from the others

For a group of normally distributed scores with a mean of 30 and a standard deviation of 6, the middle 68% of the scores will be between

24 and 36

A main disadvantage of nonparametric techniques that has frequently been stated (although there is some disagreement with this claim) is that they

are not as powerful (less likely to detect a false null hypothesis) as parametric techniques

A chi-square analysis compares the responses to a question on recreational preferences of males and females at three grade levels. The resulting two-way classification structure is called a

contingency table

To determine whether data are normally distributed, one can test to see whether the curve is shifted to the left or right. This shift is called

skewness

The inductive and deductive processes are important in

the statement of the problem

an operational definition of human intelligence is

those characteristics that are measured by the Wechsler Intelligence Scale for Children

A two-way (factorial) ANOVA with more than one person per cell will yield F values for which of following contrasts?

three F values, one each for rows, columns, and interaction

Which of the following is not a common error in the review of literature sections of theses?

synthesizing and interpreting the findings of previous research

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The categorical variable is

age level

A researcher wishes to survey student opinions on a proposed increase in fees at her university. She decides to select a sample for telephone interviewing by selecting every 20th name in the student directory. What is this type of sampling called?

systematic

The author of a test of anxiety proceeds on the premise, based on the literature, that the performance of people with high anxiety suffers when they are under stress. In an experiment, the author finds that people who scored as highly anxious on the test performed more poorly on a stressful task. The test author maintained that this finding was evidence of what kind of validity?

construct

Data such as sex, city of residence, or political party affiliation are what kind of measure?

nominal

A study involves the comparison of two instructional methods on achievement in math. Two classrooms are used; one method is administered in each classroom. The researcher notices that the pretest scores show differences between the two groups. To control for the influence of the pretest scores on the posttest scores, the researcher should use

ANCOVA

A researcher wishes to determine whether a treatment group made a significant improvement from the pretest (M = 25) to the posttest (M = 30). The correct statistical test to use to compare the two means is the

dependent t test

The determining factor in the order of authorship of a research publication is that the first author is the person who

develops the idea and plans the research

A thesis was submitted with the title "A study comparing the achievement of sixth-grade students in Moscow, Idaho, instructed in health education through closed-circuit television and regular classroom procedure for a period of 16 weeks." This title

is too long

A researcher used a t test to compare treatments and obtained a t of 3.45. One group had 48 participants, and the other group had 40. The table value for significance at the .01 level was 2.64. Which of the following is the correct way to express these results?

t(86) = 3.45, p < .01

Which one of the following statements about dual publication is not true?

Dual publication is permissible if the two journals are in different languages (e.g., published in different countries).

Which hypothesis is stated in the null form?

There is no difference between the vocabulary scores of average- and high-ability students.

The introduction to a research report should

move from a general description of the theoretical problem to the specific area to be studied

If there is a correlation of .80 between a test of scholastic aptitude and performance on an achievement test, one can infer that

no causation can be inferred

In evaluating the methods section of a research report, which is a very important question to keep in mind?

Did the author provide enough information that the study could be repeated?

For scores from a test to have good content validity, the following statement(s) must be true:

The test adequately samples what was covered in the course. The percentage of points for each topic area reflects the amount of emphasis given that topic.

Three levels of a treatment variable were evaluated for males and females on three dependent variables. A significant F is reported for the interaction of treatment and gender on a linear composite of the three dependent variables. Which statistical analysis was used?

discriminant analysis

The only type of research that can manipulate treatments and establish a cause and effect is

experimental research

It is desirable to carry out a pilot study prior to the actual research study because

it permits a thorough check of the planned data collection and analysis procedures

This question pertains to the following study: "A researcher wishes to determine the effects of an outdoor adventure summer camp on the self-concept of inner-city boys. Boys are randomly assigned to the summer camp and to a control situation. The experimental treatment is for three months. A secondary purpose is to see if age (ages 6, 9, and 12) affects the relationship of the camp effects and self-concept." The researcher states that he is aware that responses to questions on a self-concept scale may not always be what the person really believes. This is an example of a(n)

limitation