Research Quiz 5

Sarah has compiled a list of 40 indicators of prejudice and its dimensions. She finds that women are more prejudiced than men on some of the indicators but not on others. Sarah should

Check to see if the two sets of indicators represent different dimensions of prejudice. The process is called conceptualization through which researchers give definite meaning to a concept by specifying one or multiple indicators in mind. People may disagree about certain aspect of the concept in the process. If there are systematic differences in the understanding, in this case, bewteen men and women, then researchers should consider whether there is more than one dimension to the concept. A complete concepturalization includes both specifying dimensions and identifying the varous indicators for each.

Matthew wanted to be particularly careful to represent all levels of feelings about how ethical members of Congress are. So, instead of just asking how much respondents agreed with a statement that "Members of Congress are ethical," he instead asked for responses ranging from "Members are completely unethical" to "Members are always very ethical." Matthew was responding to which operationalization choice?

Range of variation The answer is NOT level of measurement. The four levels of measurement are nominal, ordinal, interval, and ratio. Since this is an opinion survey, the answer has to be ordinal. This is predetermined by the nature of opinion surveys. You want to ensure that there is a proper range of variation. In this case, some people might not have paid any attention to the question whether Members of Congress are ethical or not. If this is the case, the range of variation could be even larger by including "No knowledge."

In social science research, the process of coming to an agreement about what terms mean is:

Conceptualization

Reliability assessment is a matter of checking for __________, while validity assessment is a matter of checking for __________.

Consistency; accuracy

Bart wanted to validate his measure of driver awareness. He did so by checking with the Utah Department of Motor Vehicles a few years after giving his measure to young teens to see how many tickets they had received. Which type of validity does this example reflect?

Criterion

Reliability ensures validity.

False

Whenever you are not sure how much detail to pursue in a measurement, it is better to go for the simpler measure than the more detailed one.

False

Precision and accuracy are basically the same.

False Accuracy is the proximity of measurement results to the true value. In contrast, precision is the repeatability or reproducibility of the measurement. Therefore, these two terms are not the same.

In the article "Inclusion of Immigrant Status in Smoking Prevalence...", the unit of analysis is the same as the unit of observation.

False The unit of observation is the unit upon which one collects or analyzes data, while the unit of analysis is the major entity that is being analyzed in the study. This study uses data collected at the individual level and applies the result at the group level. Racial/ethnic and immigrant group is the unit of analysis, while the unit of observation in this case is individuals. Therefore, the answer is false.

In the article "Study suggests link between pesticides, autism", researchers treated pesticide usage as a ratio variable.

False The variable is coded as whether a pregnant woman lived within 547 yards of fields sprayed with organochlorine pesticides during their first trimester of pregnancy. Therefore, it is a nominal variable.

It is impossible to have several indicators of only one concept.

False There are often multiple aspects to one concept. Therefore, it is possible to have several indicators. For example, when you do not feel well and go to see a doctor, medical professionals are likely to check multiple indicators, such as your body temperature and blood pressure. The concept here is sickness.

Construct validity is also known as predictive validity.

False Construct validity is the degree to which a measure relates to other variables, as expected within a system of theoretical relationships. It is based on the logical relationship among variables. In contrast, predictive validity, sometimes also called criterion-related validity, is based on some external criterion. For instance,the validity of SAT is shown in its ability to predict students' success in college. The validity of driver's license test depends on the driver's subsequent driving record. In these two cases, college success and driving ability are the criteria.

Suppose a survey item asks someone if something is very important, somewhat important, not very important, or unimportant. This is an example of what level of measurement?

Ordinal

The only feature differentiating ratio from interval levels of measurement is that the interval level measure has a true zero.

False; It is the ratio measure that has a true zero.

A nominal level of measurement can be represented as a ratio level of measurement, but a ratio level of measurement cannot be represented as a nominal level of measurement.

False; The opposite is true.

Jason used IQ in his study of early childhood education outcomes. What is the level of measurement of IQ?

Interval Essentially, interval data are ordinal, but they have an extra property - the ability to meaningfully add and subtract measurements. In interval-scaled data, the gaps between the numbers are comparable, unlike with ordinal data. Any interval has the same meaning regardless of its location on the scale. "X is five inches longer than y" has meaning regardless of the values of X and Y. However, ratios are meaningless on an interval scale because an interval scale has no true zero. Temperature scales are an example of this, so are decibel scales. Zero degrees Fahrenheit does not mean the total absence of temperature. Zero decibels does not mean there is no sound. Furthermore, if it is 80 degrees outside today and it was only 40 degrees outside yesterday we cannot say that today is twice as hot as yesterday. Similarly a sound level of 80 dB is not twice as loud as a sound level of 40 dB. In short, if the data can be ordered and the arithmetic difference is meaningful, then the data are at least interval data. In this case, IQ is numeric data expressed in intervals using a fixed measurement scale. For instance, someone with an IQ of 140 is NOT twice as intelligent as someone with an IQ of 70.

Emma measured class level of students at her university, which has graduate programs, with these attributes: first-year, sophomore, junior, and senior. Which quality of measures does this measure lack?

Must be exhaustive

When the variable religious affiliation is classified as Protestant, Catholic, and Jewish, this variable has the important quality of being:

Mutually exclusive These options are not exhaustive or comprehensive, since many religions are not included. They are mutually exclusive, because they are not interchangeable. They are nominal measures and not ordinal, because there is not an order among these options.

Travel time to work each day, measured in hours and minutes. The measure is

Ratio A ratio scale possesses a meaningful (unique and non-arbitrary) zero value.

Professor Smith gave an exam on Monday. On Tuesday and Wednesday Smith gave the same class the same exam. Professor Smith was clearly interested in assessing the exam's:

Reliability

Prof. Ribar gave an exam on Monday. On Wednesday he gave the same class the same exam. Professor Ribar was clearly interested in assessing the exam's

Reliability Reliability refers whether the test produces the same result or close to the same result over repeated trials.

The ___________ of concepts in scientific inquiry depends on nominal and operational definitions?

Specification

Linda used her ten-item scale on love to see how separate sets of five indicators correlated with each other. Which type of reliability is reflected in this example?

Split-half The split-half method breaks a scale in half and uses each half to independently verify the other.

An operational definition specifies how a concept will be measured—that is, the operations we'll perform.

True

Dimensions refer to the various aspects of a concept.

True

Measurement is the process of observing concepts, as indicated by their operational definitions, and assigning some type of score or meaning to people's responses.

True

Most of the concepts of interest to social researchers are open to varied meanings.

True

Quantitative, nomothetic, and structured techniques tend to be more reliable, while qualitative and idiographic methods tend to be more valid.

True

Reification is the term given when we regard constructs as real.

True

The split-half technique for assessing reliability is closely linked to concept of the interchangeability of indicators.

True

The test-retest method assumes that the phenomena under study does not change.

True

Validity refers to the linkage between the operational and conceptual definitions.

True

Predictive validity is often used as another term for criterion-related validity.

True As discussed before,criterion-related validity is based on some external critarion.

In creating the nominal level of measurements, the two criteria for classification are exhaustiveness and mutual exclusiveness.

True Nominal measusres differentiate between items or subjects based on on their names, categories, or other qualitative classificiations they belong to. Therefore, they have to be exhaustive and mutually exclusive.

Reliability involves:

Whether a particular technique applied repeatedly to the same object would yield the same results each time. High reliability means that the same data would have been collected each time in repeated observations of the same phenomenon.

The main reason you need to know the level of measurement for your variables is so that:

You will know what statistic to use.

A researcher must decide in the process of operationalization: e- correct

a-How and what to measure. b-the range of variation to consider. c-the use of single or multiple indicators. d. What level of measurement to use. e-all of these choices must be decided in the process of operationalization

A researcher must decide in the process of operationalization: e-correct

a-How and what to measure. b-the range of variation to consider. c-the use of single or multiple indicators d-what level of measurement to use. e-all of these choices must be decided in the process of operationalization. All of these steps are integral to the process of operationalization.

Which of the following statements is FALSE? d-correct

a-The conclusions reached in descriptive studies depend directly on the specific operational definitions employed. b-Changing definitions often results in different descriptive conclusions. c-Explanatory research is more dependent upon patterns of relationships, and these are more consistent than definitions. d-Definitions are more problematic for explanatory than descriptive research. e-Definitions are more problematic for descriptive than for explanatory research. Definitions can be equally problematic for explanatory and descriptive research. Without a clear and well-agreed definition, we can not properly carry out studies.

Classifying someone as a "resident" of Utah or "non-resident" treats residency as:

nominal