MAR 4613 Exam 2
Experimental Confound
- When there is an alternative explanation beyond the experimental variables for any observed differences in the dependent variable - Once a potential confound is identified, the validity of the experiment is severely questioned - Sources: - Sampling Error - Systemic Error - Later-Identified Extraneous Variables - Careful experimental design can reduce the likelihood of confounds
Cohort Effect
A change in the dependent variable that occurs because members of one experimental group experienced different historical situations than members of other experimental groups
Instrumentation Effect
A change in the wording of questions, a change in interviewers, or a change in other procedures causes a change in the dependent variable
Control Group
A group of subjects to whom no experimental treatment is administered
Experimental Group
A group of subjects whom an experimental treatment is administered
Sampling Frame
A list of elements when a sample may be dram; also called a working population
Testing Effect
A nuisance effect occurring when the initial measurement or test alerts or prime subjects in a way that affects their response to the experimental treatments
Selection Effect
A sample bias that results from differential selection of respondents for the comparison groups, or a sample selection error
Snowball Sampling
A sampling procedure in which initial respondents are selected by probability methods and additional respondents are obtained from information provided by the initial respondents
Probability Sampling
A sampling technique in which every member of the population has a known, nonzero probability of selection
Sampling Unit
A single element or group of elements subject to selection in the sample
Laboratory Experiment
A situation in which the researcher has more complete control over the research setting and extraneous variables
Systematic Sampling
A starting point is selected by a random process and then every nth number on the list is selected
Sample
A subset, or some part, of a larger population
Primary Sampling Unit (PSU)
A unit selected in the first stage of sampling
Secondary Sampling Unit
A unit selected in the second stage of sampling
Tertiary Sampling Unit
A unit selected in the third stage of sampling
Manipulation Checks
A validity test of an experimental manipulation to make sure that the manipulation does produce differences in the independent variable
Judgement (Purposive) Sampling
An experienced individual selects the sample based on personal judgment about some appropriate characteristic of the sample member
Demand Characteristic
An experimental design element or procedure that unintentionally provides subjects with hints about the research hypothesis
Population Element
An individual member of a population
Census
An investigation of all the individual elements that make up a population
Population (universe)
Any complete group of entities that share some common set of characteristics
Simple Random Sampling
Assures each element in the population of an equal chance of being included in the sample
Counterbalancing
Attempts to eliminate the confounding effects of order of presentation by varying the order of presentation (exposure) of treatments to subject groups
International Research
Availability of sampling frames varies dramatically around the world
In which experimental research design does each subject receive only one treatment combination?
Between-subjects design
When a researcher uses students to participate in a study because he has easy access to them, what type of sampling procedure is being used?
Convenience sample
A marketing vice-president tells the marketing department to schedule a test market in Dallas because he feels that this city is "typical" of the composition of the target market for a new product nationally. The vice president is asking for a _____.
Judgement sample
Online Panels
Lists of respondents who have agreed to participate in marketing research via e-mail
Salespeople are tested one year after a sales training program and perform better on the exam, not because of the training program, but because they have gained one year's experience in sales. Which type of effect has occurred?
Maturation Effect
Nonprobability Sampling
- A sampling technique in which units of of the sample are selected on the basis of personal judgement or convenience - The probability of any particular member of the population being chosen is unknown
Cluster Sampling
- An economically efficient sampling technique in which the primary sampling unit is not the individual element in the population but a large cluster of elements - Clusters are selected randomly
Types of Nonprobability Sampling
- Convenience Sampling - Judgement (Purposive) Sampling - Quota Sampling - Snowball Sampling
Factors affecting Sampling Desgin
- Degree of Accuracy - Resources - Time - Knowledge of Population - National vs. Local
Between-Subjects Design
- Each subject receives only one treatment combination - Usually advantageous although they are usually more costly - Validity is usually higher
Extraneous Variables Affecting Internal Validity
- History Effect - Mortality Effect - Selection Effect - Maturation Effect - Testing Effect - Instrumentation Effect
Manipulation of the Independent Variable
- Several experimental treatment levels (different values of the independent) may be used - More than one independent variable may be examined
Types of Probability Sampling
- Simple Random Sampling - Systematic Sampling - Stratified sampling - Cluster sampling
Internal Validity
- The extent that an experimental variable is truly responsible for any variance in the dependent variable - Does the experimental manipulation truly cause changes in the specific outcome of interest?
Experimental Treatment
- The way an experimental variable is manipulated - Categorical variables: described by class or quality - Continuous variables: described by quantity (level)
Despite the positive results, some scientists turn somewhat skeptical about the results as many patients can recover from COVID19 probably without Remdesivir. If it were a field experiment, what kind of extraneous variables is the key reason for skepticism given the possibility of those patients recovering by themselves?
Maturation effect
When some subjects stop participating in an experiment before it is completed, affecting the results of the study, a _____ effect has occurred.
Mortality
A researcher for Procter & Gamble selects five states randomly, and then selects 10 supermarket chains randomly within each of these states to call for a phone survey for a test market of a new shampoo. Which type of sampling procedure is being used?
Multistage area sampling
Convenience Sampling
Obtaining those people or units that are most conveniently available
Sampling Frame Error
Occurs when certain sample elements are not listed or are not accurately represented in a sampling frame
Demand Effect
Occurs when demand characteristics actually affect the dependent variable
History Effect
Occurs when some change other than the experimental treatment occurs during the course of an experiment that affects the dependent variable
Mortality Effect
Occurs when some subjects withdraw from the experiment before it is completed
Experimental Conditions
One of the possible levels of an experimental (independent) variable manipulation
Hawthorne Effect
People will perform differently from normal when they know they are experimental subjects
In which type of sampling does every element in the population have a known, nonzero, equal probability of selection?
Probability sampling
Interaction Effect
Differences in dependent variable means due to a specific combination of independent variables
Maturation Effect
Effects that are a function of time and the naturally occurring events that coincide with growth and experience
Quota Sampling
Ensures that various subgroups of a population will be represented on pertinent characteristics to the exact extent that the investigator desires. - Advantages: - Convenient - Speed of Data Collection - Lower Costs
The group receiving the treatment being studied is called the _____.
Experimental group
Research projects involving experimental manipulations that are implemented in a natural environment are called ____.
Field experiments
According to an academic study, products from less developed countries received lower consumer evaluations than those from industrialized countries under all tested conditions. Additional results in the study also indicate that a product's brand name changes the effect of country of origin on consumer evaluations so that a famous brand erases such differing effect of country of origin on consumer product evaluations. The additional results illustrate an _____.
Interaction
The question as to whether the independent variable was the sole cause of the change in the dependent variable is the basic issue in _____.
Internal validity
Within-Subjects Design
Involves repeated measures because with each treatment the same subject is measured
Multistage Area Sampling
Involves using a combination of two or more probability sampling techniques
A researcher is interested in studying attitudes about raw milk sales and has reason to believe that urban, suburban, and rural groups will vary in their responses. The researcher knows that the population being studied is 50% urban, 40% suburban, and 20% rural. She classifies the potential participants as urban, suburban, or rural residents, and then, for a sample totaling 100, randomly selects 50 individuals from the urban group, 40 from the suburban group, and 20 from the rural group. The researcher is using a _____.
Proportional stratified sampling
Sampling Services (list brokers)
Provide lists or databases of the names, addresses, phone numbers, and e-mail addresses of specific populations
The head of the marketing research department instructs field interviewers to interview owners of smartphones in a shopping mall such that they each interview 10 iPhone users, 8 Samsung Galaxy users, 6 Huawei or Mi users, and 4 owners of other brands. Which type of sampling procedure is being used.
Quota sample
Field Experiments
Research projects involving experimental manipulations that are implemented in a natural environment
Possible Sources of Bias
Respondents chosen because they were: - Similar to interviewer - Easily found - Willing to be interviewed - Middle-class
A researcher wants to study the members of the American Marketing Association and selects a sample from its membership list. The membership list is an example of a _____.
Sampling frame
A researcher puts the name of each person in a sampling frame list on a 3x5 card, shuffles the cards thoroughly, and then selects 35 names from the top of the pile of cards for a phone interview study. What type of sampling procedure is being used?
Simple random sample
Stratified Sampling
Simple random subsamples that are more or less equal on some characteristic are drawn from within each stratum of the population
A marketing researcher wants to put together four focus groups of 18-24-year-old males who are "heavy downloaders of music" (defined as downloading 50 songs per month). Instead of asking people at a shopping mall whether they download music from the internet, he finds one person in the target maker who qualifies, and then asks that person to suggest the names of two other makes between the ages of 18-24 who download music. The researcher will invite those two to participate in the focus group, and then they are each asked to suggest two others similar to themselves to participate in the focus group study. This procedure describes a _____.
Snowball sample
A researcher is conducting an experiment in which one group of people is exposed to one advertisement and another group is exposed to another advertisement. Specifically, he is examining the effect of headline font sizes on consumers' attitude toward the brand advertised. The participants in the experimental research are referred to as ____.
Subjects
Constancy Conditions
Subjects in all experimental groups are exposed to identical conditions except for the differing experimental treatments
Main Effect
The experimental difference in dependent variable means between different levels of any single experimental variable
Proportional Stratified Sampling
The number of sampling units drawn from each stratum is in proportion to the population size of that stratum
Disproportional Stratified Sampling
The sample size for each stratum is allocated according to analytical considerations
Subjects
The sampling units for an experiment, usually human respondents who provide measures based on experimental manipulation