HSC4713: Planning and Evaluation, HSC 4713 Module 10: Program Resources and Management, HSC 4713 Module 12: Implementation, HSC 4713 - Module 14 Evaluation Approaches and Design, Module 13 - Purposes and Logistics of Evaluation; Evaluation Approaches...
Psychographic segmentation can be based on criteria such as health insurance and health behavior.
False
Step 1 of the CDC's framework for program evaluation is to gather credible evidence.
False
The SAM list is used when planners need to complete a Strategic Assessment Map (SAM).
False
The Theory of Planned Behavior includes attitude toward a behavior, a subjective norm, and the concept of stimulus-response. True/False
False
The alternative hypothesis holds that there is no observed difference between groups.
False
The alternative hypothesis holds that there is no observed difference between groups. True/False
False
The alternative hypothesis holds that there is no observed difference between groups. True/False
False
The best research designs involve having widely diverse control and experimental groups.
False
The best way to keep summative evaluation results from being biased is to wait until the project's end to plan them.
False
The final phase of the implementation process is to evaluate it.
False
The number and type of evaluation reports needed should be determined as soon as the program is completed.
False
The process of marketing works on the underlying theory of exchanging ideas.
False
The qualitative method of evaluation is a deductive method.
False
There are 10 points for the 6 phases of policy modification.
False
Welfare expenditures, public capital information expenditures, and public information are considered secondary building blocks.
False
Welfare expenditures, public capital information expenditures, and public information are considered secondary building blocks. True/False
False
When individuals who are part of a priority population also serve to educate their population, the process is called external sourcing.
False
Without statistical significance, practical significance is of little value.
False
Marketing's traditional "Four P's" include product, price, priority, and promotion. True/False
False Product Price Place Promotion
Primary building blocks are the least accessible assets in the mapping community capacity model. True/False
False (they are the most accessible)
Dose refers to the number of components that make up an intervention. True/False
False, Dose refers to how many times the component is offered
Models are generally more specific than theories because they attempt to explain underlying processes of learning. True/False?
False, a theory is more specific
Social Planning
Heavily task-oriented, focused on rational-empirical problem solving, usually by an outside expert
11 common threats to internal validity pg 405
History, Maturation, Testing, Instrumentation, statistical regression, Selection, Mortality, Diffusion or imitation of treatments, Compensatory equalization of treatments, Compensatory Rivalry, Resentful demorilization of respondents receiving less desirable treatments
What is dose?
How many times each activity is offered
Financial Resources
How will program be paid for? Will planning group pay for it? Program participants? Third party? Who is responsible for budget?
What are the 5 types of communication channels?
Intrapersonal Interpersonal Organization and community Mass media Social media
Community Mobilization Strategies
Involve helping communities identify and take action on shared concerns using participatory decision making, and include methods such as empowerment Includes: Community Mobilization, organizing, building, and advocacy
Which of the following is TRUE about pretesting?
It can be a collection of baseline data prior to program implementation.
What are the elements of a COMPREHENSIVE FORMATIVE EVALUATION? pg. 390, table 14.1
Justification, Evidence, Capacity, Resources, Consumer-Orientation, Multiplicity, Support, Inclusion, Accoutability, Adjustment, Recruitment, Reach, Response, Interaction, Satisfaction
If variable B increases as variable A increases, it is referred to as a positive correlation. True/False
True
It is important to determine if a vendor's costs for services or products are competitive with costs of other vendors.
True
One way to determine the effects of a program over time is to use a staggered treatment design.
True
Ongoing observation and evaluation during a program can help in readjusting strategies or components if problems develop.
True
Perceived behavioral control refers to people's perceptions of their ability to perform a given behavior. True/False
True
Planners should keep all stakeholders informed throughout the program process.
True
Reach is a term that describes the proportion of the priority population given the opportunity to participate in the program.
True
Rejecting the null hypothesis when it is true is a Type I error.
True
Rejecting the null hypothesis when it is true is a Type I error. True/False
True
Rejecting the null hypothesis when it is true is a Type I error? True/False
True
Resources include the human, fiscal, and technical assets available to plan, implement, and evaluate a program.
True
Resources include the human, fiscal, and technical assets available to plan, implement, and evaluate a program. True/False
True
Non-experimental Design
Used when participants cannot be assigned to a control group, and no comparison group can be identified.
Supporting participants of a community organization effort __________.
are seldom involved, but may contribute in non-active ways
The socio-ecological perspective for behavior change theories...
emphasizes the difference among factors within levels of a health problem
Summative evaluation __________.
encompasses impact and outcome evaluation
What is the intrapersonal level?
individual characteristics that influence behavior, such as knowledge, attitudes, beliefs and personality traits
Internal personnel
individuals from within the planning agency/organization or people within priority population to supply needed labor
informed consent
inform participants about the program they are considering joining - after they understand what the program is all about they can agree to participate requires: 1) disclosure of relevant information to prospective subjects about the research (program) 2) their comprehension of the information 3) their voluntary agreement, free to coercion and undue influence, to research (program) participation
When participants of a health program confirm that they understand what the program is all about with their signature, they are completing the __________ process.
informed consent
A person who stands in line all night long to be the first to buy the newest version of the iPad, could be considered a(n) __________.
innovator
coalition
large group formed from other groups, with the specific purpose of sharing information, raising awareness, producing an event, or advocating for an issue
Which of the following is NOT critical to the long term success of a Health Promotion Program?
large staff
commission
larger and more formal groups, appointed by the leader of an organization that is charged with making recommendations to the leadership on a specific issue or problem
task force
larger group formed for a slightly longer time to complete a specific task to do the work
Treadmill tests or percent body fat relate to which type of standard of acceptability?
norms established by research
Penetration Rate (health communication strategies)
number in the priority population exposed or reached
planning council
often created by government, as a way of soliciting broad participation in program priorities and resource allocation
committee of the whole
opportunity for members of a larger group to address issues
what is sequence?
order in which the material is preseented
Community Building
orientation to community that is strength based rather than need based and stresses the identification, nurturing and celebration of community assets.
Which of the following is not found in the most basic form of a Logic Model?
outsource
steering committee
oversee implementation of programs or initiatives
********************************Which of the following is NOT a common way to start putting health plans into action?
parallel pilots
What is perceived behavioral control in theory of planned behavior?
people's perceptions of their ability to perform a given behavior (Do i have any control over this behavior)
Determinants of Health
people, places, interests, values, experiences, traditions, policies
What is an example of community mobilization strategies?
personal visits community rally telephone call campaigns email campaigns
Treatment of an intervention
planned activities; activity or set of activities that would permit the most effective (leads to desired outcome) and efficient (uses resources in a responsible manner) achievement of the outcomes stated in the goals and objectives.
What is an example of health education strategies?
planned learning experiences that provide knowledge and skills (classes, workshops, seminars)
Dose of an intervention
refers to the number of program units delivered the greater the dose of an intervention, the greater the chance for change
Contingencies
what happens as a result of the contracts term either being met or not met
The first three considerations when creating a health promotion intervention, as described in your text, include __________.
what needs to change, what level of prevention, and what level(s) of influence
What are the different types of interventions based on their levels and characterisitcs?
- Health education (individual) • Health communication (interpersonal) • Health-related community service (organizational) • Community mobilization (community) • Health policy / enforcement • Environmental change *see lecture notes for description of each
Financial Resources -- questions to be answered
- How will the program be paid for? Will the planning group pay for it? Will the program participants pay for it? Will some third party pay for it (i.e., sponsoring group or agency, grant funded)? Or will it be paid for by a combination of sources? - Who is responsible for creating and monitoring the budget?
Curriculum and other instructional resources -- questions to be answered
- What educational materials are needed to implement the program? Will the planners create them? Will they be purchased? Will they be donated? - Is there a need for a curriculum? - Will a canned program be used?
Equipment -- questions to be answered
- What equipment is needed to plan the program? Is office equipment such as computers and copy machines needed? - Is equipment needed for implementation such as tables and chairs, instructional equipment (e.q., computer and projector), exercise equipment, etc.?
Supplies -- questions to be answered
- What supplies are needed for planning the program such as typical office supplies? Are postal and mailing supplies needed? - What supplies are needed for implementation? Who will provide them? Planners? Participants> Outside group?
Personnel -- questions to be answered
- Who is needed to PLAN the program? Professionals? Advisory Committee? - Who is needed to IMPLEMENT the program? Facilitators? Support staff? Will you use a vendor? - Who will EVALUATE the program? Someone associated with the program? Someone from outside? - Is there a need for a partnership?
Once planners have obtained a release of liability from participants, planners cannot be sued as a result of the program.
False
One person can grasp all the information and skills necessary to plan and implement an intervention.
False
Pretesting ensures planners are going to be successful in implementing their interventions.
False
Primary building blocks are the least accessible assets in the mapping community capacity model.
False
If a health educator failed to provide accurate information about prevention of infectious disease, it could be considered negligence through an act of commission.
False
In order to be ethical, an evaluation should be reported in an identical format to all interested groups.
False
In-kind support occurs when generous people provide the cash to get a program started.
False
It is best to stay with one channel of communication when preparing to reach various cultural groups with health messages.
False
It is best to stay with one channel of communication when preparing to reach various cultural groups with health messages. True/False
False
Looping back is the middle step in the community organizing and building process.
False
Looping back is the middle step in the community organizing and building process. True/False
False
Marketing's traditional "Four P's" include product, price, priority, and promotion.
False
Multivariate data analyses are the most basic and most easily interpreted tests of significance.
False
Positioning
-creating a personality for an offering based on its key attributes
Ideal manner in which control groups are selected
- participants randomly selected, then randomly assigned to one of two groups, and finally it should be randomly determined which group becomes the experimental and which becomes the control group -increases the credibility of the evaluation by controlling for extraneous events and factors
How can program planners reduce their risk or liability?
- plan ahead - be aware of legal abilities - select certified instructors - use good judgment in setting up programs and provide written guidelines for medical emergency procedures - inform participants about the risks and danger of exercise and require written informed consent - require that participants obtain medical clearance before entering an exercise program (or other strenuous programs) - instruct staff members not to "practice medicine," but instead to limit their advice to their own area of expertise - provide a safe environment by following building codes and regular maintenance schedule for equipment - purchase adequate liability insurance for all stuff
Overview of the Social Marketing Process
-Research: identify the problem 1. Develop Plan and Strategy: analyze problem, segment target audience, develop strategy 2. Select channels and materials: marketing mix 3. Develop and Pretest materials: conduct a pretest, qualitative approach, analyze results, make modifications 4. Implementation: implement campaign, monitor 5. Assess Effectiveness/Evaluation 6. Feedback for Refinement: refine materials for future campaigns
What are the three keys to understand the marketing process
-Understand the priority population -Know how to segment the priority population -have an understanding of the diffusion theory
Brand Loyalty
-a consistent preference for and choice of a particular company product -brand recognition, preference, insistence
Coalition
-a group of individuals and/or organizations with a common interest who agree to work together toward a common goal
Grassroots activities/lobbying
-a group/organization motivates community to take action on a specific legislation
Cultural sensitivity
-acknowledgement that cultural differences exist
Benefits of coalitions
-affects ultimate health behaviors and health status of the community -process of coalition building and maintenance -increased commitment, collaborating, and participation -partnerships and relationships established -relationships developed with media -public awareness is raised -legislators and policy makers aware -members empowered by experiences -community standards developed
Competition
-alternatives to an offering -more appealing
Social Marketing
-an approach used to develop activities aimed at changing or maintaining people's behavior for the benefit of individuals and society as a whole -change or maintain how people behave
Reducing Anxiety
-anticipate difficult audience members (the debater, expert, poor listener) -technology malfunction (adapt, adjust and move on)
Communication Analysis
-audience analysis and segmentation -formative research -channel analysis and selection
Support Groups
-brings together people facing similar issues increases knowledge -clarify changes -assist in skill development -provide safe environment -receive feedback and support -diversity and gain and see perspective
Health Communication
-broad area of research and practice -application of all tools in communication arts and sciences to solving practical problems in health care -inform, influence, and motivate individuals and organizations to take action toward health
Role of Health Educators in Policy Advocacy
-can support issues with data -can assess individual and community needs -are skilled in consensus building -are skilling in planning, implementing, and evaluating programs
Theories focus on communities/cultures/orgs
-center on community level change -important for community based programs -designed to support healthy lifestyles by modifying social & physical environments
Exchange
-consumers giving up what they currently have, use, or believe for what is being offered -tangible and non tangible items
Legislative Advocacy
-contact with policymaker or legislator about a social/health problem on behalf of a population group
Social Ecological Framework
-creating an environment conducive to change -understand factors affecting behavior -Intrapersonal, Interpersonal, Institutional, Community, Public Policy
Co-facilitator
-decreases leader burnout -more flexible scheduling -objective perspective, information from more than one vantage point, increased facilitation for all members
Performing Stage
-deeper relationships established -get involved in group facilitating relaxed -sharing and self disclosure occurs
Health Communication Campaign
-designed to educate specific groups about imminent health threats and risky behaviors -increase awareness -moves audience to action
Forming Stage
-develop a group structure -orient members -need to feel comfortable within the group and safe -polite, nervous, shy -roles assumed -members turn to facilitator for group leadership -decide whether or not to remain in group
Tips and Techniques for Successful Legislative Advocacy
-develop legislative alerts -initiate campaigns -meet with legislatives -testify at hearings -utilize media
Direct lobbying
-discussions with legislators about a particular bill
Diffusion of Innovation Theory
-disseminate and implement innovations -readiness to adopt innovations -community level theory -Criteria: relative advantage, compatibility, complexity, treat ability/triability, observability
The Monopolist
-dominate group discussion
The help rejecting complainer
-feel their problem is the worst -listening and empathizing sometimes more helpful than offering solutions
Consumer Orientation
-focuses on the needs and wants of the consumer -focus groups
Task Specific Groups
-formed for a specific time to address and take action on an issue -once task is completed, these groups disband
Theory of Planned Behavior
-framework to identify key behavioral, normative, and control beliefs affecting behaviors -behavior is determined by personal attitude, subjective norms, and perceived behavioral control
Consumer satisfaction
-goal of marketing -giving people what they expect or more than they expect
Planning
-identify and define the health issue -campaign objectives -consumer orientation
Theories focus on individuals
-known as cognitive behavior models -based on two premises/assumptions -behavior is determined by what we know -behavior is determined by perceptions, motivation, self efficacy, skills, resiliency & environmental factors
Transtheoretical Model/ Stages of Change Model
-long term changes in health behavior involve multiple actions and adaptations over time -Precontemplation: no interest in change -contemplation: thinking about change -preparation: planning for change -action: adopting new habits -maintenance: ongoing practice of new healthier behavior
Norming Stage
-members need to be independent, recognized, and have self esteem -leadership roles may be taken on =tasks agreed upon -positive challenges
Social Cognitive Theory
-most popular -people not only learn from their own experiences, but by observing actions of others and the results of those actions -personal factors, environmental influences, behavioral factors
The silent member
-motivated by fears of disclosure, confrontation, imperfection -will begin to participate once they feel safe and not judged
Health Communication as a Process
-multiway process -sending information does not mean effective communication -requires a multicomponent approach -Source-encoding-channel-decoding-receiver
Storming Stage
-need to belong and be secure in the group -need to review aims and absorb material -resistance -may seem negative -useful way for people to begin to deal with their needs -period of high energy involvement
Facilitation
-one of the most important sets of skills for leaders and members -actions that promote, aid, simplify, or make a task easy
Expected Outcomes
-positive health outcomes -successful selling -greater understanding of community -partnerships -updated strategies
Overcoming challenges
-prepare for the opposition -motivate community support -prevent volunteer burnout -deal with internal politics -keep bills moving
Marketing Mix
-product -price -place -promotion
Health Educator's Role in Facilitation
-promote group communication and collaboration -aid participants in making contributions to the group -making members feel good about their contributions to the meeting -promote group process -simply tasks -making sure everyone feels comfortable participating -making sure the group feels that the ideas and decisions are theirs, not just the leaders
Communication and Decision Making Groups
-provide structure and leadership for organizational units and community groups -important for productivity -exist on an ongoing basis
Presentation Formats
-public speeches -informal talks -town meetings -debates -workshops -seminars
multiculturalism
-recognition of racial and cultural diversity -respect for beliefs and cultures of others
Recruitment an element of Process eval
Degree to which members of the priority populaiton are adequately recruited through appropriate channels and places consistent with cultural and other unique characteristics
Social Network Theory
-removes people from their social context -does not take into consideration the networks people are in -characteristics: study of social relations, relationships between people not attributes, interdependence of observations, homophile, structure matters
Oversight and Advisory Group
-represent a bridge between experts and a local community -review activities and provide advice and strategies for addressing issues
Advocacy
-self initiated, evidence based, strategic action that health professionals can take to help transform systems and improve environments and policies which their patients behaviors and choices and ultimately their health.
Evaluation and Reorientation
-summative evaluation -process evaluation
Theory
-target health promotion efforts and strategies -exchange theory -behavioral theory
Cultural competence
-the capacity for people to increase their knowledge and understanding of cultural differences -ability to acknowledge cultural assumptions and biases -starts with awareness -grows with knowledge -enhanced with special skills -polished through cross cultural encounters -respects differences -avoid stereotyping
Demand
-the degree to which a transaction is wanted -culture, personality, purchasing power
Marketing Mix
-to make target population voluntarily exchange what they currently do or believe for the product, service, or idea being offered
Audience Analysis and Segmentation
-understand the priority population -socio-demographic characteristics, geographic, psychographic, barriers & facilitators, communication channels -market segmentation
Health Belief Model
-understand why people did or did not use preventative services -emphasizes the role of personal beliefs/perceptions to an illness/treatment -understand prevention and detection behaviors, sexual risk factors, and injury prevention
Implementation
-use social marketing principles and intervention strategies -message design -provide support materials
Ending Stage
-when task complete -anxiety and sense of loss will emerge -acknowledge what has been achieved and look forward to new beginnings
What are advantages to using several strategies?
1) "hitting" the priority population with a message in a variety of ways from multiple levels of influence 2) appealing to the variety of learning styles within any priority population 3) keeping the health message constantly before the priority population 4) hoping that at least one strategy appeals enough to the priority population to help bring about the expected outcome 5) appealing to the various senses of each individual in the priority population 6) increasing the chances that the combined strategies would help reach goals and objectives of the program
What are the 8 steps in preparing written material?
1) Needs and priority population identification 2) planning your project 3) Audience research 4) Material 5) Graphics 6) pre-test 7) printing 8) instruction to use
What are the considerations for creating a health promotion intervention, as described in our text? pg 243
1) What needs to change? Where is Change needed? 2) At what level of intervention will the program be aimed? 3) At what level(s) of influence will the program be aimed? 4) What types of intervention strategies are known to be effective in dealing with the program focus? 5) Is the intervention an appropriate fit for the priority population? 6) Are the necessary resources available to implement the intervention selected? 7) Would it be better to use an intervention that consists of a single strategy or one that is made up of multiple strategies?
Different ways of advocating for health and health education
1) influencing voting behavior 2) electioneering 3) direct lobbying 4) integrating grassroots lobbying into direct lobbying efforts 5) using the internet 6) media advocacy- newspaper letters to the editor and opinon-editorial articles 7) media advocacy- acting as a resource person
Criteria for Health Promotion Interventions
1. Address one or more risk factors that are defined, measurable, modifiable, and prevalent among the target population 2. Reflect a consideration of characteristics, needs, and preference of target population 3. Include interventions that will reduce target risk factor and are appropriate for the setting 4. Identify and implement interventions that make optimum use of available resources 5. Organize, plan and implement in a manner that its operation and effects can be evaluated
6 phases of policy making (Health policy strategies)
1. Agenda setting 2. Policy formulation 3. Policy adoption 4. Policy implementation 5. Policy assessment 6. Policy Modification
How to choose a strategy
1. Brainstorm 2. Time and resources 3. Strategies to different subgroups 4. Strategy with measurable objectives 5. Messages to appropriate groups 6. Select channels of communication 7. Pretest ideas and messages
Assumptions for organizing communities
1. Community has the capacity to deal with their problems 2. People want to change and can change 3. Community members should be a part of the process 4. Change self-imposed is the strongest 5. Holistic approach is better than fragmented approach 6. People must learn skills of democratic cooperation 7. Community often needs help getting organized
Creating Health Promotion Interventions
1. Complete Needs Assessment 2. Develop Program Goals and Objectives 3. Consider Intervention Strategies 4. Design Appropriate Intervention
Stages of Social Marketing Effort
1. Create awareness and interest-understand message 2. Change attitudes and conditions-positive attitude 3. Motivate people to want to change-Intention to act 4. Empower people to act- Action 5. Prevent backsliding- Followed by reinforcement
Steps
1. Cultural Destructiveness: fit everyone into the same cultural pattern 2. Cultural Incapacity: supports segregation, discriminates, and lacks capacity or will to help minority groups 3. Cultural blindness: all people are the same 4. Cultural Pre-competence: desire to serve minority communities better but lacks information how to proceed 5. Cultural competence: demonstrates and acceptance and respect for cultural differences 6. Cultural Proficiency: holds all cultures in high esteem, advocated for cultural competence
Steps for conducting effective support groups
1. Define group/audience 2. Self a facilitator/ co-facilitator -flexible schedule, lots of energy, ability, support, desire to do job, aware, skills 3. Select a time and site 4. Define goals, objectives, and activities 5. Prepare Content Materials 6. Facilitate the support group
Stages of Development
1. Formation: identify the problem, recruit, set mission, create rules and roles (3-6 months) 2. Implementation: assess needs, collect and analyze data, develop action plan (9-12 months) 3. Maintenance: initiate and monitor strategies, support and evaluate coalition (12-18 months) 4. Outcome: begin to accomplish goals, progress towards achieving result/impact (18 months-3 years)
Core Constructs of HBM
1. Perceived susceptibility: belief about getting a disease or condition 2. Perceived severity: belief about the seriousness of the condition 3. Perceived benefits: positive aspects of the health action 4. Perceived barriers: negative aspects 4. Cues to action: factors which trigger action 5. Self efficacy: confidence in one's own ability to perform a behavior
Steps for Group Facilitation
1. Plan the meeting 2. Develop an agenda 3. Arrange for minutes documentation 4. Attend to all details
Communication Campaign Model
1. Planning 2. Theory 3. Communication Analysis 4. Implementation 5. Evaluation and reorientation
Steps for Conducting Effective Presentation
1. Prepare for the presentation -know the setting and audience 2. Understand the different presentation settings -formal:large audience, uses a stage, board of health -semiformal: more relaxed, presenting to employees, speaking at a school informal:most relaxed, less than 25 people, department meeting, focus group 3. Set the stage -let the audience know what to expect, humor, relevant stories, pose questions 4. deliver the presentation -know the purpose and material, understand body language 5. Bring Closure -shortest part, summarize, discuss action points, question and answer
6 concepts to social cognitive theory
1. Reciprocal Determinism 2. Behavioral capability 3. Expectations 4. Reinforcement 5. Self-efficacy 6. Observational learning
Facilitate the support group
1. Selective perception 2. Communication 3. Group size and structure 4. Membership 5. Norms 6. Goals 7. Leadership
Evaluations are not of much benefit to programmers unless they are fully researched, and the ideal evaluation is conducted.
False
Steps for Selecting and Implementing Presentation Methods
1. Understand the assists and needs of focus population -needs assessment, search literature to understand target pop 2. Develop meaningful goals and objectives -what participants needs to take away 3. Identify and select appropriate presentation methods -skill practice, small group discussion, demonstrations, audiovisuals, games, lectures 4. Gather resources to aid program implementation of the methods -resources are accurate, up to date, and appropriate 5. Evaluate the effectiveness of methods -input to improve program
Designing appropriate interventions
1. What needs to be changed- predisposing, enabling and reinforcing factors 2. What level of prevention is focus?- primary, secondary, tertiary 3. What level of influence will be the focus?- Interpersonal, intrapersonal, institutional or public policy 4. What type of intervention strategies are known to be most effective?- efficacy and effectiveness 5. Is intervention appropriate for the target population? 6. Are necessary resources available 7. Will intervention include single or multiple strategies?
Types of Groups: 3 categories
1. communication and decision making group 2. task-specifc group 3. oversight and advisory group
Which of the following is NOT an assumption that must be made by those who assist with community organizing?
A holistic approach is the worst approach for diversified communities.
Curriculum (health education strategies)
A planned set of lessons or courses designed to lead to competence in the area of study
Which of the following is not characteristic of a theory? Select one: a. A theory is a set of interrelated concepts. b. A theory is a tool that can make basic concepts more complex. c. A theory attempts to explain and predict. d. A theory presents a systematic view.
A theory is a tool that can make basic concepts more complex.
Confounding Variables
A variety of factors affecting the effect of the program.
Resources an element of a formative eval
Adequacy of resources -- budget, community resources or assistance, assets, time, etc.
External Program Personnel
Advantages 1) Known expertise. 2) The responsibility for conducting the program becomes the work of another. 3) Can request product (program) guarantees. 4) Sometimes external personnel are more respected than internal personnel simply because they are from the outside. 5) Bring global knowledge to the program because they have worked with a variety of entities and cultures. 6) Have the resources for sophisticated tools and programs because they can spread the cost across many clients. 7) Can reach a priority population that is geographically dispersed. Disadvantages 1) Often more costly than using internal personnel. 2) Subject to the limitations of any given vendor. 3) Sometimes less control over the program.
Internal Program Personnel
Advantages 1) reduced costs 2) Internal arrangments can be made to free needed personnel from their work schedules. 3) More control over those involved Disadvantages 1) Limited by the interest and abilities of those on staff. 2) May have to train personnel or be limited by the expertise of those one staff. 3) Might spend more time developing the program than implementing it, thus reaching fewer people.
Threats to internal validity
Alternative explanations to the claim that what one does or did with their experiment caused the desired changes one was aiming for.
What is an intervention?
An activity or set of activities that help to achieve the outcomes stated in the goals and objectives
Application
Apply knowledge to actual situations EX. apply, change, choose, demonstrate, discover, etc.
One of the Areas of Responsibility that does not have competencies directly applicable to implementing a health promotion program is __________.
Area I
According to your text, tasks related to identifying and allocating resources come from all EXCEPT which of the following areas of responsibility for health educators?
Area I and Area IV
Pilot (Field) Testing
Assesses programs in limited areas and/or time frames; allows for "dry runs" to measure overall program quality.
What are the 2 critical purposes of program evaluation?
Assessing and improving quality Determining program effectiveness
Pretesting
Assessing program components before implementation and collecting baseline data as comparison in post-test data.
Immediate Effects
Awareness, knowledge, attitudes, skills, behaviors.
Commercial Marketing
Benefit of marketer
Social Action
Both task and process oriented -Increases communities problem solving ability and achieving concrete changes to redress imbalances of power and privilege between the oppressed or disadvantaged group and the larger society
Analysis
Break down objects or ideas into simpler parts and find evidence to support generalizations EX. analyze, appraise, breakdown, etc.
Technical Assistants(TA)
Capacity-building assistant relationship in which individuals with specific knowledge and skills share their expertise via advice and training
Social Marketing Campaign
Change behavior of large group of people over a long period of time
Impact Objectives: Learning Objectives
Change in awareness, knowledge, attitudes or skills Hierarchy: awareness objectives>knowledge objectives>attitude objectives>skill development objectives EX. Awareness level: After the American Heart Association's pamphlet on cardiovascular health risk factors has been placed into grocery bags, at least 20% of the shoppers will be able to identify two of their own risks. EX. Knowledge level: When asked over the telephone, one out of three viewers of the heart special television show will be able to explain the four principles of cardiovascular conditioning. EX. Attitude level: During one of the class sessions, 50% of the participants will defend their reason for regular exercise. EX. Skill Development level: After viewing the video "How to Exercise", half of those participating will be able to locate their pulse and count it every time they are asked to.
What is an example of health-related community service strategies?
Clinical screenings for diabetes, blood pressure, cholesterol, low-cost flu shots
Cost Sharing
Combination of participant fee and third party
Which of the following is NOT a recognized method to interpret data as outlined by Fitzpatrick in your text?
Compare costs of data analysis methods.
Responsibility IV of the Responsibilities and Competencies for Health Educators, Conduct Evaluation and Research Related to Health Education, specifically addresses evaluation through all EXCEPT which of the competencies listed below?
Competency 4.2: Design Instruments
Synthesis
Compile component ideas into a a new whole of propose alternative solutions EX. Arrange, categorize, assemble, etc.
Posttest Only Non-experiment
Consists of nothing but a single observation. Good for cause and effect.
Implementing and evaluating campaign
Continuous process Monitor work Define goals Establish tracking system Continually modify Celebrate accomplishments
What are the 2 theories categorized by approach?
Continuum theories and stage theories
A written plan outlining what those in the priority population will be taught is called __________.
Curriculum
Process Objectives
Daily tasks, activities, and work plans that lead to the accomplishment of all other levels of objectives Focus on program resources, appropriateness, priority population exposure, attendance, participation and feedback Administrative/process EX. By 2015, the program planners will increase the number of heart healthy educational sessions offered to the county residents from the baseline of 15 to 25 per year. EX. By August 4, the volunteers will distribute the informational brochure to 33% of the county residents.
Managing a Social Marketing Campaign
Defining and understanding Choosing strategies Implementing and Evaluating Do it all over again, forever
Justification an element of a formative eval
Degree to which a program, service, or activity is mandated or approved by relevant stakeholders and justified by needs assessment data and analysis
Support an element of a formative eval
Degree to which a support component is built into a program, service, or activity, (e.g, a hotline/quit line for a tobacco media campaign, development of walking paths for a community physical activity plan)
Health promotion programs are always better if they can make a profit.
False
Recruitment* an element of a formative eval
Degree to which members of the priority population are adequately recruited through appropriate channels and places consistent with cultural and other unique characteristics
Multiplicity an element of a formative eval
Degree to which multiple components (i.e., intervention strategies) are built into the program, service, or activity (e.g., education, communivation, policy, environmental change, etc.)
Adjustment an element of a formative eval
Degree to which programs, services, or activities are modified based on feedback received from participants, partners, or other stakeholders.
Satisfaction an element of a formative eval
Degree to which the needs of participants are being met, how satisfied they are with the program, service, or activity, and their belief that a positive impact is being made in their lives
Consumer-Orientation an element of a formative eval
Degree to which the program, activity, or service is tailored to the priority population -- i.e., culturally appropriate and based on consumer preferences
Evidence an element of a formative eval
Degree to which the program, service, or activity is evidence-based (i.e., documented evaluation results in the literature suggest the program is effective or at least promising)
Comprehension
Demonstrate an understanding of the facts EX. classify, convert, defend, indicate, locate. etc.
Impact Objectives: Behavioral Objectives
Describe behavior or actions in which the priority population will engage that will resolve health problems and move toward achieving program goals. Adherence, compliance, consumption patterns, coping, preventative actions, self-care, utilization EX. One year after the formal exercise classes have been completed, 40% of those who completed the majority of the classes will still be involved in a regular aerobic exercise program. EX. During a telephone interview follow-up, 50% of the residents will report having had their b.p. taken during the past 6 months.
Impact Objectives
Describe the immediate observable effects of a program 3 types: learning objectives, behavioral objectives, and environmental objectives
Environmental Change strategies
Designed to change structure, types of services, or systems of care to improve delivery of health care services -Designed to change the target populations physical environment -DOES NOT REQUIRE ACTION BY TARGET POPULATION -Provides force-choice or default options *close relationship to health policy strategies EX. No smoking signs, eliminating ashtrays, providing lockers and showers, speed bumps, healthy snacks in vending machines, etc.
Related to the four marketing variables, which of the following is an important core benefit as it relates to health?
Develop a product that satisfies needs and desires of clients.
Summative Evaluation
Discusses a programs effectiveness, or if the program has met some prespecified objectives or outcomes
Posttest Only Design
Doesn't use a pretest because all groups are equivalent, and there are no interaction effects between pretest and intervention because no pre-test is given.
Community advocacy (Comm. Mob. Strategies)
Engage community in social change that impact health and well being 1. Opening doors 2. Identify the players 3. Making the link 4. Crafting your position 5. Organizing the troops 6. Visiting policy makers 7. Demonstrating power of press 8. Reinforcing message 9. Serving as a resource 10. Responding quickly 11. Reaching the finish line
Focusing the Evaluation Design
Ensures that the interests of the stakeholders are addressed, while using time and resources effectively.
Humor, gestures, expectations, and values of different groups within a community should be avoided by those trying to work within that community.
False
Inclusion an element of a formative eval
Extent to which an adequate range and number if appropriate partners or organizations are involved with the program, service, or activity.
Accountability an element of a formative eval
Extent to which internal staff and external partners are fulfilling their responsibilities as planned and are communicating needs appropriately.
Capacity an element of a formative eval
Extent to which professionals have adequate knowledge, skills, and abilities to design and implement a program, service, or activity or the degree to which they can access or contract with other organizations and professionals to provide the same program, service or activity.
Fidelity an element of process eval
Extent to which the program, activity, or service was delivered as planned or as per protocol including the use of Grant charts (i.e., time lines) and logic models
Context an element of Process eval
External factors that may influence program results (e.g., competing programs, conflicting messages, other confounders.
A PERT chart is a user-friendly, simple way to track events in planning and implementation.
False
A person who organizes a community coalition to enact changes that influence health is using the advocacy strategy of direct lobbying.
False
A person with the ability to understand and respect values, attitudes, beliefs, and mores that differ across cultures, and is able to respond appropriately to these differences is culturally sensitive.
False
A strategy is a general plan of action for affecting a health problem, and is limited to only one activity.
False
A strong brand can be harmful to product image.
False
According to your text, community organizing is the science of building consensus within the democratic process.
False
Although summative evaluation can be helpful, it is often sufficient to complete process evaluation measures and avoid costly summative evaluation measures.
False
Although using multiple strategies in an intervention may be cumbersome, it is worthwhile because they are much easier to evaluate.
False
An institutional review board is available to provide methodological guidance to evaluators, but is limited to survey research only.
False
Analysis of two variables is called multivariate analysis.
False
Baseline data are collected immediately following the end of a short term program.
False
Because community organization is so limited in scope, this function only relates to Responsibility III, Implementing Health Education.
False
Dose is a measurement of any confounding factors that could affect program participation or results.
False
Dose refers to the number of components that make up an intervention.
False
What are the elements of a process evaluation? pg 393, table 14.2
Fidelity, Dose, Recruitment, Reach, Response, Context
Process Evaluation
Focuses on quality of content and program implementation. Guides development of a program as it unfolds.
Types of groups
Formal groups: command groups, task groups Informal groups: Interest groups, friendship groups
Building a team
Forming Norming Performing Adjourning (mourning) OR Reforming
Goals
General statement describing long term outcome Broad statement of direction in nontechnical language Written to include all aspects or components of a program Usually not measurable EX. Decrease Incidence of STI among teens
What is pilot testing? (field testing, alpha testing)
Generally assesses programs in limited areas and/or time periods. Gnerally presents the entire program to a limited and managed # of members of the priority population so necessary modifications can be made before the program is implemented to a larger segment of the priority population.
Experimental Designs
Greatest control over confounding variables, and minimize effects of other events on program effectiveness. These designs investigate cause-effect relationships and use random assignment to experimental, control groups.
Community
Group of people who share similar characteristics
Which of the following questions would NOT be included on a checklist to evaluate vendors of products or services?
Has the vendor settled its lawsuits?
What are the 7 types of health strategies?
Health communication strategies Health education strategies Health policy/enforcement strategies Environmental change strategies Health related community service strategies Community mobilization strategies Other strategies
Factors that affect how we communicate, understand, and respond to Health Information are called __________.
Health literacy
Community mobilization (Comm. Mob. Strategies)
Identify and take action on shared concerns using participatory decision making
Community organizing (Comm. Mob. Strategies)
Identify common problems, mobilize resources, and implement strategies for achieving goals
Health Related Community Services
Improving availability, accessibility, affordability, and health services to increase health EX. Offering low cost or free immunizations, clinical screenings, professional health check ups. Settings include: grocery stores, shopping malls, health fairs, worksites, mobile units and personal residences
Health Policy/Enforcement Strategies
Include executive orders, laws, ordinances, judicial decisions, policies, regulations, rules and position statements Effective in reinforcing and supporting prevention messages EX. can affect the built environment, such as zoning, maintenance, and architect.
Experimental Design Characteristics
Independent variables, dependent variables, hypothesis, experimental and control groups.
Gatekeepers
Individuals who formally and informally control the political climate of a community
__________ statistics are concerned with relationships and causality.
Inferential
What is Interpersonal level?
Interpersonal processes and primary groups, including family, friends and peers that provide social identity, support and role definition
What are some of the public policy factors?
Local, state and federal policies and laws that regulate or support healthy actions and practices for disease prevention, early detection, control and management
Quasi-Experimental Design
Looks like an experimental design, but lacks random assignment. Makes comparisons between groups that are not equal.
Which of the following is an advantages of using a pilot program?
Maintain close control of the program.
Evaluation
Make and defend judgements based on internal evidence or external criteria EX. appraise, argue, judge, justify, etc.
MAP-IT: Action model to achieve health people goals
Mobilize>Assess>Plan>Implement>Track
Long-term Effects
Mortality, morbidity, disability.
A weight loss program that uses weekly dues is an example of...?
Negative reinforcement
One Group Pretest-Posttest Design
No control or comparison group, or random assignment; just the pretest, then the intervention, then the posttest.
If variable B increases as variable A increases, it is referred to as a positive correlation.
True
Dose an element of process eval
Number of program units delivered
Experimental Designs pg 403
Offer the greatest control over the various factors that may influence the results (confounding variables). - random assignment to control and experimental groups with measurement of both groups. - produces the most interpretable and defensible evidence of effectiveness.
Formative Evaluation
Ongoing process of evaluation while the program is being developed and implemented.
Community building (Comm. Mob. Strategies)
Orientation to problem solving based on community strengths and assets
Impact Objectives: Environmental Objectives
Outline non-behavioral causes of a health problem present in social, physical, psychological, economic, service and political environment. EX. By the year 2020, 10% of the clinic patients will have been able to schedule an appointment either after 5pm or on a Saturday EX. By the end of the year, all senior citizens who want it will be provided transportation to the congregate meals.
Statistical Regression
Over time, the very high and very low scores on a test often tend to drift back toward the average for the group.
Which of the following is NOT part of a checklist of emergency care plan items?
Participants with high-risk problems must maintain their anonymity.
Change is most likely to occur when________
People it effects are initiating and promoting the intervention
What are the common resources used in most health promotion programs?
Personnel, Curriculum and other instructional resources, Space, Equipment, Supplies, Financial Resources
Five phases for implementing health promotion programs
Phase 1: Adoption of the Program (pg 347) Phase 2: Identifying and prioritizing the tasks to be completed (pg 347) Phase 3: Establishing a System of Management (pg 350) Phase 4: Putting the plans into action (pg 354) Phase 5: Ending or Sustaining a Program (pg 357)
Interventions
Planned set of strategies based on theory and evidence based practice that occurs between 2 measurement points designed to facilitate achievement of pre-specified objectives EX. Point 1: Police documentation of number of rapes in community is on the rise Intervention Strategies: Improved street lighting, safe ride program, skills training, policy changes Point 2: Measurement of rapes in community 1. Effective- produce desired results? 2. Efficient- use resources in reasonable manner? 3. Theory-based- Sound theory and evidence? 4. Multiplicity- How many components will comprise intervention? 5. Dose- How many programs will be delivered?
What are the types of theories and models:
Planning models and behavior change theories
Objectives
Precise statements indicate measurable terms, specific changes at a given point in time due to program exposure. Elements include: Target Population (who) Outcome (what) Condition (when) Criterion (how much)
What are the 5 stages of the transtheoretical model?
Precontemplation contemplation preparation action termination
A person who purchases new running shoes and a pedometer is in what phase of the Transtheoretical model?
Preperation
4 P's of Marketing
Product Price Place Promotion
Mission Statement
Program overview/aim Inclusive and broad Short narrative giving general focus answering what and why EX. The mission of the Walkup Health Promotion Program is to provide a wide variety of primary prevention activities for the residents of the community.
Increasing product awareness, persuading people to purchase a product, and reminding people that a product exists are all primary purposes of which marketing variable?
Promotion
Response an element of PROCESS eval
Proportion of the priority population actually participating in the program, activity, or service.
Response* an element of a formative eval
Proportion of the priority population g the actually participating in the program, activity, or service
Reach an element of PROCESS eval
Proportion of the priority population given the opportunity to participate in the program, activity, or service
Reach* an element of a formative eval
Proportion of the priority population given the opportunity to participate in the program, activity, or service
Mission, Goals, and Objectives
Provide foundation and direction
Health education strategies
Purpose: Predispose, enable and reenforce voluntary, behavioral decisions Increase awareness and knowledge, transform attitudes, an demonstrate skills Detailed, comprehensive and extensive
Interaction an element of a formative eval
Quality of interactions (e.g, customer service; interpersonal, counseling, and presentation skills; clarity of instructions) between professionals (those providing) and participants
Experimental Design
Random assignment of persons to experimental and control groups with measurement of both groups.
Measures of spread or variation include __________.
Range
Planning Model
Recognizing the issue Gaining entry into the community Organizing the people Working with Communities -Analyzing data and interpreting findings -Assessing -Priorities and Goals -Interventions -Implementing -Evaluating -Maintaining Outcomes -(Looping Back)
Knowledge
Remember previously learned information EX. arrange, describe, duplicate, identify, etc.
All EXCEPT which of the following are ways to ensure that evaluation results are used?
Report the results in one concise format.
The Responsibilities and Competencies for Health Educators that is related to creating an intervention is __________.
Responsibilities I & II
Quasi-experimental Designs pg 403
Results in interpretable and supportive evidence of program effectiveness, but usually cannot control for all factors that affect the validity of the results. - NO random assignment to the groups, and comparisons are made on experimental and comparison groups.
What are some of the community factors?
Rules, regulations policies, and informal structures, which may constrain or promote recommended behaviors
What are the concerns that need to be addressed before implementation can take place? (pg 359 - 367)
Safety and Medical Concerns, Ethical Issues, Legal Concerns, Program Registration and Fee Collection, Procedures for Record Keeping, Procedural Manual and/or Participants' Manual, Program Participants with Disabilities, Training for Facilitators, Dealing with Problems, Reporting and Documenting
Locality Development
Seeks community change through broad self-help participation from the local community -heavily process oriented, stressing consensus, and cooperation and aimed at building group identity and sense of community
Pretest-Posttest-Control-Group Design
Selects subjects and assigns them to experimental or control groups randomly, and pretests each group.
What is an example of a primary building block?
Skills and abilities of residents
SMART objectives
Specific- who is to do what? Measurable- How much change is expected? Achievable- given resources and constraints Realistic- realistic cues to action Time phased- Provide time period indicating when objectives will be met and when they will be measured
The transtheoretical model has four major constructs
Stages of change Processes of change self-efficacy decisional balance
Approaches
Strategies used in process, formative, or summative evaluations evaluations.
Designs
Strategies used in summative evaluations.
Pretest-Posttest Comparison-Group Design (Non-equivalent Groups Design)
Structured like the pretest-posttest randomized experiment, but actually lacks the key feature of random assignment.
Health Communication Strategies
Study and use of communication strategies to inform and influence individual and community decisions that affect health Increase risk perceptions, provide cues to action, reenforce attitudes, increase penetration rate, be cost effective, decrease threatening channels, be intra and inter-personal, organizational, and use mass media
Compensatory Rivalry
The comparison group knows what the program group is getting, and develops a competitive attitude with them. Ex. students seeing what special tutored kids in the math program are getting and feel jealous.
Resentful Demoralization
The comparison group knows what the program group is getting, and gets demoralized or decides to give up.
Testing as a threat to internal validity
The fact that participants are being observed or tested may affect their behavior or attitudes.
Stakeholders
The individuals involved in program operations, those served or affected by the program, and the primary users of the evaluation results
Mortality
The loss of data or participants.
What is the primary focus of formative evaluation? pg. 388
The quality of program content and program implementation. Can be used to improve a program between implementation, but it is better to allow a formative evaluation to inform and guide the development and implementation of a program as it actually unfolds.
Diffusion or imitation of treatments
This results when a comparison group learns abotu the program either directly or indirectly from program group participants. Ex. schoolchildren sharing experiences during lunch hour, and non-program students trying to imitate what the other students are getting.
A coalition is the formal alliance of organizations working for a common goal.
True
A common problem associated with evaluation is inadequate documentation of methods, results, and data analysis.
True
A group of people who meet regularly to discuss problems and identify possible solutions is called a quality circle.
True
A local speaker's bureau can provide excellent program resources as well as improved public relations and recognition.
True
A logic model is often used for Step 2 of the CDC's framework for program evaluation.
True
A logic model visually conveys the connection between a program and the desired outcomes.
True
A program procedural manual can help to avoid Type III errors.
True
According to the Stimulus-Response Theory, the two broad categories of environmental consequences include reinforcement and punishment. Select one: True False
True
According to the Stimulus-response theory, the two broad categories of environmental consequences include reinforcement and punishment. True/False?
True
Adults are motivated to learn by the need to solve problems.
True
Always consider the competition when developing health promotion interventions.
True
An independent t-test of statistical significance can be used to study differences between two groups at a single point in time.
True
An independent t-test of statistical significance can be used to study differences between two groups at a single point in time. True/False
True
As it applies to health promotion, evaluation has been defined as the comparison of an object of interest against a standard of acceptability.
True
Community stakeholders must be the ones to establish priorities and set goals if community organizing is to succeed.
True
Competencies 4.3, 4.4, and 4.5 of Area of Responsibility IV are all relevant to data analysis and reporting.
True
Considering whether or not a person is ready to find out if she is HIV positive is an emotional price of participating in a health program.
True
Evaluation processes and designs are most closely related to Area of Responsibility IV for Health Educators.
True
Even though they are not paid, it is important for volunteers to have a job description.
True
Grant funding, which is available for a limited time period is often called soft money.
True
Grant funding, which is available for a limited time period is often called soft money. True/False
True
Health educators should consider whether a canned program they are thinking about using will be enjoyable for the priority population.
True
Health policy/enforcement strategies often need to be presented in light of the common good.
True
Health promotion programs for people with disabilities should have an underlying conceptual framework.
True
Responsibilty VII, Competency 7.2 of Responsibilities and Competencies for Health Educators is Identify and Develop a variety of communication strategies, methods and techniques. This is particularly helpful for marketing skills.
True
Social reinforcers and material reinforcers are two categories of incentives.
True
Strategies that do not necessarily require action on the part of the priority population are Environmental Change Strategies.
True
The American Public Health Association and Centers for Disease Control guidelines for establishing feasibility of health promotion programs included the criterion that health promotion programs should make optimum use of available resources.
True
The act of converting planning, goals, and objectives into action is called implementation.
True
The act of converting planning, goals, and objectives into action is called implementation. True/False?
True
The best known categories of community organization are locality development, social planning, and social action.
True
The best known categories of community organization are locality development, social planning, and social action. True/False
True
The evaluation planning process should include a determination of how the results will be used.
True
The extent to which a program can be expected to produce similar effects in other populations is known as external validity.
True
The first step in community organizing is recognizing the issue.
True
The first step in community organizing is recognizing the issue. True/False
True
The most critical purposes of program evaluations are assessing and improving quality, and determining effectiveness.
True
The process of achieving results through controlling human, financial, and technical resources is known as management.
True
The term "best practices" refers to recommendations for an intervention based on review of many studies that substantiate the intervention's efficacy.
True
The term "best practices" refers to recommendations for an intervention based on review of many studies that substantiate the intervention's efficacy. True/False
True
The true mark of program success should always be linked to the extent to which its goals and objectives are achieved.
True
Tying your new program to an event in the news or current health issue is called using a news hook.
True
Using the Diffusion Theory for marketing a health program is helpful because it allows marketers to use different techniques based on the type of people involved.
True
When individuals who are part of a priority population also serve to educate their population, the process is called external sourcing. True/False
True
Outcome Objectives
Ultimate objectives of a program and are aimed at changes in the health status, social benefits, risk factors and quality of life. Reduction in risk, physiological indicators, signs and symptoms, morbidity, disability, mortality and quality of life measures EX. By the year 2020, heart disease deaths will be reduced to no more than 100 per 100,000 in the residents of Franklin County. EX. By 2020, increase to at least 25% the proportion of men in Franklin County with hypertension whose blood pressure is under control.
Which of the following is NOT a practical way to use quantitative and qualitative measures in evaluation?
Use alternating qualitative and quantitative methods, several times each.
Curriculum and other instructional resources
What educational materials are needed to implement the program? Will the planners create them? Will they be purchased? Will they be donated? Need for curriculum? Canned program be used?
Equipment
What is needed?
Space -- questions to be answered
What space is needed to implement the program? How will you obtain the space? Will there be a charge for the space? Will it be donated? If donated, are there hidden costs like paying for custodial services?
Space
What space is needed to implement the program? How will you obtain? Will there be a charge? Donated? Hidden costs?
Supplies
What supplies are needed for planning? What supplies are needed for implementation
what is a construct?
When a concept has been developed, created or adopted for us with a specific theory
Compensatory Equalization of Treatments
When program and comparison group participants are aware of each other's conditions, they may wish they were in the other group. Ex. if the special math tutoring was done with state-of-the-art computers, the parents in the non-tutoring class would also want them.
Internal Validity
Whether the intervention produced the change.
External Validity
Whether the results are likely to apply to other people and situations.
Personnel
Who is needed to plan the program? Professionals? Advisory committee? Who is needed to implement the program? Facilitators? Support staff? Vendor? Who will evaluate? Is there a need for partnership?
All EXCEPT which of the following are topics a planner would want to receive feedback on during a pretest?
Will the Priority Population purchase the product?
Lesson plan (health education strategies)
Written outline of a lesson) -Introduction -Body -Conclusion Five stages: 1. Gain attention 2. Present stimulus material 3. Provide guidance 4. Elicit performance and provide feedback 5. enhance retention and transfer
Cultural Competence
a developmental process defined as a set of values, principles, behaviors, attitudes, and policies that enable health professionals to work effectively across racial, ethnic and linguistically diverse populations
What is the ecological perspective?
a multilevel, interactive approach to examining the influences on health-related behaviors and conditions
Curriculum of an intervention
a planned set of lessons or courses designed to lead to competence in an area of study
What is a theory?
a set of interrelated concepts, definitions, and propositions that presents a systematic view of events or situations by specifying relations among variables in order to explain and predict the events of the situations
What is marketing?
a set of processes for creating, communicating, and delivering value to customers
What is a model?
a subclass of a theory
Which of the following is NOT normally a component of a canned health education program?
a tailored approach for your priority population
What is segmentation?
a way to divide the priority population into smaller, more homogeneous or similar groups
Advantages of using internal health education program personnel include __________. Select one: a. there is more control over those involved b. they have the resources for sophisticated tools and programs c. you can reach a geographically dispersed population d. the ability to request program guarantees
a. there is more control over those involved
An intervention is the __________.
activity that occurs between two things, events, or points in time
An intervention is the...
activity that occurs between two things, events, or points in time
Contract
agreement between two or more parties that outlines the future behavior of those parties
Grants and Gifts
an award or financial assistance from other agencies, foundations, groups, and individuals
Contracting with a small group of professionals who are not associated with the program, but who have expertise in the program area, to collect data, analyze the program, draw conclusions, and recommend action is called __________.
an expert panel review
What are some techniques planners can use to enhance the first day or implementation?
an extension of promotion; decide on a day, launch the program to coincide with other events or special days, kick off the program in style: have a special event on the first day (i.e., ribbon cutting, health fair, contest), news coverage
What is intention in theory of planned behavior?
an indication of a person's readiness to perform a given behavior and it is considered to be an immediate antecedent of behavior
When no one, including planners of a health promotion intervention, can connect a participant's identity to information related to the program it is called __________.
anonymity
Utility, feasibility, propriety, and accuracy __________.
are four standards of evaluation
Secondary building blocks in a community map are __________.
assets located within the community, but largely controlled by outsiders
What is social marketing?
attempts to change behavior for improved health or social outcomes
Guidelines to reaching consensus include __________.
avoid "either/or" thinking
Health educators who choose to use incentives should NOT __________.
award the incentives privately to avoid embarrassment or envy
Consumer based Programs
based on priority populations wants, needs, desires, etc.
Occasional Participants
become involved on an irregular basis and usually only when major decisions are made
What are occasional participants?
become involved on an irregular basis and usually only when major decisions are made
The socio-ecological persepctive
behavior has multiple levels of influences "emphasizes the interaction between, and the interdependence of factors within and across all levels of a health problem." interventions must be aimed at multiple levels of influence in order to achieve substantial changes in health behavior.
Cultural blindness
believes that color or culture makes no different and that all people are the same
Considering the attributes of a particular product as they would appeal to the priority population is referred to as a(n) __________.
benefit
Participant Exchange
benefit offered by product must be greater than the cost
What is social action?
both task and process oriented. concerned with increasing the community's problem solving ability and achieving concrete changes to redress imbalances of power and privilege between the oppressed or disadvantaged group and the larger society
All EXCEPT which of the following are characteristics of those in communities? Select one: a. common symbol systems b. membership c. residence in different countries d. shared values and norms
c. residence in different countries
All EXCEPT which of the following are characteristics of those in communities? Select one: a. common symbol systems b. membership c. residence in different countries d. shared values and norms
c. residence in different countries
Advantages of using internal health education program personnel include __________. Select one: a. they have the resources for sophisticated tools and programs b. the ability to request program guarantees c. there is more control over those involved d. you can reach a geographically dispersed population
c. there is more control over those involved Correct
Distinguishing between cause and effect __________.
can be a barrier to effective evaluation
Analysis of variance __________.
can be used to study differences between more than two groups
For purposes of program planning, equipment and supplies __________.
can vary as to how they are defined
Internal recognition of a community issue or concern is referred to as __________.
citizen-initiated organizing
When program planners select a curriculum to use, they should __________.
consider options for external and/or internal curricula
A suitable program evaluation consultant __________.
considers programmatic realities when designing an evaluation
What are executive participants?
core group that consists of people who are committed to the resolution of the concern, regardless of the time frame
A process that determines how many dollars will be returned for dollars invested in a health promotion program is called __________.
cost-benefit analysis
Third-party payers for health education programming __________.
could be employers or professional associations
A written plan outlining what those in the priority population will be taught is called __________.
curriculum
units of study (health education strategies)
curriculum plans, modules and strands
What is negative reinforcement?
decreased poor self-image, fatigue after exercise; weight loss program with weekly dues
Sequence
defines the order in which the material is presented the vertical relationship among the curricula areas
Step 2 of the model for selecting an evaluation design found in your text involves ___________.
dependent variables
When program planners select a curriculum to use, they should __________.
develop their own, in house curriculum, to avoid conflict
Canned Program
developed by an outside group and includes the basic components and materials necessary to implement a program
Canned Health Promotion Programs
developed by an outside group and includes the basic components and materials necessary to implement a program, the cost of these programs can range from literally nothing at all to thousands of dollars five major components: 1) Participants Manual 2) Instructor's Manual 3) Audiovisual materials that help present the program 4) Training for the instructors 5) Marketing
Diversity
difference among people
What is an example of environmental change strategies?
equipping cars with seat belt and air bags speed bumps located near playgrounds/schools to slow traffic lowering the price of healthy food in vending machines
As a part of comprehensive evaluation strategies, assessing capacity means __________.
examining the competency of those who design and implement programs
The following evaluation design is called __________. (R) O1 X O2 (R) O1 O2
experimental pretest-posttest design
Negligence
failing to act in a prudent (reasonable) manner can rise from two types of acts: Omission: an act of omission is not doing something when you should, such as failing to warn program participants of the inherent danger in participation Commission: doing something you should not be doing, such as leading an aerobic dance program when you are not trained to do so.
Analysis of two variables is called multivariate analysis. True/false
false
What is positive reinforcement (reward)?
feeling good after exercise
The extent to which a program was delivered as planned or as per protocol is called __________.
fidelity
Regarding personnel available for program implementation, planners should first __________.
focus on the tasks that need to be completed
standing committees
for the overall work and productivity of organization effort
Coalition
formal alliance of organizations that come together to work towards a common goal
Sub committees
formed from members of an existing committee
When someone from outside of a community recognizes a problem within that community __________.
gatekeepers should be sought out
Theory
general application of why people act or do not act to main or promote the health of themselves, their families, organizations, and communities
Factors that affect how we communicate, understand, and respond to Health Information are called __________.
health literacy
Oversight, partner, and advisory group
help obtain direction and guidance from people who understand the key issues and dynamics of a community based program
Segmentation of a priority population __________.
helps identify similar consumer groups within a population
What is an example of a secondary building block?
higher education, institutions and hospitals
A visual depiction of how one category differs from another in an evaluation is best shown by __________.
horizontal bar charts
Resources
human, fiscal and technical assets
The health belief model...
hypothesizes that health-related action depends on the simultaneous occurrence of three classes of factors [individual perceptions, modifying factors and likelihood of action]
Changed knowledge, attitudes, or skills are measures of __________.
impact evaluation
When evaluating materials using the SAM method, learning stimulation and motivation can be rated by __________.
interaction used
What is positive punishment?
introduction of cigarette smoke (aversive stimulus) to encourage quitting smoking
Health-related community service strategies __________
involve services, tests, or treatments within the priority population
Health-related community service strategies __________.
involve services, tests, or treatments within the priority population
A successful coalition __________.
involves community volunteer agencies
The abstract section of an evaluation report __________.
is a concise presentation of the evaluation
A brand __________.
is a name, term, design, or symbol that indentifies one sellers goods
Chi-square analysis ___________.
is appropriate to compare a sample distribution to a population distribution
Behavior modification __________.
is based on Stimulus-Response and Social Cognitive theories
What is social planning
is heavily task oriented, focused on rational-empirical problem solving, usually by an outside expert
Which of the following is NOT a key principle for marketing of products and programs?
keep the product available only in limited areas or time periods
The simplest form of timetable for program planners is the __________.
key activity chart
Strategies of health education
lecture/discussion, group work, audiovisuals, computer, practice, written materials
The methods of professional change that deal with issues beyond the individual, family, and small group level are called __________.
macro practice
Charging members of the priority population for a health education intervention __________.
may be more appropriate if a sliding payment scale is used
generalizability
most closely associated with program evaluations that involve large sample sizes and are found to be internally valid. The more a program is tailored to a particular population, the greater the threat to external validity, and the less likely it is that the program can be generalized to another group.
Evaluating whether student stress can be predicted by lack of sleep, nutritional habits, employment, and interpersonal relationships would be accomplished using __________.
multivariate analysis
What types of evaluation designs do not use control groups?
nonexperimental designs
Community organizing
process by which the community groups are helped to identify common problems or goals, mobilize resources, and develop and implement strategies for reaching their goals they have collectively set
Checking to see whether or not a program is being implemented as it was intended is an example of __________.
process evaluation
Increasing product awareness, persuading people to purchase a product, and reminding people that a product exists are all primary purposes of which marketing variable?
promotion
Program launch, rollout, or kickoff are all terms that describe the first day of a program, and they are an extension of the marketing principle of __________.
promotion
Coded data __________.
provide a way for evaluators to translate data for various analyses
What is an example of a potential building block?
public information
Measures of spread or variation include __________.
range
SMOG, Fog-Gunning, and Fry are all __________.
readability formulas
The term evaluation design __________.
refers to summative evaluation
Scope
refers to the breadth and depth of the material covered in a curriculum the horizontal organization of the substance of the curriculum
What is the scope?
refers to the depth of material covered
Multiplicity
refers to the number of components or activities that make up the intervention the interventions that include several activities are more likely to have an effect on the priority population than those that consist of a single activity. several activities and multiple levels of influence
In the stimulus response theory what are the 2 types of consequences?
reinforcement and punishment
*
relate to formative eval as they help ensure that an adequate # of ppl are participating in the program. But they also relate to process eval as an eval of the implementation process itself would naturally measure not only how many people had the opportunity to participate in the program, but more importantly, how many people actually participated.
Formative evaluation __________.
relates to quality assessment
Which of the following is NOT a criterion to consider potential population segments?
reproducible
Which of the following is NOT a criterion to consider potential population segments? differentiable actionable reproducible substantial
reproducible
Participant Fee
requires participants pay for the cost of the program
All EXCEPT which of the following are characteristics of those in communities?
residence in different countries
Communication channel (health communication strategies)
route through which message is disseminated to priority population Interpersonal (one on one) Intrapersonal (small group) Organization and community Mass media Social media
What is an example of health policy/enforcement strategies?
seat belt laws cigarette taxes no smoking laws
What is locality development?
seeks community change through broad self-help participation from the local community
What are supporting participants?
seldom involved by help swell the ranks and may contribute in nonactive ways or through financial contributions
Supporting Participants
seldom involved, but help swell the ranks and may contribute in nonactive ways or through financial contributions
A threat to internal validity, which brings about differences in experimental and control groups due to lack of randomization is called __________.
selection
In the Multidirectional Communication Model, communication does NOT occur through __________.
sender shared horizontal
HIPPA
sets national standards that health plans, health care clearinghouses, and health care providers who conduct certain health care transactions electronically must implement to protect and guard against the misuse lead to civil and criminal penalties
ad hoc committee
shortest group love and narrowest charge with a specific purpose and predefined deadline
What is a control group? pg 402
should be as close to the experimental group as possible, but the members of this group do not receive the program that is to be evaluated used to make sure that the effects are caused by the program and not by some other factor
Third-Party Support
someone other than the participants (first party) or Planners (second party) pay for the program. (employers, sponsoring agencies, professional associations)
What are active participants?
take part in most group activities and are not afraid to do the work that needs to be done
Active Participants
take part in most group activities and are not scared to do the work that needs to get done
What is negative punishment?
taking away health insurance if workers smoke
The second pretesting phase __________.
tests the promotional strategy messages and materials
What is implementation?
the act of converting planning, goals, and objectives into action through administrative structure, management activities, policies, procedures, regulations, and organizational actions of a new program
Lessons
the amount of material that can be presented during a single educational encounter example: the amount of material that can be presented in a one-hour class
health advocacy
the community advocacy that deals with health issues; the process by which the actions of individuals or groups attempt to bring about social, environmental, and/or organizational change on behalf of a particular health goal, program, interest, or population
Internal Validity
the degree to which change that was measured can be attributed to the program and allows evaluators to speak with more confidence that the program actually made a difference. factors that can threaten internal validity: page 405
Health Numeracy
the degree to which individuals have the capacity to access, process, interpret, communicate, and act on numerical, quantitative, graphical, biostatistical, and probabilistic health information needed to make effective health decisions
health literacy
the degree to which individuals have the capacity to obtain, process, and understand basic health information and services to make appropriate health decisions a complex phenomenon that involves skills, knowledge, and the expectations that health professionals have of the public's interest in and understanding of health information and services.
What is attitude toward the behavior in theory of planned behavior?
the degree to which performance of a behavior is positively or negatively valued (Do I really think this behavior is good for me) (How important is this behavior to me)
External Validity
the extent to which the program can be expected to produce similar effects in other populations. The more a program is tailored to a particular population, the greater the threat to external validity, and the less likely it is that the program can be generalized to another group. factors that can threaten external validity: page 407
What is multiplicity?
the number of components or activities
The ethical principle of nonmaleficence is __________.
the obligation to do no harm
What is a variable?
the operational (practical use) form of a construct
What is subjective norm in theory of planned behavior?
the perceived social pressure to engage or not engage in a behavior (Do others think i should behave this way) (how much do I care what others think)
What is a concept?
the primary elements or building blocks of a theory
What is market?
the set of all people who have an actual or potential interest in a product or service
Organizational Sponsorship
the sponsoring organization bears the cost of the program as a part of its programming or operating budget
What is an intervention?
the theory-based strategy or experience to which those in the priority population will be exposed or in which they will take part. "to come or occur between two things, events, or points in time; to come in or between as to hinder or alter action" something that occurs between the beginning and the end of a program or between pre- and post-program measurements. may use a single activity, or it may be a combination of two or more activities.
Units of study
the way the scope of the curriculum may be presented an orderly, self-contained collection of activities educationally designed to meet a set of objectives (curriculum plans, modules, strands)
lesson plan
the written outline of a lesson three components: introduction, body, conclusion
Punishment
there is a decrease in behavior
Reinforcement
there is an increase in behavior
Advantages of using internal health education program personnel include __________.
there is more control over those involved
Implementation
to carry out; the act of converting planning, goals, and objectives into action through administrative structure, management activities, policies, procedures, regulations, and organizational actions of new programs - the setting up, managing, and executing of a project - one of three stages of program diffusion, with the other two being adoption and sustainability.
Staff groups
to enhance communication and decision making
The process of achieving results through controlling human, financial, and technical resources is known as management. True/False
true
Cooperative Agreements
two parties share resources and work together to offer a program or service
External program evaluation __________.
typically has more technical expertise than internal evaluation
Alcoholics Anonymous, Weight Watchers, and Gamblers Anonymous are all examples of __________.
use of a support or buddy system
confidentiality
used to protect the privacy of participants - exists when planners are aware of the participants' identities and have promised not to reveal those identities to others.
anonymity
used to protect the privacy of participants - when no one, including the planners, can relate a participant's identity to any information pertaining to the program
Health communication strategies are __________.
useful in building social norms
Social Marketing
uses marketing principles to design programs that facilitate voluntary behavior change for improved personal or societal well being -Benefit of Consumer Identify Behavior to change Identify audience Identify barriers Reduce barriers Pretest ideas Publicize both benefits and efforts Assess results
A Gantt chart __________.
uses varied size lines to indicate completion of tasks
A __________ is a characteristic or attribute that can be measured or observed.
variable
The operational form of a construct is a...
variable
Health educators who work with groups of volunteers should remember that __________.
volunteers should receive clear communications and signs of appreciation
Comparison Group
when participants cannot be randomly assigned to an experimental or control group, a nonequivalent group may be selected. important to find a group that is as similar to the experimental group as possible not randomly selected or assigned
Nonexperimental Designs pg 403
without the use of a comparison or control group, has little control over the factors that affect the validity of the reults.
