Exam 2/Final Exam 458
"Annual Senior Night Out" Intervention Implementation1.Brainstorm all the preparations/activities that must be done before, during and after the activity2.Place the preparations/actitivities in chronological order, what should be done first, second etc. What can be done simultaneously?3.Identify the time to allot for each preparation/activities. For example, will it take a week to schedule venues? How long will you devote to recruiting (and training?) volunteers?4.Place the preparations/activities on the Gantt chart and block out the time frame for them to occur.
"Annual Senior Night Out" Intervention Implementation1.Brainstorm all the preparations/activities that must be done before, during and after the activity2.Place the preparations/actitivities in chronological order, what should be done first, second etc. What can be done simultaneously?3.Identify the time to allot for each preparation/activities. For example, will it take a week to schedule venues? How long will you devote to recruiting (and training?) volunteers?4.Place the preparations/activities on the Gantt chart and block out the time frame for them to occur.
Logic Models - 1 •A logic model: -systematic and visual way to see relationshipamong•resources they have to operate a program•activities they plan to implement•outputs and outcomes they hope to achieve-Can help all stakeholders understand the ''big picture'' of how planning, implementing, and evaluating all fit together. •Three components of a logic model:-Inputs (resources)•Human resources, partnerships, equipment, supplies, materials, and community resources-Outputs (activities)•Products, services, and infrastructure-Outcomes (results or effects)•Short-term, mid-term, and long-term
1_____________: -systematic and visual way to see relationship among •resources they have to operate a program •activities they plan to implement•outputs and outcomes they hope to achieve-Can help all stakeholders understand the ''big picture'' of how planning, implementing, and evaluating all fit together. •Three components of a logic model :-____________ •(resources) •Human resources, partnerships, equipment, supplies, materials, and community resources-____________ (activities)•Products, services, and infrastructure-____________ (results or effects)•Short-term, mid-term, and long-term
Advantages and Disadvantages of Using Internal and External Personnel slide 4, ch 10
Advantages and Disadvantages of Using Internal and External Personnel slide 4, ch 10
Another example of intervening variables and confounding variables •_____________ variable: -COVID-19 infections -severe symptoms -Hospitalizations-death •_____________ variable:-COVID-19 vaccinations•Intervening variable: -Transportation to clinics-Access to register for appointments-Snowstorms that delay vaccine shipments •_____________ variables: -Efficacy rate of the vaccine-Getting one or two shots (if two shots recommended)-Co-occurring medical conditions-Practicing or not preventive measures-Exposure to the virus-Others?
Another example of intervening variables and confounding variables •Dependent variable: -COVID-19 infections -severe symptoms -Hospitalizations-death •Independent variable:-COVID-19 vaccinations•Intervening variable: -Transportation to clinics-Access to register for appointments-Snowstorms that delay vaccine shipments •Confounding variables: -Efficacy rate of the vaccine-Getting one or two shots (if two shots recommended)-Co-occurring medical conditions-Practicing or not preventive measures-Exposure to the virus-Others?
Assumptions of Community Organizing 1.Communities can develop the capacity to deal with their own problems .2.People want to change and can change. 3.People should participate in making changes. 4.Self-imposed and self-developed change is more lasting. 5."Holistic" is preferred over "fragmented" approach. 6.Democracy requires cooperative participation. 7.Communities need help w/ problems just like individuals do.
Assumptions of Community Organizing 1.Communities can develop the capacity to deal with their own _____________ .2.People want to _____________ and can change. 3.People should participate in making changes. 4.Self-_____________ and self-_____________ change is more lasting. 5."_____________" is preferred over "fragmented" approach. 6.Democracy requires cooperative participation. 7.Communities need help w/ problems just like individuals do.
Basic Terminology - 1 •Evaluation - -The process of determining the value or worth of a health promotion program or any of its components based on predetermined criteria or standards of acceptability identified by stakeholders.-Impact Evaluation: https://www.youtube.com/watch?v=HEJlT8t5ezU2:07
Basic Terminology - 1 •_____________ - -The process of determining the value or worth of a health promotion program or any of its components based on predetermined criteria or standards of acceptability identified by stakeholders.-Impact Evaluation: https://www.youtube.com/watch?v=HEJlT8t5ezU2:07
Basic Terminology - 2 •Formative Evaluation --Purpose is to improve the overall quality of a program or any of its components before it is too late (i.e., the program concludes).-Attempts to enhance program components before and during implementation.•Process Evaluation --Assesses the implementation process in general, and tracks and measures what went well and what went poorly and how these factors contributed to the success or failure of a particular program.-Measures the degree to which the program was successfully implemented and generally applies lessons learned in subsequent versions or implementations of the program.•Formative and process evaluations are often used interchangeably and have become somewhat synonymous.
Basic Terminology - 2 •____________ Evaluation --Purpose is to improve the overall quality of a program or any of its components before it is too late (i.e., the program concludes).-Attempts to enhance program components before and during implementation.•____________ Evaluation --Assesses the implementation process in general, and tracks and measures what went well and what went poorly and how these factors contributed to the success or failure of a particular program.-Measures the degree to which the program was successfully implemented and generally applies lessons learned in subsequent versions or implementations of the program.•Formative and process evaluations are often used ____________ and have become somewhat synonymous.
Basic Terminology - 3 •Summative Evaluation --Purpose is to assess the effectiveness of the intervention and the extent to which awareness, attitudes, knowledge, behavior, the environment, or health status changed as a result of a particular program.•An umbrella term•Impact Evaluation* - -Focuses on intermediary measures such as behavior change or changes in attitudes, knowledge, and awareness.•Outcome Evaluation* - -Measures the degree to which end points such as diseases or injuries actually decreased.•Impact and outcome evaluations together constitute summative evaluation.•*Other sources reverse these definitions! (CDC)•Input, activity, output, outcome and impact-https://www.youtube.com/watch?v=lR8FalapJf02:51
Basic Terminology - 3 •___________ Evaluation --Purpose is to assess the effectiveness of the intervention and the extent to which awareness, attitudes, knowledge, behavior, the environment, or health status changed as a result of a particular program.•An umbrella term•___________ Evaluation* - -Focuses on intermediary measures such as behavior change or changes in attitudes, knowledge, and awareness.•___________ Evaluation* - -Measures the degree to which end points such as diseases or injuries actually decreased.•Impact and outcome evaluations together constitute summative evaluation.•*Other sources reverse these definitions! (CDC)•Input, activity, output, outcome and impact-https://www.youtube.com/watch?v=lR8FalapJf02:51
Broken Window Theory•https://www.newyorker.com/books/page-turner/the-other-side-of-broken-windowsAugust 23, 2018•Criminological theory:-visible signs of crime, anti-social behavior, and civil disorder create an urban environment that encourages further crime and disorder, including serious crimes.•Strict policing of small crimes. Take care of the small problems and that will help fix the large problems-Racial profiling-Overlooked the beginnings of the issues—abandoned buildings and vacant lots-Focus on that rehabilitation—pocket parks etc.•Place-based interventions are far more likely to succeed than people-based ones. •Cost Effective, less dangerous-"Simple treatments of abandoned buildings and vacant lots returned conservative estimates of between $5.00 - $26.00 in net taxparer benefits; between $79.00 - $333.00 to society at large, for every dollar invested,"© 2017 Pearson Education, Inc.Broken Window Theory•https://www.newyorker.com/books/page-turner/the-other-side-of-broken-windowsAugust 23, 2018•Criminological theory:-visible signs of crime, anti-social behavior, and civil disorder create an urban environment that encourages further crime and disorder, including serious crimes.•Strict policing of small crimes. Take care of the small problems and that will help fix the large problems-Racial profiling-Overlooked the beginnings of the issues—abandoned buildings and vacant lots-Focus on that rehabilitation
Broken Window Theory •_____________ theory:-visible signs of crime, anti-social behavior, and civil disorder create an urban environment that encourages further crime and disorder, including serious crimes .•Strict policing of small crimes. Take care of the small problems and that will help fix the large problems-Racial profiling-Overlooked the beginnings of the issues—abandoned buildings and vacant lots-Focus on that rehabilitation—pocket parks etc. •Place-based interventions are far more likely to succeed than people-based ones. •Cost Effective, less dangerous-"Simple treatments of abandoned buildings and vacant lots returned conservative estimates of between $5.00 - $26.00 in net taxparer benefits; between $79.00 - $333.00 to society at large, for every dollar invested,"© 2017 Pearson Education, Inc.Broken Window Theory•https://www.newyorker.com/books/page-turner/the-other-side-of-broken-windowsAugust 23, 2018•Criminological theory:-visible signs of crime, anti-social behavior, and civil disorder create an urban environment that encourages further crime and disorder, including serious crimes.•Strict policing of small crimes. Take care of the small problems and that will help fix the large problems-Racial profiling-Overlooked the beginnings of the issues—abandoned buildings and vacant lots-Focus on that rehabilitation
Budget Basics•Must include dollars for all phases of project-Program planning/development-Program implementation-Program evaluation— money for evaluation required in some grants•Must include dollars for -People-Places -Things
Budget Basics•Must include _____________ for all phases of project-Program planning/development-Program _____________-Program _____________— money for evaluation required in some grants•Must include dollars for -People-Places -Things
Building Blocks (Assets) of Communities •Primary building blocks - most accessible; located in the neighborhood & largely under the control of those who live in the neighborhood-Individual assets - skills and abilities of residents -Organizational assets - community groups •Secondary building blocks - located in the neighborhood but largely controlled by people outside-Private and nonprofits -higher education institutions, hospitals-Public institution and services - schools, police, parks, library-Physical resources - land •Potential building blocks - least accessible; resources originating outside the neighborhood & controlled by people outside (e.g., public information)
Building Blocks (Assets) of Communities •_____________ building blocks - most accessible; located in the neighborhood & largely under the control of those who live in the neighborhood-_____________ assets - skills and abilities of residents -_____________ assets - community groups •_____________ building blocks - located in the neighborhood but largely controlled by people outside-Private and _____________ -higher education institutions, hospitals-_____________ institution and services - schools, police, parks, library-Physical resources - land •_____________ building blocks - least accessible; resources originating outside the neighborhood & controlled by people outside (e.g., public information)
Characteristics of Successful Coalitions: •Continuity of staff, especially the coordinator •Ownership of problem •Community leaders' support •Active involvement of volunteer agencies •High level of trust and reciprocity •Frequent and ongoing training •Benefits of membership outweigh the costs •Members develop goals, objectives and strategies
Characteristics of Successful Coalitions: •_____________ of staff, especially the coordinator •_____________ of problem •Community leaders' _____________ •_____________ involvement of volunteer agencies •High level of _____________ and reciprocity •Frequent and ongoing _____________ •Benefits of membership outweigh the costs •Members develop goals, objectives and strategies
Coalition Stages of Development •Formation: six to nine months •Implementation: nine to 12 months •Maintenance: 12 to 18 months •Outcome: 18 months to three years
Coalition Stages of Development •_____________: six to nine months •_____________: nine to 12 months •_____________: 12 to 18 months •_____________: 18 months to three years
Collaboration through coalitions: +Advantages of Collaborating+more effective and efficient delivery of programs +professional development +improved communication +elimination of duplication +increased use of programs +improved public image +better needs assessment +consistency of information +increased availability of resources Disadvantages of Collaborations-turf protection and mistrust -slow decision making -limited resources -diverted resources from priority issues-an assumed position contrary to policy -decreased level of cooperation among-collaborators during a crisis
Collaboration through coalitions: +Advantages of Collaborating+more effective and efficient _____________ of programs +_____________ development +improved _____________ +elimination of _____________ +_____________ use of programs +improved public _____________ +better needs assessment +consistency of information +increased availability of _____________ Disadvantages of Collaborations-_____________ protection and mistrust -_____________ decision making -limited resources -diverted resources from priority issues-an assumed position contrary to policy -decreased level of cooperation among-collaborators during a crisis
Community Mobilization Strategies - 2•Community building --strength-based rather than need based -stresses the identification, nurturing, and celebrating of community assets" •Community advocacy --community members become involved in the institutions & decisions that impact their lives
Community Mobilization Strategies - 2 •Community _____________ --strength-based rather than need based -stresses the identification, nurturing, and celebrating of community assets" •Community _____________ --community members become involved in the institutions & decisions that impact their lives
Community Mobilization Strategies - 3 •Advocating for health and health education:-Influencing voting behavior-Direct lobbying/advocacy to policy makers -Integrating grassroots lobbying into direct lobbying efforts-Media advocacy — newspaper letters to the editor and opinion-editorial (op-ed) articles; use of social media-Media advocacy — acting as a resource person
Community Mobilization Strategies - 3 •Advocating for health and health education: -Influencing _____________ behavior -Direct _____________/advocacy to policy makers -Integrating _____________ lobbying into direct lobbying efforts-_____________ advocacy — newspaper _____________ to the editor and opinion-editorial (op-ed) articles; use of social media-_____________ advocacy — acting as a resource person
Community Organizing Background •Population-based approaches: community-based, community empowerment, community participation, community partnerships •Pooling resources to deal with shared problems •Community organization was coined by American social workers in 1880s. -Defined as "the process by which community groups are helped to identify common problems or change targets, mobilize resources, and develop and implement strategies to reach their collective goals"
Community Organizing Background •_____________ approaches: community-based, community empowerment, community participation, community partnerships •_____________ resources to deal with shared problems •_____________ was coined by American social workers in 1880s. -Defined as "the process by which community groups are helped to identify common problems or change targets, mobilize resources, and develop and implement strategies to reach their collective goals"
Concerns Associated with Implementation - 2 •Safety & Medical Concerns, cont'd-If the act of participating in the program puts anyone at medical risk (e.g., cardiovascular exercise programs), then these individuals need to obtain medical clearance before participating. •Medical clearance signed by a physician •Steps must be taken to ensure the safety and health of all associated with the program.-Safe program location; appropriate security-Building codes met & facilities free from any hazards-Qualified instructors-Plan in case of emergency
Concerns Associated with Implementation - 2 •Safety & Medical Concerns, cont'd-If the act of participating in the program puts anyone at _____________ risk (e.g., cardiovascular exercise programs), then these individuals need to obtain medical clearance before participating. •Medical clearance signed by a physician •Steps must be taken to ensure the safety and health of all associated with the program.-Safe program location; appropriate security-Building codes met & facilities free from any hazards-Qualified instructors-Plan in case of emergency
Concerns Associated with Implementation - 3 •2. Ethical Issues-Code of Ethics for the Health Education Profession guides the work of health educators.•Planners should have integrity, and be honest, loyal, and accountable.-The Belmont Report: Ethical Principles & Guidelines for the Protection of Human Subject Research has three fundamental ethical principles:•Respectfor persons•Beneficence- maximizing benefits; doing good•Justice - fairness.•3. Legal Concerns-Negligence - failing to act in a prudent (reasonable) manner. Arises from two acts:•Omission - doing nothing when you should•Commission - doing something you should not
Concerns Associated with Implementation - 3 •2. _____________ Issues-Code of _____________ for the Health Education Profession guides the work of health educators.•Planners should have integrity, and be honest, loyal, and accountable.-The _____________ Report: Ethical Principles & Guidelines for the Protection of Human Subject Research has three fundamental ethical principles:•_____________ for persons•_____________- maximizing benefits; doing good•_____________ - fairness.•3. Legal Concerns-_____________ - failing to act in a prudent (reasonable) manner. Arises from two acts:•_____________ - doing nothing when you should•_____________ - doing something you should not
Concerns Associated with Implementation - 6 •4. Program Registration & Fee Collection-Establish payment procedures and a system of payment-checks and balances•5. Procedures for Recordkeeping-HIPAA-Records should be kept, but ensure anonymity/ confidentiality
Concerns Associated with Implementation - 6 •4. Program _____________ & _____________ Collection-Establish payment procedures and a system of payment-checks and balances•5. Procedures for Record keeping-_____________-Records should be kept, but ensure anonymity/ confidentiality
Concerns Associated with Implementation - 7•6. Procedural Manual and/or Participants' Manual-There may be a need to create a manual for the program to:1.Ensure that everyone understands the program and its parameters2.Standardize the intervention so it can be replicated and avoid Type III errors 3.Provide ideas for facilitation4.Provide additional background information on the topic5.Provide citations for additional resources.•7. Program Participants with Disabilities-Programs should meet the needs of participants with disabilities.
Concerns Associated with Implementation - 7•6. Procedural Manual and/or Participants' Manual-There may be a need to create a manual for the program to: 1.Ensure that everyone _____________ the program and its parameters2.Standardize the _____________ so it can be replicated and avoid Type III errors 3.Provide _____________ for facilitation4.Provide additional _____________ information on the topic5.Provide citations for additional _____________.•7. Program Participants with _____________-Programs should meet the needs of participants with disabilities.
Creating Health Promotion Interventions•Once program planners have completed: 1.needs assessment2. written program goals and objectives3. considered different types of intervention strategies-Then begin to design an appropriate intervention.•There is no one best way of intervening to accomplish a specific program goal that can be generalized to all priority populations.
Creating Health Promotion Interventions•Once program planners have completed: 1._____________ assessment2. written program _____________ and _____________. considered different types of intervention strategies-Then begin to design an appropriate intervention.•There is no one best way of intervening to accomplish a specific program goal that can be generalized to all priority populations.
Concerns Associated with Implementation - 8•8. Training for Facilitators-Program facilitators need to be familiar with the intervention•Either by participating in the planning of the intervention or through a training session.•9. Dealing with Problems-Planners should anticipate and deal with problems that might arise.-What kind of problems could occur with your CHOICES programs?•10. Reporting and Documenting-Keep others informed about the progress of the program for:1. accountability2. public relations3. motivation of present participants .4. recruitment of new participants
Concerns Associated with Implementation - 8•8. _____________ for Facilitators-Program facilitators need to be familiar with the intervention•Either by participating in the planning of the intervention or through a training session.•9. Dealing with _____________-Planners should anticipate and deal with problems that might arise.-What _____________ of problems could occur with your CHOICES programs?•10. _____________ and _____________-Keep others informed about the progress of the program for:1. _____________ 2. public _____________ 3. _____________ of present participants .4. _____________ of new participants
Concerns Associated with Implementation - 5•Reducing the Risk of Liability- key to avoiding liability is to reduce risk by planning ahead.-Be aware of legal liabilities.-Use certified instructors.-Use good judgment.-Require informed consent.-Get medical clearance.-Limit work to expertise.-Provide a safe environment.-Purchase insurance. •(Check for agency coverage)•Have EMS present for some activities
Concerns Associated with _____________ - 5•Reducing the _____________ of Liability- key to avoiding liability is to reduce _____________ by planning ahead.-Be aware of _____________ liabilities.-Use certified instructors.-Use good judgment.-Require _____________ consent.-Get medical clearance.-Limit work to expertise.-Provide a safe environment.-Purchase insurance. •(Check for agency coverage)•Have EMS present for some activities
Continuous Monitoring•Determines if things are going as planned-if the program is operating below/at/above expectations-program is moving in the right direction •Provides program planners with: -Data of program acceptance by the priority population-Reach of messages -Product distribution sites-What is working and what is not working. •Continuous monitoring improves the effectiveness of the program by continually integrating feedback from the priority population.
Continuous _____________•Determines if things are going as planned-if the program is operating below/at/above expectations-program is moving in the right direction •Provides program planners with: -Data of program acceptance by the priority population-Reach of messages -Product distribution sites-What is working and what is not working. •Continuous _____________ improves the _____________ of the program by continually integrating feedback from the priority population.
Curricula and Other Instructional Resources - 2 •Developing in-house materials can involve a lot of time, money, and effort.•Wide array of materials available that have already been created.-Voluntary and governmental health agencies-Public libraries have videos/DVDs-YouTube videos (be careful of the source)-Local and state health departments•Remember that just because a piece of instructional material exists does not mean it is appropriate for the priority population.
Curricula and Other Instructional Resources - 2 •Developing _____________ materials can involve a lot of time, money, and effort.•Wide array of materials available that have already been created.-Voluntary and governmental health agencies-Public libraries have videos/DVDs-YouTube videos (be careful of the source)-Local and state health departments•Remember that just because a piece of instructional material exists does not mean it is appropriate for the priority population.
Curricula and Other Instructional Resources - 3 SAM Suitability Assessment of Material To help ensure that materials are suitable for the priority population-Steps for using SAM1.Read through the factor list and evaluation criteria.2.Read the material you wish to evaluate and write brief statements as to its purpose(s) and key points.3.Short materials - evaluate the entire piece. Long materials - select samples.http://aspiruslibrary.org/literacy/SAM.pdf4.Evaluate and score each of the 22 SAM items. ("Superior" = 2; "Adequate" = 1; "Not suitable" = 0; or "N/A")5.Calculate by summing the scores from the rated items and dividing by the total number of items rated and get a percentage.•70-100% = superior material•40-69% = adequate material•0-39% = not suitable material6.Decide on the impact of deficiencies of the material and what action to take about whether to use or not use the material.
Curricula and Other Instructional Resources - 3 _____________ _____________ _____________ of _____________ To help ensure that materials are suitable for the priority population-Steps for using SAM1.Read through the _____________ list and evaluation criteria.2._____________ the material you wish to evaluate and write brief statements as to its purpose(s) and key points. 3._____________ materials - evaluate the entire piece. Long materials - select samples.http://aspiruslibrary.org/literacy/SAM.pdf4.Evaluate and score each of the 22 SAM items. ("Superior" = 2; "Adequate" = 1; "Not suitable" = 0; or "N/A")5.Calculate by _____________ the scores from the _____________ items and dividing by the total number of items rated and get a percentage.•70-100% = superior material•40-69% = adequate material•0-39% = not suitable material 6.Decide on the _____________ of deficiencies of the material and what action to take about whether to use or not use the material.
Curricula and Other Instructional Resources - 5•A canned program -developed by an outside group and includes the basic components and materials necessary to implement a program.•Five major components: -Participant's manual-Instructor's manual- Audiovisual materials-Training-Marketing•Though no time is spent on development, the canned program may not fit the needs or the demographic characteristics of the priority population.
Curricula and Other Instructional Resources - 5 •A _____________ program -developed by an outside group and includes the basic components and materials necessary to implement a program. •Five major components: -_____________ manual-_____________ manual- Audiovisual materials-Training-Marketing •Though no time is spent on development, the canned program may not fit the _____________ or the _____________ characteristics of the priority population.
Dance Like a Dad•About 1 out of every 2 working dads (48%) say they spend too little time with their kids and want to do a better job at parenting. To inspire and support fathers everywhere, The U.S. Department of Health and Human Services' Administration for Children and Families (ACF), along with the National Responsible Fatherhood Clearinghouse, and Ad Council have launched a new series of public service advertisements (PSAs), showcasing dads and their kids sharing a moment and dancing together. The campaign tagline "Make a moment. Dance Like a Dad" is part of an ongoing effort to encourage dads to play an active role in their children's lives. •More On Fatherhood Involvement: Having an involved father significantly contributes to happier and healthier children, and this is true whether a father lives with his child or not. The Fatherhood Involvement campaign inspires and supports men in their commitment to responsible fatherhood. The PSAs communicate to fathers that their presence is essential to their children's well-being. The campaign also serves as a resource for fathers by providing the information they need to become more involved with their kids at Fatherhood.gov. Click here to learn more: http://po.st/Fatherhood
Dance Like a Dad•About 1 out of every 2 working dads (48%) say they spend too little time with their kids and want to do a better job at parenting. To inspire and support fathers everywhere, The U.S. Department of Health and Human Services' Administration for Children and Families (ACF), along with the National Responsible Fatherhood Clearinghouse, and Ad Council have launched a new series of public service advertisements (PSAs), showcasing dads and their kids sharing a moment and dancing together. The campaign tagline "Make a moment. Dance Like a Dad" is part of an ongoing effort to encourage dads to play an active role in their children's lives. •More On Fatherhood Involvement: Having an involved father significantly contributes to happier and healthier children, and this is true whether a father lives with his child or not. The Fatherhood Involvement campaign inspires and supports men in their commitment to responsible fatherhood. The PSAs communicate to fathers that their presence is essential to their children's well-being. The campaign also serves as a resource for fathers by providing the information they need to become more involved with their kids at Fatherhood.gov. Click here to learn more: http://po.st/Fatherhood
Data Analysis - 1 •Variables - -Characteristics or attributes that can be measured or observed (Creswell, 2002)•Types of variables: -Independent •Controlled or cause or exert some influence-Gender, race, age-Dependent •Are outcome variables that are being studied-Attitudes, beliefs, knowledge, skills •Descriptive Statistics - -Used to organize, summarize & describe characteristics of a group•Inferential Statistics - -Concerned with relationships & causality to make generalizations about a population based on findings from a sample•Three types of statistical analyses:-Univariate (1 variable) -Bivariate (2 variables)-Multivariate (more than 2 variables)•Not all analytical techniques can be used with all levels of measurement.
Data Analysis - 1 •_____________ - -Characteristics or attributes that can be measured or observed (Creswell, 2002)•Types of variables: -_____________ •Controlled or cause or exert some influence-Gender, race, age -_____________ •Are outcome variables that are being studied-Attitudes, beliefs, knowledge, skills •_____________ Statistics - -Used to organize, summarize & describe characteristics of a group•_____________ Statistics - -Concerned with relationships & causality to make generalizations about a population based on findings from a sample•Three types of statistical analyses:-_____________ (1 variable) -_____________ (2 variables)-_____________ (more than 2 variables)•Not all analytical techniques can be used with all levels of measurement.
Defining Implementation•''The act of converting planning, goals, and objectives into action through: -administrative structure -management activities-Policies, regulations-procedures•Setting up, managing, and executinga project •One of the three stages of program diffusion, with the other two being adoption and sustainability(implementation ---- adoption ----- sustainability)
Defining _____________•''The act of converting planning, goals, and objectives into action through: -administrative structure -management activities-Policies, regulations-procedures•Setting up, managing, and executinga project •One of the three stages of program diffusion, with the other two being adoption and sustainability(implementation ---- adoption ----- sustainability)
Designing Appropriate Interventions •Key Terms- -Best practices - using interventions that have undergone critical review of multiple research & evaluation studies -Best experiences - fall short of best practices but show promise -Best processes - original interventions based on theory -Segmenting - dividing a broader population into smaller groups -Tailoring - intervention created for specific needs, interests, & circumstances
Designing Appropriate Interventions •Key Terms- -_____________s - using interventions that have undergone critical review of multiple research & evaluation studies -_____________ - fall short of best practices but show promise -_____________ - original interventions based on theory -_____________ - dividing a broader population into smaller groups -_____________ - intervention created for specific needs, interests, & circumstances
Direct Costs continued•Equipment-Funders often scrutinize the purchase of equipment., •give documentation- program need for the equipment.-Equipment costs should be well defined and include specifications. •Example: high-speed copier system to be used to reproduce reports and other documents for committees, staff members, and volunteers. -explain how the copier will help you in administering the program.•Supplies (put these costs/expenses for CHOICES proposal under "Other" budget category)-Funders qualify or define supplies in different ways. •Always check with the funding source before including this section. •Explain how the supplies will assist in running the program. •Break down supplies into categories such as general office supplies, educational and training supplies, and computer supplies.
Direct Costs continued •_____________-Funders often scrutinize the purchase of equipment., •give documentation- program need for the equipment.-Equipment costs should be well defined and include specifications. •Example: high-speed copier system to be used to reproduce reports and other documents for committees, staff members, and volunteers. -explain how the copier will help you in administering the program.•Supplies (put these costs/expenses for CHOICES proposal under "Other" budget category)-Funders qualify or define supplies in different ways. •Always check with the funding source before including this section. •Explain how the supplies will assist in running the program. •Break down supplies into categories such as general office supplies, educational and training supplies, and computer supplies.
Direct Costs continued•Travel•Many times travel can be included in the proposal's budget. -Travel expenses are heavily scrutinized item-Approved for required meetings and to implement the program•Provide clear formulas and documentation for why travel is necessary. •Include all expenses: -Driving expenses—mileage, tolls etc.-plane ticket-cost of a hotel per night X number of nights you will be staying -food allowance -Use realistic but conservative figures,
Direct Costs continued•Travel•Many times travel can be included in the proposal's budget. -Travel expenses are heavily scrutinized item-Approved for required meetings and to implement the program•Provide clear formulas and documentation for why travel is necessary. •Include all expenses: -Driving expenses—mileage, tolls etc.-plane ticket-cost of a hotel per night X number of nights you will be staying -food allowance -Use realistic but conservative figures,
Eight Methods of Interpreting Data 1.Determining whether objectives have been achieved 2.Determining whether laws, democratic ideals, regulations, or ethical principles have been violated 3.Determining whether assessed needs have been reduced 4.Determining the value of accomplishments 5.Asking critical reference groups to review the data and to provide their judgments of successes and failures, strengths, and weaknesses 6.Comparing results with those reported by similar entities or endeavors 7.Comparing assessed performance levels on critical variables to expectations of performance or standards 8.Interpreting results in light of evaluation procedures that generated them
Eight Methods of Interpreting Data 1.Determining whether ___________ have been achieved 2.Determining whether laws, democratic ideals, regulations, or ethical principles have been ___________ 3.Determining whether assessed needs have been ___________ 4.Determining the ___________ of accomplishments 5.Asking critical reference groups to ___________ the data and to provide their judgments of successes and failures, strengths, and weaknesses 6.___________ results with those reported by similar entities or endeavors 7.Comparing assessed ___________ levels on critical variables to expectations of performance or standards 8.Interpreting results in light of evaluation procedures that generated them
Elements of Formative Evaluation - 12.Reach Proportion of priority population given the opportunity to participate in the program 13.*ResponseProportion of priority population actually participating in the program 14.InteractionQuality of interactions between planners & the participants (e.g., customer service) 15.*SatisfactionDegree to which the needs of participants are being met, how satisfied they are with the program, service, or activity, and their belief that a positive impact is being made in their lives* Most important, overlap with some of the other 15!—also may be a part of process evaluation
Elements of Formative Evaluation - 12._____________ Proportion of priority population given the opportunity to participate in the program 13.*_____________ Proportion of priority population actually participating in the program 14._____________ Quality of interactions between planners & the participants (e.g., customer service) 15.*_____________ Degree to which the needs of participants are being met, how satisfied they are with the program, service, or activity, and their belief that a positive impact is being made in their lives* Most important, overlap with some of the other 15!—also may be a part of process evaluation
Elements of Formative Evaluation - 1 1.JustificationDegree to which program is mandated/approved by stakeholders 2.Evidence Degree to which program is evidence-based 3.Capacity1.Extent to which professionals have adequate knowledge, skills, and abilities to design and implement the program 4.*Resources-Adequacy of resources (e.g., budget, community resources or assistance, assets, time, etc.)-Cost-identification analysis: compares different interventions available for a program to determine which intervention would be the least expensive 4.*Resources, cont'da. Cost-benefit analysis: looks at how resources can best be used. It will yield the dollar benefit received from the dollars invested in the program.b. Cost-effectiveness analysis: quantifies the effects of a program in monetary terms. 5.Customer OrientationDegree to which the program is adapted to the needs of the priority population 6.Multiplicity Degree to which multiple components are built into the program 7.Support Degree to which a support component is built into the intervention 8.*Inclusion Extent to which an adequate range & number of participants are involved in the program 9.*Accountability Extent to which the staff is fulfilling its responsibilities 10.*Adjustment Degree to which programs, services, or activities are modified based on feedback received from participants, partners, or other stakeholders 11.*Recruitment Degree to which members of the priority population are adequately recruited through appropriate channels and places consistent with cultural and other unique characteristics
Elements of Formative Evaluation - 1 1._____________ - Degree to which program is mandated/approved by stakeholders 2._____________ Degree to which program is evidence-based 3._____________.Extent to which professionals have adequate knowledge, skills, and abilities to design and implement the program 4.*_____________-_____________ of resources (e.g., budget, community resources or assistance, assets, time, etc.)-_____________ analysis: compares different interventions available for a program to determine which intervention would be the least expensive 4.*_____________, cont'da. _____________ analysis: looks at how resources can best be used. It will yield the dollar benefit received from the dollars invested in the program.b. Cost-effectiveness analysis: quantifies the effects of a program in monetary terms. 5._____________ OrientationDegree to which the program is adapted to the needs of the priority population 6._____________ Degree to which multiple components are built into the program 7._____________ Degree to which a support component is built into the intervention 8.*_____________ Extent to which an adequate range & number of participants are involved in the program 9.*_____________ Extent to which the staff is fulfilling its responsibilities 10.*_____________ Degree to which programs, services, or activities are modified based on feedback received from participants, partners, or other stakeholders 11.*_____________ Degree to which members of the priority population are adequately recruited through appropriate channels and places consistent with cultural and other unique characteristics
fidelity, dose, recruitment, reach, response, context
Elements of process evaluation (6)
Environmental Change Strategies - 2 •Other environments include: -Economic environment •financial costs, affordability-Service environment •accessibility to health care or patient education-Social environment •social support, peer pressure-Cultural environment •traditions of an ethnic group-Psychological environment •emotional learning environment-Political environment •support for healthy environmentsEnvironmental change strategies often are more effective when combined with intervention strategies from the other categories.
Environmental Change Strategies - 2 •Other environments include: -Economic environment •financial _____________, affordability-Service environment •_____________ to health care or patient education-_____________ environment •social support, peer pressure-_____________ environment •traditions of an ethnic group-_____________ environment •emotional learning environment-Political environment •support for healthy environments Environmental change strategies often are more effective when combined with _____________ strategies from the other categories.
Equipment & Supplies - 1 •Equipment(non-consumable / non-expendable items)-Own-On loan from others•Supplies (consumable / expendable items)-Planner provides-Participants provide•Difference between equipment & supplies is sometimes determined by monetary value or the length of "life" of the commodity.
Equipment & Supplies - 1 •_____________(non-consumable / non-expendable items)-Own-On loan from others•_____________ (consumable / expendable items)-Planner provides-Participants provide•Difference between equipment & supplies is sometimes determined by _____________ value or the length of "_____________" of the commodity.
Equipment & Supplies - 2 •Planners must also -Determine the necessary equipment and supplies to facilitate the program.-Identify the sources where the equipment and supplies can be obtained.-Find a way to pay for the needed equipment and supplies.
Equipment & Supplies - 2 •Planners must also -Determine the _____________ equipment and supplies to facilitate the program.-Identify the _____________ where the equipment and supplies can be obtained.-Find a way to _____________ for the needed equipment and supplies.
Evaluation Designs - 1 •Measurements used in evaluation designs can be collected at three different times: -after the program -both before and after the program-and several times before, during, and after the program •Pretest-Measurement before the program begins •Posttest-Measurement after the completion of the program
Evaluation Designs - 1 •Measurements used in evaluation designs can be collected at three different times: -_____________ the program -both _____________ and _____________ the program-and several times before, _____________, and after the program •_____________-Measurement before the program begins •_____________-Measurement after the completion of the program
Evaluation Reporting - 1 •Incorporated into a final report that is presented to stakeholders.•Essential and can provide:-Critical analysis of the results-Tangible product-Evidence that program or materials were carefully developed-Record of activities for use in planning future programs-Assistance to others who may be interested in developing a similar program-Foundation for evaluation activities in the future. •The number and type of reports required are determined at the beginning of the evaluation based on the needs of the stakeholders.-Formative evaluation:•Reports are needed early and may be provided on a weeklyor monthly basis. (or quarterly)-Summative evaluation•Report is more formal and may resemble a scientific paper that can be submitted to a journal for publication.
Evaluation Reporting - 1 •Incorporated into a final report that is presented to ___________.•___________ and can provide:-Critical analysis of the results-Tangible product-Evidence that program or materials were carefully developed-Record of activities for use in planning future programs-Assistance to others who may be interested in developing a similar program-Foundation for evaluation activities in the future. •The number and type of reports required are determined at the ___________ of the evaluation based on the needs of the stakeholders.-Formative evaluation:•Reports are needed ___________ and may be provided on a weekly or monthly basis. (or quarterly)-Summative evaluation•Report is more ___________ and may resemble a scientific paper that can be submitted to a journal for publication.
Evaluation Scenarios 1.You have been hired as a consultant for the Community Services Board. They want to go to the City Council to request more counselors to deal with teen mental health issues. What do information do you evaluate for the CSB to present to the City Council to justify their request? 2.Identify how to measure the outcome of the health policy that expanded CHIP-Children's Health Insurance Program (health insurance for low income children—not covered by Medicaid). 3.Identify five things you would evaluate to measure the planning for and effectiveness of providing flu shots at recreation and senior centers throughout the community. 4.What measures will you use to evaluate the effectiveness of the community food bank? Identify at least three measures. 5.What will you measure to indicate the effects of training all employees on "universal precautions" at your long-term care facility? What will you measure to indicate the effects of the hand washing training of all employees at your long - term care facility? How will you measure this? 6.How and what will you measure to indicate the effectiveness of the employee wellness program at your hospital/health care facility? Identify at least three measures. 7.What would you evaluate to indicate the effectiveness of a campus-wide recycling campaign? What would you do to conduct this evaluation? 8.Identify five things you would evaluate to measure the effectiveness of planning for a program to provide flu shots at recreation and senior centers throughout the community. 9.You are working at the city's Refugee Resettlement Center. How and what would you evaluate to determine the effectiveness of the program used to orient new refugees to health services and health providers in the community?
Evaluation Scenarios 1.You have been hired as a consultant for the Community Services Board. They want to go to the City Council to request more counselors to deal with teen mental health issues. What do information do you evaluate for the CSB to present to the City Council to justify their request? 2.Identify how to measure the outcome of the health policy that expanded CHIP-Children's Health Insurance Program (health insurance for low income children—not covered by Medicaid). 3.Identify five things you would evaluate to measure the planning for and effectiveness of providing flu shots at recreation and senior centers throughout the community. 4.What measures will you use to evaluate the effectiveness of the community food bank? Identify at least three measures. 5.What will you measure to indicate the effects of training all employees on "universal precautions" at your long-term care facility? What will you measure to indicate the effects of the hand washing training of all employees at your long - term care facility? How will you measure this? 6.How and what will you measure to indicate the effectiveness of the employee wellness program at your hospital/health care facility? Identify at least three measures. 7.What would you evaluate to indicate the effectiveness of a campus-wide recycling campaign? What would you do to conduct this evaluation? 8.Identify five things you would evaluate to measure the effectiveness of planning for a program to provide flu shots at recreation and senior centers throughout the community. 9.You are working at the city's Refugee Resettlement Center. How and what would you evaluate to determine the effectiveness of the program used to orient new refugees to health services and health providers in the community?
Evaluation Results •Who will receive the results of the evaluation? •Different aspects of the evaluation can be stressed, depending on the group's particular needs and interests. •Different stakeholders may want different questions answered. •The planning for the evaluation should include a determination of how the results will be used. •More on this later with evaluation reporting.... •How much do you know about evaluation? •EvaluationTemplate for CHOICES Project
Evaluation _____________ •_____________ will receive the results of the evaluation? •Different aspects of the evaluation can be _____________, depending on the group's particular needs and interests. •Different _____________ may want different questions answered. •The _____________ for the evaluation should include a determination of how the results will be used. •More on this later with _____________ reporting.... •How much do you know about evaluation? •EvaluationTemplate for CHOICES Project
Evaluation in the Program Planning Stages •Evaluation design must reflect the goals and objectives of the program. •The evaluation must be planned in the early stages of development and be in place before program begins. •Baseline data- those reflecting the initial status or interests of the participants; from a needs assessment •Initial data regarding the program should be analyzed promptly to make any necessary adjustments to the program. •By creating the summative evaluation early in the planning process, planners can ensure that the results are less biased.
Evaluation in the Program Planning Stages •Evaluation design must reflect the _________ and objectives of the program. •The evaluation must be planned in the _________ stages of development and be in place before program begins. •_________ data- those reflecting the initial status or interests of the participants; from a needs assessment •_________ data regarding the program should be analyzed promptly to make any necessary adjustments to the program. •By creating the summative evaluation early in the planning process, planners can ensure that the results are less _________.
Examples of Evaluation Questions Answered Using Univariate, Bivariate, and Multivariate Data Analysis
Examples of Evaluation Questions Answered Using Univariate, Bivariate, and Multivariate Data Analysis
Financial Resources - 1 •Planners often must make tough decisions about how to allocate funds.•Questions to be addressed include: 1.Is it better to run an adequately financed program for a few people or to run a poorly financed program for more people?2.If funds are limited, where is the first place we should cut?3.Should we start a program knowing that we will be short of funds, or should we wait until we have appropriate funding before we begin?4.Is it better to have fewer instructors or to make do with fewer supplies?
Financial Resources - 1 •Planners often must make tough decisions about how to _____________ funds.•Questions to be addressed include: 1.Is it better to run an adequately financed program for a few people or to run a poorly financed program for more people?2.If funds are limited, where is the first place we should cut?3.Should we start a program knowing that we will be short of funds, or should we wait until we have appropriate funding before we begin?4.Is it better to have fewer instructors or to make do with fewer supplies?
Financial Resources - 2 •Ways to finance programs:-Participant fee•Profit margin? How much? Ownership! (do not charge participant fees in your CHOICES proposal)•Sliding scale - ability to pay-Third-party support •Someone other than planning agency or participant-Employer or local civic group-Cost sharing-Cooperative agreements•Memorandum of understanding-Organizational sponsorship •Voluntary health agency, LHD, ACS-Grants & gifts•Seed dollars, in-kind support, RFPs
Financial Resources - 2 •Ways to finance programs:-_____________ fee•Profit margin? How much? Ownership! (do not charge participant fees in your CHOICES proposal)•_____________ scale - ability to pay-Third-party support •Someone other than planning agency or participant-Employer or local civic group-Cost sharing-Cooperative agreements•Memorandum of understanding-Organizational sponsorship •Voluntary health agency, LHD, ACS-Grants & gifts•Seed dollars, in-kind support, RFPs
Framework for Program Evaluation - 2 •Step 1 - Engaging Stakeholders-Who are the stakeholders?•Those involved in program operations•Those served or affected (directly or indirectly) by the program•Primary users of the evaluation results-The scope and level of stakeholder involvement will vary with each program being evaluated. •Step 2 - Describing the Program-Sets the frame of reference for all subsequent decisions in the evaluation process.-Describes•mission, goals, objectives •capacity to effect change•stage of development•how it fits into the larger community. -Logic model can be used. •Step 3 - Focusing the Evaluation Design-Makes sure the interests of stakeholders are addressed-Identifies:•reason of evaluation•how it will be used•questions to be asked•design of evaluation•finalizes any agreements about the process. •Step 4 - Gathering Credible Evidence-Decides:•measurement indicators•sources of evidence•quality & quantity of evidence•logistics for collecting evidence.-Organizes data including specific processes related to coding, filing, and cleaning. •Step 5 - Justifying Conclusions-Comparing the evidence against the standards of acceptability-Judging the worth, merit, or significance of the program-Creating recommendations for actions based on results •Step 6 - Ensuring Use and Sharing Lessons Learned-Use and dissemination of the results-Needs of each group of stakeholders addressed •Four standards of evaluation:-Utility standards- information needs of evaluation users met-Feasibility standards-evaluation is realistic, practical, affordable-Propriety standards-ethical for rights of those involved-Accuracy standards-findings are considered correct.
Framework for Program Evaluation - 2 •Step 1 - Engaging _____________-Who are the stakeholders?•Those involved in program operations•Those served or affected (directly or indirectly) by the program•Primary users of the evaluation results-The scope and level of stakeholder involvement will vary with each program being evaluated. •Step 2 - _____________ the Program-Sets the frame of reference for all subsequent decisions in the evaluation process.-Describes•mission, goals, objectives •capacity to effect change•stage of development•how it fits into the larger community. -Logic model can be used. •Step 3 - Focusing the _____________ Design-Makes sure the interests of stakeholders are addressed-Identifies:•reason of evaluation•how it will be used•questions to be asked•design of evaluation•finalizes any agreements about the process. •Step 4 - Gathering Credible _____________-Decides:•measurement indicators•sources of evidence•quality & quantity of evidence•logistics for collecting evidence.-Organizes data including specific processes related to coding, filing, and cleaning. •Step 5 - Justifying _____________-Comparing the evidence against the standards of acceptability-Judging the worth, merit, or significance of the program-Creating recommendations for actions based on results •Step 6 - Ensuring Use and _____________ Lessons Learned-Use and dissemination of the results-Needs of each group of stakeholders addressed •Four standards of evaluation:-_____________ standards- information needs of evaluation users met-_____________ standards-evaluation is realistic, practical, affordable-Propriety standards-ethical for rights of those involved-_____________ standards-findings are considered correct.
Grant Proposal Budget•Print it on a new page•Align figures correctly•Double-check your figures•Include column headings, such as -Budget Category (match categories in RFP—don't leave any categories blank-put "0" or "no funds requested" ec)-Requested Funds -Local Contributions -AKA In-kind contributions (do not include in CHOICES proposal)-Project Total•Organize your budget so it is easy to read and understand•Have another person look at your budget. -Can he or she understand it? If not, go back to the drawing board.
Grant Proposal Budget •Print it on a new page•Align figures correctly•Double-check your __________ •Include column __________, such as -Budget Category (match categories in RFP—don't leave any categories blank-put "0" or "no funds requested" ec)-Requested Funds -Local Contributions -AKA In-kind contributions (do not include in CHOICES proposal)-Project Total•Organize your budget so it is easy to __________ and __________•Have another __________ look at your budget. -Can he or she understand it? If not, go back to the drawing board.
Grant Proposal Budgets•Direct Costs•In-kind Contributions•Indirect Costs
Grant Proposal Budgets•__________ Costs•__________ Contributions•__________ Costs
Groups of Participants to Organize •Executive Participants --small, committed core group; leader or coordinator comes from this group •Active Participants --those willing to work; may also include executive participants •Occasional Participants --involved on an irregular basis; when decisions need to be made •Supporting Participants --seldom involved but participate in other ways, e.g., via financial or other resources •May form as a coalition; formal, long-term alliance of individuals representing groups who agree to work together
Groups of Participants to Organize •_____________ Participants --small, committed core group; leader or coordinator comes from this group •_____________ Participants --those willing to work; may also include executive participants •_____________ Participants --involved on an irregular basis; when decisions need to be made •_____________ Participants --seldom involved but participate in other ways, e.g., via financial or other resources •May form as a coalition; formal, long-term alliance of individuals representing groups who agree to work together
Guidelines for Successful Health Promotion Programs•Well-planned and successful health promotion programs have common characteristics such as: 1.Addressing one or more risk factors of the priority population; 2.Being theory-driven; 3.Being based on the best possible evidence4.Adhering to professional ethical standards; 5.Being culturally appropriate; 6.Being consistent with professional criteria, guidelines, or codes of practice (e.g., America College of Sports Medicine's guidelines for exercise programs (ACSM, 2014); guidelines from American College of Healthcare Executives; standards for licensed social workers etc.7.Using resources efficiently; and 8.Including an evaluation component.
Guidelines for Successful Health Promotion Programs•Well-planned and successful health promotion programs have common characteristics such as: 1.Addressing one or more _____________ factors of the priority population; 2.Being _____________-driven; 3.Being based on the best possible _____________ 4.Adhering to professional _____________ standards; 5.Being _____________ appropriate; 6.Being consistent with professional _____________, guidelines, or codes of practice (e.g., America College of Sports Medicine's guidelines for exercise programs (ACSM, 2014); guidelines from American College of Healthcare Executives; standards for licensed social workers etc.7.Using resources efficiently; and 8.Including an evaluation component.
Health Communication Strategies - 2•Tools of health communication include: -Video and audio teleconferencing -Telephones •Individual initiated - e.g., help lines •Outreach - called by health educator / counselor / coach-Mass media -In person -Printed materials -Computers, Internet, tailored emails •A communication channel is the route through which a message is disseminated to the priority population.
Health Communication Strategies - 2•Tools of health communication include: -Video and audio _____________ -_____________ •Individual initiated - e.g., help _____________ •_____________ - called by health educator / counselor / coach-Mass media -In person -Printed materials -Computers, Internet, tailored emails •A _____________ channel is the route through which a message is disseminated to the priority population.
Health Communication Strategies - 3•The five traditional channels include: 1.Intrapersonal•Health care, health coaches, hotlines2.Interpersonal•Small classes, support groups3.Organizational •Church bulletins, company or agency newsletters4.Mass media •Newspaper, billboards, magazines, PSAs, and more5.Social media•User or consumer generated, organized, and distributed•Information can be revised or updated almost immediately•Typically low cost in terms of creation and maintenance•Facebook, blogs, LinkedIn, Twitter, text messaging
Health Communication Strategies - 3 •The five traditional channels include: 1._____________ •Health care, health coaches, hotlines 2._____________ •Small classes, support groups 3._____________ •Church bulletins, company or agency newsletters 4._____________ •Newspaper, billboards, magazines, PSAs, and more 5._____________ •User or consumer generated, organized, and distributed •Information can be revised or updated almost immediately •Typically low cost in terms of creation and maintenance •Facebook, blogs, LinkedIn, Twitter, text messaging
Health Communication Strategies - 4•Motivational Interviewing-"a collaborative, person-centered form of guiding to elicit and strengthen motivation for change" (Miller & Rollnick, 2009, p. 137)•A process in which the trained professional helps guide an individual to identify internal motivation for change.•Four principles of Motivational Interviewing: 1.Express empathy 2.Develop discrepancy 3.Roll with resistance 4.Support self-efficacy
Health Communication Strategies - 4 •__________________________ -"a collaborative, person-centered form of guiding to elicit and strengthen motivation for change" (Miller & Rollnick, 2009, p. 137)•A process in which the trained professional helps guide an individual to identify internal motivation for change. •Four principles of Motivational Interviewing: 1.Express _____________ 2.Develop _____________ 3.Roll with _____________ 4.Support self-_____________
Health Communication Strategies - 5 •Health Literacy- the degree to which individuals have the capacity to obtain, process, and understand basic health information and services to make appropriate health decisions (USDHHS, 2000).•Health Numeracy-"the degree to which individuals have the capacity to access, process, interpret, communicate, and act on numerical, quantitative, graphical, biostatistical, and probabilistic health information needed to make effective health decisions" -Health education specialists need to work to ensure that the health communication interventions are appropriate for their priority population.
Health Communication Strategies - 5 •__________________________ - the degree to which individuals have the capacity to obtain, process, and understand basic health information and services to make appropriate health decisions (USDHHS, 2000) .•__________________________-"the degree to which individuals have the capacity to access, process, interpret, communicate, and act on numerical, quantitative, graphical, biostatistical, and probabilistic health information needed to make effective health decisions" -Health education specialists need to work to ensure that the health communication interventions are appropriate for their priority population.
Health Education Strategies - 1 •Ten general principles of learning (keep in mind before and during curriculum design) 1.Appeal to multiple senses (e.g., seeing, hearing, speaking). 2.Get the learner active in the learning process. 3.Limit distractions. 4.Make sure they are ready to learn. 5.Make the subject relevant to the participants. 6.Use repetition. 7.Make sure learning is recognized and encouraged. 8.Move from simple to complex concepts. 9.Make concept applicable to several settings, generalize. 10.Find an appropriate pace.
Health Education Strategies - 1 •Ten general principles of learning (keep in mind before and during curriculum design) 1.Appeal to multiple _____________ (e.g., seeing, hearing, speaking). 2.Get the learner _____________ in the learning process. 3.Limit _____________. 4.Make sure they are ready to _____________. 5.Make the subject _____________ to the participants. 6.Use _____________. 7.Make sure _____________ is recognized and encouraged. 8.Move from simple to _____________ concepts. 9.Make concept _____________ to several settings, generalize. 10.Find an appropriate _____________.
Health Education Strategies - 2 •Health education & health communication - not mutually exclusive categories. •Health education - to gain in-depth knowledge about a particular health topic. -Curriculum (course of study) - what those in the priority population will be taught -Scope - refers to breadth & depth of material covered -Sequence - defines the order in which the material is presented
Health Education Strategies - 2 •Health education & health communication - _____________ mutually exclusive categories.• __________________________ - to gain in-depth knowledge about a particular health topic. -_____________ (course of study) - what those in the priority population will be taught -_____________ - refers to breadth & depth of material covered -_____________ - defines the order in which the material is presented
Health Education Strategies - 4 •Effective health education/instruction: 1.Gain attention (convey heath threats & benefits). 2.Present stimulus material (tailor message to audience knowledge and values, demonstrate observable effectiveness, make behaviors easy to understand and do). 3.Provide guidance (use trustworthy models to demonstrate). 4.Elicit performance and provide feedback (for proficiency and self efficacy). 5.Enhance retention and transfer (social support & behavioral cues).
Health Education Strategies - 4 •Effective health education/instruction: 1.Gain _____________ (convey heath threats & benefits). 2.Present _____________ material (tailor message to audience knowledge and values, demonstrate observable effectiveness, make behaviors easy to understand and do). 3.Provide _____________ (use trustworthy models to demonstrate). 4.Elicit performance and provide _____________ (for proficiency and self efficacy). 5._____________ retention and transfer (social support & behavioral cues).
Horizontal Bar Chart—focuses on different categories
Horizontal Bar Chart—focuses on ___________ categories
How and When to Present the Report•Evaluators must consider the logistics of presenting the evaluation findings and should be discussed with decision makers.•A few suggestions:-Give key decision makers advanced information of the findings. --"Key Findings"-Maintain anonymity of individuals, institutions, & organizations; use sensitivity to avoid judging or labeling; maintain confidentiality according to wishes of administrators; maintain objectivity (Windsor et al., 2004).-Choose ways of reporting that meet the needs of stakeholders.
How and When to Present the Report•Evaluators must consider the ___________ of presenting the evaluation findings and should be discussed with decision makers.•A few suggestions:-Give key decision makers ___________ information of the findings. --"Key Findings"-Maintain ___________ of individuals, institutions, & organizations; use sensitivity to avoid judging or labeling; maintain confidentiality according to wishes of administrators; maintain objectivity (Windsor et al., 2004).-Choose ways of reporting that meet the needs of ___________.
Increasing the Utilization of the Results•Plan the study with stakeholders in mind.•If the program changesafter the planning stage, so should the evaluation.•Focus the evaluation on conditions about the program that the decision makers can change.•Reports should be written in a clear, simple manner.•The decision on making recommendations should be based on how clear the data are, how much is known about the program, and whether differences between programs are obvious.•Disseminate the results to all stakeholders using a variety of methods.•Integrate the evaluation findings with other research and evaluation about the program.•Provide high-quality research.
Increasing the Utilization of the Results•Plan the study with ___________ in mind.•If the program changes after the planning stage, so should the ___________.•Focus the evaluation on conditions about the program that the decision makers can ___________.•___________ should be written in a clear, simple manner.•The decision on making recommendations should be based on how clear the ___________ are, how much is known about the program, and whether ___________ between programs are obvious.•Disseminate the results to all stakeholders using a ___________ of methods.•Integrate the evaluation findings with other research and evaluation about the program.•Provide ___________-quality research.
Interpreting the Data•To ensure that the interpretation is fair and as objective as possible, the interpretation should not be the sole responsibility of the evaluator or any other single person.•Program significance measures the meaningfulnessof a program (based on stakeholder preferences) regardless of statistical significance. •Statistical significance is determined by statistical testing.-It is possible to have statistically significant results that indicate gains in performance but are not meaningful in terms of program goals.
Interpreting the Data•To ensure that the ___________ is fair and as objective as possible, the interpretation should not be the sole responsibility of the evaluator or any other single person.•Program ___________ measures the meaningfulnessof a program (based on stakeholder preferences) regardless of statistical significance. •Statistical ___________ is determined by statistical testing.-It is possible to have statistically significant results that indicate gains in performance but are not meaningful in terms of program goals.
ch 14 Introduction •Approaches -formative •Process-Summative •Impact •Outcome •Designs -summative evaluation •experimental •quasi-experimental •nonexperimental.
Introduction •_____________ -formative •Process-Summative •Impact •Outcome •Designs -summative evaluation •experimental •quasi-experimental •nonexperimental.
Key Terms - 1 •Consumer-based - -Program focused on the priority population's wants, needs, desires, preferences, and so forth•Marketing - -A set of processes for creating, communicating, and delivering value to customers; is concerned with a financial profit (American Marketing Association)-Social marketing - attempts to change behavior for improved health or social outcomes-20 Best Super Bowl Commercials of All Time•https://athlonsports.com/overtime/20-best-super-bowl-commercials-all-time1-26-2021-10 Best Super Bowl Commercials 2021•https://youtu.be/wr322n7_o1I 8•https://www.youtube.com/watch?v=OQmhLOFbRQw-2-3-202` 14:18
Key Terms - 1 •_____________ - -Program focused on the priority population's wants, needs, desires, preferences, and so forth•_____________ - -A set of processes for creating, communicating, and delivering value to customers; is concerned with a financial profit (American Marketing Association)-_____________ - attempts to change behavior for improved health or social outcomes-20 Best Super Bowl Commercials of All Time
Key Terms - 2•Market - -''The set of all people who have an actual or potential interest in a product or service'' (Kotler & Clarke, 1987, p.108)-Also called the consumer or target audience•Exchange --Trading a product for certain costs (financial or nonfinancial)-Items that can be marketed can be tangible or intangible: information, ideas, goods, services, events, or behaviors
Key Terms - 2•_____________ - -''The set of all people who have an actual or potential interest in a product or service'' (Kotler & Clarke, 1987, p.108)-Also called the consumer or target audience•_____________ --Trading a product for certain costs (financial or nonfinancial)-Items that can be marketed can be tangible or intangible: information, ideas, goods, services, events, or behaviors
Limitations of Interventions•Even well-planned interventions are not always successful in achieving the expected outcomes. •Most interventions come with some limitations.-In order for engineering and technology innovations to be successful in preventing injuries they must be: •effective and reliable•acceptable to those for whom they were intended •easy to use•used properly•The same or similar limitations could be applied to the other categories of intervention strategies.
Limitations of Interventions •Even well-planned interventions are not always _____________ in achieving the expected outcomes. •Most interventions come with some limitations.-In order for engineering and technology innovations to be successful in preventing injuries they must be: •effective and _____________•acceptable to those for whom they were _____________ •_____________ to use•used _____________•The same or similar limitations could be applied to the other _____________ of intervention strategies.
Methods of Collecting Process Evaluation Data Method When to Use Examples of Measures Pros Cons Questionnaire Need to quickly collect data from reliable respondents and have a reliable and valid questionnaire; need quantitative data Degree of satisfaction with program and with physical environment of the program Straightforward to distribute and collect pen-and-paper version of questions; easy data analysis (if well constructed), efficient Requires respondent to have good reading skills and motivation to complete; use less data if not well written Interview Have time and need qualitative data or have respondents for whom questionnaire is not appropriate Commitment of staff to program and intervention Able to get detailed descriptions during one-on-one interview; possibly new insights Time intensive; need private place for the interview; need interview question and format, more complex data analysis
Methods of Collecting Process Evaluation Data _____________ When to Use Examples of Measures Pros Cons Questionnaire Need to quickly collect data from reliable respondents and have a reliable and valid questionnaire; need quantitative data Degree of satisfaction with program and with physical environment of the program Straightforward to distribute and collect pen-and-paper version of questions; easy data analysis (if well constructed), efficient Requires respondent to have good reading skills and motivation to complete; use less data if not well written _____________ Have time and need qualitative data or have respondents for whom questionnaire is not appropriate Commitment of staff to program and intervention Able to get detailed descriptions during one-on-one interview; possibly new insights Time intensive; need private place for the interview; need interview question and format, more complex data analysis
Other Strategies - 1 •Behavior Modification Activities-Often used in intrapersonal-level interventions, include techniques intended to help those in the priority population experience a change in behavior-Based on SR theory•Process-Keep records (logs, diaries, journals) for a period of time-Analyze the records-Create a plan to modify the behavior
Other Strategies - 1 •_____________ _____________ Activities -Often used in intrapersonal-level interventions, include techniques intended to help those in the priority population experience a change in behavior-Based on SR theory •_____________-Keep records (logs, diaries, journals) for a period of time-Analyze the records-Create a plan to modify the behavior
Other Strategies - 2 •Organizational Cultural Activities-This is not necessarily an additional strategy but underlies understanding your audience for needs assessment, program planning and implementation-Like people, organizations also have a "culture". -Consists of norms and traditions that are generated by and linked to the community.-The culture of an organization expresses what is and what is not considered important for the organization.-Should begin with an assessment or cultural audit to determine if the culture hinders or supports health promotion.
Other Strategies - 2 •__________________________-This is not necessarily an additional strategy but underlies understanding your audience for needs assessment, program planning and implementation-Like people, organizations also have a "culture". -Consists of norms and traditions that are generated by and linked to the community.-The culture of an organization expresses what is and what is not considered important for the organization.-Should begin with an assessment or cultural audit to determine if the culture hinders or supports health promotion.
Other Strategies - 3 •Incentives (i.e., carrot; receiving) -"An anticipated positive or desirable reward designed to influence performance of an individual or group"-Matching motivation & incentives-Types — social, material, miscellaneous•Disincentives(i.e., stick; taking away)-Discourages behavior-"An anticipated negative or undesirable consequence designed to influence performance of an individual or group" -Can range from intrapersonal (e.g., surcharge) to public policy levels (e.g., cigarette taxes)Incentives and disincentive may be part of any program, not a separate strategy •Incentives/Disincentives, cont'd-Regulated by HIPAA•GINA - treating genetic information as protected health information (PHI)•Remove any financial incentives or penalties if genetic information is collected in the HRA-Employers cannot discriminate against their employees because of a "health status related factor" with the outcome affecting coverage or cost to the employee under a group or individual health -In other words, cannot deny coverage or charge employees more because of health status related conditions such as high blood pressure or high blood cholesterol.-ACA further refined rules associated with how incentives could be used in programs that are a part of group health insurance plans. Distinction between participating in wellness programs (no incentive) and health-contingent wellness programs (meet health standard for incentive- i.e. smoking cessation
Other Strategies - 3 •_____________ (i.e., carrot; receiving)-"An anticipated positive or desirable reward designed to influence performance of an individual or group"-Matching motivation & incentives-Types — social, material, miscellaneous•_____________(i.e., stick; taking away)-Discourages behavior-"An anticipated negative or undesirable consequence designed to influence performance of an individual or group"-Can range from intrapersonal (e.g., surcharge) to public policy levels (e.g., cigarette taxes)Incentives and disincentive may be part of any program, not a separate strategy•Incentives/Disincentives, cont'd-Regulated by HIPAA•_____________ - treating genetic information as protected health information (PHI)•Remove any financial incentives or penalties if genetic information is collected in the HRA-Employers cannot discriminate against their employees because of a "health status related factor" with the outcome affecting coverage or cost to the employee under a group or individual health -In other words, cannot deny coverage or charge employees more because of health status related conditions such as high blood pressure or high blood cholesterol.-ACA further refined rules associated with how incentives could be used in programs that are a part of group health insurance plans. Distinction between participating in wellness programs (no incentive) and health-contingent wellness programs (meet health standard for incentive- i.e. smoking cessation
Pathways to Behavior Change•Change knowledge-Awareness of problem, solutions, specific perceptions of risks•Change ability-Skills, resisting peer pressure, decision making, environmental change-bike lanes, reduce barriers-willing and want to change but not able•Change norms-Resistant, don't want to change
Pathways to Behavior Change •_____________-Awareness of problem, solutions, specific perceptions of risks•Change _____________-Skills, resisting peer pressure, decision making, environmental change-bike lanes, reduce barriers-willing and want to change but not able•Change _____________-Resistant, don't want to change
Personnel•Items related to personnel-Technical assistance•Capacity building assistance-Volunteers-Teamwork-Cultural factors•Cultural competence •The key resource; people needed to carry outcertain tasks•Where to get personnel-Internal•Flex time, own time, & program ownership-External (vendors)•Public / voluntary / free (e.g., speaker's bureaus)•Private-Combination of internal & external
Personnel•Items related to personnel-_____________ assistance•_____________ building assistance-Volunteers-Teamwork-Cultural factors•Cultural competence •The key resource; people needed to carry out certain _____________ •Where to get personnel -_____________•Flex time, own time, & program ownership-_____________ (vendors)•Public / voluntary / free (e.g., speaker's bureaus)•Private-Combination of internal & external
Phase 1: Adoption of the Program•This phase is a part of the marketing process.•Great care must go into the marketing process to ensure that a relevant product (i.e., the health promotion program) is planned so that those in the priority population will want to participate in it. Phase 2: Identifying & Prioritizing the Tasks to Be Completed - 1 •Many tasks need to be completed when implementing a program. -e.g., reserving space, ordering equipment, etc.•Tasks need to be identified and prioritized.-Planning timetables and timelines can help with this process. •Types of timetables and timelines include:-Basic time lines (calendars)-Task development time lines (TDTLs)-Gantt charts-PERT charts-Critical path method (CPM)•GANTT handout/file on Canvas
Phase 1: _____________ of the Program•This phase is a part of the marketing process.•Great care must go into the marketing process to ensure that a relevant product (i.e., the health promotion program) is planned so that those in the priority population will want to participate in it. Phase 2: Identifying & Prioritizing the Tasks to Be _____________ - 1 •Many tasks need to be completed when implementing a program. -e.g., reserving space, ordering equipment, etc.•Tasks need to be identified and prioritized.-Planning timetables and timelines can help with this process. •Types of timetables and timelines include:-_____________ time lines (calendars)-Task _____________ time lines (TDTLs)-Gantt charts-PERT charts-Critical path method (CPM)•GANTT handout/file on Canvas
Phase 3: Establishing a System of Management - 1 •Management - ''the process of assembling and using sets of resources in a goal-directed manner to accomplish tasks in an organizational setting'' Includes human, financial, and technical resources•''The efficient, satisfactory management of a health promotion program is vital to its long-term success'' •Good management is needed to ensure that programs are-Effective: meet stated goals and objectives-Efficient: well-organized, cost effective•Managers need technical, interpersonal, and conceptual skills.•Human Resources Management (HRM)-Four functions (or PADS)•Planning - defining personnel•Acquisition - hiring personnel•Development - training personnel•Sanction - discipline, rewards, safety •Financial Management -''Process of developing and using system to ensure that funds are spent for the purpose for which they have been appropriated'' (Klingner, et al, 2010, p. 88)•Accounting, fiscal year, fiscal accountability•Audits - Internal and external•Technical Resources Management-All other resources besides human and financial •Equipment, expertise, information, material, partnerships
Phase 3: Establishing a _____________ of _____________ - 1 •_____________ - ''the process of assembling and using sets of resources in a goal-directed manner to accomplish tasks in an organizational setting'' Includes human, financial, and technical resources•''The efficient, satisfactory management of a health promotion program is vital to its long-term success'' •Good management is needed to ensure that programs are-_____________: meet stated goals and objectives-_____________: well-organized, cost effective•Managers need technical, interpersonal, and conceptual skills.•Human Resources Management (HRM)-Four functions (or PADS)•Planning - defining personnel•Acquisition - hiring personnel•Development - training personnel•Sanction - discipline, rewards, safety •_____________ _____________ -''Process of developing and using system to ensure that funds are spent for the purpose for which they have been appropriated'' (Klingner, et al, 2010, p. 88)•Accounting, fiscal year, fiscal accountability•Audits - Internal and external•Technical Resources Management-All other resources besides human and financial •Equipment, expertise, information, material, partnerships
Phase 4: Putting Plans into Action - 1 •There are three major ways of putting plans into action: -Pilot testing- trying the program out with a small group from the priority population to identify any problems-Phasing in- limiting the number of people who are exposed, then gradually increasing the numbers; by offerings, by location, by ability, by number-Total program- all in priority population are exposed at same time Phase 4: Putting Plans into Action - 2 •First Day of Implementation-Also referred to as program launch, program rollout, or program kick off•Some special planning may be necessary: -Decide on a first day.•Consider launching to coincide with other already occurring event (e.g., weight loss program & New Year's resolution). •Some special planning may be necessary, cont'd-Kick off in style. •Create a special event; use celebrities.-Seek news coverage, if appropriate.•Inform appropriate media representatives of your plans.•Make arrangements to meet the media representatives at the designated time and place.•Use press releases, video releases, spokespeople .•Consider a news hook; e.g., day in history. •Monitoring Implementation-Program monitoring-- ongoing collection and analysis of data and other information to determine if the program is operating as planned.•Basic monitoring data and information for a program has the following utilities (USDJ, n.d.):-operating and descriptive data and information.-basic information to outcomesto the program objectives. -preventive maintenance function by tracking indicators of critical elements.
Phase 4: Putting Plans into _____________ - 1 •There are three major ways of putting plans into action: -_____________ testing- trying the program out with a small group from the priority population to identify any problems-_____________ in- limiting the number of people who are exposed, then gradually increasing the numbers; by offerings, by location, by ability, by number-Total program- all in priority population are exposed at same time Phase 4: Putting Plans into Action - 2 •First Day of _____________-Also referred to as program launch, program rollout, or program kick off•Some special planning may be necessary: -Decide on a first day.•Consider launching to coincide with other already occurring event (e.g., weight loss program & New Year's resolution). •Some special planning may be necessary, cont'd-Kick off in style. •Create a special event; use celebrities.-Seek news coverage, if appropriate.•Inform appropriate media representatives of your plans.•Make arrangements to meet the media representatives at the designated time and place.•Use press releases, video releases, spokespeople .•Consider a news hook; e.g., day in history. •_____________ Implementation-__________________________-- ongoing collection and analysis of data and other information to determine if the program is operating as planned.•Basic monitoring data and information for a program has the following utilities (USDJ, n.d.):-operating and descriptive data and information.-basic information to outcomesto the program objectives. -preventive maintenance function by tracking indicators of critical elements.
Phase 5: Ending or Sustaining a Program•Planners should determine how long to run a program.•If the program met its goals and objectives and the priority population has been served to the fullest extent necessary, then the program can be ended.•Sustaining a program is more difficult. Six techniques include:1.Work to institutionalize2.Seek feedback 3.Advocate for the program4.Partner with others5.Revisit and revise the rationale6.Establish a resource development committee
Phase 5: _____________ or _____________ a Program•Planners should determine how long to run a program.•If the program met its goals and objectives and the priority population has been served to the fullest extent necessary, then the program can be ended.•Sustaining a program is more difficult. Six techniques include:1.Work to _____________ 2.Seek _____________ 3._____________ for the program4.Partner with others5.Revisit and _____________ the rationale 6.Establish a _____________ development committee
Phases of Program Implementation•Phases are flexible in nature and can be modified to meet the many different situations and circumstances faced by planners.•Phases of implementation 1. Adoption of the program 2. Identifying & prioritizing the tasks to be completed 3. Establishing a system of management 4. Putting the plans into action 5. Ending or sustaining a program
Phases of Program _____________•Phases are flexible in nature and can be modified to meet the many different situations and circumstances faced by planners.•Phases of implementation 1. _____________ of the program 2. Identifying & prioritizing the _____________ to be completed 3. Establishing a system of _____________ 4. Putting the plans into _____________ 5. _____________ or sustaining a program
Practical Problems in Evaluation 1.Planner failed to build evaluation into program planning. 2.Adequate procedures cost time and resources. 3.Changes in adults occur slowly. 4.Some changes do not last 5.It is often difficult to distinguish because cause and effect. 6.Competing motives can hinder effective evaluation
Practical Problems in Evaluation 1.Planner _____________ to build evaluation into program planning. 2._____________ procedures cost time and resources. 3.Changes in adults occur _____________. 4.Some changes do not _____________ 5.It is often _____________ to distinguish because cause and effect. 6._____________ motives can hinder effective evaluation
Practical Problems or Barriers in Evaluation - 1 1.Planners either fail to build evaluation in the planning process or do so too late. 2.Adequate resources may not be available to conduct an appropriate evaluation. 3.Organizational restrictions may prevent hiring consultants and contractors. 4.Effects are often hard to detect because changes are sometimes small, come slowly, or do not last. 5.Length of time allotted for the program and its evaluation is not realistic. 6.Restrictions may limit the collection of data among the priority population 7.It is difficult to make an association between cause and effect.8.It is difficult to evaluate multi-strategy interventions. 9.Discrepancies between professional standards and actual practice exist with regard to appropriate evaluation design. 10.Evaluators' motives to demonstrate success introduce bias. 11.Stakeholders' perceptions of the evaluation's value may vary too drastically. 12.Intervention strategies are sometimes not delivered as intended or are not culturally specific.
Practical Problems or Barriers in Evaluation - 1 1.Planners either fail to build _____________ in the planning process or do so too late. 2.Adequate resources may not be _____________ to conduct an appropriate evaluation. 3.Organizational _____________ may prevent hiring consultants and contractors. 4.Effects are often hard to _____________ because changes are sometimes small, come slowly, or do not last. 5._____________ of time allotted for the program and its evaluation is not realistic. 6._____________ may limit the collection of data among the priority population 7.It is difficult to make an association between cause and effect. 8.It is difficult to _____________ multi-strategy interventions. 9._____________ between professional standards and actual practice exist with regard to appropriate evaluation design. 10.Evaluators' motives to demonstrate _____________ introduce bias. 11._____________' perceptions of the evaluation's value may vary too drastically. 12.Intervention strategies are sometimes not delivered as _____________ or are not _____________ specific.
Preparing and Monitoring a Budget - 2 •Steps of the budgeting process:-Examine the financial objectiveof the program.-Find the expected revenue. (grant funding; budget allocations within the agency)•Where will the money come from?-Estimate what expendituresare necessary for the program.•Personnel, instructional materials or supplies, utilities, etc.-Monitor the budget once program has begun.
Preparing and Monitoring a Budget - 2 •Steps of the budgeting process:-Examine the financial _____________ of the program.-Find the expected _____________. (grant funding; budget allocations within the agency)•Where will the money _____________ from?-Estimate what _____________ are necessary for the program.•Personnel, instructional materials or supplies, utilities, etc.-_____________ the budget once program has begun.
Preparing and Monitoring a Budget - 1 •Project Budget-The financial picture of your project-Formal statement of the estimated revenues and expenditures•For the length of the program•but broken into 12-month periods if it lasts longer than a year. -developed by program planners and those who control resources that will be used in the program.
Preparing and Monitoring a _____________ - 1 •_____________-The financial picture of your project-Formal statement of the estimated revenues and expenditures•For the length of the program•but broken into 12-month periods if it lasts longer than a year. -developed by program planners and those who control resources that will be used in the program.
Program or Project Champions Champions are:•Key stakeholders •Influential •Deep rooted •Up front and/or behind the scenes •Necessary for success
Program or Project _____________ _____________ are:•Key stakeholders •Influential •Deep rooted •Up front and/or behind the scenes •Necessary for success
Presenting Data - 1 •Data presentation should be simple and straightforward. •Tables and graphs can 1. help illustrate certain findings 2. make reports easier to read 3. understand findings, be self-explanatory. •Use graphic displays that are appropriate for the results.-Horizontal bar charts - focus attention on different categories-Vertical bar charts - focus attention to change over time-Cluster bar charts - contrast one variable from others-Line graphs - plot data and show a trend over time-Pie charts - show distributionof a set of events or a total quantity-Brownie pans—show proportions of data-Pictographs—show pictorial representationsof data
Presenting Data - 1 •Data presentation should be ___________ and straightforward. •___________ and ___________ can 1. help illustrate certain findings 2. make reports easier to read 3. understand findings, be self-explanatory. •Use ___________ displays that are appropriate for the results.-Horizontal bar charts - focus attention on different categories-Vertical bar charts - focus attention to change over time-Cluster bar charts - contrast one variable from others-Line graphs - plot data and show a trend over time-Pie charts - show distributionof a set of events or a total quantity-Brownie pans—show proportions of data-Pictographs—show pictorial representationsof data
Processes of Community Organizing & Community Building - 3 Negotiating entrance with the gatekeepers Recognizing the issue -> Gaining entry into the community ->Organizing the people -> ontinued... Mapping community capacity - Building blocks (primary, secondary, & potential) Assessing the community -> Determining the priorities & setting goals -> Arriving at a solution & selecting intervention strategies -> continued...
Processes of Community Organizing & Community Building - 3 Negotiating entrance with the _____________ Recognizing the issue -> Gaining _____________ into the community ->Organizing the people -> continued... _____________ community capacity - Building blocks (primary, secondary, & potential) Assessing the community -> Determining the priorities & setting goals -> Arriving at a solution & selecting intervention strategies -> continued...
Processes of Community Organizing & Community Building - 5 Looping back - could go back as far as the"assessing the community"step.. Implementing the plan -> Evaluating the outcomes of the plan of action -> Maintaining the outcomes in the community -> Looping back
Processes of Community Organizing & Community Building - 5 _____________ back - could go back as far as the"assessing the community"step.. Implementing the plan -> Evaluating the outcomes of the plan of action -> Maintaining the outcomes in the community -> Looping back
Processes of Community Organizing and Community Building - 2 •Three new categories of community organization include:-Planning and policy practice •community/public health workers use data to generate persuasive rationales that lead toward proposing and enacting particular solutions-Community capacity development •based on empowering those impacted by a problem with knowledge and skills to understand the problem and then work cooperatively together to deal with the problem -Social advocacy •used to address a problem through the application of pressure, including confrontation, on those who have created the problem or stand as a barrier to a solution to the problem
Processes of Community Organizing and Community Building - 2 •Three new categories of community organization include:-_____________ and _____________ practice •community/public health workers use data to generate persuasive rationales that lead toward proposing and enacting particular solutions-Community _____________ development •based on empowering those impacted by a problem with knowledge and skills to understand the problem and then work cooperatively together to deal with the problem -Social _____________ •used to address a problem through the application of pressure, including confrontation, on those who have created the problem or stand as a barrier to a solution to the problem
Processes of Community Organizing & Community Building - 1 •No single unified model, though there are several methods. •Three categories of community organization include:-Locality development - •seeks community change through broad self-help participation from the local community; builds a sense of community-Social planning -•task oriented, focused on problem solving usually by outside expert-Social action - •both task & process oriented; achieving change to redress imbalances in power
Processes of Community _____________ & Community _____________ - 1 •No single unified model, though there are several methods. •Three categories of community organization include: -_____________ development - •seeks community change through broad self-help participation from the local community; builds a sense of community-_____________ planning -•task oriented, focused on problem solving usually by outside expert-Social _____________ - •both task & process oriented; achieving change to redress imbalances in power
Promote Your Program:1.Describe your product/program2.Describe your target audience (segment)3.What will you charge for your program? Explain the rationale for this?4.Where will you place your program (days, times, location)? Why?5.How will you promote it? How, when and where will you advertise?6.Create a message that you could post on social media promoting your program. Create a print ad that you could public or display.7.How could you use contracts, social support, incentives, competition to motivate participants to stay in the program?
Promote Your Program:1._____________ your product/program2.Describe your target _____________ (segment)3.What will you _____________ for your program? Explain the rationale for this?4.Where will you _____________ your program (days, times, location)? Why?5._____________ will you promote it? How, when and where will you advertise? 6.Create a _____________ that you could post on social media promoting your program. Create a print ad that you could public or display.7.How could you use contracts, social support, incentives, competition to _____________ participants to stay in the program?
Proposal Budget-Direct Costs•Possibly most important part of grant's budget. They are the funds you are asking from the funding source. •Direct costs usually include: Personnel-Fringe benefits-Travel-Equipment-Supplies-Consulting/contracting fees/costs-(different budget categories listed for CHOICES Project)•There are also: •In-kind Contributions (no need to include these on CHOICES proposal)•Indirect Costs
Proposal Budget-__________ •Possibly most important part of grant's budget. They are the funds you are asking from the funding source. •Direct costs usually include: __________-Fringe benefits-__________-Equipment-Supplies-Consulting/contracting fees/costs-(different budget categories listed for CHOICES Project)•There are also: •__________ Contributions (no need to include these on CHOICES proposal)•Indirect Costs
Purpose of Evaluation 1.To determine achievement of objectives related to improved health status 2.To improve program implementation 3.To provide accountability to funders, the community, and other stakeholders 4.To increase community support for initiatives 5.To contribute to the scientific base for community public health interventions 6.To inform policy decisions
Purpose of Evaluation 1.To determine _____________ of objectives related to improved health status 2.To improve program _____________ 3.To provide _____________ to funders, the community, and other stakeholders 4.To increase community _____________ for initiatives 5.To contribute to the _____________ base for community public health interventions 6.To inform _____________ decisions
Purposes of Project Budget•Demonstrates how much the project will cost•Shows funders exactly what they will support/where their money will go•Serves as a plan on how to operate your project•Serves as a basis for the end of the year report
Purposes of Project Budget •Demonstrates how much the project will _____________•Shows _____________ exactly what they will support/where their money will go•Serves as a plan on how to _____________ your project•Serves as a basis for the end of the year _____________
Recruiting Coalition Members •Agencies •Organizations •Individuals
Recruiting Coalition Members (3)
Segmentation - 3•The following five criteria can assist a program planner in choosing the appropriate segment to focus on:-Measurable •How many people are in each segment & can the factors be measured?-Substantial •Is the segment large enough & profitable enough to reach enough people to make a difference?-Accessible •Can the segment be reached & services delivered?-Differentiable •Are segments different enough that they will react differently to marketing strategies?-Actionable •Can products be created to attract segments?
Segmentation - 3•The following five criteria can assist a program planner in choosing the appropriate segment to focus on:-_____________ •How many people are in each segment & can the factors be measured?-_____________ •Is the segment large enough & profitable enough to reach enough people to make a difference?-_____________ •Can the segment be reached & services delivered?-_____________ •Are segments different enough that they will react differently to marketing strategies?-_____________ •Can products be created to attract segments?
Selecting an Evaluation Design - 2 •Two possible methods of data collection: -Quantitative (deductive; applying principle to case) •Produces numeric (hard) data, such as counts, ratings, scores, or classifications •Suited to programs that are well defined •It is the method most often used in evaluation designs. -Qualitative (inductive; examining case to form principle) •Produces narrative data, such as words and descriptions •This is a good method to use for programs that emphasize individual outcomes or in cases where other descriptive information from participants is needed. •Useful in gathering information to improve the program during process evaluation. •Rather than choose one method, it may be advantageous to combine quantitative and qualitative methods.
Selecting an Evaluation Design - 2 •Two possible methods of data collection: -_____________ (deductive; applying principle to case) •Produces numeric (hard) data, such as counts, ratings, scores, or classifications •Suited to programs that are well defined •It is the method most often used in evaluation designs. -_____________ (inductive; examining case to form principle) •Produces narrative data, such as words and descriptions •This is a good method to use for programs that emphasize individual outcomes or in cases where other descriptive information from participants is needed. •Useful in gathering information to improve the program during process evaluation. •Rather than choose one method, it may be advantageous to combine quantitative and qualitative methods.
Some Process Evaluation Measures •Participants -Undercoverage, overcoverage -Participant satisfaction survey (create?) •Queuing-Length of time on waiting list •Social Marketing- Number of ads, response to ads •Intervention-Number of sessions etc.
Some Process Evaluation Measures •_____________ -Undercoverage, overcoverage -Participant satisfaction survey (create?) •_____________-Length of time on waiting list •_____________ Marketing- Number of ads, response to ads •_____________-Number of sessions etc.
Space•Where will the program be held?-Depending on the type of program and the intended audience, space may or may not be readily available.•Inexpensive space: -local schools, colleges and universities, religious facilities, and in "community service rooms."-The planner may also be able to trade expertise for space.•Free space is not always free.-Set up and clean-up charge (e.g., custodial service).-Charge for security services-Parking may not be free or available
Space• _____________ will the program be held?-Depending on the _____________ of program and the intended _____________, space may or may not be readily available. •_____________ space: -local schools, colleges and universities, religious facilities, and in "community service rooms."-The planner may also be able to trade _____________ for space. •Free space is not always _____________. -Set up and clean-up charge (e.g., custodial service).-Charge for _____________ services-_____________ may not be free or available
Ten Concerns Associated with Implementation - 1 •1. Safety & Medical Concerns-Most programs are designed to improve health, thus give attention to the safety and medical concerns associated with the program.-Informed consent•Explain nature of program.•Inform participants of risk or dangers and any possible discomfort.•Explain expected benefits.•Inform of alternative programs.•Indicate that they are free to discontinue participation at any time.•Allow participants to ask questions.-Informed consent forms (waiver of liability or release of liability) do not protect planners from being sued.•They just make participants aware of special concerns.
Ten Concerns Associated with Implementation - 1 •1. _____________ & _____________ Concerns-Most programs are designed to improve health, thus give attention to the safety and medical concerns associated with the program.- _____________•Explain nature of program.•Inform participants of risk or dangers and any possible discomfort.•Explain expected benefits.•Inform of alternative programs.•Indicate that they are free to discontinue participation at any time.•Allow participants to ask questions.-Informed consent forms (waiver of liability or release of liability) do not protect planners from being sued.•They just make participants aware of special concerns.
The Marketing Process & Health Promotion Programs - 1 •Consumer Orientation-All marketing-related program decisions—including the type of product that is developed, how it is offered, how much it will cost, how it is promoted, and the benefits promised— are based on what planners know about the priority population and their preferences.-Usually done during the formative research process and needs assessment process. •Competition-Planners should identify the competition during the formative research phase.-Knowing what the priority population perceives is the competition and the benefits that they get from choosing that option can help planners make strategic decisions.•Segmentation-A way to divide the priority population into smaller, more homogeneous groups -The goal of segmentation is to create groups of people who share similar characteristics or qualities that are associated with being at risk for certain health problems and who will respond in a similar way to the intervention.
The Marketing Process & Health Promotion Programs - 1 •_____________ Orientation-All marketing-related program decisions—including the type of product that is developed, how it is offered, how much it will cost, how it is promoted, and the benefits promised— are based on what planners know about the priority population and their preferences.-Usually done during the formative research process and needs assessment process •_____________-Planners should identify this during the formative research phase.-Knowing what the priority population perceives is the competition and the benefits that they get from choosing that option can help planners make strategic decisions.•_____________-A way to divide the priority population into smaller, more homogeneous groups -The goal of segmentation is to create groups of people who share similar characteristics or qualities that are associated with being at risk for certain health problems and who will respond in a similar way to the intervention..
There are three types of evaluation designs. 1.Experimental design-Offers the greatest control over the confounding variables -Involves random assignment to experimental and control groups with measurement of both groups Produces the most interpretable and defensible evidence of effectiveness. 2.Quasi-experimental -Results in interpretable and supportive evidence of program effectiveness -Usually cannot control for all factors that affect the validity of the results -No random assignment to the groups-Comparisons are made on experimental and comparison groups. 3. Nonexperimental Without the use of a comparison or control group, has little control over the factors that affect the validity of the results.
There are three types of evaluation designs. 1._____________ design-Offers the greatest control over the confounding variables -Involves random assignment to experimental and control groups with measurement of both groups Produces the most interpretable and defensible evidence of effectiveness. 2._____________l -Results in interpretable and supportive evidence of program effectiveness -Usually cannot control for all factors that affect the validity of the results -No random assignment to the groups-Comparisons are made on experimental and comparison groups. 3. _____________ Without the use of a comparison or control group, has little control over the factors that affect the validity of the results.
Threats to External Validity •Social desirability -respond to impress evaluator •Expectancy effect -Attitudes projected cause individuals to act in a certain way •Hawthorne effect -Behavior because they are aware they are being tested •Placebo effect -Belief in the treatment leads to effect Priority Population #1 Priority Population #2
Threats to External Validity •_____________ -respond to impress evaluator •_____________ effect -Attitudes projected cause individuals to act in a certain way •_____________ effect -Behavior because they are aware they are being tested •_____________ effect -Belief in the treatment leads to effect Priority Population #1 Priority Population #2
Threats to Internal Validity •History •Maturation •Testing (e.g., pretesting) •Instrumentation •Statistical regression •Selection •Attrition •Interaction •Compensatory equalization of treatments •Compensatory rivalry •Resentful demoralization •Interaction of several threats
Threats to _____________ _____________ •History •Maturation •Testing (e.g., pretesting) •Instrumentation •Statistical regression •Selection •Attrition •Interaction •Compensatory equalization of treatments •Compensatory rivalry •Resentful demoralization •Interaction of several threats
Three Rules for Epidemics•Law of the Few-Connectors, Mavens, Salespeople-The nature of the messenger is important•Stickiness Factor-Importance of direct marketing•Power of Context-The environment is critical-physical, psychological
Three Rules for Epidemics•Law of the Few-_____________, _____________, _____________-The nature of the messenger is important•Stickiness Factor-Importance of direct marketing•Power of Context-The environment is critical-physical, psychological
Top 10 Marketing and Advertising Campaigns of All Time•1. Woodbury Soap Company: Skin You Love to Touch•2. Lucky Strike: Torches of Freedom•3. De Beers: A Diamond is Forever•4. Marlboro: Marlboro Man•5. Volkswagen: Think Small•6. California Milk Processor Board: Got Milk?•7. Nike: Just do it•8. Apple: Get a Mac•9. Dos Equis: Most Interesting Man in the World•10. Old Spice: The Man Your Man Could Smell Likehttps://inkbotdesign.com/advertising-campaigns/https://youtu.be/k_klOhy-el0 Marlboro Man 1.01https://youtu.be/owGykVbfgUE Old Spice .31
Top 10 Marketing and Advertising Campaigns of All Time•1. Woodbury Soap Company: Skin You Love to Touch•2. Lucky Strike: Torches of Freedom•3. De Beers: A Diamond is Forever•4. Marlboro: Marlboro Man•5. Volkswagen: Think Small•6. California Milk Processor Board: Got Milk?•7. Nike: Just do it•8. Apple: Get a Mac•9. Dos Equis: Most Interesting Man in the World•10. Old Spice: The Man Your Man Could Smell Likehttps://inkbotdesign.com/advertising-campaigns/https://youtu.be/k_klOhy-el0 Marlboro Man 1.01https://youtu.be/owGykVbfgUE Old Spice .31
Types of Costs•The two types of costs that are most often found in budgets are direct costs and indirect costs.•Direct costs •costs that are directly expended in providing a product or service and is expressed in a budget as the actual number of dollars expected to be spent (e.g., wages, salaries, and supplies).•Indirect cost •portion of costs that are indirectly expended in providing a product or service The purpose of indirect cost is to capture overhead/administrative costs that cannot be connected directly to a program (e.g., cost of telephones, other utilities, insurance, space, and equipment maintenance).•Other cost terms: fixed, variable, capital, hard, soft
Types of Costs•The two types of costs that are most often found in budgets are _____________ costs and _____________ costs. _____________ •costs that are directly expended in providing a product or service and is expressed in a budget as the actual number of dollars expected to be spent (e.g., wages, salaries, and supplies). _____________ •portion of costs that are indirectly expended in providing a product or service The purpose of indirect cost is to capture overhead/administrative costs that cannot be connected directly to a program (e.g., cost of telephones, other utilities, insurance, space, and equipment maintenance).•Other cost terms: fixed, variable, capital, hard, soft
Types of Intervention Strategies Strategy - "A general plan of action for affecting a health problem. A strategy may encompass several activities" (CDC, 2003). CDC system of classification for strategies-More common strategies used by planners -Categories not independent of each other -Categories include: 1.health communication 2.health education 3.health policy/enforcement 4.environmental change 5.health-related community service 6.community mobilization 7.otherStrategies for change •Re-educative Persuasive •Power •Facilitative
Types of Intervention Strategies _____________ - "A general plan of action for affecting a health problem. may encompass several activities" (CDC, 2003). CDC system of classification for strategies-More common strategies used by planners -Categories not _____________ of each other -Categories include: 1.health _____________ 2.health _____________ 3.health _____________/enforcement 4._____________ change 5.health-related _____________ service 6.community _____________ 7.other Strategies for change •Re-educative Persuasive •Power •Facilitative
Useful Resource:•Developing an Effective Evaluation Report-Setting the course for effective program evaluation-http://www.cdc.gov/eval/materials/Developing-An-Effective-Evaluation-Report_TAG508.pdf
Useful Resource:•Developing an Effective Evaluation ___________-Setting the course for effective program ___________-http://www.cdc.gov/eval/materials/Developing-An-Effective-Evaluation-Report_TAG508.pdf
Variables •Dependent variable: effect, measure outcome •Independent variable: cause, manipulated, treatment, Intervening variable: variable that forms a link between the independent variable, AND without which the independent variable is not related to the dependent variable (outcome). -AKA mediating variable -purposively manipulated or managed •Confounding variable is an extraneous variable which accounts for all or part of the effects on the dependent variable (outcome); mask underlying true assumptions. --Exogenous Exogenous (outside of individuals) confounding confounding factors are uncontrollable (selection bias, coverage bias) .--Endogenous Endogenous (within individuals) confounding confounding factors equally important: secular drift in attitudes/knowledge, maturation (children or elderly), seasonality, interfering events that alter individuals.
Variables •_____________ variable: effect, measure outcome •_____________ variable: cause, manipulated, treatment, _____________ variable: variable that forms a link between the independent variable, AND without which the independent variable is not related to the dependent variable (outcome). -AKA _____________ variable -purposively manipulated or managed •_____________ variable is an extraneous variable which accounts for all or part of the effects on the dependent variable (outcome); mask underlying true assumptions. --_____________ (outside of individuals) confounding confounding factors are uncontrollable (selection bias, coverage bias) .--_____________ (within individuals) confounding confounding factors equally important: secular drift in attitudes/knowledge, maturation (children or elderly), seasonality, interfering events that alter individuals.
What kind of strategies will you use for your CHOICES proposal?1.Health communication2.Health education3.Health policy/enforcement 4.Environmental change5.Health-related community service6.Community mobilization 7.Other1.Behavior modification2.Cultural activities3.Incentives/disincentives4.Social activities•Friendly City Long Term Care facility activitiy
What kind of strategies will you use for your CHOICES proposal?1.Health communication2.Health education3.Health policy/enforcement 4.Environmental change5.Health-related community service6.Community mobilization 7.Other1.Behavior modification2.Cultural activities3.Incentives/disincentives4.Social activities•Friendly City Long Term Care facility activitiy
What segment of the population are you targeting with....•Shampoo?•Birth control methods?•Work out equipment/gym membership?1.Big box gyms2.Boutique gyms3.Personal training gyms4.Women's gyms5.CrossFit gyms6.Group fitness gyms or studios7.Powerlifting gyms8.Rock climbing gyms9.Home equipment—Peloton, The Mirror•Remember your market-rarely does one size fit all.
What segment of the population are you targeting with....•Shampoo?•Birth control methods?•Work out equipment/gym membership?1.Big box gyms2.Boutique gyms3.Personal training gyms4.Women's gyms5.CrossFit gyms6.Group fitness gyms or studios7.Powerlifting gyms8.Rock climbing gyms9.Home equipment—Peloton, The Mirror•Remember your market-rarely does one size fit all.
Who Will Conduct the Evaluation? - 1 •Internal Evaluation-An individual trained in evaluation and personally involved with the program conducts the evaluation.-Advantages •More familiar with organization and program history •Knows decision-making style of those in the organization •Present to remind people of results now and in the future •Able to communicate results more frequently and clearly •Less expensive-Disadvantages •Possibility of evaluator bias or conflict of interest
Who Will Conduct the Evaluation? - 1 •_____________ Evaluation-An individual trained in evaluation and personally involved with the program conducts the evaluation. -Advantages •More _____________ with organization and program history •Knows _____________-making style of those in the organization •Present to _____________ people of results now and in the future •Able to _____________ results more frequently and clearly •Less expensive -Disadvantages •Possibility of _____________ bias or conflict of _____________
Who Will Conduct the Evaluation? - 2 •External Evaluation-Conducted by someone who is not connected with the program (Evaluation consultant) -Advantages •More objective review and fresh perspective•Can ensure unbiased evaluation outcome •Brings global knowledge of working in a variety of settings •Typically brings more breadth and depth of technical expertise -Disadvantages •More expensive •Can be somewhat isolated, often lacking knowledge of and experience with the program •Evaluator should be credible and objective, have a clear role in evaluation design, and accurately report findings.
Who Will Conduct the Evaluation? - 2 •_____________ Evaluation-Conducted by someone who is not connected with the program (Evaluation consultant) -Advantages •More _____________ review and fresh perspective •Can ensure _____________ evaluation outcome •Brings global knowledge of working in a variety of settings •Typically brings more breadth and depth of technical expertise -Disadvantages •More _____________ •Can be somewhat _____________, often lacking knowledge of and experience with the program •Evaluator should be _____________ and _____________, have a clear role in evaluation design, and accurately report findings.
Team Building-for project staff and volunteers Involves: •Diversity •Awareness and appreciation personal uniqueness •Trust •Identification of common threads •Risk-taking •Leadership •Interdependence
__________ Building-for project staff and volunteers Involves: •Diversity •Awareness and appreciation personal uniqueness •Trust •Identification of common threads •Risk-taking •Leadership •Interdependence
Procedures Used in Formative Evaluation •Focus groups •Surveys•In-depth interviews •Informal interviews •Key informant interviews •Community Awareness example-Ch. 5 •Expert panel reviews •Quality circles •Protocol checklist •Gantt chart- document with Ch. 12 Implementation Planning •Program & evaluation forms
_____________ Used in _____________ Evaluation •Focus groups •Surveys•In-depth interviews •Informal interviews •Key informant interviews •Community Awareness example-Ch. 5 •Expert panel reviews •Quality circles •Protocol checklist •Gantt chart- document with Ch. 12 Implementation Planning •Program & evaluation forms
Personnel Costs•Staff costs - include wages and salaries under the category "personnel."•New employees: determining the actual salary can be tricky. -One place to start is by checking with similar organizations to find out what they are paying program employees in similar positions.•Indicate whether or not a salary is annual or an hourly wage. -If hourly, show the breakdown of hours and weeks: Example: $10.00 per hour X 40 hours per week X 52 weeks = $20,800)•Budget calculation for personnel
__________ Costs •__________ costs - include wages and salaries under the category "personnel." •New __________: determining the actual salary can be tricky. -One place to start is by checking with similar organizations to find out what they are paying program employees in similar positions.•Indicate whether or not a salary is annual or an hourly wage. -If hourly, show the breakdown of hours and weeks: Example: $10.00 per hour X 40 hours per week X 52 weeks = $20,800)•Budget calculation for personnel
Multivariate Data Analyses - 1 •Used to study three or more variables simultaneously•Examples of multivariate analyses include multiple regression, discriminant analysis, and factor analysis.-Multiple regression is the most commonly used. •Useful in exploring relationships among variables or in exploring the independent effects of many variables on one dependent variable•Many types, including: -Stepwise-Logistic-General linear
___________ Data Analyses - 1 •Used to study three or more variables simultaneously•Examples of multivariate analyses include multiple regression, discriminant analysis, and factor analysis.-Multiple regression is the most commonly used. •Useful in exploring relationships among variables or in exploring the independent effects of many variables on one dependent variable•Many types, including: -Stepwise-Logistic-General linear
Volunteers Know what inspires them Show how they can make an impactCreate a positive climate Facilitate their success-trainings and support Celebrate small successes Collect their feedback
_____________ Know what inspires them Show how they can make an impactCreate a positive climate Facilitate their success-trainings and support Celebrate small successes Collect their feedback
Ch 8 Intervention or treatment •An intervention (or treatment) is an activity or set of activities/strategies that help to achieve the outcomes stated in the goals & objectives. -A theory-based strategy or experience to which those in the priority population will be exposed or in which they will take part-Occurs between two points in time •An intervention should be effective (leads to desired outcome) & efficient (uses resources in a responsible manner). •Multiplicity - number of components or activities •Dose - number of program units delivered; how many times offered
_____________ •This is an activity or set of activities/strategies that help to achieve the outcomes stated in the goals & objectives. -A theory-based strategy or experience to which those in the priority population will be exposed or in which they will take part-Occurs between two points in time • should be effective (leads to desired outcome) & efficient (uses resources in a responsible manner). •_____________ - number of components or activities •_____________ - number of program units delivered; how many times offered
Program Evaluation & Review Technique (PERT) 00. Start planning10. Develop rationale20. Needs assessment23. Create instrument25. Select sample27. Collect & analyze data30. Create goals/objectives40. Create intervention50. Pilot test60. Identify & allocate resources70. Marketing80. Implement program90. Evaluate (process, impact, & outcome) Time estimated 3 ways: optimistic, pessimistic, & probabilistic
_____________ (PERT) 00. Start planning10. Develop rationale20. Needs assessment23. Create instrument25. Select sample27. Collect & analyze data30. Create goals/objectives40. Create intervention50. Pilot test60. Identify & allocate resources70. Marketing80. Implement program90. Evaluate (process, impact, & outcome) Time estimated 3 ways: optimistic, pessimistic, & probabilistic
Pretesting - 3 •Provides feedback and identifies red flags.•Methods depend on the aspect of marketing strategy being tested, the topics being explored, the amount of money available for pretesting, and the timeline.-Common methods include:•Focus groups•Central location intercept interview•Who should complete pretesting?-Priority population for understanding-Experts in field for content validity-Gatekeepers for acceptance and approval— •opinion leaders, parents in some cases.
_____________ - 3 •Provides _____________ and identifies red flags.•Methods depend on the aspect of marketing strategy being tested, the topics being explored, the amount of money available for pretesting, and the timeline.-Common methods include:•Focus groups•Central location intercept interview•Who should complete pretesting?-Priority population for understanding-Experts in field for content validity-Gatekeepers for acceptance and approval— •opinion leaders, parents in some cases.
Promotion - 1 •Promotion - communication strategy used to let the priority population know about the product, how to obtain or purchase it, and the benefits they will receive•Purpose:1. Inform—increase product awareness or inform consumers2. Persuade—convince people to purchase the product3. Reinforce—remind them that the product exists4. Differentiate—position the product as being different from the competition Promotion - 2 •Routes of promotion: -Advertising-Direct marketing-Personal selling-Sales promotions-Public relations-Digital communication
_____________ - communication strategy used to let the priority population know about the product, how to obtain or purchase it, and the benefits they will receive•Purpose:1. _____________—increase product awareness or inform consumers. _____________—convince people to purchase the product3. _____________—remind them that the product exists4. _____________—position the product as being different from the competition 2 •Routes of promotion: -Advertising-Direct marketing-Personal selling-Sales promotions-Public relations-Digital communication
Implementation Terms1.Are used for identifying and prioritizing tasksGantt charts2.Reducing the risk of liabilityRisk Management3.Indicate to participants that they are free to discontinue participation at any timeAutonomy1.No one should participate without first giving thisInformed Consent2.Dive right in Total Implementation 3.Allows planners to work out the bugs before full implementation Pilot testing4.The act of converting planning, goals, and objectives into action through administrative structure, management activities, policies, procedures, regulations, and organizational actions of new programs Implementation5.Inform participants about risk and dangers of participation to do what?Reduce Risk of Liability •Gradual implementationPhasing In•The buck stops here. You can be held responsible if something bad happensLiability•HIPAA (Health Insurance Portability and Accountability Act of 1996 aka PL 104-191)Confidentiality1.Program is institutionalized Sustainable
_____________ Terms1.Are used for identifying and prioritizing tasks Gantt charts2.Reducing the risk of liability Risk Management3.Indicate to participants that they are free to discontinue participation at any timeAutonomy1.No one should participate without first giving thisInformed Consent2.Dive right in Total Implementation 3.Allows planners to work out the bugs before full implementation Pilot testing4.The act of converting planning, goals, and objectives into action through administrative structure, management activities, policies, procedures, regulations, and organizational actions of new programs Implementation5.Inform participants about risk and dangers of participation to do what?Reduce Risk of Liability •Gradual implementationPhasing In•The buck stops here. You can be held responsible if something bad happensLiability•HIPAA (Health Insurance Portability and Accountability Act of 1996 aka PL 104-191)Confidentiality1.Program is institutionalized Sustainable
Product•Product - what is being offered to meet the customers' needs-Augmented products --tangible items or services.•Examples: bike helmets, contraceptives, glasses, hand-washing facilities/containers, medicine.-Benefits associated with using a product or service = ''core products'' or the ''bundle of benefits'' .•Become motivation to use the products/services to help them change behavior.•Examples: makes us healthy; avoids costly fines and penalties from noncompliance; close loving bond; emotional benefits; crew dependability on fire scene. Price - 1 •Price - what it costs the priority population to obtain the product and its associated benefits -May be financial or nonfinancial•Social, mental, emotional, behavioral, or psychological costs•Barriers are what keep people from responding to an intervention or doing a behavior. Price - 2 •Planners should answer seven questions regarding price:1. Who are the clients?2. What is their ability to pay?3. Are co-payers involved?4. Is the program covered under an insurance program?5. What is the mission of the planner's agency?6. What are competitors charging?7. What is the demand for the program or product?
_____________ - what is being offered to meet the customers' needs-Augmented products --tangible items or services.•Examples: bike helmets, contraceptives, glasses, hand-washing facilities/containers, medicine.-Benefits associated with using a product or service = ''core products'' or the ''bundle of benefits'' .•Become motivation to use the products/services to help them change behavior.•Examples: makes us healthy; avoids costly fines and penalties from noncompliance; close loving bond; emotional benefits; crew dependability on fire scene. _____________ - what it costs the priority population to obtain the product and its associated benefits -May be financial or nonfinancial•Social, mental, emotional, behavioral, or psychological costs•Barriers are what keep people from responding to an intervention or doing a behavior. •Planners should answer seven questions regarding _____________:1. Who are the clients?2. What is their ability to pay?3. Are co-payers involved?4. Is the program covered under an insurance program?5. What is the mission of the planner's agency?6. What are competitors charging?7. What is the demand for the program or product?
Bivariate Analyses - 1 •It is common to state evaluation questions in the form of hypotheses.•Types of hypotheses:-Null - no observed difference between groups-Alternative - there is a difference between groups•Statistical significance - ''refers to whether the observed differences between the two or more groups are real or not, or whether they are chance occurrences'' (McDermott & Sarvela, 1999, p. 300). •Types of null hypothesis errors-Type I error - failing to reject when the null hypothesis is true-Type II error - failing to reject when the null hypothesis is not true-Level of significance (alpha level) - probability of making a type I error; e.g., p < 0.01 •Statistical tests used in bivariate analysis include:-Chi-square:•Measures the association between two nominal and/or ordinal variables-t-test (numerical):•Studies group differences when the dependent variables involve interval or ratio data•Dependent (one group twice) or independent (two groups once)-Analysis of Variance (ANOVA) (numerical):•Like t-test, more commonly used to study differences between more than two groups-Correlations (numerical):•Used to study the strength and direction of relationships between two variables•Only indicates a relationship, not cause and effect
_____________ Analyses - 1 •It is common to state evaluation questions in the form of hypotheses.•Types of hypotheses:-_____________ - no observed difference between groups-_____________ - there is a difference between groups•Statistical _____________ - ''refers to whether the observed differences between the two or more groups are real or not, or whether they are chance occurrences'' (McDermott & Sarvela, 1999, p. 300). •Types of null hypothesis errors-_____________ error - failing to reject when the null hypothesis is true-_____________ error - failing to reject when the null hypothesis is not true-Level of significance (alpha level) - probability of making a type I error; e.g., p < 0.01 •Statistical tests used in bivariate analysis include:-_____________:•Measures the association between two nominal and/or ordinal variables-t-test (numerical):•Studies group differences when the dependent variables involve interval or ratio data•Dependent (one group twice) or independent (two groups once)-_____________ (_____________) (numerical):•Like t-test, more commonly used to study differences between more than two groups-_____________ (numerical):•Used to study the strength and direction of relationships between two variables•Only indicates a relationship, not cause and effect
Ethical Considerations •Evaluation or research should never cause mental, emotional, or physical harm to those in the priority population. •Participants should always be informed of the purpose & potential risks and should give consent. •No individual should ever have his or her personal information revealed in any setting or circumstance. •When appropriate, evaluation plans should be approved by institutional review boards (IRBs). Avoid evaluation bias....
_____________ Considerations •_____________ or _____________ should never cause mental, emotional, or physical harm to those in the priority population. •Participants should always be _____________ of the purpose & potential risks and should give consent. •No individual should ever have his or her _____________ information revealed in any setting or circumstance. •When appropriate, evaluation plans should be approved by _____________ _____________ boards (IRBs). Avoid evaluation bias....
Univariate Data Analyses•Examine one variable at a time.•Summary Counts-Frequency distributions•Measures of Central Tendency -Mean, median, & mode-All are useful in describing the results, and will be helpful if extreme scores are found.•Measures of Spread or Variation-Range, standard deviation, variance-Used to determine whether scores from groups are similar or spread apart.
_____________ Data Analyses•Examine one variable at a time.•Summary Counts-Frequency distributions•Measures of Central Tendency -Mean, median, & mode-All are useful in describing the results, and will be helpful if extreme scores are found.•Measures of Spread or Variation-Range, standard deviation, variance-Used to determine whether scores from groups are similar or spread apart.
Process Evaluation •Looks back on the implementation process and measures what went well and what went poorly. (formative is before or during) •Objectives: -How closely the program implementation followed protocols -How successful it was in recruiting and reaching members of the priority population -How many people participated or how many products or services were distributed -Other factors that may have competed with or confounded program results.
_____________ Evaluation •Looks back on the implementation process and measures what went well and what went poorly. (formative is before or during) •Objectives: -How closely the program implementation followed protocols -How successful it was in recruiting and reaching members of the priority population -How many people participated or how many products or services were distributed -Other factors that may have competed with or confounded program results.
Process Evaluation •Effective-Realistic potential for achieving the desired outcome -Provide data that document program was following protocol (or not) to support effects were due to the program (or not). •Efficient-Relationship between the amount of output and the amount of input- higher output with less inputs generally more efficient -Workshop Evaluation example
_____________ Evaluation •_____________-Realistic potential for achieving the desired outcome -Provide data that document program was following protocol (or not) to support effects were due to the program (or not). •_____________-Relationship between the amount of output and the amount of input- higher output with less inputs generally more efficient -Workshop Evaluation example
Qualitative Methods Used in Evaluation •Case studies •Content analysis •Delphi technique •Ethnographic studies •Film ethnography •Focus groups •Those underlined more commonly used•Historical analysis•In-depth interviewing •Nominal group process •Participant-observer studies •Quality circle •Unobtrusive techniques
_____________ Methods Used in Evaluation •Case studies •Content analysis •Delphi technique •Ethnographic studies •Film ethnography •Focus groups •Those underlined more commonly used•Historical analysis•In-depth interviewing •Nominal group process •Participant-observer studies •Quality circle •Unobtrusive techniques
Curricula and Other Instructional Resources - 1 •Curriculum - -Planned set of lessons or courses examples: •Sources of curricula & other instructional resources -Developing your own (in-house) or having someone else develop them; development time-Purchasing or obtaining various materials from outside sources; cost may be a concern-Purchasing or obtaining entire "canned" (participant & instructor's manuals, AV, training, & marketing) from a vendor; Do they meet the needs of the priority population? -Combination of the above
_____________ and Other Instructional Resources - 1 •_____________ - -Planned set of lessons or courses examples: •Sources of curricula & other instructional resources -Developing your own (in-house) or having someone else develop them; development time-Purchasing or obtaining various materials from outside sources; cost may be a concern-Purchasing or obtaining entire "canned" (participant & instructor's manuals, AV, training, & marketing) from a vendor; Do they meet the needs of the priority population? -Combination of the above
Facilities and Administrative Cost Rates-Indirect Costs for James Madison University Sponsored Projects•At least every 4 years, JMU is required to renegotiate our Indirect Cost Rate Agreement with the federal government (also called Facilities and Administration or Overhead rate). The chart below explains the current rates and base.
_____________ and _____________ Cost Rates-Indirect Costs for James Madison University Sponsored Projects•At least every 4 years, JMU is required to renegotiate our Indirect Cost Rate Agreement with the federal government (also called Facilities and Administration or Overhead rate). The chart below explains the current rates and base.
Inputs and Outputs of Organizational Plan --Components of formative and process evaluations •Human resources -personnel -Largest cost component of program -Increased importance on monitoring community coalitions-Commitment •Informational resources -Often able to computerize this •Monetary resources -Monitored monthly, usually no greater than 10-20% variance •Physical resources -Sometimes a dichotomous yes/no for available facilities •Transportation -Staff and clients •Managerial resources -Control or delegation •Time resources -Delays, deadlines met, repeated requests
_____________ and _____________ of Organizational Plan --Components of formative and process evaluations •Human _____________ -personnel -Largest cost component of program -Increased importance on monitoring community coalitions-Commitment •Informational resources -Often able to computerize this •_____________ resources -Monitored monthly, usually no greater than 10-20% variance _____________ resources -Sometimes a dichotomous yes/no for available facilities •_____________ -Staff and clients •_____________ resources -Control or delegation •_____________ resources -Delays, deadlines met, repeated requests
Pretesting - 1 •Pretesting ensures that planners have developed program components in response to, and reflective of the consumer's needs, wants, and expectations.•There are two phases of pretesting. •Phase 1 tests product concept.-How likely they would be to use the product-What they see as benefits to using the product•If the benefits associated with product use are believable-What they see as the barriers; what factors would keep them from using it-What product features they like-What product features they would change, and why-If the places selected to offer the product are convenient-If the product price is reasonable-If the product functions as designed-If instructions for how to use the product are clear-https://www.youtube.com/watch?v=8fG-uPh2h1sIkea .30•Phase 2 tests promotional strategy message & materials.-Ask for opinions on:•Twitter•Facebook•YouTube•Instagram•Others?
_____________ ensures that planners have developed program components in response to, and reflective of the consumer's needs, wants, and expectations.•There are two phases of pretesting. •Phase 1 tests product _____________.-How likely they would be to use the product-What they see as benefits to using the product•If the benefits associated with product use are believable-What they see as the barriers; what factors would keep them from using it-What product features they like-What product features they would change, and why-If the places selected to offer the product are convenient-If the product price is reasonable-If the product functions as designed-If instructions for how to use the product are clear-https://www.youtube.com/watch?v=8fG-uPh2h1sIkea .30•Phase 2 tests _____________ strategy message & materials.-Ask for opinions on:•Twitter•Facebook•YouTube•Instagram•Others?
Ch 9 ResourcesResources include the "human, fiscal, and technical assets available" to plan, implement, & evaluate a program.•Include: •personnel •curriculum & other instructional resources•Space•equipment •Supplies•financial resources. •Most carry a "price-tag," but many/some are free or inexpensive.
_____________ include the "human, fiscal, and technical assets available" to plan, implement, & evaluate a program.•Include: •personnel •curriculum & other instructional resources•Space•equipment •Supplies•financial resources. •Most carry a "price-tag," but many/some are free or inexpensive.
Place•Place is where the priority population has access to the product.•Place includes:-Location (where are services provided?)-Convenience (can the priority population easily access the service?)-Safety (is the service provided in a safe location?)-Time of day (is the service provided at a good time for the priority population?)•Planners should make sure that it is easy for the consumer to obtain the product or service.
_____________ is where the priority population has access to the product.• includes:-_____________ (where are services provided?)-_____________ (can the priority population easily access the service?)-_____________ (is the service provided in a safe location?)-_____________ of day (is the service provided at a good time for the priority population?)•Planners should make sure that it is easy for the consumer to obtain the product or service.
ch 15 Data Management•Includes coding, cleaning, and organizing data into a usable format (preparing for analysis)•Coding - -assigning labels so data can be read and understood by a computer-1 = yes, 2 = no•Cleaning - -making sure the values are valid and consistent (e.g., if 1 = true and 2 = false, there should be no 3s)
_____________ •Includes coding, cleaning, and organizing data into a usable format (preparing for analysis)•___________ - -assigning labels so data can be read and understood by a computer-1 = yes, 2 = no•___________ - -making sure the values are valid and consistent (e.g., if 1 = true and 2 = false, there should be no 3s)
Critical Path Method (CPM) or PERT/CPM *A. Start planning B. Develop rationale*C. Needs assessment D. Create instrument E. Select sample F. Collect & analyze data*G. Create goals/objectives*H. Create intervention I. Pilot test*J. Implement program K. Identify & allocate resources L. Marketing*M. Evaluate (process, impact, & outcome) Items on critical path cannot be delayed without delaying the program; time of important estimates is made for earliest & latest start & finish times for each activity.
_____________(_____________) or _____________/_____________ *A. Start planning B. Develop rationale*C. Needs assessment D. Create instrument E. Select sample F. Collect & analyze data*G. Create goals/objectives*H. Create intervention I. Pilot test*J. Implement program K. Identify & allocate resources L. Marketing*M. Evaluate (process, impact, & outcome) Items on critical path cannot be delayed without delaying the program; time of important estimates is made for earliest & latest start & finish times for each activity.
Fringe Benefits•Fringe benefits = taxes and benefits that the employer must pay for an employee. Based upon gross salary, they typically average 30-45% (text says less), depending on the size of your agency and its benefits package. •Fringe benefits that are required by law include: -FICA (Social Security and Medicare) •7.65%-FUTA (Federal Unemployment Taxes/Insurance) •0.8 % of the first $7,000 of wages per year. Thus, the maximum annual amount of FUTA tax for any one employee is $56.-SUTA or SUI (State Unemployment Taxes/Insurance) •State unemployment rates and payment requirements differ in amount and how they are charged and paid. State unemployment taxes are paid to the state workforce office or state department of labor. -Worker's Compensation (on-the-job accident insurance).•the level and type of coverage is different for each state•Other benefits include medical insurance and paid sick leave
____________________ = taxes and benefits that the employer must pay for an employee. Based upon gross salary, they typically average 30-45% (text says less), depending on the size of your agency and its benefits package. •Fringe benefits that are required by law include: -FICA (Social Security and Medicare) •7.65%-FUTA (Federal Unemployment Taxes/Insurance) •0.8 % of the first $7,000 of wages per year. Thus, the maximum annual amount of FUTA tax for any one employee is $56.-SUTA or SUI (State Unemployment Taxes/Insurance) •State unemployment rates and payment requirements differ in amount and how they are charged and paid. State unemployment taxes are paid to the state workforce office or state department of labor. -Worker's Compensation (on-the-job accident insurance).•the level and type of coverage is different for each state•Other benefits include medical insurance and paid sick leave
Evaluation Reporting - 3•At times, more than one method should be selected in order to meet the needs of all stakeholders.•The evaluator must fit the report to the audience as well as prepare for a negative response if the results of the evaluation are not favorable. Warren Buffett to Release His Shareholder Letter on Saturday 2-18-18•OMAHA, Neb. (AP) — Investor Warren Buffett will release his annual letter to Berkshire Hathaway shareholders on Saturday.•The letter is always well-read in the business world because of Buffett's remarkably successful track record leading Berkshire for more than five decades.•And Buffett has a knack for explaining complicated issues in simple terms.•Buffett will review the performance of Berkshire's businesses, which include Geico insurance and BNSF railroad, and he may discuss other topics.•Omaha, Nebraska-based Berkshire owns more than 90 different companies in a variety of businesses, including utilities, retail and insurance.
______________________ - 3•At times, more than one method should be selected in order to meet the needs of all stakeholders.•The evaluator must fit the report to the audience as well as prepare for a negative response if the results of the evaluation are not favorable. Warren Buffett to Release His Shareholder Letter on Saturday 2-18-18•OMAHA, Neb. (AP) — Investor Warren Buffett will release his annual letter to Berkshire Hathaway shareholders on Saturday.•The letter is always well-read in the business world because of Buffett's remarkably successful track record leading Berkshire for more than five decades.•And Buffett has a knack for explaining complicated issues in simple terms.•Buffett will review the performance of Berkshire's businesses, which include Geico insurance and BNSF railroad, and he may discuss other topics.•Omaha, Nebraska-based Berkshire owns more than 90 different companies in a variety of businesses, including utilities, retail and insurance.
Community Mobilization Strategies - 1 •"Community mobilization strategies involve helping communities identify and take action on shared concerns using participatory decision making, and include such methods as empowerment" -Community organizing - the process by which community groups are helped to identify common problems or goals, mobilize resources, and in other ways develop and implement strategies for reaching the goals they have collectively set
_________________________ involve helping communities identify and take action on shared concerns using participatory decision making, and include such methods as empowerment" -___________ ___________ - the process by which community groups are helped to identify common problems or goals, mobilize resources, and in other ways develop and implement strategies for reaching the goals they have collectively set
Data Collection •Decide how the information will be collected: survey, records and documents, telephone interview, personal interview, observation. •Determine who will collect the data.•Plan and administer a pilot test. •Review the results of the pilot test to refine the data collection instrument or the collection procedures. •Determine who will be included in the evaluation - for example, all the program participants, or a random sample of participants. •Conduct the data collection.
__________________________ •Decide how the information will be collected: survey, records and documents, telephone interview, personal interview, observation. •Determine who will collect the data.•Plan and administer a pilot test. •Review the results of the pilot test to refine the data collection instrument or the collection procedures. •Determine who will be included in the evaluation - for example, all the program participants, or a random sample of participants. •Conduct the data collection.
Data Analysis •Determine how the data will be analyzed. •Determine who will analyze the data. •Conduct the analysis, and allow for several interpretations of the data. -Stay tuned for more in Chapter 15 on data analysis
__________________________ •Determine _____________ the data will be analyzed. •Determine _____________ will analyze the data. •_____________ the analysis, and allow for several interpretations of the data. -Stay tuned for more in Chapter 15 on data analysis
Health-Related Community Service Strategies•Examples include-HRAs-Clinical (biometric) screenings- BP, cholesterol, glucose-Services, tests, or treatments to improve health- flu shots & other immunizations-Check-ups, exams•Reduce barriers to the services - be mindful of affordability, accessibility.•Referrals and follow-ups are important; link with priority population's health care providers.
__________________________ Strategies •Examples include-HRAs-Clinical (biometric) screenings- BP, cholesterol, glucose-Services, tests, or treatments to improve health- flu shots & other immunizations-Check-ups, exams•Reduce barriers to the services - be mindful of affordability, accessibility.•Referrals and follow-ups are important; link with priority population's health care providers.
In-Kind Contributions •In-kind contributions are goods or services that are donated to the organization. These services/contributions can often be used as matching funds by many funding sources. -Examples:•corporate volunteers and pro-bono professional services•use of a building and utilities•advertising•donation of computers, or other tech resources•transportation•The value of these services or goods is based on their "market value." -Example: volunteer working in an unskilled position would be calculated at minimum wage dollar value.•To indicate this in a budget, you might include a formula such as: 5 volunteers X $xxx hourly X 5 hours per week X 36 weeks = $xxxx. In-kind contributions can impress reviewers or they may be required as they present evidence of community or agency support for the program.
__________________________ are goods or services that are donated to the organization. These services/contributions can often be used as matching funds by many funding sources. -Examples:•corporate volunteers and pro-bono professional services•use of a building and utilities•advertising•donation of computers, or other tech resources•transportation•The value of these services or goods is based on their "market value." -Example: volunteer working in an unskilled position would be calculated at minimum wage dollar value.•To indicate this in a budget, you might include a formula such as: 5 volunteers X $xxx hourly X 5 hours per week X 36 weeks = $xxxx. In-kind contributions can impress reviewers or they may be required as they present evidence of community or agency support for the program.
Indirect Costs•Indirect costs for your grant ("overhead") are costs associated with administration and facilities, such as:•Building costs •Insurance•Utilities•Trash Pickup, professional cleaning services, etc.•Sometimes a percentage of total indirect costs can be reimbursed by a funding source but only if an indirect cost rate has been negotiated and approved by the grantor. JMU rate = 35.0%-55.0%•Before including an indirect costs category in your budget, make sure you thoroughly read the RFP (request for proposal) and the grant guidelines. Those resources will tell you whether or not indirect costs apply to this grant program.
__________________________ for your grant ("overhead") are costs associated with administration and facilities, such as:•Building costs •Insurance•Utilities•Trash Pickup, professional cleaning services, etc.•Sometimes a percentage of total indirect costs can be reimbursed by a funding source but only if an indirect cost rate has been negotiated and approved by the grantor. JMU rate = 35.0%-55.0%•Before including an indirect costs category in your budget, make sure you thoroughly read the RFP (request for proposal) and the grant guidelines. Those resources will tell you whether or not indirect costs apply to this grant program.
Background Information on Evaluation•Adequate and appropriate evaluation is necessary for any program regardless of size, nature, and duration.•Two critical purposes of program evaluation are 1. Assessing & improving quality 2. Determining program effectiveness.•Conducting evaluation and research is a major area of responsibility for health professionals.
__________________________ on Evaluation•Adequate and appropriate evaluation is necessary for any program regardless of size, nature, and duration.•Two critical purposes of program evaluation are 1. Assessing & improving _____________ 2. Determining program _____________.•Conducting evaluation and research is a major area of responsibility for health professionals.
Environmental Change Strategies - 1 •Have been most useful in providing "opportunities, support, and cues to help people develop healthier behaviors" (Brownson, Haire-Joshu, & Luke, 2006, p. 342). •They help remove barriers to change in the environment.-Removing environmental barriers often helps to make the healthier choice the easier choice.•Environmental change strategies are characterized by changes "around" individuals and are not limited to the physical environment.Flint Michigan Water Crisis 2014"Why Flint residents are still dealing with water worries, 5 years after lead crisis"https://youtu.be/rNlLHXglPfo6:44Michigan to pay 600 Million Settlement to residents -August 2020
______________________________ Strategies - 1 •Have been most useful in providing "opportunities, support, and cues to help people develop healthier behaviors" •They help remove barriers to change in the environment.-Removing environmental barriers often helps to make the healthier choice the easier choice .•Environmental change strategies are characterized by changes "around" individuals and are not limited to the physical environment.Flint Michigan Water Crisis 2014"Why Flint residents are still dealing with water worries, 5 years after lead crisis"
Health Communication Strategies - 1 •Health communication strategies are designed to inform & influence individual & community decisions to influence health.-Usually a part of most interventions and are useful in reaching many goals & objectives-High penetration rate-More cost effective and less threatening than other strategies
_______________________________________ are designed to inform & influence individual & community decisions to influence health.-Usually a part of most interventions and are useful in reaching many goals & objectives-High penetration rate-More cost effective and less threatening than other strategies
Health Policy / Enforcement Strategies - 1 •Include executive orders, laws, ordinances, policies, position statements, regulations, and formal/informal rules-Mandated or regulated activities; e.g., state laws to raise cigarette taxes, wearing masks, immunizations for school attendance-May be controversial; may be political, can take away freedoms, pride, $, psyche•Based on common good; protect the public's health
_______________________________________ Strategies - 1 •Include executive orders, laws, ordinances, policies, position statements, regulations, and formal/informal rules -Mandated or regulated activities; e.g., state laws to raise cigarette taxes, wearing masks, immunizations for school attendance -May be controversial; may be political, can take away freedoms, pride, $, psyche•Based on common good; protect the public's health
Marketing Mix •Planners need to make strategic decisions related to four marketing variables (the four Ps):-Product- What?-Price - How much?-Place - Where?-Promotion - How?•These variables are referred to as the marketing mix.-https://youtu.be/Mco8vBAwOmAThefour p's simplified 2.26
_____________•Planners need to make strategic decisions related to four marketing variables (the four Ps):-_____________- What?-_____________ - How much?-_____________ - Where?-_____________ - How?•These variables are referred to as the marketing mix.-https://youtu.be/Mco8vBAwOmAThefour p's simplified 2.26
ch 11 Commercial Marketing vs Behavior Change Marketing - Social MarketingCommercial•Objective:-Sell a product•Audience:-Customers and likelycustomers •Tactics: •Awareness and memorabilityBehavior Change•Objective: -Change or prevent a behavior•Audience:-Users and likely users; unhealthy behaviors•Tactics:-Persuasion and relevance
ch 11 Commercial Marketing vs Behavior Change Marketing - ___________ •Objective:-Sell a product•Audience:-Customers and likelycustomers •Tactics: •Awareness and memorability ___________ •Objective: -Change or prevent a behavior•Audience:-Users and likely users; unhealthy behaviors•Tactics:-Persuasion and relevance
ch 12 CHOICES Program•When implementing your programs, what kind of problems may occur?-Bad weather-Low attendance-Volunteers don't show-Food and supplies are inadequate-Technical difficulties-Messages not read-People show up after drinking
ch 12 CHOICES Program•When implementing your programs, what kind of _____________ may occur?-Bad weather-Low attendance-Volunteers don't show-Food and supplies are inadequate-Technical difficulties-Messages not read-People show up after drinking
ch 9 A Community •A community - "a group of people who have common characteristics" •A community is characterized by: -Membership - a sense of identity and belonging -Common symbol systems - language, rituals, ceremonies -Shared values & norms -Mutual influence-Shared needs & commitment to meeting them -Shared emotional connection - common history, experiences, and mutual support. •Can be defined by location, race, ethnicity, age, occupation, problems, outcomes, or other common bonds.
•A _____________ - "a group of people who have common characteristics" •A community is characterized by: -_____________ - a sense of identity and belonging -Common _____________ systems - language, rituals, ceremonies -Shared _____________ & norms -Mutual _____________-Shared needs & commitment to meeting them -Shared _____________ connection - common history, experiences, and mutual support. •Can be defined by location, race, ethnicity, age, occupation, problems, outcomes, or other common bonds.
•Segmentation - helps planners to narrow the focus of their marketing strategy.-Allows planners to better meet the needs of the consumer, allowing for a greater chance of an exchange taking place. •Factors or variables used for segmentation: -Geography -Demographics-Psychographics-Behavioral-Benefits sought-Construct of behavior theories•Most of the time multiple factors are used to identify segments; no right or wrong way to segment; can be done a priori or a posteriori.•Fatherhood Involvement | Ad Council-https://www.youtube.com/watch?v=chJA1JUqECUDance Like a Dad 1.00-https://youtu.be/S6lG7X7N7UE The Worm .16-https://youtu.be/9hTMDmn7NpQ Dad and Son Dance Off .31-https://www.youtube.com/watch?v=rbzVadfrgr8Let's Crawl .31
•_____________ - helps planners to narrow the focus of their marketing strategy.-Allows planners to better meet the needs of the consumer, allowing for a greater chance of an exchange taking place. •Factors or variables used for segmentation: -Geography -Demographics-Psychographics-Behavioral-Benefits sought-Construct of behavior theories•Most of the time multiple factors are used to identify segments; no right or wrong way to segment; can be done a priori or a posteriori.•Fatherhood Involvement | Ad Council-
Experimental, Control, & Comparison Groups - 1 •Experimental Group-The group of individuals who receive the intervention •Control Group-Should be similar to the experimental group, but the individuals in this group do not receive the intervention-Individuals should be randomly assigned to this group-Conner's premises for control group use: 1. right to status quo 2. informed of purpose 3. right to new services 4. not subjected to infective or harmful programs. •Comparison Group-When individuals cannot be randomly assigned to an experimental or control group, a nonequivalent group may be formed.
•_____________ Group-The group of individuals who receive the intervention •_____________ Group-Should be similar to the experimental group, but the individuals in this group do not receive the intervention-Individuals should be randomly assigned to this group-Conner's premises for control group use: 1. right to status quo 2. informed of purpose 3. right to new services 4. not subjected to infective or harmful programs. •_____________ Group-When individuals cannot be randomly assigned to an experimental or control group, a nonequivalent group may be formed.
External Validity - 1 •External Validity -The extent to which the program can be expected to produce similar effects in other populations •Factors that threaten external validity are sometimes known as reactive effects, since they cause individuals to react in a certain way. •Threats to external validity can also be counteracted by making a greater effort to treat all subjects identically. -Blind study: the participants do not know to what group they have been assigned. -Double blind study: the type of group participants are in is not known by either the participants or the planners. -Triple blind study: this information is not available to the participants, planners, or evaluators.
•_____________ Validity -The extent to which the program can be expected to produce similar effects in other populations •Factors that threaten external validity are sometimes known as reactive effects, since they cause individuals to react in a certain way. •Threats to external validity can also be counteracted by making a greater effort to treat all subjects identically. -_____________ study: the participants do not know to what group they have been assigned. -_____________study: the type of group participants are in is not known by either the participants or the planners. -_____________ study: this information is not available to the participants, planners, or evaluators.
•Formative evaluation -quality of program content and program implementation.-Collects data and informs stakeholders of important findings that could potentially improve a program or its delivery, and allows for appropriate changes before the program is fully implemented and completed. •before the start of the implementation phase -helps ensure that a program and its elements have been conceptualized and developed appropriately. •Informs and guides the development and implementation of a program as it actually unfolds. •There are 15 elements of a comprehensive formative evaluation.
•_____________ evaluation -quality of program content and program implementation.-Collects data and informs stakeholders of important findings that could potentially improve a program or its delivery, and allows for appropriate changes before the program is fully implemented and completed. •before the start of the implementation phase -helps ensure that a program and its elements have been conceptualized and developed appropriately. •Informs and guides the development and implementation of a program as it actually unfolds. •There are 15 elements of a comprehensive formative evaluation.
Summative Evaluation •Summative evaluation-includes both impact* (immediate indicators) and outcome*(long-term program indicators) evaluation. •An evaluation design is used to organize a summative evaluation and to provide for planned, systematic data collection, analysis, and reporting. •*remember: defined in reverse by others.
•_____________ evaluation-includes both impact* (immediate indicators) and outcome*(long-term program indicators) evaluation. •An evaluation design is used to organize this evaluation and to provide for planned, systematic data collection, analysis, and reporting. •*remember: defined in reverse by others.
Variables, Indicators, Measures •Variable is the "thing" of interest, variable is how that thing gets measured •Some agencies use "indicator" to mean the number that indicates how well the program is doing •Measure the way that the variable is knownIt's all just language.... Stay focused on what is needed.
•_____________ is the "thing" of interest, variable is how that thing gets measured •Some agencies use "_____________" to mean the number that indicates how well the program is doing •Measure the way that the variable is known It's all just _____________.... Stay focused on what is needed.
Pretesting and Pilot Testing •Pretesting- Testing components of a program prior to implementation-relates to formative evaluation -Collecting baseline data prior to program implementation that will be compared with posttest data to measure the effectiveness of programs-Assumes that program components have already been reviewed for evidence •Pilot Testing (also called field testing or alpha testing) -Assesses programs in limited areas and/or time periods Allows for "dry runs" to measure overall program quality -Generally involves collecting data from program participants
•_____________- Testing components of a program prior to implementation-relates to formative evaluation -Collecting baseline data prior to program implementation that will be compared with posttest data to measure the effectiveness of programs-Assumes that program components have already been reviewed for evidence •_____________ (also called field testing or alpha testing) -Assesses programs in limited areas and/or time periods Allows for "dry runs" to measure overall program quality -Generally involves collecting data from program participants
•Social Support Activities-Many people find it much easier to change a behavior if those around them provide support or are willing to be partners in the behavior change process.-Social support can work as an incentive.•Types of social support include: -Support groups (e.g., Weight Watchers, Overeaters Anonymous)-"Buddy" systems; can be used with contests & contracts-Social gatherings -Social networks - a web of social relationships
•__________________________-Many people find it much easier to change a behavior if those around them provide support or are willing to be partners in the behavior change process.-Social support can work as an incentive.•Types of social support include: -Support groups (e.g., Weight Watchers, Overeaters Anonymous)-"_____________" systems; can be used with contests & contracts-Social gatherings -Social networks - a web of social relationships