Abstract: Publication date: Available online 22 January 2020Source: Evaluation and Program PlanningAuthor(s): Anna Newton-Levinson, Megan Higdon, Jessica Sales, Laurie Gaydos, Roger RochatAbstractThe need for conducting evaluations which reflect of the influence of context on complex programs is increasingly recognized in the field of evaluation. Better data visualization techniques for connecting context with program evaluation data are needed. We share our experience developing a mixed methods timeline to visualize complexity and context with evaluation data. Mixed methods timelines provide a meaningful way to show change over time in both a visually stimulating and accessible format for evaluation audiences. This paper provides an innovative example of using mixed methods timelines to integrate evaluation data with key program activities and milestones, while also showing internal and external contextual influences in one cohesive visual. We present methods and best practices for collecting contextual data and for incorporating a variety of data sources into such a visual. We discuss several strategies to collect and organize context related data including: qualitative interviews, program materials, narrative reports, and member checking with stakeholders and staff. Gathering multiple perspectives is essential to better capture the multi-layered elements of program activities and context.
Abstract: Publication date: Available online 21 January 2020Source: Evaluation and Program PlanningAuthor(s): Randi M. Williams, Jing Zhang, Nathaniel Woodard, Jimmie Slade, Sherie Lou Zara Santos, Cheryl L. KnottAbstractInstitutionalization of health promotion interventions occurs when the organization makes changes to support the program as a component of its routine operations. To date there has not been a way to systematically measure institutionalization of health promotion interventions outside of healthcare settings. The purpose of the present study was to develop and evaluate the initial psychometric properties of an instrument to assess institutionalization (i.e., integration) of health activities into faith-based organizations (i.e., churches). This process was informed by previous institutionalization models led by a team of experts and a community-based advisory panel. We recruited African American church leaders (N = 91) to complete a 22-item instrument. An exploratory factor analysis revealed four factors: 1) Organizational Structures (e.g., existing health ministry, health team), 2) Organizational Processes (e.g., records on health activities; instituted health policy), 3) Organizational Resources (e.g., health promotion budget; space for health activities), and 4) Organizational Communication (e.g., health content in church bulletins, discussion of health within sermons) that explained 62.3% of the variance. The measure, the Faith-Based Organization Health Integration Inventory (FBO-HII), had excellent internal consistency reliability (α = .89) including the subscales (α = .90, .82, .81, and .87). This measure has promising initial psychometric properties for assessing institutionalization of health promotion interventions in faith-based settings.
Abstract: Publication date: April 2020Source: Evaluation and Program Planning, Volume 79Author(s): Jay Wade, Leanne KallemeynAbstractEvaluation capacity building (ECB) is a practice that can help organizations conduct and use evaluations; however, there is little research on the sustainable impact of ECB interventions. This study provides an empirical inquiry into how ECB develops sustained evaluation practice. Interviews were conducted with 15 organizational leaders from non-profits, higher education institutions, and foundations that “bought in” to ECB and were at least six months removed from an ECB contract. The result of this work highlights how sustained evaluation practice developed over time and what these practices looked like in real-world settings. A developmental, iterative cycle for how ECB led organizations to sustain evaluation practice emerged around key components to sustainability. First, leadership supported ECB work and resources were dedicated to evaluation. Staff began to conduct and use evaluation, which led to understanding the benefits of evaluation, and promoted value and buy-in to evaluation among staff. Common barriers and emerging sustainability supports not previously identified by ECB literature—the “personal” factor and ongoing ECB practitioner contact—are described. Practical tips for ECB practitioners to promote sustainability are also detailed.
Abstract: Publication date: April 2020Source: Evaluation and Program Planning, Volume 79Author(s): Ruby A. Natale, Ellen Kolomeyer, Ana Robleto, Zafreen Jaffery, Rachel SpectorAbstractSocial-emotional issues in preschoolers continue to be an area of concern across the nation. Models to determine effective implementation practices are needed. The Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework is one model that can be used to evaluate program implementation in preschool settings. The Jump Start program provided short-term intervention to children in low-income preschools from multiethnic backgrounds. The goal was to promote prosocial behaviors while minimizing problem behaviors. Various evidenced-based practices (i.e., I Can Problem Solve, play therapy, Pyramid Model) were utilized. 305 children from 73 childcare centers participated in the program. The majority of participants were from ethnic minority backgrounds and resided in high-poverty areas of the county. The RE-AIM framework was utilized to determine program outcomes. Results showed successes on each level of RE-AIM with an at-risk population. The Jump Start program significantly increased positive behaviors and decreased challenging behaviors in preschool-aged children. Results indicated medium to large effect sizes. One year following program participation, the majority of children who participated in the program were at decreased risk of special education services and expulsion.
Abstract: Publication date: April 2020Source: Evaluation and Program Planning, Volume 79Author(s): Erin Stern, Ingrid van der Heijden, Kristin DunkleAbstractWomen with disabilities are more vulnerable to violence, including intimate partner violence (IPV), yet the majority of emerging IPV prevention programs fail to explicitly consider the needs of participants with disabilities. Women and men living with disabilities engaged with IPV prevention programs in four countries were interviewed to explore how disability shaped their experiences of gender, violence, IPV, and whether the programs met their disability related needs. In-depth interviews were conducted with 16 women and 15 men living with disabilities in Ghana, Rwanda, Tajikistan and South Africa. The data were analysed thematically and compared across the settings. Participants described experiencing disability-related stigma, discrimination, exclusion, and for women, increased vulnerability to IPV. Barriers to full participation in programs included limited accessibility, and lack of disability-specific materials, recruitment or outreach. Enablers of inclusion included recruitment and monitoring strategies aimed at people with disabilities, partnering with a local disabled people’s organization, training staff in disability inclusion, and raising awareness of disability rights. The data encouragingly suggests that inclusion of women and men with disabilities in IPV prevention programs designed for the general population has beneficial outcomes. Inclusion can prevent violence, promote their wellbeing, support economic empowerment, and challenge disability-related stigma and discrimination.
Abstract: Publication date: April 2020Source: Evaluation and Program Planning, Volume 79Author(s): Jill R. Reed, Danae Dinkel, Matthew R. Bice, Paul Estabrooks, Bunny Pozehl, Kate HeelanAbstractAddressing the lack of physical activity (PA) in rural adults is vital because of the role it plays in the risk for many chronic diseases. The purpose of the study was to explore the feasibility of conducting a 12-week intervention utilizing a Fitbit to increase PA behavior in inactive rural adults recruited from a primary care clinic. Semi-structured interviews were conducted with study participants (n=10) and a focus group was held with nurses (n=7) from the primary care clinic. Data were analyzed using the process of immersion/crystallization. Participants and nurses both felt the program had a positive impact on PA and that the program was needed in the community. Study participants most often reported their favorite part of the study was being able to track their activity as well as the goal setting. However, study participants reported barriers to continued participation in PA related to a lack of time and ability to be active in cold weather. Further, nursing staff reported barriers in regard to a lack of resources (staffing and money) These barriers need to be examined further and addressed in order to implement a sustainable PA program that can be maintained through a primary care clinic.
Abstract: Publication date: Available online 3 January 2020Source: Evaluation and Program PlanningAuthor(s): Christian Dagenais, Didier Dupont, Frédéric Nault-Brière, Diego Mena, Gabrielle Yale-Soulière, Esther Mc Sween-Cadieux
Abstract: Publication date: Available online 20 December 2019Source: Evaluation and Program PlanningAuthor(s): Parthenia Dinora, Andrew Schoeneman, Molly Dellinger-Wray, Elizabeth Cramer, Jack Brandt, Allison D’Aguilar
Abstract: Publication date: Available online 20 December 2019Source: Evaluation and Program PlanningAuthor(s): Susanne Bührer, Rainer FrietschAbstractThis article examines whether two of the major German flagship programmes to increase the participation of female researchers in the German science system, the "Women Professorship Programme" and the "Pact for Research and Innovation", have actually increased the number of women, especially in leadership positions. In a second step, we analyse whether such an assumed increase influences the publication patterns of authors with German affiliation. This article is based on literature and desk research as well as bibliometric analysis using Scopus. The most important result is that the number of women in research has indeed increased significantly in recent years and that, accordingly, more women are the (co)authors of scientific publications. In particular, it can be seen that quality indicators such as citations and excellence rates are high for female authors. This enables us to show that more women in the science system not only bring about a "gain in justice", but also a concrete scientific benefit.
Abstract: Publication date: Available online 9 December 2019Source: Evaluation and Program PlanningAuthor(s): Anil Kumar Chaudhary, John Diaz, K.S.U. Jayaratne, Elsie AssanAbstractPolicymakers’ demand for increased accountability has compelled organizations to pay more attention to internal evaluation capacity building (ECB). The existing literature about ECB has focused on capacity building experiences and organizational research, with limited attention on challenges that internal evaluation specialists face in building organizational evaluative capacity. To address this knowledge gap, we conducted a Delphi study with evaluation specialists in the United States’ Cooperative Extension Service and developed a consensus on the most pervasive ECB challenges as well as the most useful strategies for overcoming ECB challenges. Challenges identified in this study include limited time and resources, limited understanding of the value of evaluation, evaluation considered as an afterthought, and limited support and buy-in from administrators. Alternatively, strategies found in the study include a shift in an organizational culture where evaluation is appreciated, buy-in and support from administration, clarifying the importance of quality than quantity of evaluations, and a strategic approach to ECB. The challenges identified in this study have persisted for decades, meaning administrators must understand the persistence of these issues and make an earnest investment (financial and human resource) to make noticeable progress. The Delphi approach can be used more often to prioritize ECB efforts.
Abstract: Publication date: Available online 27 November 2019Source: Evaluation and Program PlanningAuthor(s): Jean Marie Buregeya, Christine Loignon, Astrid BrousselleAbstractThe health impact assessment (HIA) is a tool used to estimate the potential impact on health of non-health-related proposals prior to implementation. While it is increasingly used in Quebec, Canada, studies have not analyzed its medium-term impacts and potential long-term impacts. We conducted a contribution analysis using in-depth interviews with key stakeholders, as well as documents, observation and images related to HIA in order to analyze its impacts on the revitalization of road infrastructure, parks and green spaces, and residential housing. Our analysis not only reflects on the decision-making process through the adoption and implementation of HIA recommendations, but also on the link between actions implemented in the field and health outcomes.RésuméL’évaluation d’impact sur la santé (ÉIS) estime l’impact potentiel sur la santé des actions hors du champ de la santé avant leur implantation. Bien qu’elle soit de plus en plus utilisée au Canada, en particulier au Québec, les études n’ont pas analysé ses impacts intermédiaires et ses effets potentiels à long-terme. Nous avons appliqué l’analyse de contribution à l’aide d’entretiens approfondis avec les principales parties prenantes, les documents, l’observation et les images liées à l’ÉIS pour analyser ses effets sur la revitalisation des infrastructures routières, des parcs et espaces verts et des logements résidentiels. L’analyse des effets de l’évaluation d’impact sur la santé porte davantage sur le processus décisionnel en rapport à l’adoption et l’implantation des recommandations issues de l’ÉIS, mais aussi sur le lien entre les actions mises en œuvre sur le terrain et les résultats en matière de santé.
Abstract: Publication date: Available online 22 November 2019Source: Evaluation and Program PlanningAuthor(s): Catherine Hudon, Maud-Christine Chouinard, Astrid Brousselle, Mathieu Bisson, Alya DanishAbstractCase management programs for frequent users of healthcare services are complex interventions which implementation and application are challenging to evaluate. The aim of this article was to conduct a logic analysis to evaluate a case management program for frequent users of healthcare services. The study proceeded in three phases: 1) establishing causal links between the program’s components by the construction of a logic model, 2) developing an integrated framework from a realistic synthesis, and 3) making a new reading of the case management program in regard of the integrated framework. The study demonstrated, on one hand, strengths and weaknesses of the actual case management program, and, on the other hand, how logic analysis can create a constructive dialogue between theory and practice. The evaluative process with decision-makers, clinicians and patients has helped to make connexions between theory, practice, experience and services organization.
Abstract: Publication date: Available online 12 November 2019Source: Evaluation and Program PlanningAuthor(s): Evanthia Kalpazidou Schmidt, Ebbe Krogh GraversenAbstractIn this article, we discuss the development of a conceptual evaluation framework to design and assess gender equality interventions and their effects in research and innovation. The conceptual framework presented herewith embraces the complexity, gender-sensitive and theory-based evaluation approaches ensuring that design and evaluation of gender equality interventions consider the complex systems that constitute the context in which the interventions operate. The evaluation framework offers a non-linear concept, where the notion of contribution - not attribution - to achieve impact is central to the integration of team, organizational and system factors in policy design and evaluation. The paper opens the “black box” to address the question of how and why a policy intervention works and in which context and discusses a systematic process on how to approach the interwoven linkages between input, implementation and effects in gender equality interventions in research and innovation, accounting for context sensitivity and methodological pluralism. The evaluation framework may serve as reference for researchers, evaluators, policymakers and other stakeholders in designing and assessing gender equality interventions, and in further developing their evidence, and theoretical and methodological base.
Abstract: Publication date: Available online 12 November 2019Source: Evaluation and Program PlanningAuthor(s): Rachel Palmén, Lidia Arroyo, Jörg Müller, Sybille Reidl, Maria Caprile, Maximillian UngerAbstractGender equality and gender mainstreaming in research is one of the six European Research Area (ERA) priorities. Integrating the gender dimension in research content and teaching is one of its three objectives. It is arguably the objective where least progress has been made. In this article we contribute to the evidence base by applying the EFFORTI evaluation framework to three empirical case study interventions that aim to integrate the gender dimension in tertiary education and research content. Comparison is based on an evaluation of the design of the intervention, those factors that have enabled/ hindered its implementation as well as an assessment of outcomes and impacts. The findings of the case studies highlight the importance of design, specifically regarding resources, legal status and the definition and operationalisation of the gender concept. Implementation hinges on top-level institutional commitment and mainstreaming gender studies with support of a central unit and crucially gender competence. A lack of recognition and status of gender studies and innovations was seen to hamper implementation. Outcomes and impacts included an increased awareness and interest in gender, increased gender competence, a push towards gender equality regarding representation and organisational change as well as an improved accreditation process and more and better research.
Abstract: Publication date: Available online 11 November 2019Source: Evaluation and Program PlanningAuthor(s): Susanne Bührer, Rainer FrietschAbstractThis article examines whether two of the major German flagship programmes to increase the participation of female researchers in the German science system, the "Women Professorship Programme" and the "Pact for Research and Innovation", have actually increased the number of women, especially in leadership positions. In a second step, we analyse whether such an assumed increase influences the publication patterns of authors with German affiliation. This article is based on literature and desk research as well as bibliometric analysis using Scopus. The most important result is that the number of women in research has indeed increased significantly in recent years and that, accordingly, more women are the (co)authors of scientific publications. In particular, it can be seen that quality indicators such as citations and excellence rates are high for female authors. This enables us to show that more women in the science system not only bring about a "gain in justice", but also a concrete scientific benefit.
Abstract: Publication date: Available online 8 November 2019Source: Evaluation and Program PlanningAuthor(s): James J. AnnesiAbstractCamp leadership programs have the potential of improving important psychosocial factors in teens who might eventually become counselors. Accepted behavioral theory might increase understandings of those changes so program training architectures can be improved. As part of larger-scale longitudinal research, participants (N = 129; 64% female, Mage = 14.6 years, SD = 0.6) were selected by senior camp administrators for a structured leadership training program that required in-person conferences, viewing training videos every 2 weeks, obtaining ongoing mentoring from senior camp staff, and attending several weeks of summer camp where further training was provided. Validated surveys of proposed dimensions of self-control and interpersonal functioning were administered twice over 6 months to assess training program-associated changes. There were significant improvements in total self-control, self-control specifically related to coping, and family-related functioning. Although no demographic factor was associated with score change, baseline score was a significant predictor across measures. After controlling for baseline scores, stepwise multiple regression analyses indicated that higher self-control scores (i.e., planful behavior, coping efficacy, affective thought management) significantly predicted improvements in general, family, and peer-related functioning. Theory-based relationships between changes in self-control and interpersonal functioning enabled the identification of training program areas that might be targeted for improvement.
Abstract: Publication date: Available online 7 November 2019Source: Evaluation and Program PlanningAuthor(s): Joshua Brisson, Igor Pekelny, Michael UngarAbstractThis article reflects on common challenges and lessons learned during the evaluation of gang prevention programs based on case studies of three federally funded Canadian programs. Elements of evaluation design, implementation, data analysis and reporting of results are discussed. More specifically, the article highlights issues that occur when evaluating community projects focused on preventing extreme risks for violence and the complexity of working in potentially dangerous and/or unstable work environments. Topics covered include the problem with quasi-experimental designs, model fidelity adherence, program documentation, client recruitment and retention, and data collection. Recommendations are provided to improve evaluations of youth gang prevention programs and similar community-based interventions that focus on the prevention of youth violence.
Abstract: Publication date: Available online 6 November 2019Source: Evaluation and Program PlanningAuthor(s): Wenhui Pan, Pengwei Zhao, Chunxiu Qin, Xianfeng DingAbstractThe paper focuses on how to improve academic output of a granted fund when the adding of new members changes principal investigator’s network position. This objective is refined by exploring how new members affect the relationship between principal investigator’s network position and the academic output of granted funds, and whether this effect is similar in high-output and low-output collaboration networks. New members are divided into two groups, namely, international collaboration and inbound mobility. Using negative binomial regression on research funds supported by the National Natural Science Foundation of China, the results indicate that that new members indeed have moderating effects on the relationship between principal investigator’s network position and the academic output of granted funds. Moreover, we find that this moderating effect in high-output collaboration networks is larger than that in low-output collaboration networks. Our findings provide practical implications for the decision makers to design funding planning and for the principal investigators to improve academic output.
Abstract: Publication date: Available online 6 November 2019Source: Evaluation and Program PlanningAuthor(s): M.E. Menconi, S. Tasso, M. Santinelli, D. GrohmannAbstractUrban parks are often designed and renewed using standardized models that fail to incorporate the different functions and services required by the local communities served. Furthermore, when the citizens are involved in co-design, the participation processes are seldom fully inclusive, and the results are not representative of the entire local community. The paper starts from these considerations for developing an innovative participatory design method to renew urban parks. This method simultaneously uses multiple and alternative participation tools for adapting to the different technical skills of the citizens and to their inclinations. Furthermore, it entails the analysis and interpretation of the expectations of the local community in light of the urban green network. The method uses the conceptual framework of the SWOT analysis and the Trochim's concept mapping for developing a card game playable face to face or online. The results of the card game are processed using the statistical analysis to identify the main design themes (the clusters), and to split the participants’ suggestions into different design alternatives. Successively, the participants vote these alternatives for selecting the renewal design respondent to the local community's needs.
Abstract: Publication date: Available online 3 November 2019Source: Evaluation and Program PlanningAuthor(s): LaShawn Glasgow, Elizabeth Adams, Lucia Rojas Smith, Jeanette Renaud
Abstract: Publication date: Available online 2 November 2019Source: Evaluation and Program PlanningAuthor(s): Rocio Rodriguez, Göran Svensson, Greg WoodAbstractPurposeThe purpose of this study is to examine the previous and the current efforts and the priorities of sustainability initiatives in the public sector.Design/Methodology/approachThis study has been conducted in one industry, overcoming contextual bias as a judgmental sampling was used to select the public hospitals that were studied. Only knowledgeable key informants were approached and used.FindingsThe examination of the previous and the current efforts and the priorities of the sustainability initiatives revealed in this study indicate the existence of different trends in the public hospitals studied.Research limitations/implicationsThe results report the key trends that were disclosed in the public hospitals studied in their efforts towards sustainability. In particular, the results show that there appears to be a lack of guidelines and homogeneity in sustainability planning in public hospitals in Spain, accompanied by the near universal absence of the evaluation phase in respect to the outcomes of the sustainability initiatives that have been put in place in these organizations.Managerial ImplicationsThe multi-dimensional factors of sustainability initiatives provide managerial guidance to assess the previous and the current efforts and priorities. These factors also provide organizational guidance to assess the trends of an organization through time.Originality/ValueThis study contributes to a selection of factors regarding the previous and the current efforts and the priorities of sustainability initiatives applicable in public hospitals. It provides a multi-dimensional framework of factors that can be used in order to describe sustainability trends.
Abstract: Publication date: Available online 31 October 2019Source: Evaluation and Program PlanningAuthor(s): Deirdre Dingman, Jingwei Wu, Heather M. MurphyAbstractIn the United States, lack of proper handwashing is associated with respiratory and gastrointestinal illnesses. Interventions to improve handwashing practices have led to an increase in handwashing knowledge and behavior, and decreases in gastrointestinal illnesses. Most studies have evaluated their interventions in the context of reported handwashing rates by observation, reduction of illnesses, as well as reduced absences, however none of these studies examined handwashing quality or knowledge as outcome measures. The objective of this paper is to present the results from a handwashing program with a special focus on the evaluation methods.A pre-post design was used to evaluate a handwashing program that took place in two pre-schools the northeast of the United States. The program utilized a black light technology to demonstrate to children the importance of good quality. The evaluation consisted of assessing knowledge and quality of handwashing using a linear puzzle and individual handwashing observation, respectively.Students from both schools improved on both knowledge and quality over time (p-values 0.071 and
Abstract: Publication date: Available online 22 October 2019Source: Evaluation and Program PlanningAuthor(s): Chunyan Liu, Leiheng WangAbstractIn order to achieve “gender mainstreaming” which is a global strategy to promote the development of women, it has in recent years been a major task for the All-China Women's Federation (ACWF) to improve the gender awareness and ability of policy makers and implementers. Thus, researchers should constantly propose and evaluate various possible attempts to improve gender awareness and the ability of individuals. There are few empirical studies on the assessment of gender awareness and the improvement of the ability of staff who have been trained and educated. Research studies focusing on the promotion of gender-sensitive awareness and ability of staff by participating in programs are even rarer.This study presents a specific case, namely the evaluation of promoting social service workers’ gender awareness and ability within the implementation of the “3861 My Home” program. Based on this case, this study examines how to promote gender awareness and ability of social service workers through the implementation of the service program of Women's Federation, and also assesses the quality of the results of this implementation. Moreover, this study also contributes to the literature pertaining to assessing the development of social service workers’ gender awareness and ability. In addition, the study provides an option for enhancing the gender awareness and ability of social service workers in addition to training: The participatory learning or action pertaining to gender awareness and ability based on the Women's Federation programs are able to effectively improve the gender awareness and ability of staff.
Abstract: Publication date: Available online 22 October 2019Source: Evaluation and Program PlanningAuthor(s): Traci H. Abraham, Tisha L. Deen, Michelle Hamilton, Gala True, Marie T. O’Neil, Jessica Blanchard, Madeline UddoAbstractDespite widespread availability of yoga in the Veterans Health Administration (VA), it remains unclear how to best evaluate yoga programs. This is particularly problematic for programs aimed at veterans with mental health concerns, as evaluation typically focuses narrowly upon mental health symptom severity, even though program participants may have other health-related priorities. We analyzed responses to free-text questions on 237 surveys completed by veterans with mental health concerns enrolled in a yoga program at six VA clinics in Louisiana to characterize veteran participants’ experiences with yoga. Qualitative analysis resulted in 15 domains reflecting veterans’ individual health-related values and priorities. We use results to illustrate the potential for analysis of free-text responses to reveal valuable insights into patient experiences, demonstrating how these data can inform patient-centered program evaluation. The approach we present is more accessible to those responsible for decision-making about local programs than conventional methods of analyzing qualitive evaluation data.
Abstract: Publication date: Available online 18 October 2019Source: Evaluation and Program PlanningAuthor(s): Rachel Claire Mitchell, Glenn D. Israel, David C. Diehl, Sebastian Galindo-GonzalezAbstractThe Southeastern Coastal Center for Agricultural Health and Safety (SCCAHS) is one of many newly-funded federal research centers, housing five multidisciplinary research projects and seven pilot projects, and serving a multi-state region. In the early stages of such a complex project, with multiple teams separated by geography and disciplines, the evaluation program has been integral in connecting internal and external stakeholders at the center and project levels. We used a developmental evaluation (DE) framework to respond to the complex political environment surrounding agricultural health and safety in the southeast; to engage external stakeholders in guiding the center’s research and outreach trajectories; to support center research teams in a co-creation process to develop logic models and tailored indicators; and to provide timely and feedback within the center to address communications gaps identified by the evaluation program. By using DE principles to shape monitoring and evaluation approaches, our evaluation program has adapted to the dynamic circumstances presented as our center’s progress has been translated from a plan in a grant proposal to implementation.
Abstract: Publication date: Available online 9 October 2019Source: Evaluation and Program PlanningAuthor(s): Abigail M Hatcher, Ruari McBride, Dumisani Rebombo, Shehnaz Munshi, Mzwakhe Khumalo, Nicola ChristofidesAbstractIntimate partner violence (IPV) is experienced by one-third of women globally, yet few programs attempt to shift men’s IPV perpetration. Community mobilization is a potential strategy for reducing men’s IPV perpetration, but this has rarely been examined globally. We conducted a mixed-methods process evaluation alongside a trial testing community mobilization in peri-urban South Africa. We used in-depth interviews (n=114), participant observation (160 hours), and monitoring and evaluation data to assess program delivery. Qualitative data (verbatim transcripts and observation notes) were managed in Dedoose using thematic coding and quantitative data were descriptively analyzed using Stata13. We learned that outreach elements of community mobilization were implemented with high fidelity, but that critical reflection and local advocacy were difficult to achieve. The context of a peri-urban settlement (characterized by poor infrastructure, migrancy, low education, social marginalization, and high levels of violence) severely limited intervention delivery, as did lack of institutional support for staff and activist volunteers. That community mobilization was poorly implemented may explain null trial findings; in the larger trial, the intervention failed to measurably reduce men’s IPV perpetration. Designing community mobilization for resource-constrained settings may require additional financial, infrastructural, organizational, or political support to effectively engage community members and reduce IPV.
Abstract: Publication date: Available online 5 October 2019Source: Evaluation and Program PlanningAuthor(s): Saul Ngarava, Abbyssinia Mushunje, Petronella ChaminukaAbstractThe objective of the study was to develop an index which circumvents the need for quantitative measures in evaluating Livestock Development Programmes (LDPs). This was done through a conceptual framework which integrates indexing and the Sustainable Livelihoods Framework (SLF) to attain qualitative benefits. The study utilised a cross-sectional survey of Kaonafatso ya Dikgomo (KyD) Scheme participants in KwaZulu-Natal, Eastern Cape and Limpopo Provinces, South Africa, as a case. Data were collected through a questionnaire. Multiple sampling methods were used to identify 164 respondents. The results showed low benefits as exhibited by an index of 0.26. The Scheme showed highest benefits through social capital, followed by human, natural, financial and physical capital, respectively. The study concluded that concentrating on income proxies through convectional cost-benefit analysis (CBA) tends to mask the qualitative benefits exhibited by livestock improvement programmes. The theoretical lessons learnt included the exhibition and possibility of measuring qualitative benefits through indexing. Recommendations include further inquiry and refining the construction of the index to circumvent its subjectivity.
Abstract: Publication date: Available online 12 September 2019Source: Evaluation and Program PlanningAuthor(s): Andrew Pleasant, Catina O’Leary, Richard H. CarmonaAbstractThis case study attempts to illustrate and address in-depth the issues surrounding the collection, analysis, and application of formative research findings to program development and implementation. We provide an in-depth case study of tailoring a program for the residents of Berkshire County, Massachusetts. The formative research process includes collection and analysis of secondary data sources, extensive in-person interviews with community leaders, and in-depth focus groups with members of the population of interest. Findings from the formative research are then applied to tailoring the program materials and presentations and the training of the integrative team of health professionals that offer the program. Distinct components of program are tailored to the realities of the social, cultural, historical, and health and medical contexts in each community while other components of the program are tailored to individual participants. Overall, we believe this case study fully illustrates the utility of formative research in tailoring evidenced-based programs to increase program relevance and positive outcomes while maintaining fidelity to a program’s learning objectives and evaluation. We hope this in-depth account with specific examples proves useful as a guide to others when designing and conducting formative research to tailor health and medical interventions to the audience.
Abstract: Publication date: Available online 11 August 2019Source: Evaluation and Program PlanningAuthor(s): E. Mc Hugh, M. StarkeAbstractSpecific aimsThis study explored feasibility and fidelity of an education program for parents with intellectual disability. The Australian Parenting Young Children intervention was translated and adapted for support workers in the Swedish social services.MethodFidelity was examined using implementation diaries tracking frequency of implementation of program activities and teaching approaches ( (over 14 months, completed by 27 support workers from 15 municipalities). Eighteen of these support workers and their managers (n = 12) completed questionnaires examining feasibility using Roger’s concepts of program compatibility and complexity.FindingsResults showed that implementation of Parenting Young Children was feasible, with overall positive attitudes to Evidence Based Practice, good program compatibility, low perceived program complexity, and high satisfaction with implementation support. The fidelity measures suggest problems in how the program is used by some support workers: parents received less than the recommended number of sessions and activities such as observation of parents and follow up, were infrequently used by support workers.DiscussionThe findings raise questions about how program support and education should be provided. Difficulties in defining fidelity within the flexibility of the Parenting Young Children program are also discussed.
Hybrid journal (It can contain Open Access articles)
[3147 journals]
