Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Oleg Mazuryk, Marharyta Shyrokova Pages: 434 - 451 Abstract: Evaluation, Volume 30, Issue 3, Page 434-451, July 2024. This article evaluates the effectiveness of the Shelter.Ukraine Initiative, a civic response to the humanitarian crisis resulting from Russia’s full-scale invasion of Ukraine. The Initiative aims to address pressing needs through a local umbrella funding approach. Utilizing an evaluative framework that combines multiple approaches, including causal attribution techniques, contribution analysis, and regression analysis, we assess the effectiveness of the Shelter.Ukraine Initiative. We uncover influencing factors that contribute to the Initiative success. These include organizational ambidexterity, learning-by-doing, inter-organizational structure, and advanced technology for financial resource distribution. Our findings underscore the importance of reconfiguring the humanitarian aid architecture to enhance effectiveness. In addition, we suggest that the insights gained from our study can inform future evaluations of humanitarian aid initiatives. By incorporating similar evaluative frameworks and methodologies, researchers can assess the effectiveness of other initiatives and identify key factors contributing to success. Citation: Evaluation PubDate: 2024-07-30T11:52:49Z DOI: 10.1177/13563890241263956 Issue No:Vol. 30, No. 3 (2024)
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Elizabeth-Rose Ahearn, Cameron Parsell Abstract: Evaluation, Ahead of Print. This study investigates the evolution of evaluation approaches within the charitable sector, emphasising the proliferation of options throughout waves of evaluation diffusion. We draw on imprinting theory to describe the persistence of specific practices despite the emergence of alternatives. The research aims to examine the imprinted values and practices of earlier evaluation waves on the current practice of evaluation by documenting the current methodological practice in a large sample of evaluation reports. The study illuminates the enduring impact of theory-driven evaluation, introduced in the 1980s, on current practices. However, it also reveals how this approach has evolved over subsequent evaluation waves, acquiring divergent characteristics. This imprinting is not only due to effectiveness but also due to normative pressures, which prioritise conformity with norms over practical utility. The study highlights the potential consequences of this imprinting, including management-focused evaluations and mission drift. We conclude by offering practical options to address tensions within the field and call for further research to better understand the nuances of decision-making in evaluation approaches. Citation: Evaluation PubDate: 2024-08-02T05:50:29Z DOI: 10.1177/13563890241267729
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Astrid Brousselle Abstract: Evaluation, Ahead of Print. Post-truth relates to the combination of tactics of influence and opinion manipulation orchestrated by powerful economic and political interests, principally targeting initiatives or ideas with a transformative potential. Post-truth strategies express themselves in multiple tactics, which happen synchronously at varied levels and through different channels. Scientifically valid information is forced to compete with narratives which are designed to create doubt or skepticism. Disinformation weakens efforts to implement policies intended to support transformative goals. The distortion, discrediting, or ignoring of scientific evidence has become a threat to our societies. This article starts by defining the post-truth phenomenon, first discussing the roots, tactics, and contextual conditions supporting its expansion. Then it explores what stance evaluators can adopt to work in this new era where people are polarized and disinformation is widespread. This article aims to raise awareness of this disruptive phenomenon and brings evaluators together to consider promising practices. Citation: Evaluation PubDate: 2024-08-02T05:48:48Z DOI: 10.1177/13563890241265859
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Sarah Chapman, Peter Dahler-Larsen Abstract: Evaluation, Ahead of Print. Theory-based evaluation has undergone changes over time, adapting to challenges and aligning with trends that emphasise increased participation and complexity. However, integrating both high participation and complexity in programme theory does not consistently led to productive outcomes in intricate systems. This article introduces contingency-oriented questions to assess the appropriate balance of complexity and participation in theory-based evaluation. Using a case study focused on the Accelerating Achievement for Adolescents Hub, a Global Challenges Research Fund initiative, we demonstrate the practical application of these questions. Our analysis highlights why efforts to elaborate a more complex programme theory were unsuccessful and explains the rationale behind concluding the project with a theory characterised by more moderate complexity and participation. Citation: Evaluation PubDate: 2024-08-02T05:46:23Z DOI: 10.1177/13563890241255682
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Mathilde de Goër de Herve Abstract: Evaluation, Ahead of Print. Evaluation should be part of the sustainable transition, but the transformational power of evaluation is limited by a short-term focus. This article explores long-term issues, according to evaluation practitioners, when evaluating the consequences of an initiative. A survey (n = 282) followed by discussions with 12 evaluators investigates what is long term in evaluations of impacts and outcomes, and why it is included or not. The results identify 2 to 5 years after the implementation of an initiative as the most common long-term timeframe. The main challenges to including long-term perspectives are missing data, attribution difficulties, and the lack of resources. The main motivations are discovering particular causalities, incorporating contextual elements, and answering the demands of other actors involved in the evaluation. These findings have implications for the transformational power of evaluation: despite challenges and a long-term timeframe that is rather short compared to sustainable development issues, practitioners are positive toward long-term integration. Citation: Evaluation PubDate: 2024-07-31T11:59:03Z DOI: 10.1177/13563890241258202
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Nassibou Bassongui Abstract: Evaluation, Ahead of Print. This article aims to provide practical guidance for conducting culturally responsive data analysis for evaluations in contexts of fragility, conflict and violence. To this end, we propose three core principles – or ‘golden rules’ -that must be taken into consideration when analyzing such data. These include the engagement of wise stakeholders in data analysis, the consideration of diversity in detecting and treating outliers and the documentation of all data analysis processes, including the assumptions made. We are aware that applying these principles may pose practical challenges given the complexity of fragile and conflict-based environments. However, doing so can enhance the validity of evaluation findings and their acceptability. Further research is encouraged to empirically test the proposed principles in conflict regions, notably in Sub-Saharan Africa. Citation: Evaluation PubDate: 2024-05-13T12:47:43Z DOI: 10.1177/13563890241247053
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Marina Apgar, Helene Bradburn, Livia Rohrbach, Leslie Wingender, Edwin Cubillos Rodriguez, Angela Baez-Silva Arias, Alamousa Dioma, Tiffany Fairey, Stephen Gray, Ayak Chol Deng Alak, Steff Deprez Abstract: Evaluation, Ahead of Print. The field of peacebuilding evaluation has evolved over time in response to the complex nature of peace efforts. However, it still predominantly relies on evaluation models that aim to measure discrete peace outcomes adhering to rigid notions of rigour. The inclusive rigour framework presented in this article responds to this challenge, adding to complexity-aware and epistemologically plural approaches to build credible causal explanations in conditions of uncertainty. It identifies three interconnected domains of evaluation design and practice: effective methodological bricolage, meaningful participation and inclusion, utilisation and impact. Rigour here is not defined by methodological choice alone, but rather, relies on an active view of evolving methodological choices throughout an iterative process as maximum use value and meaningful participation are sought. Using three cases, we highlight the critical role of partnership arrangements and associated evaluation cultures and mindsets underpinned by power dynamics that enable or hinder the practice of inclusive rigour. Citation: Evaluation PubDate: 2024-04-27T05:45:10Z DOI: 10.1177/13563890241232405
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Courtney Stone, Caitlin J. Albrechtsen, Ayesha S. Boyce Abstract: Evaluation, Ahead of Print. Postcolonial theory can be paired with a values-engaged educative evaluation approach to resist imperialism and colonialism in evaluation spaces, de-Westernize conceptualizations of diversity, equity, and inclusion, and extend the capacity of culturally responsive evaluation. Beyond the joining of the values-engaged educative approach and postcolonial theory, Collaboration Research Network theories offer another distinct but complementary avenue for exploring structural power imbalance and invisible hierarchies in science, technology, engineering, and mathematics evaluation contexts. Using these three theories, values-engaged educative, Collaboration Research Network, and postcolonial theory, this qualitative study examined the perceptions and experiences of faculty and students at three minority-serving institutions participating in a science, technology, engineering, and mathematics Center. This study aims to bridge theories traditionally used in research with evaluation frameworks to reconceptualize concepts of diversity, equity, and inclusion. Citation: Evaluation PubDate: 2024-04-27T05:44:11Z DOI: 10.1177/13563890241246006
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Claire Salama, Silvia Picalarga Abstract: Evaluation, Ahead of Print. Policy evaluation is now recognised by many governments as fundamental to ensuring that policies are informed by quality evidence. Nevertheless, the practice of policy evaluation is still difficult to systematise inside governments. Building on more than 20 years of work on this topic, the Organisation for Economic Co-operation and Development Recommendation on Public Policy Evaluation, adopted in 2022, represents the first international legal guidance on the topic. It identifies three essential pillars to ensure the impact of policy evaluation: institutionalisation, quality and use. This article explains how the Organisation for Economic Co-operation and Development Recommendation was developed, what these three pillars cover, and reflect on how the Organisation for Economic Co-operation and Development can further help countries developing a sound evaluation system. Citation: Evaluation PubDate: 2024-03-11T03:56:53Z DOI: 10.1177/13563890241234699
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Brynne Gilmore, Jessica Power, Nazarius Tumwesigye, Henry Mollel, Eilish McAuliffe, Frédérique Vallières Abstract: Evaluation, Ahead of Print. Health committees link formalised health services and the community. However, ‘how, why, and for whom’ health committees work warrants further exploration. This article presents the development of a middle-range theory for how health committees work for building community capacity for health. Resulting programme theories from a realist evaluation in Uganda were synthesised for demi-regularities and supplemented by four key informant interviews – substantive theories were used to help explain the findings from the case studies to develop the final middle-range theories. Eighteen existing programme theories and 47 supporting context-mechanism-outcome configurations were synthesised into four middle-range theories for how health committees work for community capacity building for health at the individual, organisational, community and societal levels. The middle-range theories developed in this study provide important insight for those implementing health committees. Given the little guidance available for developing and refining middle-range theories, this study provides transparent methodological processes, which may assist future research. Citation: Evaluation PubDate: 2024-01-30T07:10:07Z DOI: 10.1177/13563890231223182
Please help us test our new pre-print finding feature by giving the pre-print link a rating. A 5 star rating indicates the linked pre-print has the exact same content as the published article.
Authors:Rodney Schmidt Abstract: Evaluation, Ahead of Print. We describe a simple yet rigorous graphical method for eliminating bias in theory-based program evaluation. The method is an application to social and international development program evaluation of the graphical causal models used to test medical treatments. We implement a graphical causal model for the World Bank’s well-known Bangladesh Integrated Nutrition Project. We show how to construct the graphical causal model to represent program theory in context in explicitly causal terms. We then show how to visually inspect the graphical causal model to distinguish causal from non-causal associations between variables in evaluation data. Finally, we show how to select a set of adjustment variables to neutralize non-causal associations, eliminating bias in all forms of causal inference—qualitative and quantitative, linear and non-linear. Citation: Evaluation PubDate: 2024-01-30T07:04:07Z DOI: 10.1177/13563890231223171
Hybrid journal (It can contain Open Access articles)
[1176 journals]
