Abstract: The way quality of assessment has been perceived and assured has changed considerably in the recent 5 decades. Originally, assessment was mainly seen as a measurement problem with the aim to tell people apart, the competent from the not competent. Logically, reproducibility or reliability and construct validity were seen as necessary and sufficient for assessment quality and the role of human judgement was minimised. Later, assessment moved back into the authentic workplace with various workplace-based assessment (WBA) methods. Although originally approached from the same measurement framework, WBA and other assessments gradually became assessment processes that included or embraced human judgement but based on good support and assessment expertise. Currently, assessment is treated as a whole system problem in which competence is evaluated from an integrated rather than a reductionist perspective. Current research therefore focuses on how to support and improve human judgement, how to triangulate assessment information meaningfully and how to construct fairness, credibility and defensibility from a systems perspective. But, given the rapid changes in society, education and healthcare, yet another evolution in our thinking about good assessment is likely to lurk around the corner. PubDate: 2020-10-28
Abstract: The imperative for all healthcare professionals to partake in quality improvement (QI) has resulted in the development of QI education programs with participants from different professional backgrounds. However, there is limited empirical and theoretical examination as to why, when and how interprofessional and multiprofessional education occurs in QI and the outcomes of these approaches. This paper reports on a qualitative collective case study of interprofessional and multiprofessional education in three longitudinal QI education programs. We conducted 58 interviews with learners, QI project coaches, program directors and institutional leads and 135 h of observations of in-class education sessions, and collected relevant documents such as course syllabi and handouts. We used an interpretive thematic analysis using a conventional and directed content analysis approach. In the directed content approach, we used sociology of professions theory with particular attention to professional socialization, hierarchies and boundaries in QI, to understand the ways in which individuals’ professional backgrounds informed the planning and experiences of the QI education programs. Findings demonstrated that both interprofessional and multiprofessional education approaches were being used to achieve different education objectives. While each approach demonstrated positive learning and practice outcomes, tensions related to the different ways in which professional groups are engaging in QI, power dynamics between professional groups, and disconnects between curricula and practice existed. Further conceptual clarity is essential for a more informed discussion about interprofessional and multiprofessional education approaches in QI and explicit attention is needed to professional processes and tensions, to optimize the impact of education on practice. PubDate: 2020-10-28
Abstract: While collaboration is an important and key attribute for medical students in order to prepare them to perform well in health care teams, how to effectively develop and assess such skills is challenging. The current widespread practice of using Likert-scale questionnaire only to measure the quantity of collaboration at course and/or program level appears to be insufficient to provide an evidence-base for what counts desirable collaborative learning experience. Drawing on research into student approaches to learning and social network analysis, this study investigates differences in collaborative learning configurations amongst 217 Australian medical students. Based on students’ learning orientations (i.e., ‘understanding’ and ‘reproducing’) and their choice of collaborations (i.e., whether to collaborate or not, with whom to collaborate, and mode of collaboration), the analyses found five configurations of collaborations differing in a number of features. The most desirable collaborative experience was a configuration of collaborations formed by students with an ‘understanding’ orientation. This configuration revealed a strong tendency towards intensive pair work with measurable differences in how easy and effectively they collaborated. The results of the study not only have practical implications for teaching and curriculum design for collaborative learning, but also have significant implications for assessing students’ collaborative learning experiences. PubDate: 2020-10-25
Abstract: Students as partners is a movement which is gaining momentum in higher education, yet disciplinary perspectives are underexplored. Using a qualitative synthesis approach informed by Major and Savin-Baden (2010), we systematically investigated how health professional education has taken up the practice of working in partnership with students. Fifty-five publications were identified in our search from 2011 to -mid 2018. The majority of literature came from North America and medicine was the most frequently represented health profession. Our three stage analysis identified five key themes: (1) framing (i.e. ethos) of the partnership; (2) drivers for partnership; (3) sustainability; (4) inclusion of student voice; and (5) understanding of partnership and its benefits and challenges. Health professional educators are well equipped to enact partnership opportunities due to their clinical skills in person-centred care. However to gain the most from student-staff partnerships, health professional education would benefit from greater awareness of the field’s theoretical understandings of partnership and its key principles of reciprocity, respect and responsibility. PubDate: 2020-10-21
Abstract: Correctional systems in several U.S. states have entered into partnerships with academic medical centers (AMCs) to provide healthcare for persons who are incarcerated. One AMC specializing in the care of incarcerated patients is the University of Texas Medical Branch at Galveston (UTMB), which hosts the only dedicated prison hospital in the U.S. and supplies 80% of the medical care for the entire Texas Department of Criminal Justice (TDCJ). Nearly all medical students and residents at UTMB take part in the care of the incarcerated. This research, through qualitative exploration using focus group discussions, sets out to characterize the correctional care learning environment medical trainees enter. Participants outlined an institutional culture of low prioritization and neglect that dominated the learning environment in the prison hospital, resulting in treatment of the incarcerated as second-class patients. Medical learners pointed to delays in care, both within the prison hospital and within the TDCJ system, where diagnostic, laboratory, and medical procedures were delivered to incarcerated patients at a lower priority compared to free-world patients. Medical learners elaborated further on ethical issues that included the moral judgment of those who are incarcerated, bias in clinical decision making, and concerns for patient autonomy. Medical learners were left to grapple with complex challenges like the problem of dual loyalties without opportunities to critically reflect upon what they experienced. This study finds that, without specific vulnerable populations training for both trainees and correctional care faculty to address these institutional dynamics, AMCs risk replicating a system of exploitation and neglect of incarcerated patients and thereby exacerbating health inequities. PubDate: 2020-10-19
Abstract: The concept of quality culture has gained increased attention in health professions education, drawing on insights that quality management processes and positive work-related attitudes of staff in synergy lead to continuous improvement. However, the directions that guide institutions from quality culture theory to educational practice have been missing so far. A prospective qualitative case study of three health professions education programmes was conducted to explore how a quality culture can be enhanced according to the experiences and perspectives of educational leaders. The data collection was structured by an appreciative inquiry approach, supported with vignette-based interviews. A total of 25 participants (a selection of course coordinators, bachelor coordinators and directors of education) reflected on quality culture themes to learn about the best of what is (Discover), envision positive future developments (Dream), identify actions to reach the desired future (Design), and determine how to support and sustain improvement actions (Destiny) within their own educational setting. The results are presented as themes subsumed under these four phases. The experiences and perspectives of educational leaders reveal that peer learning in teams and communities, attention to professional development, and embedding support- and innovation networks, are at the heart of quality culture enhancement. An emphasis on human resources, (inter)relations and contextual awareness of leaders stood out as quality culture catalysts. Educational leaders are therefore encouraged to especially fuel their networking, communication, coalition building, and reflection competencies. PubDate: 2020-10-12
Abstract: The current study used theories on expertise development (the holistic model of image perception and the information reduction hypothesis) as a starting point to identify and explore potentially relevant process measures to monitor and evaluate expertise development in radiology residency training. It is the first to examine expertise development in volumetric image interpretation (i.e., CT scans) within radiology residents using scroll data collected longitudinally over five years of residency training. Consistent with the holistic model of image perception, the percentage of time spent on full runs, i.e. scrolling through more than 50% of the CT-scan slices (global search), decreased within residents over residency training years. Furthermore, the percentage of time spent on question-relevant areas in the CT scans increased within residents over residency training years, consistent with the information reduction hypothesis. Second, we examined if scroll patterns can predict diagnostic accuracy. The percentage of time spent on full runs and the percentage of time spent on question-relevant areas did not predict diagnostic accuracy. Thus, although scroll patterns over training years are consistent with visual expertise theories, they could not be used as predictors of diagnostic accuracy in the current study. Therefore, the relation between scroll patterns and performance needs to be further examined, before process measures can be used to monitor and evaluate expertise development in radiology residency training. PubDate: 2020-10-08
Abstract: Teaching clinical reasoning in emergency medicine requires educators to foster diagnostic accuracy and judicious decision-making amidst chaotic ambient factors including clinician fatigue, high cognitive load, and diverse patient expectations. The current study applies the early work of Jurgen Habermas and his knowledge-constitutive interests as a lens to explore an educational approach where physician-educators were asked to make their expert reasoning visible to emergency medicine trainees, to more deliberately make visible and accessible the context-specific thinking that emergency physicians routinely use. An action research methodology was used. The ‘making thinking visible’ teaching approach was introduced to five emergency medicine educators working in large public hospital emergency departments. Participants were asked to trial this teaching method and document its impact on student learning over two reporting cycles. Based on written reports of trialing the teaching approach, participants identified a need to change from: (1) introducing thinking structures to cultivating enquiry; and, (2) providing explanations based on cognitive thinking routines towards encouraging the learner to see the relevance of the clinical context. Educators described how they developed a more diagnostic and reflexive approach to learners, recognized the need to cultivate independent thinking, and valued the opportunity to reflect on their usual teaching. Teaching clinical reasoning using the ‘making thinking visible’ approach prompted educators to decrease the emphasis on providing technical information to assisting learners to understand the purposes and meanings behind clinical reasoning in emergency medicine. The knowledge-constitutive interests work of Jurgen Habermas was found to provide a robust framework supporting this emancipatory teaching approach. PubDate: 2020-10-01
Abstract: Competency frameworks serve various roles including outlining characteristics of a competent workforce, facilitating mobility, and analysing or assessing expertise. Given these roles and their relevance in the health professions, we sought to understand the methods and strategies used in the development of existing competency frameworks. We applied the Arksey and O’Malley framework to undertake this scoping review. We searched six electronic databases (MEDLINE, CINAHL, PsycINFO, EMBASE, Scopus, and ERIC) and three grey literature sources (greylit.org, Trove and Google Scholar) using keywords related to competency frameworks. We screened studies for inclusion by title and abstract, and we included studies of any type that described the development of a competency framework in a healthcare profession. Two reviewers independently extracted data including study characteristics. Data synthesis was both quantitative and qualitative. Among 5710 citations, we selected 190 for analysis. The majority of studies were conducted in medicine and nursing professions. Literature reviews and group techniques were conducted in 116 studies each (61%), and 85 (45%) outlined some form of stakeholder deliberation. We observed a significant degree of diversity in methodological strategies, inconsistent adherence to existing guidance on the selection of methods, who was involved, and based on the variation we observed in timeframes, combination, function, application and reporting of methods and strategies, there is no apparent gold standard or standardised approach to competency framework development. We observed significant variation within the conduct and reporting of the competency framework development process. While some variation can be expected given the differences across and within professions, our results suggest there is some difficulty in determining whether methods were fit-for-purpose, and therefore in making determinations regarding the appropriateness of the development process. This uncertainty may unwillingly create and legitimise uncertain or artificial outcomes. There is a need for improved guidance in the process for developing and reporting competency frameworks. PubDate: 2020-10-01
Abstract: Undergraduate clinical assessors make expert, multifaceted judgements of consultation skills in concert with medical school OSCE grading rubrics. Assessors are not cognitive machines: their judgements are made in the light of prior experience and social interactions with students. It is important to understand assessors’ working conceptualisations of consultation skills and whether they could be used to develop assessment tools for undergraduate assessment. To identify any working conceptualisations that assessors use while assessing undergraduate medical students’ consultation skills and develop assessment tools based on assessors’ working conceptualisations and natural language for undergraduate consultation skills. In semi-structured interviews, 12 experienced assessors from a UK medical school populated a blank assessment scale with personally meaningful descriptors while describing how they made judgements of students’ consultation skills (at exit standard). A two-step iterative thematic framework analysis was performed drawing on constructionism and interactionism. Five domains were found within working conceptualisations of consultation skills: Application of knowledge; Manner with patients; Getting it done; Safety; and Overall impression. Three mechanisms of judgement about student behaviour were identified: observations, inferences and feelings. Assessment tools drawing on participants’ conceptualisations and natural language were generated, including ‘grade descriptors’ for common conceptualisations in each domain by mechanism of judgement and matched to grading rubrics of Fail, Borderline, Pass, Very good. Utilising working conceptualisations to develop assessment tools is feasible and potentially useful. Work is needed to test impact on assessment quality. PubDate: 2020-10-01
Abstract: The array of different philosophical positions underlying contemporary views on competence, assessment strategies and justification have led to advances in assessment science. Challenges may arise when these philosophical positions are not considered in assessment design. These can include (a) a logical incompatibility leading to varied or difficult interpretations of assessment results, (b) an “anything goes” approach, and (c) uncertainty regarding when and in what context various philosophical positions are appropriate. We propose a compatibility principle that recognizes that different philosophical positions commit assessors/assessment researchers to particular ideas, assumptions and commitments, and applies ta logic of philosophically-informed, assessment-based inquiry. Assessment is optimized when its underlying philosophical position produces congruent, aligned and coherent views on constructs, assessment strategies, justification and their interpretations. As a way forward we argue that (a) there can and should be variability in the philosophical positions used in assessment, and these should be clearly articulated to promote understanding of assumptions and make sense of justifications; (b) we focus on developing the merits, boundaries and relationships within and/or between philosophical positions in assessment; (c) we examine a core set of principles related to the role and relevance of philosophical positions; (d) we elaborate strategies and criteria to delineate compatible from incompatible; and (f) we articulate a need to broaden knowledge/competencies related to these issues. The broadened use of philosophical positions in assessment in the health professions affect the “state of play” and can undermine assessment programs. This may be overcome with attention to the alignment between underlying assumptions/commitments. PubDate: 2020-10-01
Abstract: Scoping reviews are increasingly used in health professions education to synthesize research and scholarship, and to report on the depth and breadth of the literature on a given topic. In this Perspective, we argue that the philosophical stance scholars adopt during the execution of a scoping review, including the meaning they attribute to fundamental concepts such as knowledge and evidence, influences how they gather, analyze, and interpret information obtained from a heterogeneous body of literature. We highlight the principles informing scoping reviews and outline how epistemology—the aspect of philosophy that “deals with questions involving the nature of knowledge, the justification of beliefs, and rationality”—should guide methodological considerations, toward the aim of ensuring the production of a high-quality review with defensible and appropriate conclusions. To contextualize our claims, we illustrate some of the methodological challenges we have personally encountered while executing a scoping review on clinical reasoning and reflect on how these challenges could have been reconciled through a broader understanding of the methodology’s philosophical foundation. We conclude with a description of lessons we have learned that might usefully inform other scholars who are considering undertaking a scoping review in their own domains of inquiry. PubDate: 2020-10-01
Abstract: Models for diagnostic reasoning in radiology have been based on the observed behaviors of experienced radiologists but have not directly focused on the thought processes of novices as they improve their accuracy of image interpretation. By collecting think-aloud verbal reports, the current study was designed to investigate differences in specific thought processes between medical students (novices) as they learn and radiologists (experts), so that we can better design future instructional environments. Seven medical students and four physicians with radiology training were asked to interpret and diagnose pediatric elbow radiographs where fracture is suspected. After reporting their diagnosis of a case, they were given immediate feedback. Participants were asked to verbalize their thoughts while completing the diagnosis and while they reflected on the provided feedback. The protocol analysis of their verbalizations showed that participants used some combination of four processes to interpret the case: gestalt interpretation, purposeful search, rule application, and reasoning from a prior case. All types of processes except reasoning from a prior case were applied significantly more frequently by experts. Further, gestalt interpretation was used with higher frequency in abnormal cases while purposeful search was used more often for normal cases. Our assessment of processes could help guide the design of instructional environments with well-curated image banks and analytics to facilitate the novice’s journey to expertise in image interpretation. PubDate: 2020-10-01
Abstract: Transitioning from student to doctor is notoriously challenging. Newly qualified doctors feel required to make decisions before owning their new identity. It is essential to understand how responsibility relates to identity formation to improve transitions for doctors and patients. This multiphase ethnographic study explores realities of transition through anticipatory, lived and reflective stages. We utilised Labov’s narrative framework (Labov in J Narrat Life Hist 7(1–4):395–415, 1997) to conduct in-depth analysis of complex relationships between changes in responsibility and development of professional identity. Our objective was to understand how these concepts interact. Newly qualified doctors acclimatise to their role requirements through participatory experience, perceived as a series of challenges, told as stories of adventure or quest. Rules of interaction within clinical teams were complex, context dependent and rarely explicit. Students, newly qualified and supervising doctors felt tensions around whether responsibility should be grasped or conferred. Perceived clinical necessity was a common determinant of responsibility rather than planned learning. Identity formation was chronologically mismatched to accepting responsibility. We provide a rich illumination of the complex relationship between responsibility and identity pre, during, and post-transition to qualified doctor: the two are inherently intertwined, each generating the other through successful actions in practice. This suggests successful transition requires a supported period of identity reconciliation during which responsibility may feel burdensome. During this, there is a fine line between too much and too little responsibility: seemingly innocuous assumptions can have a significant impact. More effort is needed to facilitate behaviours that delegate authority to the transitioning learner whilst maintaining true oversight. PubDate: 2020-10-01
Abstract: Medical students’ motivations for choosing a medical career are likely based on and remain tethered to the affectively-laden caring component of doctor–patient interactions. However, this component is rarely presented in educational surgical videos. It is unknown whether affectively engaging students by including patient-related emotionally salient information potentiates or draws focus away from learning a surgical procedure and whether such information affects motivation and attitudes toward the video. Therefore, we investigate whether presenting a patient’s emotional state before video surgery enhances or weakens the educational value of that video. In a within-subjects crossover design, second-year medical students (n = 130) viewed video clips of surgeries. These videos, from online medical education platforms, were preceded by the patient’s information from the original video or by information about the patient’s preoperative emotional preparation. After each video, participants completed a multiple-choice test about the video’s content to measure learning, answered a question about their motivation to re-watch the video, and completed an attitude scale regarding the video. Incorporating patient’s information into surgical videos significantly enhanced students’ acquisition of the technical aspects of surgery procedures (p < 0.0001), motivation to re-watch the video (p < 0.001), and favorable attitudes toward the video (p = 0.02). These findings show that incorporating information about patients’ emotional states may enhance students’ positive attitudes and motivations toward educational videos and may improve their learning of surgical techniques. They also suggest that the role of this factor should be considered when developing guidelines for medical educational video release. PubDate: 2020-10-01
Abstract: Healthcare graduates are often characterised as ill-prepared for workplace entry. Historically, research on health professional’s work preparedness has focused on the quality of graduates’ clinical knowledge, skills and problem-solving. This ignores the role of professional identity formation in determining readiness for clinical practice. Yet, professional identity defines graduate self-perception, how others perceive them and informs clinical behaviour. The scholarship of identity formation at the transition from undergraduate to graduate is characterised by individual (cognitive) rather than relational (sociocultural) perspectives. Yet there is growing recognition that identity formation is not just individually mediated, but is also constructed between individuals and social context. The aim of this study was to explore professional identity formation among undergraduates and graduates from one healthcare profession (speech and language therapy-SLT) using a sociocultural theoretical standpoint. A qualitative descriptive methodology was used. Final (4th) year SLT undergraduate students and graduate SLTs with less than 2 years’ clinical experience participated in individual semi-structured interviews. Thematic analysis was used to describe patterns in the data, which were subsequently subjected to interpretation informed by the constructs of Figured Worlds. Data analysis revealed that undergraduate professional identity was characterised by dependency, self-centredness (as opposed to patient-centredness), and a naïve role concept. Graduate identity on the other hand included expectations of self-sufficiency, patient-centredness and a more nuanced perception of the professional role. Undergraduates have naïve, prototypical understandings of what it is to be a graduate practitioner. The nature of undergraduate clinical placement hinders meaningful identity development. This suggests that curriculums should facilitate undergraduates to act with meaningful autonomy and to be positioned in more patient-centred roles, e.g. involvement in the decision-making process for patients. Graduates may then feel more authentic as autonomous professionals in their early graduate posts. This leads to better graduate, patient and service outcomes. PubDate: 2020-10-01
Abstract: Medical education is a rapidly growing field of research, incorporating diverse disciplinary perspectives to assist physician trainees in developing the complex skills needed for practice. Education science is happening in many medical specialties; however, Family Medicine or General Practice settings have not seen a proportional share of theory-driven education research. The limited nature of education research in Family Medicine is surprising, given that there are several aspects of general practice that make it a particularly unique and interesting context to study issues of general importance to medical education, and there is a particular need for education research to further the discipline of Family Medicine. It is important that the community of medical education researchers in Family Medicine have a strong understanding and perspective on the breadth and potential impact of their work, and what this means for the training that occurs within and for the discipline. This Reflection aims to inform strategic thinking, collaboration, and innovation in medical education research as it pertains to Family Medicine. It does so by discussing four hallmarks of Family Medicine practice and outlining their independent and interactive potential for medical education research. PubDate: 2020-09-28
Abstract: The use of walking workstations in educational and work settings has been shown to improve cognitive abilities. At the same time, it has been repeatedly shown that medical residents around the world do not meet exercise guidelines, mainly due to a scarcity of available free time. Our study investigates the boundaries of the previously observed phenomenon of improved cognitive performance with physical activity using materials that represent real life tasks. Participants had different level of expertise and involved second year psychology students, medical students, and family medicine residents. We examined the effect of being physically inactive (i.e., sitting) or active (i.e., walking) while diagnosing multiple complex presentations of four skin conditions. We assumed that being physically active, irrespective of the level of expertise, will bolster diagnostic performance. Our findings show, however, that being physically active does not change the performance level of participants with different levels of medical expertise. Implications for medical education and suggestions for further research will be discussed. PubDate: 2020-09-28
Hybrid journal (It can contain Open Access articles)
[2626 journals]
