{"id":3556,"date":"2020-08-07T10:17:23","date_gmt":"2020-08-07T14:17:23","guid":{"rendered":"http:\/\/alanbatt.net\/?p=3556"},"modified":"2024-08-07T16:07:06","modified_gmt":"2024-08-07T20:07:06","slug":"phd-overview-do-we-preach-what-we-practice-capturing-the-complexities-of-clinical-practice-in-health-professions-education","status":"publish","type":"post","link":"http:\/\/alanbatt.net\/?p=3556","title":{"rendered":"PhD overview: Do we preach what we practice? Capturing the complexities of clinical practice in health professions education."},"content":{"rendered":"\n

My PhD research aims to explore competency frameworks in the health professions. This includes reviewing how they have been developed to date, outlining implications of these findings, identifying means by which the development process could be improved, and proposing updated reporting and evaluation processes. The project will include the development of a competency framework as a worked example. Outlined here is an overview of my PhD to date, with abstracts and links to published articles, pre-prints, copies of posters, and updates.<\/p>\n\n\n\n

Publications<\/h2>\n\n\n\n

The development of competency frameworks in healthcare professions: a scoping review<\/h3>\n\n\n\n

Competency frameworks serve various roles including outlining characteristics of a competent workforce, facilitating mobility, and analysing or assessing expertise. Given these roles and their relevance in the health professions, we sought to understand the methods and strategies used in the development of existing competency frameworks. We applied the Arksey and O\u2019Malley framework to undertake this scoping review. We searched six electronic databases (MEDLINE, CINAHL, PsycINFO, EMBASE, Scopus, and ERIC) and three grey literature sources (greylit.org, Trove and Google Scholar) using keywords related to competency frameworks. We screened studies for inclusion by title and abstract, and we included studies of any type that described the development of a competency framework in a healthcare profession. Two reviewers independently extracted data including study characteristics. Data synthesis was both quantitative and qualitative. Among 5710 citations, we selected 190 for analysis. The majority of studies were conducted in medicine and nursing professions. Literature reviews and group techniques were conducted in 116 studies each (61%), and 85 (45%) outlined some form of stakeholder deliberation. We observed a significant degree of diversity in methodological strategies, inconsistent adherence to existing guidance on the selection of methods, who was involved, and based on the variation we observed in timeframes, combination, function, application and reporting of methods and strategies, there is no apparent gold standard or standardised approach to competency framework development. We observed significant variation within the conduct and reporting of the competency framework development process. While some variation can be expected given the differences across and within professions, our results suggest there is some difficulty in determining whether methods were fit-for-purpose, and therefore in making determinations regarding the appropriateness of the development process. This uncertainty may unwillingly create and legitimise uncertain or artificial outcomes. There is a need for improved guidance in the process for developing and reporting competency frameworks.<\/p>\n\n\n\n

Full text here: https:\/\/link.springer.com\/article\/10.1007\/s10459-019-09946-w<\/a>
Author accepted version here: http:\/\/alanbatt.net\/wp-content\/uploads\/2014\/10\/191205-Scoping-review-competency-development-AAM.pdf<\/a><\/p>\n\n\n\n

New ways of seeing: the role of systems thinking when developing competency frameworks in health professions education<\/h3>\n\n\n\n

Introduction<\/h4>\n\n\n\n

Competency frameworks provide a link between\nprofessional practice, education, training, and assessment. They support and\ninform downstream processes such as curriculum design, assessment,\naccreditation and professional accountability. However, a lack of organizing\nframeworks, and difficulties in representing complex professional practice\nresult in uncertainty regarding the validity and utility of competency\nframeworks. This necessitates additional ways of \u201cseeing\u201d practice when\ndeveloping competency frameworks. We highlight what a systems-thinking\nconceptual framework can offer when developing competency frameworks.<\/p>\n\n\n\n

A Systems-Thinking Approach<\/h4>\n\n\n\n

Mirroring shifts towards systems thinking in program\nevaluation and quality improvement, we suggest that similar approaches that\nidentify and make use of the role and influence of system features and contexts\ncan provide value when developing competency frameworks. We framed a systems\nthinking approach first by adapting Ecological Systems Theory (EST). EST offers\na realist perspective of the person and environment, and the evolving\ninteraction between the two. Second, we utilized complexity thinking, which obligates\nattention to the relationships and influences, to explore the multiple complex,\nunique, and context-embedded problems that exist within the messy, real-world\nsystem. <\/p>\n\n\n\n

Summary<\/h4>\n\n\n\n

The ability to represent clinical practice when developing competency frameworks may be improved when features that may be relevant, including their potential interactions, can be identified and understood. A systems thinking approach makes visible features of a practice in context that may otherwise be overlooked in the development of competency frameworks. <\/p>\n\n\n

Pre-print here: http:\/\/alanbatt.net\/wp-content\/uploads\/2020\/07\/200731-Systems-thinking-pre-print.pdf<\/a><\/p>\n\n\n

Abstracts and commentaries<\/h2>\n\n\n\n

Batt, A.M.<\/strong>, Williams, B., Brydges, M., Leyenaar, M., Tavares, W. A ‘systems thinking’ conceptual framework to explore clinical practice. DP 4-6. Canadian Medical Education Journal<\/em>. 11(2):e170. Abstract.<\/a><\/p>\n\n\n\n

Batt, A.M.<\/strong>, Tavares, W., Williams, B. How do healthcare professions develop competency frameworks? DP 12-5. Canadian Medical Education Journal<\/em>. 2020. 11(2):e201.<\/p>\n\n\n\n

Batt, A.M.<\/strong>, Tavares, W., Williams, B. A35. A scoping review of competency framework development in healthcare professions. PAC Paramedic Research Symposium Book of Abstracts<\/em>. 2019. Abstract<\/a>.<\/p>\n\n\n\n

Batt, A.M.<\/strong> Explore and evolve. International Paramedic Practice<\/em>. 2019;9(3):53 10.12968\/ippr.2019.9.3.53. Full-text<\/a>.<\/p>\n\n\n\n

Presentations<\/h2>\n\n\n\n

Do we preach what we practice? The misalignment of paramedic practice and education. BSc in Paramedicine, University of Prince Edward Island, PEI, Canada, March 26, 2020.<\/p>\n\n\n\n

Identifying training and education needs for community paramedics: a systems based approach. Ontario Community Paramedicine Secretariat Provincial Workshop, Toronto, ON, Canada, February 27, 2020.<\/p>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. Towards a best practice model for developing competency frameworks. Monash Centre for Scholarship in Health Education HDR Symposium, Melbourne, VIC, Australia, October 31, 2019.<\/p>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. The misalignment of paramedic practice and education. Ontario Paramedic Association Conference, Toronto, ON, Canada, October 26, 2019. Link: https:\/\/www.researchgate.net\/publication\/336779040_The_misalignment_of_paramedic_practice_and_education<\/a> <\/p>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. The development of competency frameworks in healthcare professions: a scoping review. Richard K. Reznick Wilson Centre Research Day, Toronto, ON, Canada, October 18, 2019. Link: https:\/\/www.researchgate.net\/publication\/336672273_The_development_of_competency_frameworks_in_healthcare_professions_a_scoping_review<\/a> <\/p>\n\n\n\n

Just what do paramedics do? Towards a definition of paramedic practice. Cape Breton Paramedic Conference, St. Ann\u2019s, NS, Canada, September 27-29, 2019.<\/p>\n\n\n\n

Preaching what we practice? Towards Practice Informed Education. BSc in Paramedicine, University of Prince Edward Island, PEI, Canada, March 7, 2019.<\/p>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. Developing practice informed paramedic education. Monash Centre for Scholarship in Health Education HDR Symposium, Melbourne, VIC, Australia, November 8, 2018.<\/p>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. The relationship between practice and education. County of Renfrew Paramedic Research Symposium, ON, Canada, June 12, 2018.<\/p>\n\n\n\n

Poster presentations<\/h2>\n\n\n\n

Batt, A.M., Williams, B., Brydges, M., Leyenaar, M., Tavares, W. A ‘systems thinking’ conceptual framework to explore clinical practice. Canadian Conference on Medical Education, Vancouver, BC, Canada, April 19, 2020 (conference cancelled due to COVID-19). 10.13140\/RG.2.2.13626.54720<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. How do healthcare professions develop competency frameworks? Canadian Conference on Medical Education, Vancouver, BC, Canada, April 19, 2020 (conference cancelled due to COVID-19). 10.13140\/RG.2.2.30403.76328<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Batt, A.M., Tavares, W., Williams, B. A scoping review of competency framework development in healthcare professions. PAC Paramedic Research Symposium, Winnipeg, MB, Canada, September 19, 2019. 10.13140\/RG.2.2.26401.35681<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n

PhD Cartoon – “Worshipping False Gods”<\/h2>\n\n\n

I recently received my PhD cartoon from\u00a0Ashleigh Neill\u00a0of PhD Cartoons! In our scoping review of competency framework development processes (pre-print available on profile) we highlighted the risk that flawed development processes might lead to the creation of illegitimate or uncertain “false-god” competency frameworks. These frameworks appear legitimate, but contain artificial or uncertain outcomes, and are then inappropriately worshipped or admired in that they influence policy, assessment etc.Ashleigh took this rather abstract concept and created a cartoon which depicts tourists (who represent downstream processes such as policy and assessment) worshipping and admiring a cardboard cutout of Asclepius (who represents a competency framework), yet they do not realise it is a cutout, and is therefore illegitimate or artificial.It’s great to see a concept make it from my head to a visual interpretation on paper! Thank you Ashleigh, I’m very pleased with it and everyone who has seen it so far has been impressed! <\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

CONFERD-HP Guideline<\/h2>\n\n\n\n

CONFERD-HP stands for the Guideline for Reporting COmpeteNcy FramEwoRk Development in Healthcare Professions. CONFERD-HP is a consensus-based reporting guideline that is being developed via the recommended EQUATOR Network methodology as a component of my PhD.<\/p>\n\n\n\n

Our scoping review of competency framework development in healthcare professions highlighted a number of areas for improvement, including significant variability in the reporting of frameworks. As such, by developing this reporting guideline we aim to reduce this variability. The guideline aims to clarify and outline key reporting items for those who develop competency frameworks or competency profiles in healthcare professions.<\/p>\n\n\n\n

CONFERD-HP is registered with the EQUATOR Network as a guideline under development. Updates will be posted on the CONFERD-HP website as they occur:\u00a0conferd-guideline.org<\/a><\/p>\n\n\n\n

\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

My PhD research aims to explore competency frameworks in the health professions. This includes reviewing how they have been developed to date, outlining implications of these findings, identifying means by which the development process could be improved, and proposing updated reporting and evaluation processes. The project will include the development of a competency framework as […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"saved_in_kubio":false,"_uag_custom_page_level_css":"","footnotes":""},"categories":[76,65],"tags":[],"class_list":["post-3556","post","type-post","status-publish","format-standard","hentry","category-blog","category-phd"],"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"kubio-fullhd":false},"uagb_author_info":{"display_name":"Alan","author_link":"http:\/\/alanbatt.net\/?author=1"},"uagb_comment_info":0,"uagb_excerpt":"My PhD research aims to explore competency frameworks in the health professions. This includes reviewing how they have been developed to date, outlining implications of these findings, identifying means by which the development process could be improved, and proposing updated reporting and evaluation processes. The project will include the development of a competency framework as…","_links":{"self":[{"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/posts\/3556","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/alanbatt.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3556"}],"version-history":[{"count":3,"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/posts\/3556\/revisions"}],"predecessor-version":[{"id":3564,"href":"http:\/\/alanbatt.net\/index.php?rest_route=\/wp\/v2\/posts\/3556\/revisions\/3564"}],"wp:attachment":[{"href":"http:\/\/alanbatt.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3556"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/alanbatt.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3556"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/alanbatt.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3556"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}