EDP Sciences logo
Submit your paper
Search
Menu
All issues Volume 8 (2022) SICOT-J, 8 (2022) 39 Full HTML
Open Access

This article has an erratum: [https://doi.org/10.1051/sicotj/2022047]

Issue
SICOT-J
Volume 8, 2022
Article Number 39
Number of page(s) 8
Section Hip
DOI https://doi.org/10.1051/sicotj/2022039
Published online 22 September 2022

© The Authors, published by EDP Sciences, 2022

Licence Creative CommonsThis is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Introduction

Femoroacetabular impingement (FAI) is a medical entity that has been historically known since 1936, and its definition was only recently updated by Ganz in 2003 following the development of hip arthroscopy [1, 2]. Given this recent development of a multidisciplinary international consensus, “The Warwick Agreement,” along with the increasing number of patients, traditional academic training remains low for this very specialized theme, while the number of media available for online training is increasing [3, 4].

Continuing medical education (CME) and resident learning are changing with the new rules of the health system modernization [5]. Video platforms are currently at the student’s fingertips and are playing a growing role for increasingly overburdened residents [5, 6]. Taking advantage of its accessibility, e-learning has become an increasingly attractive medical training method. The use of virtual simulation and videos before performing real procedures could potentially serve as an excellent educational tool before the actual procedures [7, 8]. In a randomized controlled trial, blinded by an evaluator, a group of medical students who received video instruction significantly improved their venipuncture performance as measured by the checklist, more than the group of students who did not receive video instruction, with scores of 14.15 and 9.18, respectively, out of a total of 18 points [9].

In our modern world, several open access platforms are available, with over four billion videos available. YouTube (https://www.youtube.com) is considered the second most popular website in the world, following Google (https://www.google.com) [10]. In addition, more than 65,000 new videos are uploaded daily [10, 11]. The advantages of this website are its accessibility worldwide and the ability to share medical content easily. However, YouTube is a mainstream generalized website fed by consumers without regulations specific to the health environment, which inevitably includes the risk of disseminating inappropriate information. This led to the establishment of more specialized video platforms dedicated to medical training and information, such as VuMedi (https://www.VuMedi.com): the first network for video education for doctors. This platform aims at helping doctors optimize patient care decision-making by providing authentic and complete education videos from various institutions and practitioners.

However, these two platforms are neither peer-reviewed nor professionally verified techniques. This study hypothesized that a specialized platform presented videos of higher educational merit than a generalist platform.

Purpose of the study

This study compares the quality of each website contents using a specific measurement, analyzing the pedagogical quality of FAI arthroscopic videos on YouTube versus VuMedi.

Material and methods

Study design

A prospective study was conducted between January and March of 2021. Twenty arthroscopy videos of arthroscopic FAI surgery were analyzed on two different online hosting platforms: 10 on the generalist platform YouTube and 10 on a specialized platform, VuMedi. Two surgeons made the initial selection, a junior surgeon and a senior consultant practicing hip arthroscopy. The study was not subject to institutional review by our ethics committee because it did not involve the use of personal data.

Video selection and exclusion criteria

The selection objective was to choose 10 videos on YouTube and ten on VuMedi. Only one observer made the selection using the following keywords, “FEMOROACETABULAR IMPINGEMENT” or “FAI,” in the search. Before videos were selected, they were sorted by those most viewed. Regarding the YouTube platform, the keyword addition of “HIP ARTHROSCOPY” was required to obtain the ten videos. The following exclusion criteria were used for the videos: incomplete videos, arthroscopies not treating FAI, open surgery, too short, missing video or webinar, FAI rehabilitation, FAI clinic or imaging, patient information included, non-English, and duplicates. The results were deliberately limited to ten videos per platform to simulate a practical search of a junior user, not a systematic search.

Judgment criteria

Two surgeons independently evaluated each video. For each video, the length and number of views at the time of analysis were recorded. The 10 videos in each group were analyzed and evaluated according to two scoring standards.

The first LAP-VEGaS-FAI is an adaptation of the LAP-VEGaS score, which judges the character of the pedagogical merit of the endoscopic surgical videos [12]. The LAP-VEGaS score was used to analyze the videos according to the following criteria: author information/conflicts of interest, presentation of the case, surgical installation, surgical approach, description of procedure, anatomical description, postoperative results, tips and tricks, audio comments and/or written in English, and video quality. The primary outcome of this study was based on the 18-point score of the LAP-VEGaS-FAI for each video, with the minimum being 0 points. The LAP-VEGaS and LAP-VEGaS-FAI scores are presented in Table 1. Figure 1 specifies the arthroscopic key points that made it possible to adapt the score to fit the management of femoroacetabular impingement.

thumbnail Figure 1

Graded surgical steps. a: Locating the medial plica, b: Acetabular step – exposure of the acetabular clamp, c: Labrum suture and “suction cup effect”, d: Femoral step – exposure of the femoral cam, e: Femoral step – control of the femoral resection, f: Locating the vessel, g: Preoperative imaging of the forceps, h: Checking clamp resection, i: Preoperative imaging of the cam.
Table 1

LAP-VEGaS Video Assessment Tool (original in bold)/LAP-VEGaS-FAI (modified in italics).

The second score allowed the evaluation of the perceived quality of the video. The reviewers were asked if they would have recommended the video to a peer or resident, and they were also asked if they would have accepted the video for publication and/or a podium presentation, using closed-ended questions and a 5-point Likert scale. Table 2 shows the 5-point Likert scale.

Table 2

Five-point Likert scale on single-peer/trainer video recommendations and the acceptance of the video for publication or presentation on the podium.

Statistics

The statistics were calculated using IBM© SPSS© Statistics software, version 23.0.0.0. Quantitative variables were presented by mean, standard deviations, minimum, and maximum values. Qualitative variables were matched with their number and percentage. Unmatched quantitative variables were compared using a student test, and the matched variables were compared using a Wilcoxon test. Qualitative variables were compared using a χ2-test. Intra-class correlation coefficients were calculated to define inter- and intra-observer variability for all measured parameters. A difference was considered statistically significant when the degree of significance was less than or equal to 0.05.

Results

Search results

The search results for “FEMOROACETABULAR IMPINGEMENT” or “FAI” on VuMedi and YouTube were presented. In the YouTube group, given the search’s failure to find 10 videos with these keywords alone, the search was refined using the keywords “FAI” + “HIP ARTHROSCOPY.” The research was statistically more cost-effective on the VuMedi platform versus YouTube, according to the first modality (p < 0.0001) and the second research modality (p = 0.02) (Figure 2).

thumbnail Figure 2

Video search flowchart.

Video features

The average length of the YouTube videos was 503 ± 355.02 s (198–1430). The average number of views for the YouTube videos was 56,114.6 ± 116,832.61 (1149–383,694). The average length of the VuMedi videos was 797.5 ± 522.5 s (185–1927). The average number of views for the VuMedi video was 10,404.7 ± 10,071.2 (1625–37,115). Despite an average of five times more views in the YouTube group and an average duration of 1.5 times longer in the VuMedi group, there was no statistical difference between the two groups regarding the duration (p = 0.16) and the number of views (p = 0.25).

Inter-observer correlation

The intraclass correlation coefficient between observers 1 and 2 for the LAP-VEGaS scores was 0.951 for the YouTube videos and 0.878 for the VuMedi videos. The coefficient of the overall intraclass correlation between observers 1 and 2 for LAP-VEGaS scores was 0.939.

Regarding the Likert scale, the intra-class correlation coefficient between observers 1 and 2 was 0.569 for the YouTube videos and 0.503 for the VuMedi videos. The coefficient of the global intraclass correlation between observers 1 and 2 for the Likert scale was 0.604.

The correlation between the two reviewers appeared to be better when using the LAP-VEGaS score.

Video evaluation

The average LAP-VEGaS scores of the YouTube and VuMedi videos were 8.2 ± 3.47 (3–15) and 11.95 ± 2.64 (6–15), respectively (p < 0.0005). Figures 3 and 4 represent the distribution of the scores for each of the nine items in the evaluated video.

thumbnail Figure 3

Distribution of scores for each of the nine items of the VuMedi videos. Q1-Q9: Items from the assessment tool: 0 – Item not shown; 1 – Item partially presented; and 2 – Widely featured item.
thumbnail Figure 4

Distribution of scores for each of the nine items of the VuMedi videos. Q1–Q9: Items from the assessment tool: 0 – Item not shown; 1 – Item partially presented; and 2 – Widely featured item.

The evaluators indicated that the average time to complete the LAP-VEGaS-FAI score was less than 1 min. In addition, the evaluators were very satisfied with the use of the tool. The LAP-VEGaS video evaluation assigned average scores of 4.45 and 4.35, respectively, to the questions regarding “general satisfaction” and “probability of iterative use” on the 5-point Likert scale (Figure 5).

thumbnail Figure 5

Comparative diagram of the 5-point Likert scale.

Discussion

This study shows a significant difference between the educational value of videos from a general platform (YouTube) against a specialized platform (VuMedi). The average score obtained by the LAP-VEGaS-FAI rating was 8.2 for YouTube, compared to VuMedi’s 11.95. Despite a lower viewership (10,404.7 vs. 56,114.6 average views), the specialized platform is more beneficial to surgical pedagogy.

The advent of information and communication technologies can potentially improve surgical education. We found that video learning is currently a feature of surgical preparation for residents and surgeons. A thriving diffusion presents the opportunity to account for the current flaws in surgical education. However, many ethical entities could be breached while building those surgical videos. Dorfman et al. reported in a systematic review that sharing live videos or patients’ photos in plastic surgery can have significant ethical implications, and particular guidelines should be used [13]. In addition, Turnbull and Emsley reported the ethical and legal considerations in a video recording of ophthalmic surgery and considered that legal systems should be placed to deal with storage issues, consent forms, and particular requests [14].

The LAP-VEGaS-FAI score comes from the LAP-VEGAS score and is conditioned for this study to evaluate videos that treat femoroacetabular impingement [12]. Prior to the establishment of LAP-VEGaS guidelines, there was no accreditation or regulation for the use of medical videos as training resources [15]. The LAP-VEGaS video assessment tool aims to facilitate and standardize the peer review process of submitted videos. However, this score has limitations because this score is generic and must be adapted to fit the pathology of interest. Some original guidelines may not be relevant for certain procedures. In addition, many online videos focus on a specific procedure aspect, displaying the technical nuances or variations of established operations. These videos can be of very good quality while still having a bad evaluation score.

Finally, teamwork and communication remain essential qualities for safe and effective performance. They have not been explored in this video assessment tool, which focuses on the technical skills of the surgeon [16]. In addition, although the use of videos for surgical preparation is customary nowadays, the quality of the available videos is not assured, and no provision was made for evaluating the technical quality of the surgical content [17, 18]. Several studies have addressed this topic and evaluated the quality of YouTube in relation to medical procedures and concluded that this platform offers enormous variability in quality [17–19]. For this reason, some authors suggest that the solution could be creating a ranking system distinguishing between videos and implementing a quality assurance system that is updated regularly [20, 21].

Among the other limitations, each video was only analyzed twice for simplicity. The study by Celentano et al. reported identical score reliability between two or three assessors [12]. On the other hand, the presence of an evaluator who was not specialized in hip arthroscopy could have affected the quality of the analysis. However, as the study assesses compliance with LAP-VEGaS guidelines rather than an analysis of the surgical technique, we judged the level of expertise of the evaluators as a secondary element. Finally, the non-systematic nature of the search was too narrow, which may have excluded other relevant videos in each group.

This study has a strong potential to be one of the few articles in the field of orthopedic surgery to be interested in surgical educational videos. This can lead to a second comparative study that will assess and compare the quality of training between traditional academic teaching and video teaching.

Many surgically treated femoroacetabular impingement videos analyzed in this study did not demonstrate high-quality content when applying the LAP-VEGaS criteria. Using a specialized website makes it possible to obtain better quality and content educational videos. Health professionals need to be aware of this difference when using random surgical videos as a resource for learning. Therefore, it should be in the interest of educational institutions to share optimal and complete surgical videos on those platforms and/ or to create their own platform to improve the quality of the information provided and the overall pedagogical experience.

Conflict of interest

The authors declare that they have no relevant financial or non-financial interest to report.

Funding

This research did not receive any specific funding.

Ethical approval

Ethical approval was not required.

Informed consent

No informed consent was required for this study.

Author’s contribution

A. Ghersi: Writing, J. Mansour: Writing, P. Marchand: Review, A. Al Rubaie: Writing, P. Kouyoumdjian: Conceptualization, R. Coulomb: Reviewing, editing.

Acknowledgments

We would like to thank Algerian Orthopaedics Club of Arthroscopy and Sports Surgery.

References

  1. Ganz R, Bamert P, Hausner P, Isler B, Vrevc F (1991) Cervico-acetabular impingement after femoral neck fracture. Unfallchirurg 94, 172–175. [PubMed] [Google Scholar]
  2. Ganz R, Parvizi J, Beck M, Leunig M, Nötzli H, Siebenrock KA (2003) Femoroacetabular impingement: a cause for osteoarthritis of the hip. Clin Orthop Relat Res 417, 112–120. [Google Scholar]
  3. Röling M, Mathijssen N, Bloem R (2016) Incidence of symptomatic femoroacetabular impingement in the general population: A prospective registration study. J Hip Preserv Surg 3, 203–207. [CrossRef] [PubMed] [Google Scholar]
  4. Griffin D, Dickenson E, O’Donnell J (2016) The Warwick Agreement on femoroacetabular impingement syndrome (FAI syndrome): An international consensus statement. Br J Sports Med 50, 1169–1176. [CrossRef] [PubMed] [Google Scholar]
  5. Loi de santé = 5: Décret no 2016–942 du 8 juillet 2016 relatif à l’organisation du développement professionnel continu des professionnels de santé. 2016–942 juillet, 2016. [Google Scholar]
  6. Choules A (2007) The use of elearning in medical education: a review of the current situation. Postgrad Med J 83, 212–216. [CrossRef] [PubMed] [Google Scholar]
  7. Boutefnouchet T, Laios T (2016) Transfer of arthroscopic skills from computer simulation training to the operating theatre: a review of evidence from two randomised controlled studies. SICOT-J 2, 4. [CrossRef] [EDP Sciences] [PubMed] [Google Scholar]
  8. Pusponegoro H, Soebadi A, Surya R (2015) Web-based versus conventional training for medical students on infant gross motor screening. Telemed J E Health 2, 992–997. [CrossRef] [PubMed] [Google Scholar]
  9. Pan M, Harcharik S, Moskalenko M, Luber A, Bernardo S, Levitt J (2014) Instructional video for teaching venipuncture. Clin Teach 11, 436–441. [CrossRef] [PubMed] [Google Scholar]
  10. Azer S, Algrain H, AlKhelaif R, AlEshaiwi SM (2013) Evaluation of the educational value of YouTube videos about physical examination of the cardiovascular and respiratory systems. J Med Internet Res 15, e241. [CrossRef] [PubMed] [Google Scholar]
  11. Boutefnouchet T, Budair B (2017) The perceptions and attitudes of medical students towards trauma and orthopaedic teaching: a cross-sectional study. SICOT-J. 3, 8. [CrossRef] [EDP Sciences] [PubMed] [Google Scholar]
  12. Celentano V, Smart N, McGrath J (2018) LAP-VEGaS practice guidelines for reporting of educational videos in laparoscopic surgery: A joint trainers and trainees consensus statement. Ann Surg 268, 920–926. [CrossRef] [PubMed] [Google Scholar]
  13. Dorfman R, Vaca E, Fine N, Schierle C (2017) The ethics of sharing plastic surgery videos on social media: Systematic literature review, ethical analysis, and proposed guidelines. Plast Reconstr Surg 140, 825–836. [CrossRef] [PubMed] [Google Scholar]
  14. Turnbull A, Emsley E (2014) Video recording of ophthalmic surgery – Ethical and legal considerations. Surv Ophthalmol 59, 553–558. [CrossRef] [PubMed] [Google Scholar]
  15. Langerman A, Grantcharov T (2017) Are we ready for our close-up? Why and how we must embrace video in the OR. Ann Surg 266, 934–936. [CrossRef] [PubMed] [Google Scholar]
  16. Sgarbura O, Vasilescu C (2010) The decisive role of the patient-side surgeon in robotic surgery. Surg Endosc 24, 3149–3155. [CrossRef] [PubMed] [Google Scholar]
  17. Luu N, Yver C, Douglas J, Tasche TP, Rajasekaran K (2021) Assessment of YouTube as an educational tool in teaching key indicator cases in otolaryngology during the COVID-19 pandemic and beyond: Neck dissection. J Surg Educ 78, 214–231. [CrossRef] [PubMed] [Google Scholar]
  18. Mota P, Carvalho N, Carvalho-Dias E, João Costa M, Correia-Pinto J, Lima E (2018) Video-based surgical learning: Improving trainee education and preparation for surgery. J Surg Educ 75, 828–835. [CrossRef] [PubMed] [Google Scholar]
  19. Pitcher G, Newton D, Amendola M (2017) Common femoral artery access on YouTube: What practices are being shown and who is delivering the message? J Surg Educ 74, 455–458. [CrossRef] [PubMed] [Google Scholar]
  20. Rapp A, Healy M, Charlton M, Keith J, Rosenbaum M, Kapadia M (2016) YouTube is the most frequently used educational video source for surgical preparation. J Surg Educ 73, 1072–1076. [CrossRef] [PubMed] [Google Scholar]
  21. Chen H, Hu Z, Zheng X (2013) Effectiveness of YouTube as a source of medical information on heart transplantation. Interact J Med Res 2, 28. [Google Scholar]

Cite this article as: Ghersi A, Mansour J, Marchand P, Al Rubaie A, Kouyoumdjian P & Coulomb R (2022) Surgical videos on the internet: Is this a reliable pedagogical tool in residency training? SICOT-J 8, 39

All Tables

Table 1

LAP-VEGaS Video Assessment Tool (original in bold)/LAP-VEGaS-FAI (modified in italics).

In the text
Table 2

Five-point Likert scale on single-peer/trainer video recommendations and the acceptance of the video for publication or presentation on the podium.

In the text

All Figures

thumbnail Figure 1

Graded surgical steps. a: Locating the medial plica, b: Acetabular step – exposure of the acetabular clamp, c: Labrum suture and “suction cup effect”, d: Femoral step – exposure of the femoral cam, e: Femoral step – control of the femoral resection, f: Locating the vessel, g: Preoperative imaging of the forceps, h: Checking clamp resection, i: Preoperative imaging of the cam.
In the text
thumbnail Figure 2

Video search flowchart.
In the text
thumbnail Figure 3

Distribution of scores for each of the nine items of the VuMedi videos. Q1-Q9: Items from the assessment tool: 0 – Item not shown; 1 – Item partially presented; and 2 – Widely featured item.
In the text
thumbnail Figure 4

Distribution of scores for each of the nine items of the VuMedi videos. Q1–Q9: Items from the assessment tool: 0 – Item not shown; 1 – Item partially presented; and 2 – Widely featured item.
In the text
thumbnail Figure 5

Comparative diagram of the 5-point Likert scale.
In the text

Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.

Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.

Initial download of the metrics may take a while.