Introduction
Rhinosinusitis is a common health problem that is associated with a significant financial burden for the National Health Service. It is defined as an inflammation process within the mucosa of the nose and paranasal sinuses. Rhinosinusitis is characterised by two or more symptoms; one of which must be nasal obstruction or discharge (anterior or posterior nasal drip), with the others being facial pain or loss of smell.Reference Fokkens, Lund, Mullol, Bachert, Alobid and Baroody1 Rhinosinusitis is one of the most common disorders encountered by general practitioners and otorhinolaryngologists, with the chronic form of the disease affecting between 5 and 15 per cent of the population.Reference Fokkens, Lund, Mullol, Bachert, Alobid and Baroody1 The prevalence of sinusitis (146 per 1000 individuals) has been reported to exceed that of any other chronic condition.Reference Fokkens, Lund, Mullol, Bachert, Alobid and Baroody1 Quality of life scores for chronic rhinosinusitis patients are reported to be lower than the scores for those suffering from chronic obstructive pulmonary disease, congestive heart failure, back pain or even angina.Reference Suh, Cohen and Palmer2
Traditionally, patients received health information and advice via their general practitioner. However, with the development of the internet over recent decades, this dynamic has changed. It has been reported that a third of patients use the internet as a source of medical information,Reference Murray, Lo, Pollack, Donelan, Catania and White3 with 11 per cent of patients researching their symptoms prior to an out-patient appointment.Reference Moran and Oliver4
Video provides an excellent medium for medical education, both for clinicians and for the public. The website YouTube (Google, Mountain View, California, USA), which was launched in June 2005 as an internet-based repository of user-generated content,Reference Clifton and Mann5 has emerged as one of the largest sources of freely accessible content. In addition to home videos, music and television clips, YouTube is increasingly being used as a source of educational material, and now includes videos from prestigious academic institutions such as Cambridge and Stanford universities, as well as numerous uploads from individual medical professionals and health information websites (e.g. www.patient.co.uk).Reference Hughes and Quraishi6 However, as with many internet sites, the content on YouTube is not peer reviewed, it has no source citations, and it is often difficult to verify the source or credibility of the material posted on the site. This can lead to potentially misleading or frankly dangerous advice.Reference Mishoe7, Reference Sethuram and Weerakkody8
YouTube has been evaluated as a source of information on various topics, including prostate cancer,Reference Steinberg, Wason, Stern, Deters, Kowal and Seigne9 flu pandemicsReference Pandey, Patni, Singh, Sood and Singh10 and human papillomavirus immunisation.Reference Ache and Wallace11 However, within the literature, there have been no such studies in relation to otorhinolaryngological conditions. The current study was conducted to evaluate and analyse the quality of rhinosinusitis videos, with the aim of deciding whether YouTube represented a valuable tool in patient education within this area.
Materials and methods
The aims of this study were threefold. Firstly, we attempted to ascertain the general nature of videos uploaded onto YouTube on the topic of rhinosinusitis with analysis of the information made available for patients. Secondly, we aimed to grade the videos in an attempt to evaluate the quality of the available content. Thirdly, we sought to make a recommendation as to the overall value of YouTube as a resource for patient education in relation to rhinosinusitis.
The YouTube website (www.youtube.com) was searched for the term ‘sinusitis’ on 17 and 18 August 2012, with the first 100 videos selected for inclusion into the study. All videos uploaded since the start of YouTube (2005) were eligible for inclusion. Non-English language videos were excluded.
All videos were viewed by the first author (TCB), who assessed their content and documented the following parameters: length of video; number of views; number of likes or dislikes (an indication of whether users prefer certain videos); uploaded source (independent user, medical professional, health information website, news site or drug company); symptoms described; and the various management options mentioned, including medical and surgical, as well as other complementary forms of treatment with no clear evidence base (e.g. acupuncture, massage, vitamin supplementation and herbal remedies). The content of the videos was also graded according to the ability of the videos to inform the lay person on the general topic, symptoms and management options of rhinosinusitis. The videos were categorised as: ‘useful’, ‘not useful’, ‘slightly misleading’, ‘completely misleading’ or ‘useful but only for medical personnel’. A list of the top 10 videos was compiled based on those videos that scored the highest for the number of mentions of both key symptoms, and European position paper on rhinosinusitis and nasal polyps management guidelines (2012).Reference Fokkens, Lund, Mullol, Bachert, Alobid and Baroody1
To ensure quality control, the second author (JHB) separately assessed the videos for all the parameters listed, and provided an overall grade based on the ability of the videos to inform the lay person about rhinosinusitis. The two classifications of video results were compared, revealing an inter-observer correlation rate of over 95 per cent. Where parameter grading differed significantly, discussion was undertaken to decide on a mutually agreed outcome.
Data were collated and analysed using Microsoft Excel (2009) (Redmond, Washington, USA). Statistical analyses were performed with the Statistical Package for the Social Sciences (version 20) software (IBM, Armonk, New York, USA), using the chi-square and Mann–Whitney U tests (statistical significance was defined as p < 0.05).
Results
The study included 100 videos, comprising a total of 9 hours and 29 minutes. The majority of the videos were uploaded by individual users (48), with the remainder uploaded by medical professionals (22), and from health information websites (14), news channels (14) and drug companies (2). The total number of views for all videos was 2 281 225, with a mean of 2281 views per video clip. Figure 1 shows the graded content for all videos studied.
Grading of content for all videos studied.
The analysis of video demographics, symptoms and management options in relation to content grading is shown in Table I. Videos deemed to be ‘useful but only for medical personnel’ received the highest mean number of ‘likes’ from viewers at 45.3. Those deemed to be ‘completely misleading’ received a mean of 10.6 ‘likes’ and 1.6 ‘dislikes’. Nasal discharge and nasal obstruction appeared in 28 per cent and 33 per cent of all videos respectively, compared with 90 per cent of the videos deemed to be in the top 10 per cent. ‘Completely misleading’ videos were statistically more likely to suggest complementary medicines (48 per cent) compared with those that contained ‘useful’ information (7 per cent, p < 0.001). Antibiotics, nasal irrigation, steroids and surgery appeared in 54 per cent of ‘useful’ videos, compared with 6 per cent of misleading videos (p < 0.001); however, these treatments were discussed in 95 per cent of videos judged to be in the top 10 per cent (p < 0.001). The top graded videos had a mean number of 3630 views, compared with a mean of 8091 views for ‘completely misleading’ videos (p = 0.531). The top graded videos were also ‘liked’ less (mean of 6.6) than ‘completely misleading’ videos (mean of 10.6, p = 0.491).
Analysis of videos in relation to content grading
Y = yes; N = no
The findings for the analysis of video demographics, symptoms and management options in relation to upload source are shown in Table II. Videos uploaded by independent users mentioned key symptoms (nasal discharge, obstruction, change in smell and facial pain) in 11 per cent of the videos, compared with 43 per cent of those uploaded by medical professionals (p = 0.01). Independent users highlighted the European position paper management guidelines in 9 per cent of the videos, compared with 57 per cent of those uploaded by medical professionals (p < 0.001). Complementary forms of treatment with no clear evidence base were suggested in 29 per cent of videos uploaded by independent users, compared with 9 per cent of those uploaded by medical professionals (p = 0.063).
Analysis of videos in relation to upload source
Y = yes; N = no
Discussion
YouTube has a large number of medically orientated videos that are available to anyone with access to the internet. Since the advent of YouTube, over 2 million viewers have accessed the top 100 videos on sinusitis alone. Within this study, 45 per cent of videos were deemed to provide some useful information. However, the remaining 55 per cent contained little or no useful facts, with 27 per cent containing potentially misleading or even dangerous information. A large number of patients are likely to access the internet in search of health-related advice and information, with many likely to use the resources available on YouTube. Within the context of this study, YouTube was found to provide a limited resource on rhinosinusitis education for the lay person: only 10 per cent of the videos on this topic were fit for this purpose. The results presented here suggest that the majority of users seem to access the videos with poorer quality content rather than those graded as more ‘useful’.
Patients are more likely now than in the past to access internet-based health resources.Reference Murray, Lo, Pollack, Donelan, Catania and White3, Reference Moran and Oliver4 However, patients experience difficulty in deciding what information is accurate or reliable within the vast resources provided to them through the internet.Reference Smith, Pate, Guss, Lee, Chiodo and Bluman12 Interestingly, within this study, patients seemed to have accessed the top rated videos significantly less than those deemed to contain little or no useful information, or those comprising completely misleading information. The top rated videos were also liked less compared with those deemed to be completely misleading. Despite the lack of appreciation and views from users, the top 10 rated videos highlighted key symptoms and treatments in 50–100 per cent of cases, compared with only 4–19 per cent of completely misleading videos. This indicates that patients find it difficult to select appropriate videos with quality information. This may be because the higher quality videos were much longer (mean of 14 minutes and 47 seconds) than those that were not so informative (mean of 4 minutes and 37 seconds), potentially putting viewers off.
When examining videos in relation to their upload source (Table II), the majority of poorer videos (i.e. those that do not mention common symptoms and evidence-based treatments for both acute and chronic rhinosinusitis) were uploaded by individual users. Videos deemed to provide more accurate information were uploaded by medical professionals or from health information websites. For example, 90 per cent of the top 10 videos were uploaded by medical professionals or from health information websites, whereas 43 per cent of the content uploaded by individual users was found to be completely misleading. One particularly worrying video, uploaded by an individual user, showed a self-demonstration of how to place a needle through the hard palate, adjacent to an implanted tooth, into the maxillary sinus.13 The individual then proceeded to connect the needle to an irrigation device to flush out the sinus. Other videos contained personal accounts of herbal treatments and ‘scaremongering’ reports on the use of antibiotics. In addition, a number of videos highlighted the use of a technique termed ‘craniofacial relief’, whereby a balloon is placed into the nasal cavity by a chiropractor and inflated at speed, out-fracturing the inferior turbinate as a result.
A number of studies have examined YouTube as a source of health information for the lay general public, but no such studies have been reported in relation to otorhinolaryngological conditions. There is mixed opinion in the literature on the educational value of YouTube with regard to medical conditions and the ability of YouTube videos to educate patients. Some studies have concluded that YouTube is of real benefitReference Pandey, Patni, Singh, Sood and Singh10 and others have questioned its usefulness.Reference Steinberg, Wason, Stern, Deters, Kowal and Seigne9, Reference Briones, Nan, Madden and Waks14–Reference Pant, Deshmukh, Murugiah, Kumar, Sachdeva and Mehta16 A study conducted by Steinberg et al. (2010) revealed that the majority of videos (73 per cent) on YouTube relating to prostate cancer were poor in both quality and content, and that YouTube was an inadequate source of prostate cancer information for patients.Reference Steinberg, Wason, Stern, Deters, Kowal and Seigne9 In a similar study by Pant et al. (2012), which evaluated myocardial infarction information, it was again concluded that only a minority of videos (6 per cent) provided unbiased opinions on all relevant aspects of that disease.Reference Pant, Deshmukh, Murugiah, Kumar, Sachdeva and Mehta16 However, in a study by Pandey et al. (2010), which assessed YouTube as a source of information on the H1N1 influenza pandemic, 71 per cent of videos were found to contain useful information, with 23 per cent providing misleading facts.Reference Pandey, Patni, Singh, Sood and Singh10 Our study results lie somewhere between the other studies, with 42 per cent of all videos providing some useful and accurate information on the topic of rhinosinusitis. However, the majority of videos (55 per cent) were found to contain no useful information or a varying amount of misleading information, suggesting that YouTube is a far from ideal resource for those wishing to learn more about this condition.
• YouTube is one of the largest sources of freely accessible video content
• Over 2 million viewers have accessed the top 100 YouTube videos on sinusitis
• Of these videos, 27 per cent contained potentially misleading or dangerous information
• YouTube does not appear to constitute a reliable resource for accurate, up to date medical information on rhinosinusitis
• The situation could improve if there was a mechanism that directed lay people to verifiable and credible resources
Nevertheless, YouTube could constitute a very useful resource for information if a mechanism existed whereby lay people were directed to verifiable and credible sources, and by improving the usability of online healthcare information. This could be facilitated through various measures including: emphasising to patients the pitfalls of misleading and potentially dangerous information that is freely available on the internet; providing patients with basic guidelines for content evaluation, with a pre-verified list of reputable sources; improving the awareness of doctors regarding the availability of quality online content in order to better guide patients; encouraging both patients and doctors to highlight inaccurate or misleading videos to YouTube management for removal; and finally, and perhaps most importantly, encouraging doctors to upload their own videos, enabling quality information to be freely available online.
Conclusion
YouTube has emerged as one of the largest sources of freely accessible video content, but as things currently stand, YouTube does not appear to constitute a reliable resource for accurate and up to date medical information relating to rhinosinusitis. Patients should be aware of the source and intent of the material, and be prepared to filter the content accordingly. In particular, patients should be wary of videos uploaded by individual users, as these can include potentially inaccurate or, in extreme cases, dangerous advice. Nevertheless, YouTube could constitute a very useful resource for information if patients were better educated on the location and availability of quality online content, and if doctors took a more active role in uploading reputable videos and highlighting inappropriate videos for removal.
