- Research article
- Open Access
Assessment of oral health conditions presented in photographs - is there a difference between dentists and non-dental professional caregivers?
BMC Oral Health volume 20, Article number: 188 (2020)
Photographs can help non-dental professional caregivers to identify problems when inspecting the mouth of care-dependent older individuals. This study evaluated whether the assessment of oral health-related conditions presented in photographs differed between dentists and non-dental professional caregivers.
Materials and methods
One-hundred-and-seventy-nine photographs were taken from long-term care facility residents and from patients at the Department of Dentistry of a University Hospital. The following oral health aspects were depicted: denture hygiene, oral hygiene, teeth, gums, tongue and palate/lips/cheeks. Collection continued until for each oral health aspect a pool of photographs was available that showed conditions from perfect health and hygiene to severe problems. A segmented Visual Analogue Scale was applied to assess the conditions presented in the photographs. Each photograph was assessed by each participant of this study. The benchmark was established by three dentists with academic-clinical expertise in gerodontology, special needs dentistry and periodontology. For each photograph, they provided a collective score after reaching consensus. Photographs were assessed individually by 32 general dentists and by 164 non-dental professional caregivers. Linear mixed effects models and generalized linear mixed effects models were fitted and mean squared errors were computed to quantify differences between both groups.
For the different oral health aspects, absolute distances from the benchmark scores were 1.13 (95%CI:1.03–1.23) to 1.51 (95%CI:1.39–1.65) times higher for the caregivers than for the dentists. The odds to overestimate the condition were higher for the caregivers than the dentists for oral hygiene (OR = 0.72, 95%CI = 0.62–0.84) and teeth (OR = 0.74; 95%CI = 0.61–0.88). The odds to underestimate the condition were higher for the caregivers than the dentists for gums (OR = 1.39; 95%CI:1.22–1.59) and palate/lips/cheeks (OR = 1.22; 95%CI = 1.07–1.40). Over all assessments, the variance in caregiver scores was 1.9 (95%CI:1.62–2.23) times higher than that for the dentists.
Small but significant differences were found between dentists and non-dental professional caregivers assessing oral health-related conditions presented in photographs. When photographs are used to aid non-dental professional caregivers with the oral health assessment, these visualizations should be complemented with comments to facilitate accurate interpretation.
International research shows that oral health in care-dependent individuals is poor [1,2,3]. This is confirmed by the ‘World Report on Ageing and Health’, which states that “Oral health is a crucial but often neglected area of healthy ageing” . The challenges of oral disease are considerable due to associations with impaired oral functioning , aspects of general health [6,7,8], a number of systemic diseases [9,10,11] and quality of life [12,13,14,15]. Daily oral care and regular professional check-ups are the cornerstones of good oral health. They both are impeded in care-dependent individuals due to physical and cognitive restraints and insufficient availability or accessibility of care . An oral health assessment by non-dental professional caregivers is suggested as a supplementary procedure to detect oral-health related care- and treatment needs . A variety of assessment instruments for caregivers are available such as the Oral Health Assessment Tool (OHAT), the Revised Oral Assessment Guide (ROAG) or the oral health-related section of the Minimum Data Set/interRAI suite of instruments (MDS/interRAI). The instruments above expect caregivers to assess different oral health aspects on a nominal scale, in order to determine whether assistance with daily oral care and/or referral to an oral health professional is required. However, studies on concurrent validity that compare professional oral examination data with non-dental caregiver registrations show shortcomings in the latter in correctly identifying oral care needs [16,17,18,19].
As pictures do support, reinforce and illustrate written text , oral photographs could be used to visualize item categories and illustrate training materials. A review on the role of pictures in improving health communication concluded that visualizations can support comprehension by providing a context for organizing text information. Pictures are particularly helpful when content is complex and when prior knowledge of individuals is low . Hence, clinical photographs may help non-dental professional caregivers to correctly identify oral care needs. However, expertise differences with regard to the interpretation of medical visualizations have been described in literature . This raises the question of whether non-dental professional caregivers see what dentists see. Or, in other words, whether the interpretation of clinical photographs significantly differs between both groups.
To our knowledge the present study is the first to explore the presence of differences between dentists and non-dental professional caregivers assessing oral health-related conditions presented in photographs. A pool of clinical photographs showing different oral health aspects was used to test the following hypotheses:
Distance from a benchmark assessment is higher for professional non-dental caregivers than for dentists.
Direction of the distance from the benchmark depends on the oral health aspect that is shown.
Variance around the benchmark assessment is higher for professional non-dental caregivers than for dentists.
Materials and methods
Background of the research project
The present study is part of a larger research project that aims to develop an optimized photograph-supported oral health-related section for the interRAI suite of instruments (ohr-interRAI). The interRAI suite is used internationally and consists of tools for comprehensive assessment of conditions and needs of care-dependent individuals. Different versions are available for various sectors, such as home care, nursing homes, hospitals or mental health care settings .
Collection of a pool of clinical photographs
Photographs were taken from consenting long-term care facility residents and from patients at the Department of Dentistry of the University Hospitals KU Leuven, Belgium. Equipment for professional digital dental photography was used: Canon EOS5500 camera, EF-S60mmF2.8USM Macro Objective Lens and a Macro Ring Lite MR-14EX. Lip and cheek retractors as well as oral mirrors were used.
High-definition close-up photographs were taken of the following oral health aspects: denture hygiene, oral hygiene, teeth, gums, tongue and palate/lips/cheeks. The dentist (SKH) who took the photographs used the criteria provided in Table 1 to ensure that for each oral health aspect a balanced number of photographs was included showing ‘acceptable’, ‘not acceptable moderate’ and ‘not acceptable marked’ conditions. In addition, each condition of the different oral health aspects included multiple variations such as full and partial dentures, anterior and posterior teeth as well as buccal and palatal/lingual views. Implant-supported structures were depicted and dorsal, lateral and ventral tongue photographs were taken.
The final pool consisted of 179 clinical photographs: denture hygiene (30), oral hygiene (30), teeth (20), gums (35), tongue (30) and palate/lips/cheeks (34) including a variety of conditions from perfect health and hygiene to severe problems.
Assessment of the photographs
Each of the 179 photographs was assessed by each participant of this study. Photographs were presented per oral-health aspect in six blocks in randomized order on an individual PC screen that was placed in front of each participant. A three-segmented 150 mm Visual Analogue Scale (VAS), (100 mm two-segmented for teeth) was used for the assessment. Participants were instructed to apply the VAS as follows: 1. First select a segment of the scale. The definition of the segment should most suitably describe the appearance of denture or tissue shown on the photograph (Table 1). 2. Then indicate a position on the VAS that is located within the range of the chosen segment. Zero on the VAS represents a perfectly healthy or clean condition, while the right end of the scale indicates severe problems. An example of a photograph on denture hygiene and the scale that was applied is shown in Fig. 1.
The benchmark was established by three dentists with expertise in gerodontology, special needs dentistry and periodontology, affiliated with the Dentistry Department of the University Hospitals, KU Leuven. For each photograph they provided a collective VAS score after reaching consensus. The photographs were assessed individually by dentists and by non-dental professional caregivers in separate sessions. The sessions were organized during certified continuous education activities that were in no way linked to the assessment of the photographs. Participants did not receive any training related to appearance, diagnosis or interpretation of oral health-related pathology.
Sample and recruitment of dentists and non-dental professional caregivers
Previous studies with a similar aim and design were not available to estimate the minimum sample size. The current research focused on large effects as literature reports substantial problems of professional non-dental caregivers to correctly identify oral treatment need in care clients [18, 19, 24]. Defining a standard α-level of 0.05 and a recommended power of 0.8 to compare mean differences, a minimum of 26 participants per group were required to detect a large effect (0.8) .
To recruit dentists, an invitation was sent to all attendees of previous permanent education activities organized by the Department of Oral Health Sciences of the University. To recruit the caregivers, care facilities, high-schools for nursing education, umbrella organizations and professional associations for caregivers in Flanders, Belgium were contacted to circulate the invitation among employees or members. Professional non-dental caregivers having direct contact with clients in home- or long-term care were invited to participate (e.g., nurses, auxiliary nurses, speech therapists, occupational therapists, dietitians or physicians). Participation was allowed to all dentists and non-dental professional caregivers who responded to the invitation.
The absolute value of the distance from the benchmark score was calculated for dentists and for non-dental caregivers for each photograph. Due to skewness of the distribution, logarithm of the values was used. The direction of distance from the benchmark indicated whether the score assigned to a photograph was lower, equal or higher than the benchmark score.
To quantify differences between caregivers and dentists with regard to the distance from the benchmark as well as the direction of this difference, a linear mixed effects model and a generalized linear mixed effects model were fitted, respectively. Type of assessor (caregiver, dentist) and oral health aspect (denture hygiene, oral hygiene, teeth, gums, tongue, palate/lips/cheeks) were added to the models as random effects.
Mean squared errors were computed to compare the scores provided by non-dental caregivers and dentists with regard to the variance around the benchmark for each oral health aspect. Statistical programs R (version 3.6) and SAS (version 9.4) were used.
Characteristics of dentists and caregivers
Thirty-two dentists and 164 non-dental professional caregivers participated in this study. All participants were Caucasian. Table 2 shows that most participants were female. In the caregiver group the gender imbalance was more pronounced with 94.5% female participants. The caregiver group was also relatively younger than the dentist group. Most frequent occupations among caregivers were nurses and nurse aids with 57.9 and 23.8%, respectively. All dentists were primary dental care providers with 46.9% having an additional training in endodontology or prosthetic dentistry.
Distance from the benchmark
Figure 2 illustrates the distance from the benchmark for dentists and caregivers, for each oral health aspect, respectively. In both groups, the majority of the assessments peak around the value zero, indicating no or little distance from the benchmark. However, in each of the six graphs, the curve of the dentists exceeds the curve of the caregivers around the zero value. This implies that the distance from the benchmark tends to be lower for dentists. Accordingly, over all photographs the mean absolute distance from the benchmark score on the VAS is 20.1 for the dentists and 27.7 for the caregivers
Table 3 presents the results of the linear mixed effects model. It confirms that for all oral health aspects the distances from the benchmark scores are 1.13–1.51 times higher for the caregivers than for the dentists.
Direction of the distance from the benchmark
With regard to the direction of the distance, a lower VAS score than the benchmark implies that the condition was underestimated by the participant. A higher score than the benchmark implies that the condition was overestimated. Table 4 provides an overview over all photographs for caregivers and dentists.
The results of the generalized linear mixed effects model allow a more detailed view. Table 5 illustrates the odds ratios for caregivers versus dentists to assign a lower score than the benchmark. Odds ratios are < 1 for aspects of hygiene and teeth, but > 1 for aspects of the oral soft tissues. This implies that compared to the dentists, caregivers tended to overestimate aspects of hygiene and condition of the teeth, but underestimated aspects of the soft tissues.
Variance around the benchmark
Considering all oral health aspects, the variance around the benchmark scores was significantly higher for the caregivers than for the dentists. The mean squared error was 1.9 times higher for the caregivers than for the dentists (95% confidence interval: 1.62–2.23). When mean squared errors were computed for each oral health aspect separately, no differences were found between the two groups.
Interpretation and relevance of the study results
To our knowledge this is the first study that evaluated whether the assessment of oral health-related conditions presented in clinical photographs differed between dentists and non-dental professional caregivers. Results indicate small but significant differences. A first graphical analysis illustrated that in both groups the majority of the assessments peaked around the benchmark scores. Graphs of dentists and caregivers appeared approximately congruent. This is in line with two studies from the field of dermatology showing high accuracy of nurses to classify skin damage shown in photographs when compared to dermatologists [26, 27].
A more detailed evaluation of the data revealed small but significant differences between both groups, with caregivers having a higher distance from the benchmark than dentists. In addition, the variance in scores provided by the caregivers was higher than the variance in scores provided by the dentists. This confirms the findings published by Yazdanyar et al. (2013) who compared general practitioners and dermatologists with regard to their congruence with a benchmark in identifying acne morphology using photographs and a short description. In all cases, responses of the dermatologists were more congruent with the benchmark and variation was lower compared to the general practitioners . A meta-analysis on differences in the comprehension of visualizations found higher performance accuracy and shorter reaction times for experts than for non-experts .
With regard to the direction of the distance from the benchmark, differences between dentists and caregivers depended on the type of oral health aspect. For photographs showing aspects of oral hygiene and teeth, the non-dental professional caregivers tended to overestimate the condition compared to the dentists. In contrast, for photographs showing gums and palate/lips/cheeks the odds to underestimate the condition were higher for the caregivers than for the dentists. To suggest a possible explanation, age-related physiological changes such as discoloration or tooth wear might be misinterpreted by non-dental professional caregivers. Furthermore, dental plaque and tooth decay may look impressive to non-dental caregivers, while dentists know that these conditions often can be treated easily. On the other hand, caregivers are maybe less aware than dentists that oral soft tissue lesions can involve harmful malignities.
Considering the supporting role of pictures in health communication, our findings confirm that complex visualizations require instruction and guidance to ensure a correct interpretation . Hence, when photographs are used to aid non-dental caregivers with the oral health assessment, these visualizations should be complemented with comments to facilitate accurate interpretation. Results of the current study indicate that for aspects of hygiene and teeth, instructions are needed to differentiate between pathology and normal, age-related phenomena. It should further be emphasized that soft tissue lesions require close attention.
With regard to the development of the optimized interRAI oral health-related section, the benefits of including visualizations might reach beyond the correct identification of care needs. Focus group discussions with caregivers revealed that oral health has low priority in the care environment and that the oral health-related section of the interRAI is completed only superficially without inspection of the mouth . As human beings are attracted to visual stimuli , photographs have the potential to enhance attention and raise awareness for the oral health assessment. Inclusion of various views of the different oral health aspects - such as dorsal, lateral and ventral tongue photographs - might motivate a more thorough assessment of the mouth. In this context it needs to be mentioned that oral health is often neglected in current training programs for non-dental professional caregivers. A study showed that among high schools in Norway providing basic education for auxiliary nurses, solely 49% offered three or more hours of teaching on oral health . In a French study with professional caregivers only 21% reported previous theoretical training on oral disorders . More emphasis on the topic of oral health during professional training of non-dental caregivers may raise the awareness and improve the ability to correctly recognize pathology.
Study limitations and further research
Correct understanding of the terminology used to describe the different segments the VAS can be questioned for certain participants such as care aides who often receive only limited professional training. Accordingly, involvement of non-dental professional caregivers in development and pilot-testing of the scale should have been considered. Although the minimum sample size was exceeded for both groups, the number of participants was markedly unbalanced. The sample reflected actual differences between dentists and non-dental professional caregivers with regard to gender and age, but was not representative for the population of both groups. Further research – preferably on an international scale - needs to clarify whether findings are generalizable. In addition, the impact of participant demographics and oral health-related training, knowledge and awareness should be evaluated.
Small but significant differences were found between dentists and non-dental caregivers regarding the assessment of oral health-related conditions presented in clinical photographs. When photographs are used to aid non-dental professional caregivers with the oral health assessment, these visualizations should be complemented with comments to facilitate accurate interpretation.
Availability of data and materials
All data analyzed during this study are included in this published article [and its supplementary information files].
De Visschere L, Janssens B, Reu G, Duyck J, Vanobbergen J. An oral health survey of vulnerable older people in Belgium. Clin Oral Investig. 2016;20:1903–12Available from:. https://doi.org/10.1007/s00784-015-1652-8.
Chen X, Clark JJJ, Naorungroj S. Oral health in nursing home residents with different cognitive statuses. Gerodontology. 2013;30(1):49–60 [cited 2014 Oct 21]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22364512.
Panchbhai A. Oral health care needs in the dependant elderly in India. Indian J Palliat Care. 2012;18(1):19 Available from: http://www.jpalliativecare.com/text.asp?2012/18/1/19/97344.
World Health Organization. World report on ageing and health; 2015. Available from: www.who.int/.
Kossioni AE, Hajto-Bryk J, Maggi S, McKenna G, Petrovic M, Roller-Wirnberger RE, et al. An expert opinion from the European College of Gerodontology and the European geriatric medicine society: European policy recommendations on Oral health in older adults. J Am Geriatr Soc. 2017Available from:. https://doi.org/10.1111/jgs.15191.
Moriya S, Tei K, Nagatsu I, Muramatsu M, Inoue N, Miura H. Perceived chewing ability and need for long-term care in the elderly: a 5-year follow-up study. J Oral Rehabil. 2012; [cited 2012 May 17]; Available from: http://www.ncbi.nlm.nih.gov/pubmed/22506492.
Moriya S, Notani K, Miura H, Inoue N. Relationship between masticatory ability and physical performance in community-dwelling edentulous older adults wearing complete dentures. Gerodontology. 2014;31(4):251–9Available from:. https://doi.org/10.1111/ger.12029.
Teixeira FB, Pereira Fernandes LDM, Noronha PAT, dos Santos MAR, Gomes-Leal W, Ferraz Maia CDS, et al. Masticatory deficiency as a risk factor for cognitive dysfunction. Int J Med Sci. 2014;11(2):209–14 [cited 2014 May 4]. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3894406&tool=pmcentrez&rendertype=abstract.
Graziani F, Gennai S, Solini A, Petrini M. A systematic review and meta-analysis of epidemiologic observational evidence on the effect of periodontitis on diabetes an update of the EFP-AAP review. J Clin Periodontol. 2018;45(2):167–87.
Dietrich T, Webb I, Stenhouse L, Pattni A, Ready D, Wanyonyi KL, et al. Evidence summary: the relationship between oral and cardiovascular disease. Br Dent J. 2017;222(5):381–5Available from:. https://doi.org/10.1038/sj.bdj.2017.224.
Teeuw WJ, Slot DE, Susanto H, Gerdes VEA, Abbas F, D’Aiuto F, et al. Treatment of periodontitis improves the atherosclerotic profile: a systematic review and meta-analysis. J Clin Periodontol. 2014;41(1):70–9 [cited 2014 Jun 27]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24111886.
Kimura Y, Wada T, Ishine M, Ishimoto Y, Kasahara Y, Hirosaki M, et al. Community-dwelling elderly with chewing difficulties are more disabled, depressed and have lower quality of life scores. Geriatr Gerontol Int. 2009;9(1):102–4 [cited 2013 Oct 18]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/19260989.
Haag DG, Peres KG, Balasubramanian M, Brennan DS. Oral conditions and health-related quality of life: a systematic review. J Dent Res. 2017;96(8):864–74 Available from: http://www.ncbi.nlm.nih.gov/pubmed/28581891.
Masood M, Newton T, Bakri NN, Khalid T, Masood Y. The relationship between oral health and oral health related quality of life among elderly people in United Kingdom. J Dent. 2017;56:78–83Available from:. https://doi.org/10.1016/j.jdent.2016.11.002.
Rouxel P, Tsakos G, Chandola T, Watt RG. Oral health-a neglected aspect of subjective well-being in later life. J Gerontol B Psychol Sci Soc Sci. 2018;73(3):382–6 Available from: http://www.ncbi.nlm.nih.gov/pubmed/26970523.
Chalmers JM, King PL, Spencer AJ, Wright FAC, Carter KD. The oral health assessment tool--validity and reliability. Aust Dent J. 2005;50(3):191–9.
Ribeiro MTF, Ferreira RC, Vargas AMD, Ferreira e Ferreira E. Validity and reproducibility of the revised oral assessment guide applied by community health workers. Gerodontology. 2014;31(2):101–10 Available from: http://www.ncbi.nlm.nih.gov/pubmed/23294324.
Nordenram G, Ljunggren G. Oral status, cognitive and functional capacity versus oral treatment need in nursing home residents: a comparison between assessments by dental and ward staff. Oral Dis. 2002;8(6):296–302.
Hoben M, Poss JW, Norton PG, Estabrooks CA. Oral/dental items in the resident assessment instrument – minimum data set 2.0 lack validity: results of a retrospective, longitudinal validation study. Popul Health Metr. 2016;14(1):36 Available from: http://pophealthmetrics.biomedcentral.com/articles/10.1186/s12963-016-0108-y.
Arbuckle K. The language of pictures : visual literacy and print materials for adult basic education and training (ABET) the language of pictures : visual literacy and print materials for adult basic education and training (ABET). Lang Matters. 2004;35(2):445–58.
Houts PS, Doak CC, Doak LG, Loscalzo MJ. The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence. Patient Educ Couns. 2006;61(2):173–90 Available from: https://linkinghub.elsevier.com/retrieve/pii/S0738399105001461.
Gegenfurtner A, Siewiorek A, Lehtinen E, Säljö R. Assessing the quality of expertise differences in the comprehension of medical visualizations. Vocat Learn. 2013;6(1):37–54.
InterRAI. Use of interRAI Instruments - Worldwide. 2020. [cited 2020 Apr 15]. Available from: https://www.interrai.org/worldwide.html.
Folse GJ. National MDS and dental deficiency data reported by the US health care financing administration (HCFA). Spec Care Dentist. 2001;21(1):37–8.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988.
Russell Localio A, Margolis DJ, Kagan SH, Lowe RA, Kinosian B, Abbuhl S, et al. Use of photographs for the identification of pressure ulcers in elderly hospitalized patients: validity and reliability. Wound Repair Regen. 2006;14(4):506–13.
Bliss DZ, Gurvich OV, Hurlow J, Cefalu JE, Gannon A, Wilhems A, et al. Evaluation of validity and reliability of a revised incontinence-associated skin damage severity instrument (IASD.D.2) by 3 groups of nursing staff. J Wound, Ostomy, Cont Nurs off Publ Wound, Ostomy Cont nurses Soc. 2018;45(5):449–55 Available from: http://www.ncbi.nlm.nih.gov/pubmed/30188393.
Yazdanyar S, Bryld LE, Heidenheim M, Jemec GBE. Do generalists and specialists agree on descriptive acne morphology? J Eur Acad Dermatology Venereol. 2013;27(1):116–20.
Gegenfurtner A, Lehtinen E, Säljö R. Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ Psychol Rev. 2011;23(4):523–52.
Krausch-Hofmann S, De Almeida MJ, Declerck D, Declercq A, De Lepeleire J, Tran TD, et al. The oral health-related section of the interRAI: evaluation of test content validity by expert rating and assessment of potential reasons for inaccurate assessments based on focus group discussions with caregivers. Gerodontology. 2019; Available from: http://www.ncbi.nlm.nih.gov/pubmed/31274218.
Mehl AE, Ellingsen OG, Kjeksrud J, Willumsen T. Oral healthcare education of future nursing personnel and auxiliary nurses. Gerodontology. 2016;33(2):233–9.
Catteau C, Piaton S, Nicolas E, Hennequin M, Lassauzay C. Assessment of the oral health knowledge of healthcare providers in geriatric nursing homes: additional training needs required. Gerodontology. 2016;33(1):11–9Available from:. https://doi.org/10.1111/ger.12094.
The authors gratefully acknowledge all participants who contributed to the collection of the data used in the present paper.
This study was part of a research project financed by an internal fund of the KU Leuven (C24/15/034). Study design, analysis, interpretation and presentation of results was not influenced by the funding source.
Ethics approval and consent to participate
The study was approved by the ethics committee research UZ/KU Leuven with study number s59152. Participants were informed comprehensively and provided written consent. To ensure anonymity, the identity of the participants was not registered during data collection.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Krausch-Hofmann, S., Tran, T.D., Declerck, D. et al. Assessment of oral health conditions presented in photographs - is there a difference between dentists and non-dental professional caregivers?. BMC Oral Health 20, 188 (2020). https://doi.org/10.1186/s12903-020-01171-x
- Oral health assessment
- Oral photographs