- Open Access
- Open Peer Review
Unintended consequences and challenges of quality measurements in dentistry
BMC Oral Healthvolume 19, Article number: 38 (2019)
In recent years, several state dental programs, researchers and the Dental Quality Alliance (DQA) have sought to develop baseline quality measures for dentistry as a way to improve health outcomes, reduce costs and enhance patient experiences. Some of these measures have been tested and validated for various population groups. However, there are some unintended consequences and challenges with quality measurement in dentistry as observed from our previous work on refining and transforming dental quality measures into e-measures.
Some examples of the unintended consequences and challenges associated with implementing dental quality measures include: a de-emphasis on patient-centeredness with process-based quality measures, an incentivization of unethical behavior due to fee-for-service reimbursement systems, the risk of compromising patient and provider autonomy with plan-level measures, a disproportionate benefits of dental quality measurement going toward payers, and the risk of alienating smaller dental offices due to the resource-intensive nature of quality measurement.
As our medical counterparts have embraced quality measurement for improved health outcomes, so too must the dental profession. Our ultimate goal is to ensure the delivery of high quality, patient-centered dental care and effective quality measurement is the first step. By continuously monitoring the performance of dental quality measures and their continued refinement when unintended consequences are observed, we can improve patient and population health outcomes.
From the early debates of an elitist profession bewildered by the advent of quality assurance and the reluctance to subject one’s practices to external scrutiny [1, 2] to the widespread prevalence of accreditation standards that serve as prerequisites for acceptance into the dental profession, [3,4,5,6] quality in dentistry has come a long way since its inception. While quality assurance is essential for ensuring the efficacy and effectiveness of dental interventions, it lacks the holistic and systems level focus that encourages continuous learning from engendering small changes to creating lasting solutions . Quality improvement (QI), made popular by the Institute of Healthcare Improvement (IHI) through initiatives such as the Triple Aim , and furthered through efforts by the Joint Commission, has become the hallmark of forward-leaning healthcare institutions and learning healthcare systems [9, 10]. One crucial aspect of QI is the utilization of standardized measures of structure, process, and outcomes to assess performance and evaluate system changes [10, 11]. For the dental profession to keep pace with the healthcare system in the United States, there must be a shift from dentistry’s traditional understanding of quality systems encompassing risk management, quality control and quality assurance, to continuous QI through standardized measurement [12,13,14].
In recent years, several state dental programs, researchers and the DQA - a team of dental stakeholders representing payers, educators, professional organizations, federal agencies, providers and the public, have sought to develop baseline quality measures for dentistry as a way to improve health outcomes, reduce costs and enhance patient experiences [15,16,17]. Some of these measures (n = 18) have been tested and validated for various population groups (e.g. DQA Starter Set of Pediatric Oral Health Performance Measures) [18, 19] and nine of them have been endorsed by the National Quality Forum . With the exception of some e-measures, all of these measures are derived from the administrative or claims-based data of public or private dental insurance agencies across the United States. As an integral part of the healthcare delivery system, and since oral health is essential to overall health , dental providers must enthusiastically embrace and support efforts to implement quality measures in the dental office . This is our true north if we are to move towards achieving the six dimensions of quality - safety, timeliness, efficiency, effectiveness, efficacy and patient-centeredness, described by the Health and Medicine Division [previously the Institute of Medicine (IOM)] of the National Academy of Sciences, Engineering and Medicine (NASEM) .
What are some of the unintended consequences and challenges with quality measurement?
Our research team, through grant funding from the National Institute of Dental and Craniofacial Research (NIDCR) grant number 1R01DE024166, has been working to refine and transform dental quality measures into e-measures that are diagnosis-centered and can be easily deployed through the electronic health records (EHRs) at dental offices [24, 25]. Through this work, we have observed some unintended consequences and challenges with quality measurement in dentistry. These observations deserve attention to safeguard this nascent quality measurement effort in dentistry from avoidable pitfalls experienced by our medical counterparts . The continuous monitoring of the performance of dental quality measures and their continuous refinement when unintended consequences are observed is essential to ensuring the sustenance of these efforts and that they truly reflect the quality of care being delivered. Some of these observations include:
Process-based dental quality measures De-emphasize patient-centeredness
As described above, a critical hallmark of quality care is patient-centeredness. An improvement in the patient’s oral health outcome should always drive the dental care delivery process . Crucial to achieving this goal is arriving at an accurate diagnosis and creating a treatment plan that matches this diagnosis in the appropriate sequence. The widely recognized NASEM definition of quality emphasizes outcomes-based quality measures, defining quality as “the degree to which health services for individuals and populations increases the likelihood of desired health outcomes and are consistent with current professional knowledge” . However, evaluating treatment outcomes remains a challenge for the dental profession due to the slow-paced spread and implementation of the American National Standards Institute (ANSI)-approved standardized dental diagnostic terminology of the Systematized Nomenclature for Dental Diagnostic System (SNODDS) . When procedure-based process measures are used as indicators of quality (as is the case with most prevailing dental quality measures), it becomes difficult to track the attainment of desired oral health outcomes (e.g. disease-free mouth, improved well-being) following procedure completion, or to ascertain the validity of diagnosis-procedure code pairs and their consistency with current scientific evidence. While process-based quality measures provide valuable insight into the standards of dental care delivery, they might also misrepresent the true quality of care being rendered [29,30,31]. Furthermore, it inadvertently promotes a culture that is intervention-prone rather than patient-centered, outcomes-focused and prevention-prone.
Fee-for-service dental reimbursement systems incentivize unethical behavior
In tandem with the procedure-based process measures is the predominant use of fee-for-service payment mechanisms in dentistry . The lack of a mandatory requirement for the use of diagnostic codes when processing billing claims means that dental providers are incentivized to simply complete a procedure irrespective of its indication. This has a dissuading effect on providers who deliver high quality and indicated care, howbeit ‘low-volume’ . For example, providers obtaining a high-performance score for the proportion of children receiving sealants within their dental practice, although the sealants needed to be replaced every year due to low quality, or for the placement of sealants in low risk patients (see Fig. 1) [33,34,35]. While some promising payment mechanisms have been tested by our medical counterparts, such as ‘Pay-for-performance’ (P4P) or ‘value-based payments’, which provide financial incentives to clinicians and heath care providers for delivering high-quality care and an improvement in patient outcomes [36,37,38], they have not made their way into mainstream dentistry. Furthermore, unintended consequences have also been observed in P4P programs including the phenomenon of ‘gaming’, where providers “cherry pick” only patients who are expected to have better outcomes and exclude the ones expected to have poor outcomes in order to receive higher compensations (,para. 2). In dentistry, this may lead to dentists preferentially treating low-risk patients or those in need of less complex procedures . If the dental profession is to tie reimbursement to performance, there needs to be a valid mechanism for adjusting for the case-mix and/or the severity of patients’ presenting conditions. Unfortunately, measures to assess case severity are not widely available or standardized in dentistry; therefore, more research will be needed before performance-based incentives can be implemented. The high percentage of out-of-pocket payments and multiple insurers per dental practice also means that the enforcement of P4P programs in dentistry will be an uphill battle .
Plan-level measures risk compromising provider and patient autonomy
In recent years, there has been an increase in the emphasis on patient and family engagement in the healthcare delivery process. Providers are encouraged to work with patients as partners to ensure the delivery of high quality care. In fact, patients who are ‘activated’ have been shown to have better outcomes than those who are not . Increased patient engagement and satisfaction also lead to increased provider satisfaction [43, 44]. However, the satisfaction of patients’ needs or preferences may require the performance of procedures that are neither conventional nor routine and may not be covered by the patient’s dental plan. While providers are focused on getting the best treatment outcomes for their patients, dental plans might be more interested in cost-savings and getting the most ‘bang for their buck’. The reliance on plan-level dental quality measures might mean that these providers would appear as outliers amongst their peers and be rated poorly for not adhering to conventional practices. When providers are faced with the choice of meeting their professional obligations to their patients or being truthful to the dental plans, some have chosen to ‘game the system’ by wrongly coding the procedures performed on their billing forms, as a way around this conflict. Conversely, other providers have chosen to perform procedures that do not meet the patient’s needs and even risk poor treatment outcomes just to comply with the plan-approved treatment recommendations [45, 46]. In order to avoid the unintended consequence of jeopardizing the provider-patient decision-making process, plan-level quality measures need to be interpreted with these nuances in mind .
The benefits of dental quality measurement are skewed towards dental payment organizations
The implementation of quality measures by public and private dental payment organizations provide useful information to the payers regarding the performance of enrolled providers on a spectrum and allows them to identify outliers, infer expected treatment outcomes and evaluate adherence to evidence-based practices. However, most dental patients are not provided with access to this information and providers do not typically receive feedback about their performance in relation to their counterparts except when extreme practices are observed. This reduces the learning opportunities available to providers and colors their perception of the merits of quality measurement, especially when it consumes time, resources, and is not tied to their reimbursement. Similarly, patients are unaware of the performance scores of their providers and are unable to make informed choices when selecting their primary providers. Public reporting of provider-level dental quality measures, as is the case with Medicare providers, needs to be encouraged as a way to drive better provider performance and provide patients with validated quality measures upon which to base their assessments of providers . In the absence of these measures, dental patients have relied on commercial review websites, such as Yelp, to choose their dental providers, which may not necessarily be a true reflection of the quality of care provided in terms of treatment outcomes [49, 50] but rather a reflection on the provider’s chair-side manners [43, 51, 52]. To develop provider-level measures that assess treatment outcomes, more funding is needed for large, observational research studies, and the creation of centralized, publicly accessible reporting systems .
Although there is a shifting trend towards Dental Service Organizations (DSOs) and corporate dental chains, the majority of dental offices in the United States are still solo-practices or small group practices [36, 53, 54]. This often means limited staffing and the absence of dedicated staff to handle back-office operations such as implementing health information technology (IT), performing chart review audits, data entry, and organizing quality improvement activities. Any quality measurement attempts at these smaller offices will come at the expense of productivity and chairside time. While the benefits and potential savings from delivering high quality care range from improved efficiency and wastage elimination, to better patient and provider satisfaction, the upfront costs are often untenable for a majority of these solo practices. As we develop quality measures in dentistry, significant attention needs to be focused on developing e-measures that can be easily deployed through EHRs with minimal staff effort and time. Pulling structured data from the EHRs also has the added advantage of reducing documentation fatigue that comes with having to complete redundant forms that have no bearing on the care being provided just to meet certain quality metrics . Furthermore, it has been shown that dentists are less likely to participate in programs that require extensive or complicated documentation completion . The implementation of quality measures without the consideration of the time and financial implications to providers may ultimately lead to low provider engagement in quality measurement or a reduction in time spent providing face-to-face patient-centered care.
As our medical counterparts have embraced quality measurement for improved patient and population health outcomes, so too must the dental profession. The standardization and implementation of diagnostic terminologies in dental offices nationwide is an important step towards achieving widespread quality measurement [57,58,59]. Without diagnostic terms, the dental profession is severely limited in its ability to measure appropriate treatment and health outcomes. Furthermore, as quality measurement evolves, the challenge of the dental reimbursement structure and payment mechanisms cannot be ignored. It is essential that new dental quality measures account for the subtle nuances involved with delivering high quality dental care, and that smaller dental offices or solo practitioners are not left behind. In the end, our ultimate goal is to ensure the delivery of high quality, patient-centered dental care and effective quality measurement is the first step.
American National Standards Institute
Current Dental Terminology
Dental Quality Alliance
Dental service organizations
Electronic health records
Institute of Healthcare Improvement
Institute of Medicine
National Academy of Sciences, Engineering and Medicine
National Institute of Dental and Craniofacial Research
Oregon Health Authority
Systematized Nomenclature for Dental Diagnostic System
Jago JD. Issues in assurance of quality dental care. Journal of the American Dental Association (1939). 1974;89(4):854–65.
Barish NH, Collins WK. Peer review for quality care in private solo dental practice. J Am Dent Assoc. 1974;89(4):866–71.
Guarino KS. Licensure and certification of dentists and accreditation of dental schools. J Dent Educ. 1995;59(1):205–36.
Jones ML, Hobson RS, Plasschaert AJM, et al. Quality assurance and benchmarking: an approach for European dental schools. Eur J Dent Educ. 2007;11(3):137–43.
Council on Dental Education. The establishment of a Commission on Accreditation of Dental and Dental Auxiliary Educational Programs. J Am Dent Assoc. 1974;88(5):1032–8.
Commission on Dental Accreditation. Accreditation Standards For Dental Education Programs. 2018. https://www.ada.org/~/media/CODA/Files/pde.pdf?la=en. Accessed 14 Feb 2019.
Thomas PC, Kettrick RG, Singsen BH. Quality assurance and continuous quality improvement: history, current practice, and future directions. Del Med J. 1992;64(8):507–13.
Berwick DM, Nolan TW, Whittington J. The triple aim: care, health, and cost. Health Aff (Millwood). 2008;27(3):759–69.
Stiefel M, Nolan K. A guide to measuring the triple aim: population health, experience of care, and per capita cost. In: IHI Innovation Series white paper Cambridge. Massachusetts: Institute for Healthcare Improvement; 2012.
Institute for Healthcare Improvement. Triple Aim for Populations. http://www.ihi.org/Topics/TripleAim/Pages/default.aspx. Accessed 14 Feb 2019.
Donabedian A. A Guide to Medical Care Administration. In: Medical Care Appraisal: Quality and Utilization. Vol 2. New York: The American Public Health Association, Inc.; 1969.
Schyve PM, Prevost JA. From quality assurance to quality improvement. Psychiatr Clin North Am. 1990;13(1):61–71.
Ramoni R, Walji MF, Tavares A, et al. Open wide: looking into the safety culture of dental school clinics. J Dent Educ. 2014;78(5):745–56.
Ramoni RB, Walji MF, White J, et al. From good to better: toward a patient safety initiative in dentistry. J Am Dent Assoc. 2012;143(9):956–60.
Ojha D, Aravamudhan K. Leading the dental quality movement: a dental quality Alliance perspective. J Calif Dent Assoc. 2016;44(4):239–44.
Vidone L, Hunt RJ, Ojha D. An Emerging Era in Dentistry--Quality Measurment. J Mass Dent Soc. 2016;65(3):18-21.
Dental Quality Alliance. Quality Measurement in Dentistry: A Guidebook. 2012.
Herndon JB, Crall JJ, Aravamudhan K, et al. Developing and testing pediatric oral healthcare quality measures. J Public Health Dent. 2015;75(3):191–201.
Herndon JB, Tomar SL, Catalanotto FA, et al. Measuring quality of dental care: Caries prevention services for children. J Am Dent Assoc. 2015;146(8):581–91.
Agency of Healthcare Research and Quality. National Quality Measures Clearinghouse. Rochville: U.S. Department of Health and Human Services; 2016.
Donoff B, McDonough JE, Riedy CA. Integrating oral and general health care. N Engl J Med. 2014;371(24):2247–9.
Satcher D, Nottingham JH. Revisiting Oral health in America: a report of the surgeon general. Am J Public Health. 2017;107(S1):S32–3.
Institute of Medicine, Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington: National Academies Press. National Academy of Sciences; 2001.
Bhardwaj A, Ramoni R, Kalenderian E, et al. Measuring up: implementing a dental quality measure in the electronic health record context. J Am Dent Assoc. 2016;147(1):35–40.
Neumann A, Kalenderian E, Ramoni R, et al. Evaluating quality of dental care among patients with diabetes: Adaptation and testing of a dental quality measure in electronic health records. J Am Dent Assoc. 2017;148(9):634–43 e631.
Wharam JF, Farber NJ, Paasche-Orlow MK, et al. Can Pay-for-Performance be Ethical? An Analysis by the Society of General Internal Medicine Ethics Committee. 2009.
Donabedian A. The role of outcomes in quality assessment and assurance. QRB Qual Rev Bull. 1992;18(11):356–60.
Kalenderian E, Tokede B, Ramoni R, et al. Dental clinical research: an illustration of the value of standardized diagnostic terms. J Public Health Dent. 2016;76(2):152–6.
Bader JD. Challenges in quality assessment of dental care. J Am Dent Assoc. 2009;140(12):1458–64.
Tokede O, Walji M, Ramoni R, et al. Treatment planning in dentistry using an electronic health record: implications for undergraduate education. Eur J Dent Educ. 2013;17(1):e34–43.
Tokede O, White J, Stark P, et al. Assessing the use of a standardized dental diagnostic terminology in an electronic health record. J Dent Educ. 2012; in Press.
Grytten J. Payment systems and incentives in dentistry. Community Dent Oral Epidemiol. 2017;45(1):1–11.
Kerr EA, Lucatorto MA, Holleman R, et al. Monitoring performance for blood pressure management among patients with diabetes mellitus: too much of a good thing? Arch Intern Med. 2012;172(12):938–45.
Beard AJ, Hofer TP, Downs JR, et al. Assessing appropriateness of lipid management among patients with diabetes mellitus. Circ Cardiovasc Qual Outcomes. 2013;6(1):66–74.
Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. Jama. 2012;307(17):1801–2.
Winegarden W, Arduin D. The benefits created by dental service organizations. 2012. https://www.pacificresearch.org/wp-content/uploads/2017/06/DSOFinal.pdf. Accessed 14 Feb 2019.
Rosenthal MB, Landon BE, Normand S-LT, Frank RG, Epstein AM. Pay for performance in commercial HMOs. N Engl J Med. 2006;355(18):1895–902.
Institute of Medicine. Rewarding provider performance (aligning incentives in medicare). Int J Health Plann Manage. 2008;23(1):83–4.
Page L. Are More Doctors Cherry-Picking and Lemon-Dropping Patients? Medscape 2017; https://www.medscape.com/viewarticle/874530_4. Accessed January 18, 2018.
Doméjean S, White JM, Featherstone J. Validation of the CDA CAMBRA caries risk assessment--a six-year retrospective study. J Calif Dent Assoc. 2011;39(10):709–15.
Voinea-Griffin A, Fellows JL, Rindal DB, Barasch A, Gilbert GH, Safford MM. Pay for performance: will dentistry follow? BMC Oral Health. 2010;10(1):9.
Greene J, Hibbard JH. Why does patient activation matter? An examination of the relationships between patient activation and health-related outcomes. J Gen Intern Med. 2012;27(5):520–6.
Gawande A. The Bell Curve: What happens when patients find out how good their doctors really are. The New Yorker, Annals of Medicine. 2004.
Bardach NS, Cabana MD. The unintended consequences of quality improvement. Curr Opin Pediatr. 2009;21(6):777–82.
Cassel CK, Jain SH. Assessing individual physician performance: does measurement suppress motivation? Jama. 2012;307(24):2595–6.
Larriviere DG, Bernat JL. Invited article: threats to physician autonomy in a performance-based reimbursement system. Neurology. 2008;70(24):2338–42.
Meyer GS, Nelson EC, Pryor DB, et al. More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf. 2012;21(11):964-68.
Koltov MK, Damle NS. Health policy basics: physician quality reporting system. Ann Intern Med. 2014;161(5):365–7.
Bardach NS, Asteria-Penaloza R, Boscardin WJ, Dudley RA. The relationship between commercial website ratings and traditional hospital performance measures in the USA. BMJ Qual Saf. 2013;22(3):194–202.
Holtzclaw DJ. Comparative analysis of user-generated online yelp reviews for periodontal practices in multiple metropolitan markets. J Periodontol. 2017;88(2):137–43.
Dimick JB, Welch HG, Birkmeyer JD. Surgical mortality as an indicator of hospital quality: the problem with small sample size. Jama. 2004;292(7):847–51.
Hofer TP, Hayward RA. Identifying poor-quality hospitals: can hospital mortality rates detect quality problems for medical diagnoses? Med Care. 1996;34(8):737–53.
Call RL. Dental management service organizations: lessons from medicine. J Am Dent Assoc. 1999;130(4):489–95.
Gesko DS, Bailit HL. Dental Group Practice and the Need for Dentists. J Dent Educ. 2017;81(8):eS120–5.
PricewaterhouseCoopers, American Hospital Association. Patients or paperwork? The regulatory burden facing America’s hospitals. 2001. https://procentive.com/wpcontent/uploads/2015/02/FinalPaperworkReport.pdf. Accessed 14 Feb 2019.
Shulman JD, Ezemobi EO, Sutherland JN, Barsley R. Louisiana dentists' attitudes toward the dental Medicaid program. Pediatr Dent. 2001;23(5):395–400.
Reed SG, Adibi SS, Coover M, et al. Does use of an electronic health record with dental diagnostic system terminology promote dental students' critical thinking? J Dent Educ. 2015;79(6):686–96.
Tokede O, White J, Stark PC, et al. Assessing use of a standardized dental diagnostic terminology in an electronic health record. J Dent Educ. 2013;77(1):24–36.
Obadan-Udoh E, Simon L, Etolue J, et al. Dental Providers' Perspectives on Diagnosis-Driven Dentistry: Strategies to Enhance Adoption of Dental Diagnostic Terminology. Int J Environ Res Public Health. 2017;14(7):767
This project was funded in part by the National Institute of Dental and Craniofacial Research (NIDCR), grant number-R01DE024166, Implementing Dental Quality Measures in Practice. NIDCR was not involved in the preparation of the manuscript and the views presented reflect those of the authors alone.
Availability of data and materials
Ethics approval and consent to participate
This manuscript did not involve human subjects, and therefore, did not require ethics approval. However, the idea was born out of an ongoing project titled, Implementing Dental Quality Measures in Practice, which is approved by the Institutional Review Board (IRB) at the University of California San Francisco (IRB#: 15–16,296).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.