Skip to main content

Table 2 Inter-rater reliability statistics for selected dental health conditions

From: Performance of a quality assurance program for assessing dental health in methamphetamine users

Site Assessment n Ref case % Examiner case % Percent agreement Kappa -Kappa)
  Dentition/Dental caries       
A Tooth Retention (has all 28 teeth excluding 3rd molars) 33 9.1 % 9.1 % 100 % 1.00 0
B 18 22.2 % 22.2 % 100 % 1.00 0
A Has Untreated Caries (DT ≥ 1) 33 57.6 % 57.6 % 87.9 % 0.75 0.12
B   18 83.3 % 83.3 % 83.3 % 0.57 0.20
A Has Restorations (FT ≥ 1) 33 84.9 % 84.9 % 100 % 1.00 0
B   18 83.3 % 83.3 % 100 % 1.00 0
A Caries experience (DMFT >0) 33 93.9 % 93.9 % 100 % 1.00 0
B   18 100 % 100 % 100 % NAa NAa
A At least 5 surfaces of anterior decay (DS ≥ 5) 33 12.1 % 15.2 % 97.0 % 0.87 0.13
B   18 11.1 % 16.7 % 94.4 % 0.77 0.22
A Has root caries 33 39.4 % 48.5 % 90.9 % 0.82 0.10
B   18 33.3 % 27.8 % 83.3 % 0.61 0.20
  Periodontal Status       
A At least one site with AL ≥3 31 96.8 % 100 % 96.7 % NAa NAa
B   18 100 % 100 % 100 % NAa NAa
A At least one site with AL ≥4 31 87.1 % 90.3 % 90.3 % 0.52 0.24
B   18 72.2 % 100 % 72.2 % NAa NAa
A At least one site with AL ≥6 31 51.6 % 51.6 % 64.4 % 0.29 0.17
B   18 72.2 % 61.1 % 77.9 % 0.51 0.21
A At least one site with PD ≥4 31 90.3 % 87.1 % 83.9 % 0.20 0.24
B   18 88.9 % 77.8 % 88.9 % 0.61 0.24
A At least one site with PD ≥5 31 48.4 % 45.2 % 77.4 % 0.55 0.15
B   18 61.1 % 61.1 % 88.9 % 0.77 0.16
A At least one site with PD ≥7 31 12.9 % 3.2 % 90.3 % 0.37 0.27
B   18 11.1 % 11.1 % 88.9 % 0.44 0.33
A At least one site with bleeding 31 64.5 % 83.9 % 61.3 % 0.04 0.16
B   14 92.9 % 92.9 % 100 % 1.00 0
A Total Periodontitis 31 93.6 % 90.3 % 90.3 % 0.35 0.29
B   18 100 % 83.3 % 83.3 % NAa NAa
A Severe Periodontitis 31 29.0 % 35.5 % 67.7 % 0.27 0.18
B   18 55.6 % 50 % 83.3 % 0.67 0.23
A Moderate Periodontitis 31 61.3 % 51.6 % 58.2 % 0.15 0.17
B   18 44.4 % 28.8 % 72.2 % 0.42 0.21
  1. n number of replicate exams, SE asymptotic standard error of Kappa, DT decayed teeth, FT restored/filled teeth, DMFT decayed, missing, filled teeth, DS decayed tooth surfaces, AL attachment loss, PD pocket depth, Periodontitis defined using CDC/AAP case definitions
  2. NAa -Kappa statistics could not be computed when any frequencies in a 2 × 2 table of raters and outcomes are zero. When the percent of subjects rated with an outcome was 100 %, Kappa statistics were not obtained