- Research article
- Open Access
An analysis of the readability characteristics of oral health information literature available to the public in Tasmania, Australia
BMC Oral Health volume 16, Article number: 35 (2016)
The effectiveness of print-based health promotion materials is dependent on their readability. This study aimed to assess the characteristics of print-based oral health information literature publically available in Tasmania, Australia.
Oral health education brochures were collected from 11 dental clinics across Tasmania and assessed for structure and format, content and readability. Reading level was calculated using three widely-used measures: Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease, and Simple Measure of Gobbledygook (SMOG) reading grade level.
The FKGL of the 67 brochures sampled ranged from grade 3 to 13. The grade level for government health department brochures (n = 14) ranged from grade 4 to 11 (5.6 ± 1.8). Reading levels for materials produced by commercial sources (n = 22) ranged from 3 to 13 (8.3 ± 2.1), those from professional associations (n = 22) ranged from grade 7 to 11 (8.9 ± 0.9) and brochures produced by other sources (n = 9) ranged from 5 to 10 (7.6 ± 1.5). The SMOG test was positively correlated with the FKGL (rs = 0.92, p < 0.001) though consistently rated materials 2-3 grades higher. The reading level required to comprehend brochures published by government sources were, on average, lower than those from commercial, professional and other sources. Government materials were also more likely to contain fewer words and professional jargon terms than brochures from the other sources.
A range of oral health information brochures were publically available for patients in both public and private dental clinics. However, their readability characteristics differed. Many brochures required a reading skill level higher than that suited to a large proportion of the Tasmanian population. Readability and other characteristics of oral health education materials should be assessed to ensure their suitability for use with patients, especially those suspected of having low literacy skills.
Information about oral health is provided in a variety of forms and obtained from a range of sources including the media and more directly from oral health practitioners. Verbal messages from a dentist may be reinforced through a printed handout or brochure provided to a patient regarding ongoing care. Most public and private dental clinics make printed information freely available to patients to promote oral health. It is important that printed educational material should be pitched at an appropriate level for a particular target audience and be “fit for purpose”. Research suggests however, that health educational materials are often designed at a level beyond that which could be readily understood by the average adult or the majority of the population .
Wilson  assessed the readability of 35 patient education information brochures used in community healthcare centres serving low-income populations. The author found that these were written at a level higher than that for an average patient to understand . Alexander  assessed the reading level of 24 general dental educational materials and reported that over 40 % of them were written at a grade level higher than recommended. Hendrickson and colleagues  assessed readability as well as thoroughness, textual framework, and the terminology used in 27 paediatric oral health materials and found both conflicting information and variation in readability across publishers . Noticeably, there has been limited research published on the readability of print based oral health information made available in Australia. Our search recovered only three recent studies [5–7] which was limited to information about paediatric oral health.
Systematic reviews [8, 9] have demonstrated a significant association between socioeconomic status (determined by income, education and occupational background) and dental caries. There is a similar association between low oral health literacy and self-reported poor oral health [10–12]. Given that health literacy contributes to oral health literacy, it is of concern that the Australian adult literacy survey found that nearly 60 % of Australian and 63 % of Tasmanian 15-74 year olds were not able to demonstrate the minimum level of health literacy “to meet the complex demands of everyday life” . Compared to other states, Tasmania’s population of around half a million persons is one of the least advantaged in term of socio-economic status. It is widely disbursed and ageing rapidly; factors that all contribute to poorer oral health outcomes . Within this context, the aim of this study was to assess the readability characteristics of print-based oral health information literature available to the Tasmanian public. The results may assist the future development and use of these materials to better tailor them to the literacy level of a particular target audience.
Oral health brochures readily available to patients were collected from a convenient sampling of public and private general dental clinics located in large and small towns in Tasmania. A member of the research team initially visited 7 clinics and collected all the materials that were made readily available to the public free of charge. A verbal request was made to another 4 clinics to mail all available oral health brochures to the research team. Collection ceased when no new brochure was identified in the yield from the last site sampled.
A total of 238 information brochures were collected and the following inclusion criteria were applied to each: written in the English language; aimed at patients and not health professionals/educators; oral health specific rather than general health or disease conditions that may impact oral health; and were in current use.
Figure 1 shows the design of the study. After removing duplicates, 67 (28 %) brochures remained and were grouped according to type of publisher: commercial (22), professional associations (22), government departments (14), and other (9) (eg. in-house) sources. The materials were assessed on 20 features across three major attributes: structure and format, content, and readability. Sampled brochures were scanned and converted to plain text Microsoft Word 2010 documents  for calculation of word counts and readability analyses.
Structure and format
Presentation and layout of brochures can enhance readability and comprehension. Generally, materials that are complex, excessively wordy and or contain extraneous information are less likely to be read and can have less impact than those that are more focussed. Using everyday language, the logical sequencing of information, judicious use of white space, headings, bullets and using devices such as pictures or illustrations can help break up long passages of text, reduce text density and help reinforce key messages and assist understanding . The structure and format of the brochures was evaluated by an assessment of: size of the brochure; type of fold (double fold, tri-fold or gate fold); the presence of bulleted text; number of pictures, use of colour, total word count; font size and type.
This attribute was evaluated using six features that included the broad purpose or content area of the brochure and target audience. Currency of information was assessed by locating the date on which the brochure was last published or reviewed. As a proxy measure for the accuracy and evidence-base of the information presented, we searched for any statement indicating endorsement by an appropriate (non-commercial) dental authority or professional association. Given that our sampling frame included clinics that serviced clients from different cultural backgrounds, we also looked for indicators that the brochure or the information it contained was available in languages other than English. Accepting that most brochures are designed to convey a particular message simply and succinctly rather than provide detailed or extensive coverage of the topic, we also looked for statements that directed the reader to additional sources of information on the topic.
Readability refers to the degree to which written information can be understood by the reader. The reading level of each brochure was calculated using three widely-used measures. The Flesch-Kincaid Grade Level (FKGL)  and the Flesch Reading Ease (FRE)  score is calculated by formula based on average sentence length and average number of syllables per word. The Simple Measure of Gobbledygook (SMOG) is a count of polysyllabic words and typically used to analyse short documents . The SMOG score may be calculated manually using a formula or via an on-line calculator . Essentially, the more polysyllabic words, the higher the SMOG score.
Both the FKGL and the SMOG estimate the U.S. primary or secondary school grade level (from 1-12) that a reader would be expected to have completed in order to understand a particular text. These grade levels approximate those in the Australian school system. The FRE test produces a score from a given text that can range from 0 to 100. The higher the score, the easier a text is to read. In general, scores below 30 are “very difficult” and scores above 90 “very easy” to read . The higher the FRE score, the lower the FKGL and SMOG grade level.
Professional jargon refers to words that would be uncommon to an average adult who had not received a health sciences education. Words that were explained in a brochure were not considered as jargon . For this study, we drew upon lists of professional jargon identified by others [3-5] and extracted additional acronyms, dental or medical terms used in the sampled brochures that the research team thought could be difficult to understand. This list of 171 words was sorted alphabetically and five university qualified adults who were not health care professionals were asked to independently identify those words on the list that they found difficult to understand. Any word that more than one person rated as difficult was retained on the final list of 132 “professional jargon” words applied in our analysis.
Data for each brochure were recorded in a spreadsheet then analysed using descriptive and inferential statistics available in SPSS 20. Descriptive statistics included, frequency tallies, range, mean, median and standard deviation were used to summarise characteristics related to the structure and format of each brochure as well as readability. A Spearman correlation coefficient was computed to determine the strength of the association between readability measures (Flesch-Kincaid, SMOG, and FRE).
Approval for the study from a research ethical review board was not required as our procedures did not involve the collection of data from humans or any experimental intervention. The study was restricted to a desk-top analysis of publicly available, print-based literature.
Structure and format
Most brochures used standard paper sizes A3 (9), A4 (38) and A5 (2), though 18 were customised. A majority (60 %) of brochures were folded: 11 used a double fold, 21 tri-fold, 5 quad-fold and 3 utilised a gate-fold. The remainder (27) were single page hand-outs.
All except 4 brochures used colour and most (95 %) contained pictures or illustrations. The number of pictures used ranged from 0 to 17 (median: 5 pictures). A majority of brochures (79 %) distributed text under sub-headings (range: 13 (1-14), median: 4) and all but 1 made use of bulleted text. Brochures produced “in-house” were less likely to use pictures and more likely to be produced in black and white.
Word length ranged from 84 to 3856 (median 854 words). The smallest font size was 7 and largest 14. The most frequent font size used was 11 (used in 32 brochures). Ten different font types were used. The most frequently used was Calibri (22) followed by Gillsans MT (13) and DaxOT-light (10). Publishers tended to use one font type for their brochures. For example, Calibri was the preferred font type for all of the brochures sampled from the Australian Dental Association (Table 1).
Table 1 shows that out of the 67 oral health brochures reviewed, 20 targeted adult patients, 21 all patients and 16 contained information about child oral health though this latter group targeted parents rather than children as the reading audience. Materials were also written for late teens and adults (6), denture holders (2), diabetic patients (1), and seniors (1).
A range of topics were represented in the brochures samples and included: preventative oral health care (9), care in response to a specific oral health condition (15), age group (13) or oral health specific to a general health status/condition (4). Seven were about oral health products and the remaining 19 focussed information on a dental appliances or procedures.
Only thirty one brochures (46 %) listed the year of publication or revision and these ranged from the years 2002 to 2014. Twenty eight brochures reported endorsement by a professional association, 14 by a government department and 20 did not list any endorsement. Thirty four brochures (51 %) provided information on how the reader could access additional information though there were only 6 brochures (5 from industry sources and 1 from a Government source) that were also available in up to 6 other languages.
The FKGL of the 67 brochures ranged from Grade 3 to 13 (post-secondary). The SMOG test was positively correlated with the FKGL (rs = 0.92, p < 0.001) though consistently rated materials 2–3 grades higher. The FRE scores ranged from 43.5 to 98.1 (the higher the FRE score, the more readable the material) and scores demonstrated a high inverse correlation with grades computed for the FKGL (rs = -0.96, p < 0.001) and the SMOG (rs = -0.90, p < 0.001).
The brochure produced by Colgate entitled “Oral Health through everyday care” had the lowest reading-grade level with a FKGL level of 3.1 and contained only1 professional jargon term (Table 1, #1). The highest reading level (12.6) required was obtained for a well-illustrated brochure “GC Tooth mousse for children” which had 13 professional jargon terms recorded (Table 1, #20).
Brochures produced by government publishers required a lower level of reading ability than those from other sources with median and mean scores for the FKGL and the SMOG being lower than those from commercial, professional and other sources (Table 2). The FKGL for government brochures (n = 14) ranged from grade 4 to 11 (mean = 5.6 ± 1.8). Reading levels for materials produced by commercial sources (n = 22) ranged from 3 to 13 (mean = 8.3 ± 2.1), those from professional colleges (n = 22) ranged from grade 7 to 11 (mean = 8.9 ± 0.9) and brochures produced by “other” sources (n = 9) ranged from 5 to 10 (mean = 7.6 ± 1.5).
There were 132 dental jargon terms identified in the 67 brochures sampled (Table 3). The number used in each ranged from 0 to 18. Ten brochures (6 from government sources) contained no professional jargon terms. Government brochures (with the exception of #57 “Child dental benefits schedule”) used fewer professional jargon terms (mean = 0.9 ± 0.9) than those produced by “other” (mean = 1.6 ± 1.5), commercial (mean = 4.3 ± 4.0) or professional associations (mean = 9.8 ± 4.2). Brochures from these latter three sources also used a greater average number of words (Table 2).
A number of factors contribute to the readability of health education materials such as content of the message, complexity, the language used, text type and size, visual appearance, layout and understandability . In this study, we focussed upon the structure and format of materials, features related to content as well as readability metrics. The format and presentation of the brochures such as font type and size, use of headings, bullets and pictures as devises to illustrate key concepts and to break up passages of text can influence how readers engage with and comprehend the information presented . In the present study, consideration had clearly been given to these (and other) factors by publishers though brochures from professional and to a slightly lesser extent those produced by commercial publishers tended to use a greater number of words and demonstrated readability characteristics suited to a more literate audience.
The median and most frequent font size used in the brochures reviewed was 11 point. Out of the 67 brochures, only 10 made used of a recommended font size between 12 and 14 points . Noticeably, one brochure written for older people (Table 1, #18) used a font size of 9 points and could present a challenge for those with some visual impairment even with the assistance of glasses.
The reading level of brochures sampled ranged from grade 3 to grade 13. Within the context of the U.S. assessment of grade level, it has been recommended that the reading level of patient education brochures should be no higher than sixth- to eighth-grade [22, 23]. However, about 50 % of the 67 brochures sampled in this study were written at a level above this upper limit. This suggests that the information contained in these materials may be difficult to fully comprehend by sections of the Tasmanian population where it has been estimated that less than 50 % of people are able to demonstrate the minimum level of health literacy required to function adequately in this domain (skill level 3 or above) .
Consistent with the previous studies [4, 5], our findings indicated that government brochures were the easiest to read though did contain some jargon words and, as reported in an Australian qualitative study , could therefore still be confusing to a reader. Brochures from professional associations and commercial publishers made more frequent use of professional jargon. Such differences may reflect assumptions about differences in the overall literacy level of the populations serviced by each sector with government materials (public dental services) directed to a larger proportion of clients with lower levels of literacy.
Although a wide range of assessment tools is available, no gold standard has been established to assess the readability of print-based patient education information across all settings . Generally, using more than one readability assessment tool is preferred over using a single measure. This can provide some assurance of reliability and also highlight different aspects of the attribute under investigation. In this study, we chose four indictors of readability for reasons of simplicity (ease to use) and their widespread use across health discipline areas: the FKGL, FRE, SMOG and count of professional jargon words . Consistent with the literature, the FKGL, FRE, SMOG were highly correlated though the reading grade results obtained from the SMOG were consistently from two to three grades higher than results obtained from the FKGL. This was because the SMOG formula is based on 100 % comprehension ability i.e. stricter criteria . For example, if a brochure has SMOG readability grade of 5, it indicates that all people with grade 5 reading skills would normally be able to comprehend the brochure.
Whilst strong associations have been demonstrated between literacy level and the health status of a population , health education and promotion materials are only one component of a broader public health message. Dental clinics often make use of oral health information materials to inform patients and augment verbal advice provided by the dentist and members of the dental team . To help maximise their effectiveness, at the readability of these materials should suit the skill level and other characteristics of the patient. Identifying attributes important to the readability of materials can help dental practitioners apply the more relevant of these to the selection or even design of materials best suited to their patient’s needs.
Whilst our selection of printed materials was limited to one state of Australia and clearly not exhaustive, we did sample a relatively large number of brochures and, as found elsewhere [4, 5] they did vary in their readability characteristics. The readability attributes we assessed were limited. For example, we did not assess the use of active and passive verbs or directly measure white space, density or “clutter” in each brochure (however, our word, picture and heading counts provide some estimate of this). As acknowledged elsewhere  the list of professional jargon terms identified were subjective and, given the procedure we used, is likely to be an underestimate of the number of words someone with a low reading skill level would find difficult to read and understand. A critical observation to be made of this and similar studies is to recognise that reading skill level and the readability of health information is only one component of oral health literacy. The judicious and appropriate use of health education materials can however, contribute to public health and education measures directed to improving oral health outcomes.
Print-based oral health materials provide important information about the maintenance of good oral health and prevention of disease. Oral health brochures are publically available for patients in both public and private dental clinics in Tasmania. However their reading characteristics differed. Government (health department) brochures were easier to read than those produced by commercial, professional and other publishers. Some brochures required a high reading grade level and may not be suitable for a wide range of patients. Readability and other characteristics of oral health education materials should be assessed to ensure their suitability for use with patients, especially those suspected of having low literacy skills. The criteria applied in this study could be used as a checklist when reviewing, selecting or developing oral health brochures.
This study did not involve human subject or animals. HREC approval was therefore not required.
Amini H, Casamassimo PS, Lin HL, Hayes JR. Readability of the American Academy of Pediatric Dentistry patient education materials. Pediatr Dent. 2007;29(5):431–5.
Wilson M. Readability and patient education materials used for low-income populations. Clin Nurse Spec. 2009;23(1):33–40.
Alexander R. Readability of published dental educational materials. J Am Dent Assoc. 2000;131:937–42.
Hendrickson RL, Huebner CE, Riedy CA. Readability of pediatric health materials for preventive dental care. BMC Oral Health. 2006;6:6–14.
Arora A, Lam AS, Karami Z, Do LG, Harris MF. How readable are Australian paediatric oral health education materials? BMC Oral Health. 2014;14(1):111.
Arora A, Nguyen D, Do QV, Nguyen B, Hilton G, Do LG, et al. ‘What do these words mean?’: A qualitative approach to explore oral health literacy in Vietnamese immigrant mothers in Australia. Health Educ J. 2014;73(3):303–12.
Arora A, McNAB MA, Lewis MW, Hilton G, Blinkhorn AS, Schwarz E. ‘I can’t relate it to teeth’: a qualitative approach to evaluate oral health education materials for preschool children in New South Wales, Australia. Int J Paediat Dent. 2012;22(4):302–9.
Costa SM, Martins CC, Bonfim MLC, Zina LG, Paiva SM, Pordeus IA, et al. A systematic review of socioeconomic indicators and dental caries in adults. Int J Environ Res Public Health. 2012;9(10):3540–74.
Schwendicke F, Dörfer C, Schlattmann P, Page LF, Thomson W, Paris S. Socioeconomic inequality and caries a systematic review and meta-analysis. J Dent Res. 2015;94(1):10–8.
Naghibi Sistani MM, Yazdani R, Virtanen J, Pakdaman A, Murtomaa H. Determinants of oral health: does oral health literacy matter? ISRN Dentistry. Hindawi Publishing Corporation. 2013;2013:1-6. http://dx.doi.org/10.1155/2013/249591.
Jones K, Parker E, Jamieson L. Access, literacy and behavioural correlates of poor self-rated oral health amongst an indigenous South Australian population. Community Dent Health. 2014;31(3):167–71.
Baur C, Comings J, Evans C, Garcia R, Horowitz A, Ismail A, et al. The invisible barrier: literacy and its relationship with oral health. J Public Health Dent. 2005;65(3):174–82.
Australian Bureau of Statistics. Adult literacy and life skills survey, Summary results. 422 8.0. 2006 (Re issue). Canberra: Australian Bureau of Statistics; 2008.
National Advisory Council on Dental Health. Report of the National Advisory Council on Dental Health Canberra: National Advisory Council on Dental Health (NACDH); 2012. Available from: http://www.health.gov.au/internet/main/publishing.nsf/Content/final-report-of-national-advisory-council-on-dental-health.htm . Accessed 5 May 2014.
Online OCR. Convert scanned Pdf to Word: Online OCR; 2014. Available from: http://www.onlineocr.net/ . Accessed 15 May 2014.
Lewis M, Newton J. An evaluation of the quality of commercially produced patient information leaflets. Br Dent J. 2006;201(2):114–7.
Kincaid JP, Fishburne Jr RP, Rogers RL, Chissom BS. Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Springfield: US Department of Commerce; 1975.
Flesch R. A new readability yardstick. J Appl Psychol. 1948;32(3):221.
McLaughlin GH. SMOG grading: A new readability formula. J Reading. 1969;12(8):639–46.
The University of Nottingham. How to use the SMOG calculator: The University of Nottingham; no year. Available from: http://www.niace.org.uk/misc/SMOG-calculator/smogcalc.php#userguide . Accessed 15 June 2014.
Centers For Disease Control Prevention. Simply put: A guide for creating easy-to-understand materials. Atlanta: Georgia Strategic and Proactive Communication Branch; 2009.
Kindig DA, Panzer AM, Nielsen-Bohlman L. Health Literacy: A Prescription to End Confusion. Washington: National Academies Press; 2004.
Weiss BD, Blanchard JS, McGee DL, Hart G, Warren B, Burgoon M, et al. Illiteracy among Medicaid recipients and its relationship to health care costs. J Health Care Poor Underserved. 1994;5(2):99–111.
Badarudeen S, Sabharwal S. Assessing readability of patient education materials: current role in orthopaedics. Clin Orthop Relat Res. 2010;468(10):2572–80.
Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health. 2002;92(8):1278–83.
Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J. Readability of patient education materials: implications for clinical practice. Appl Nurs Res. 1996;9(3):139–43.
The authors declare that they have no competing interests.
TB, HH and AF contributed to the design of the study, the collection and analysis of data and the write up of the report. All authors have read and approved the final manuscript.
About this article
Cite this article
Barnett, T., Hoang, H. & Furlan, A. An analysis of the readability characteristics of oral health information literature available to the public in Tasmania, Australia. BMC Oral Health 16, 35 (2016). https://doi.org/10.1186/s12903-016-0196-x
- Oral health
- Health education and promotion materials
- Health literacy