Skip to main content

CpG immunostimulatory oligodeoxynucleotide 1826 as a novel nasal ODN adjuvant enhanced the protective efficacy of the periodontitis gene vaccine in a periodontitis model in SD rats

Abstract

Background

We previously demonstrated that nasal administration of periodontitis gene vaccine (pVAX1-HA2-fimA) or pVAX1-HA2-fimA plus IL-15 as adjuvant provoked protective immunity in the periodontal tissue of SD rats. This study evaluated the immune effect of pVAX1-HA2-fimA plus CpG-ODN 1826 as an adjuvant in the SD rat periodontitis models to improve the efficacy of the previously used vaccine.

Methods

Periodontitis was induced in maxillary second molars in SD rats receiving a ligature and infected with Porphyromonas gingivalis. Forty-two SD rats were randomly assigned to six groups: A, control without P. gingivalis; B, P. gingivalis with saline; C, P. gingivalis with pVAX1; D, P. gingivalis with pVAX1-HA2-fimA; E, P. gingivalis with pVAX1-HA2-fimA/IL-15; F, P. gingivalis with pVAX1-HA2-fimA+CpG ODN 1826 (30 µg). The levels of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of rats were measured by ELISA. The levels of COX-2 and RANKL were detected by immunohistochemical assay. Morphometric analysis was used to evaluate alveolar bone loss. Major organs were observed by HE staining.

Results

30 μg could be the optimal immunization dose for CpG-ODN 1826 and the levels of SIgA antibody were consistently higher in the pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) group than in the other groups during weeks 1–8 (P < 0.05, except week 1 or 2). Morphometric analysis demonstrated that pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) significantly reduced alveolar bone loss in ligated maxillary molars in group F compared with groups B–E (P < 0.05). Immunohistochemical assays revealed that the levels of COX-2 and RANKL were significantly lower in group F compared with groups B–E (P < 0.05). HE staining results of the major organs indicated that pVAX1-HA2-fimA with or without CpG-ODN 1826 was not toxic for in vivo use.

Conclusions

These results indicated that CpG-ODN 1826 (30 µg) could be used as an effective and safe mucosal adjuvant for pVAX1-HA2-fimA in SD rats since it could elicit mucosal SIgA responses and modulate COX-2 and RANKL production during weeks 1–8, thereby inhibiting inflammation and decreasing bone loss.

Peer Review reports

Background

Periodontitis is one of the most common oral diseases worldwide and leads to the destruction of periodontal tissue, mainly in the form of inflammation of the gingiva and alveolar bone loss [1]. Besides, periodontitis is a risk factor for various systemic diseases, including cardiovascular disease, diabetes, and osteoporosis [2,3,4]. The Gram-negative anaerobic bacterium Porphyromonas gingivalis (P. gingivalis) is one of the key pathogens in chronic periodontitis [5]. Multiple studies have demonstrated that P. gingivalis could produce many virulent factors, such as gingipains, lipopolysaccharide (LPS), and fimbriae/pili, to destruct the periodontal tissue on their own or act through other mediators to induce inflammation [6, 7]. For instance, it is thought that P. gingivalis needed exogenous porphyrin and iron to survive [8]. In the inflamed periodontal pocket, cysteine proteases bound heme with domains such as hemagglutinin-2 (HA2), and high-affinity HA2-hemin binding would be a ready source of heme-associated porphyrin and iron required for growth and virulence and participate in cell-surface heme deposition [9, 10]. The polymer of the fimA protein (fimbrillin), encoded by the gene fimA, is an important virulence factor of P. gingivalis [11,12,13]. It plays an important role in the pathogenesis of P. gingivalis, which is closely related to periodontitis [14].

In previous studies, we developed a gene vaccine (pVAX1-HA2-fimA) for periodontitis. Those studies have demonstrated that nasal administration of pVAX1-HA2-fimA induced FimA-specific and HA2-specific secretory immunoglobulin A (S-IgA) antibodies in saliva, thereby reducing alveolar bone loss due to oral infection with P. gingivalis [15,16,17,18]. It is well known that one of the main tasks in the development of periodontitis vaccines is to improve their immunogenicity. Traditionally, vaccines, especially mucosal vaccines, generally require the use of adjuvants to achieve these objectives. This study aimed to investigate whether the immunogenicity of the periodontitis gene vaccine (pVAX1-HA2-fimA) could be further improved by including some adjuvants.

In recent years, CpG oligodeoxynucleotides (CpG-ODNs) have been widely used as new options for vaccine adjuvants based on their strong capacity to safely enhance vaccine immunogenicity. The unmethylated CpG-ODNs are ligands and agonists for human and mouse toll-like receptor 9 (TLR9). When CpG-ODNs served as vaccine adjuvants, they could enhance the induction of vaccine-specific humoral and cellular immune responses [19,20,21,22,23,24]. For example, Kataoka et al. showed that nasal CpG-ODN effectively enhanced dendritic cells and supplied balanced rFimA-specific IgA protective immunity against P. gingivalis in the respiratory tract [19]. Khodadadi et al. demonstrated that combined use of CpG-ODN adjuvant enhanced the immune protection and efficacy of a multi-epitope DNA vaccine [20]. So far, three major types of immunostimulatory CpG ODNs (A, B, or C type) have been well characterized. B-type CpG ODNs contain one or more CpG motifs with phosphorothiolate bond instead of phosphodiester linkage. The phosphorothiolate bond enhances resistance to DNase digestion and substantially prolongs in vivo half-life [25]. B-type CpG ODNs could markedly activate B cells to produce antibodies, but induce relatively little IFN-α secretion or natural killer (NK) cell activity [26]. CpG-ODN 1826, a well-known B-type CpG, has been successfully tested in various vaccination models and exerted an immune enhancing effect on its own or when used as an adjuvant for vaccines [27,28,29].

In this study, to study the influence of CpG-ODNs on the immunogenicity of periodontitis gene vaccine (pVAX1-HA2-fimA), a vaccine containing CpG-ODN 1826 (5’-TCC ATG ACG TTC CTG ACG TT-3’) was assembled. We evaluated the specific immune responses and protective efficacy in SD rats given a periodontitis gene vaccine (pVAX1-HA2-fimA) plus CpG-ODN 1826 adjuvant to prevent oral infection by P. gingivalis by measuring the levels of SIgA antibody, alveolar bone loss, and immune-inflammatory modulation. Besides, we also compared the effect of CpG-ODN 1826 with that of the previously used IL-15 adjuvant to our pVAX1-HA2-fimA periodontitis gene vaccine in this study.

Methods

Animals

Forty-two, 4- to 6-week-old, healthy, male Sprague Dawley (SD) rats (100 ± 10 g) were included in the study. The animals were purchased from TianQin Biotechnology Company of Changsha and kept in the Special Key Laboratory of Oral Diseases, Higher Education Institution in Guizhou Province. This study was approved by the medical ethics committee of Zunyi Medical University (Approval No. YJSKTLS-2018-2021-034A) and all studies involving animals were reported in accordance with the ARRIVE guidelines for reporting experiments involving animals [30].

Antigen and adjuvant

Plasmid pVAX1 expressing pVAX1-HA2-fimA and pVAX1-HA2-fimA/IL-15 was constructed by the research group in the early stage and stored in the Special Key Laboratory of Oral Diseases, Higher Education Institution in Guizhou Province, as described previously [31]. The purity of pVAX1-HA2-fimA and pVAX1-HA2-fimA/IL-15 was determined by SDS-PAGE, and no contaminating protein bands were noted.

Experimental groups

First, six groups of SD rats (3 SD rats/group) were administered drops to bilateral nasal mucosa to detect the expression of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of SD rats. Control groups were administered to bilateral nasal mucosa with 100 ug of pVAX1 (group I), 100 ug of pVAX1-HA2-fimA (group II), 100 ug of pVAX1-HA2-fimA/IL-15 (group III), respectively. Experimental groups were administered to bilateral nasal mucosa with 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (10 μg) (group IV), 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) (group V), and 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (50 μg) (group VI), respectively. Each SD rat was administered drops to bilateral nasal mucosa on weeks 0, 1, and 3. Before immunization by nasal mucosal drip and during the 1st-10th weeks after immunization, rats were injected weekly with 2% trichothecene drops (0.2 mg/100 g body weight) subcutaneously through the neck, and 0.5 mL of saliva was collected after 5 min of injection, followed by centrifugation at 4 °C for 10 min (12,000 rpm), and impurities were discarded for detection using the ELASA method as described elsewhere [32].

Next, Forty-two SD rats were randomly assigned to the blank group (group A), saline group (group B), pVAX1 group (group C), pVAX1-HA2-fimA group (group D), pVAX1-HA2-fimA/IL-15 group (group E), and pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) group (group F) with 7 SD rats in each group. Except for group A, the remaining 5 groups of 35 SD rats were used to construct periodontitis models. Subsequently, the SD rats in the group B–F were administered to bilateral nasal mucosa with 100 ug of saline, 100 ug of pVAX1, 100 ug of pVAX1-HA2-fimA, 100 ug of pVAX1-HA2-fimA/IL-15, and 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) on weeks 0, 1 and 3, respectively. Before immunization by nasal mucosal drip and during the 1st–5th weeks after the last immunization (on week 3), the saliva of 42 SD rats was collected using the same method described above, and the levels of FimA-specific and HA2-specific secretory IgA antibodies were measured separately using the ELISA method.

Establishment of SD rat periodontitis models

Seven SD rats of group A and 35 immunized SD rats of group B–F were used to establish periodontitis models by the following surgery. At week 4, rats in all groups (A–F) were anesthetized with 10% chloral hydrate (0.3 mL/100 g). A 4–0 wire was placed in the dentogingival area of both maxillary second molars. Rats in the experimental groups (B–F) were inoculated with 200 µL (1 × 109 CFU/mL) of P. gingivalis at the silk ligation, and the control group (A) was inoculated with 200 µL of BHI broth. Inoculation was performed three times a day for three consecutive days. The gingival status, tooth looseness, and wire loss were observed weekly, and ligation was performed again after anesthesia if there was wire loss. One rat from each of group A and group C was executed by excessive anesthesia at week 8, and the maxilla was dissected and separated. Histopathological sections of the maxilla on one side were observed by HE staining using the method as described elsewhere [33], and the maxilla on the other side was treated to observe the degree of alveolar bone resorption under a microscope and photographed.

Histopathological examination

All SD rats in group A–F were executed at week 8 to obtain organs and maxillary periodontal tissues. SD rat organs, including heart, liver, spleen, lung, and kidney, were harvested and preserved in 10% buffered formalin, followed by HE staining treatment. All maxillary periodontal tissues were rinsed in running tap water for 12 h. Next, the samples were fixed in 4% paraformaldehyde at 4 °C for 24 h and placed in 10% ethylenediaminetetraacetic acid (EDTA) for decalcification for 30 days. Subsequently, samples were rinsed in phosphate-buffered saline (PBS), dehydrated, embedded, and cut into 5 μm sections using a Leica microtome (Leica, Germany). After antigen retrieval and blocking were performed, the tissue sections were incubated with 3% H2O2 in methanol for 10 min to quench endogenous peroxidase activity. The sections were then rinsed with phosphate-buffered saline (PBS) and blocked with 5% BSA for 1 h and incubated with primary antibodies against COX-2 (1:100, ab179800; Proteintech Group, Inc, Wuhan City, Hubei, China) and RANKL (1:100, ab182158; Proteintech Group, Inc, Wuhan City, Hubei, China) at 37 °C for 2 h. After being washed, sections were incubated with the secondary antibody (Goat Anti-Rat IgG) for 40 min at room temperature (1:500 to 1:2,000, Abcam, Cambridge, UK). After being rinsed with PBS, 50 μL of 3,3′-diaminobenzidine (DAB) solution was added, and the mixture was left to react for 5 min. The sections were stained with hematoxylin for 1 min and rinsed with water for 1 min. Integrated optical density quantified using Image-Pro Plus 5.0 software was used to assess the expression of COX-2 and RANKL. Three views from each sample were selected for mean value calculations, and group means were calculated using the mean of the individual measurements.

Measurement of alveolar bone loss

After the sacrifice by excessive anesthesia, the rat maxillaries were boiled in deionized water for 15 min, the periodontal soft tissues were gently removed, and then soaked in 3% hydrogen peroxide for 24 h and stained with 1% methylene blue. A stereomicroscope (Leica, Switzerland) was used for observing the morphology of the alveolar bone of each group of rats. Image J software was used to measure the distance between the cemento-enamel junction and alveolar bone crest along the axis of the teeth. To assess the average alveolar bone loss, three points were measured along the axis of the teeth in the buccal and lingual regions. The average bone loss was calculated for each tooth.

Statistical analysis

The results were expressed as means ± standard deviations. Statistical differences among groups were detected by one-way analysis of variance (ANOVA) using GraphPad Prism 7 (GraphPad Inc., La Jolla, CA, USA). A P value of < 0.05 was considered to be statistically significant.

Results

Periodontitis models establishment and evaluation

After the periodontitis model was established at week 4, the periodontal condition of the maxillary second molars of SD rats in group C was examined, and it was found that there was no significant redness and swelling of gingiva, no loosening of teeth, and no obvious periodontal pocket formation (Fig. 1a). Gingival redness and swelling, tooth loosening, bleeding on probing and significant periodontal pocket formation in the maxillary second molars of the rats could be observed at week 8 (Fig. 1b). In addition, compared with the blank group (Fig. 2a), HE staining results showed that the gingival sulcus epithelium of the rats in the pVAX1 group showed erosion or ulceration, separation of the bound epithelium from the tooth surface, and proliferation of the epithelium toward the root, forming periodontal pockets. The gingival sulcus epithelium and the connective tissue beneath the bound gingival sulcus epithelium were degenerated and destroyed and formed structureless material (Fig. 2b). The alveolar bone height of rats in the pVAX1 group (Fig. 2d) was significantly reduced compared with the blank group (Fig. 2c) by stereomicroscopic examining. All the above results proved that the rat periodontitis model was successfully constructed.

Fig. 1
figure 1

Establishment of periodontitis model in SD rats. a At week 4. b At week 8

Fig. 2
figure 2

Evaluation of periodontitis model in rats at week 8. HE staining result of the maxilla on one side of one rat from each of blank group (a) and pVAX1 group (b). Scale bars represent 20 μm. Magnification, 100×. Detection of buccal alveolar bone and palatal alveolar bone damage of the maxilla on the other side of one rat from each of blank group (c) and pVAX1 group (d) by stereomicroscopy and immunohistochemical staining

Periodontitis gene vaccine-induced salivary secretory IgA (sIgA) antibodies expression

The levels of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of rats in groups I-VI were measured by ELISA from week 0 to 10, and the results showed that the levels of SIgA antibody in all groups, except the blank group, started to increase from week 1, reached the highest level at week 5 or week 6, and then started to decrease (Fig. 3a, b). The SIgA antibody levels in the pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) group were consistently higher than those in the other groups, significantly higher at week 6 (P < 0.05), and remained at a high level at week 10. Therefore, 30 μg could be the optimal immunization dose for CpG-ODN 1826 and used in subsequent experiments (Fig. 3a, b).

Fig. 3
figure 3

Expression levels of FimA-specific (a) and HA2-specific (b) secretory IgA antibodies in the saliva of SD rats at week 0–8, which were immunized with 100 ug of pVAX1 (group I), 100 ug of pVAX1-HA2-fimA (group II), 100 ug of pVAX1-HA2-fimA/IL-15 (group III), 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (10 μg) (group IV), 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) (group V) and 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (50 μg) (group VI), respectively. Asterisk represents a significant difference between group V and the other groups, respectively, *P < 0.05

Similarly, the levels of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of rats in the groups A–F were measured by ELISA from weeks 1 to 8, respectively. The results showed that the antibody levels in all groups except the blank group (group A), the saline group (group B) and the pVAX1 group (group C) increased rapidly in the first week after immunization, reached the highest level at week 6, and then decreased slowly (Fig. 4a, b). The levels of SIgA antibody were consistently higher in the pVAX1-HA2-fimA+CpG-ODN 1826 group (30 µg) than in the other groups during weeks 1–8 (P < 0.05, except week 1 or 2) (Fig. 4a, b).

Fig. 4
figure 4

Expression levels of FimA-specific (a) and HA2-specific (b) secretory IgA antibodies in the saliva of SD rats at week 0–8, which were immunized with nothing (group A), 100 ug of saline (group B), 100 ug of pVAX1 (group C), 100 ug of pVAX1-HA2-fimA (group D), 100 ug of pVAX1-HA2-fimA/IL-15 (group E), and 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) (group F), respectively. Asterisk represents a significant difference between group F and the other groups, respectively, *P < 0.05

Alveolar bone loss

A stereomicroscope observation showed that rats in groups B and C had severe alveolar bone destruction (Fig. 5b, c) compared with group A (Fig. 5a), and the administration of pVAX1-HA2-fimA with or without IL-15 or CpG-ODN 1826 inhibited the destruction of alveolar bone in the maxillary second molars of rats during the establishment of the rat periodontitis models (Fig. 5d–f). Severe alveolar bone destruction in rats in group B and C was characterized by an increased distance between the enamel-cement junction and the alveolar bone crest of the second molars (571.97 ± 47.07 μm and 562.88 ± 39.43 μm, respectively) (Fig. 5b, c). The mean distance between the enamel-cement junction and the alveolar bone crest (along the axis of the teeth) was 503.44 ± 49.46 μm and 481.77 ± 17.12 μm in the second maxillary molars in groups D and group E, respectively (Fig. 5d, e). pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) significantly reduced alveolar bone loss in ligated maxillary molars in group F compared with groups B–E (P < 0.05) (Fig. 5g).

Fig. 5
figure 5

Detection of rat alveolar bone damage by stereomicroscopy and immunohistochemical staining. Buccal and palatal alveolar bone loss were measured along the long axis of the teeth in a group A (blank), b group B (100 ug of saline), c group C (100 ug of pVAX1), d group D (100 ug of pVAX1-HA2-fimA), e group E (100 ug of pVAX1-HA2-fimA/IL-15), and f group F (100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg)), respectively. g Statistical results. Asterisk represents a significant difference between group F and group B–E, respectively, *P < 0.05

Expression of COX-2 and RANKL

The result of immunohistochemical staining showed that there was a large amount of COX-2 and RANKL in the periodontal tissue of the maxillary second molars of SD rats in groups B–F compared with group A. Specifically, the integrated optical densities of COX-2 in the groups B–F were 0.255 ± 0.0128, 0.257 ± 0.0188, 0.204 ± 0.0088, 0.195 ± 0.0172, and 0.135 ± 0.0085, respectively (Fig. 6). The integrated optical densities of RANKL in the groups B–F were 0.144 ± 0.0061, 0.139 ± 0.0079, 0.101 ± 0.0028, 0.100 ± 0.0041, and 0.065 ± 0.0021, respectively (Fig. 7). The levels of COX-2 and RANKL were significantly lower in the periodontal tissue of the maxillary second molars of SD rats in group F compared with groups B–E (P < 0.05) (Figs. 6g, 7g).

Fig. 6
figure 6

Expression of COX-2 in the periodontal tissue of the maxillary second molars of SD rats in group A-F. a group A (blank), b group B (100 ug of saline), c group C (100 ug of pVAX1), d group D (100 ug of pVAX1-HA2-fimA), e group E (100 ug of pVAX1-HA2-fimA/IL-15), and f group F (100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg)), g statistical results. Asterisk represents a significant difference between group F and group B–E, respectively, *P < 0.05. Scale bars represent 20 μm. Magnification, 200×

Fig. 7
figure 7

Expression of RANKL in the periodontal tissue of the maxillary second molars of SD rats in group A-F. a group A (blank), b group B (100 ug of saline), c group C (100 ug of pVAX1), d group D (100 ug of pVAX1-HA2-fimA), e group E (100 ug of pVAX1-HA2-fimA/IL-15), and f group F [100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg)], g Statistical results. Asterisk represents a significant difference between group F and group B–E, respectively, *P < 0.05. Scale bars represent 100 μm. Magnification, 200×

Histopathological study on organs of rat-immunized periodontitis gene vaccines

To evaluate the safety of periodontitis gene vaccines, the major organs, including heart, liver, spleen, lung, and kidney, were collected from SD rats in the groups A–F at week 8. HE staining results showed that no significant abnormities were found in all organs of SD rats treated with the periodontitis gene vaccines with or without adjuvant (Fig. 8).

Fig. 8
figure 8

Histopathological examination of organs from SD rats, which were immunized with nothing (group A), 100 ug of saline (group B), 100 ug of pVAX1 (group C), 100 ug of pVAX1-HA2-fimA (group D), 100 ug of pVAX1-HA2-fimA/IL-15 (group E), and 100 ug of pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) (group F), respectively. Scale bars represent 20 μm. Magnification, 200×

Discussion

Periodontitis is one of the most common inflammatory diseases produced by a dysbiotic subgingival microbiota, including P. gingivalis, Tannerella forsythia, and Treponema denticola [6, 34]. Accumulating evidence supports the “keystone-pathogen hypothesis” in which P. gingivalis is identified as a keystone pathogen among several bacteria present in this dysbiotic subgingival microbiota, and its colonization triggers dysbiosis and alteration of host immune responses, and other bacteria orchestrate inflammatory disease leading to bone loss [6, 34,35,36]. Because there are no obvious symptoms in the early stages, patients often already have deep periodontal pocket formation and symptoms of bone resorption by the time they seek medical attention, which can eventually lead to loosening of the teeth [37]. Vaccines are considered to be one of the most economical and effective means to prevent and treat diseases because they can effectively stimulate a protective immune response in the host. In recent years, there is increasing evidence that genetic vaccines, as a new type of vaccines after attenuated and inactivated vaccines, are effective in the prevention and treatment of periodontitis disease [38,39,40,41,42].

We previously developed a gene vaccine (pVAX1-HA2-fimA) against P. gingivalis to prevent and treat periodontitis [15,16,17,18]. However, there are still problems of poor immunogenicity and immunoreactivity of pVAX1-HA2-fimA. The emergence of immune adjuvants has solved these problems well. Toll-Like Receptors (TLRs) are a significant class of pattern recognition receptor (PRR), and because of their innate immunostimulatory properties, they have been used as candidate adjuvants for research in vaccines, particularly that which can be modified by genetic engineering or chemically synthesized, like Poly(I:C) (TLR3) and CpG DNA (TLR9) [43, 44]. CpG-ODN is a favorable vaccine adjuvant that mimics the immunostimulatory activity of bacterial DNA and TLR9 signaling and is not immunogenic itself and does not induce autoimmune responses [45]. In this study, CpG-ODN 1826 was used as an adjuvant to study the influence of the immunogenicity of the periodontitis gene vaccine (pVAX1-HA2-fimA).

It has been shown that pathogen-specific secretory IgA (SIgA) antibody (Ab) plays a critical role in the protection and homeostatic regulation of the mucosal epithelia [46]. In this study, the levels of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of rats in group I-VI were measured from week 0 to 10, respectively, and the results showed that the SIgA antibody levels in the pVAX1-HA2-fimA+CpG-ODN 1826 (30 μg) group were consistently higher than those in the other groups. Therefore, 30 μg could be the optimal immunization dose for CpG-ODN 1826 and used in subsequent experiments (Fig. 3a, b).

Several researches have demonstrated that CpG-ODN had better effects compared to other adjuvants in enhancing the organism's response to antigens, especially for less immunogenic antigens and when the dose of the immunogen was not sufficient to elicit an effective immune response [20, 47, 48]. In this study, we evaluated the specific immune responses and protective efficacy in SD rats given a periodontitis gene vaccine (pVAX1-HA2-fimA) plus CpG-ODN 1826 (30 µg) adjuvant to prevent oral infection by P. gingivalis and also compared the effect of CpG-ODN 1826 with that of the previously used IL-15 adjuvant. The levels of FimA-specific and HA2-specific secretory IgA antibodies in the saliva of rats in the group A–F were measured from weeks 1 to 8, respectively and the results showed that the levels of SIgA antibody were consistently higher in the pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) group than in the other groups during weeks 1–8 (P < 0.05, except week 1 or 2) (Fig. 4a, b). Our results were consistent with these studies, showing the effect of CpG-ODN 1826 as an adjuvant for immunization against periodontitis.

Alveolar bone loss is a prominent feature of periodontitis and is usually used as a marker of periodontitis. Tumor necrosis factor (TNF)-α and interleukin-1β (IL-1β) are inflammatory cytokines involved in periodontitis, and they can affect and amplify the inflammatory response, resulting in tissue destruction and bone loss [49]. COX-2 acts as a mediator in the inflammatory pathways and strongly activates the inflammatory response by releasing pro-inflammatory cytokines like TNF-α and IL-1β [50]. It has been demonstrated that COX inhibitors could significantly reduce alveolar bone loss in periodontitis rats [51, 52]. RANKL, a polypeptide of amino acids, binds to RANK on the cellular membranes of osteoclast precursors. It induces the conversion of osteoclast precursors into mature osteoclasts and promotes their activity, playing an important role in periodontal bone resorption [53]. Kim et al. suggested the innate immune response promoted osteoclastogenic activity by activating RANKL via TLR pathways [54]. It has been reported that RANKL-associated periodontal bone loss involved an increase of RANKL-dependent B and T cell response with P. gingivalis infection [55]. In summary, COX-2 and RANKL were susceptible markers of inflammation and periodontal tissue destruction in periodontitis. In this study, we evaluated the specific immune responses and protective efficacy in SD rats given a periodontitis gene vaccine (pVAX1-HA2-fimA) plus CpG-ODN 1826 adjuvant by measuring alveolar bone loss and immune-inflammatory modulation. A stereomicroscope observation showed that pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) significantly reduced alveolar bone loss in ligated maxillary molars in group F compared with groups B–E (P < 0.05) (Fig. 5g). The result of immunohistochemical staining showed that the levels of COX-2 and RANKL were significantly lower in the periodontal tissue of the maxillary second molars of SD rats in group F compared with groups B–E (P < 0.05) (Figs. 6g, 7g). In conclusion, treatment with pVAX1-HA2-fimA+CpG-ODN 1826 (30 µg) compared to pVAX1-HA2-fimA alone or pVAX1-HA2-fimA plus IL15 as adjuvant proved its potential in reducing the expression of COX-2 and RANKL in bone, thereby inhibiting inflammation and reducing osteoclast activation and differentiation, thus decreasing bone loss.

Safety is always the top concern in developing a vaccine. As shown in Fig. 8, no significant abnormities were found in all organs of SD rats at week 8 treated with the periodontitis gene vaccines with or without adjuvant. These results were consistent with the previous safety study on pVAX1-HA2-fimA and pVAX1-HA2-fimA/IL-15 [17], indicating that pVAX1-HA2-fimA with or without CpG-ODN 1826 was not toxic in the short term for in vivo use.

Limitations

The concentrations of CpG-ODN 1826 (10, 30, 50 µg) and the number of samples (7 per group) in this study were established with reference to literatures, such as 20 µg of CpG 1826 for 20 mice per group [56] and 50 µg of CpG 1826 for 6 BALB/c mice per group [57]. In general, the precision of the results increased with increasing concentration gradients as well as the number of samples. In this study, there were limitations in terms of concentration gradient as well as sample size.

Conclusion

In conclusion, the present investigation demonstrated that CpG-ODN 1826 (30 µg) could be used as an effective and safe mucosal adjuvant for periodontitis gene vaccine (pVAX1-HA2-fimA) since it could elicit mucosal SIgA responses and modulate COX-2 and RANKL production, thereby inhibiting inflammation and decreasing bone loss.

Availability of data and materials

Data used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CpG-ODN:

CpG oligodeoxynucleotide

P. gingivalis :

Porphyromonas gingivalis

COX-2:

Cyclooxygenase 2

RANKL:

Receptor activator of nuclear factor (NF)-B ligand

HA2:

Hemagglutinin-2

FimA:

Fimbrillin

LPS:

Lipopolysaccharide

TLR9:

Toll-like receptor 9

SD:

Sprague Dawley

TNF:

Tumor necrosis factor

IL:

Interleukin

PRR:

Pattern recognition receptor

HE staining:

Hematoxylin and eosin staining

References

  1. Pihlstrom B, Michalowicz B, Johnson N. Periodontal diseases. Lancet. 2005;366(9499):1809–20.

    Article  PubMed  Google Scholar 

  2. Mei F, Xie M, Huang X, Long Y, Lu X, Wang X, Chen L. Porphyromonas gingivalis and its systemic impact: current status. Pathogens (Basel, Switzerland). 2020;9(11):944.

    Google Scholar 

  3. Passos-Soares J, Vianna M, Gomes-Filho I, Cruz S, Barreto M, Adan L, Rösing C, Trindade S, Cerqueira E, Scannapieco F. Association between osteoporosis treatment and severe periodontitis in postmenopausal women. Menopause: J North Ame Menopause Soc. 2017;24(7):789–95.

    Article  Google Scholar 

  4. Shrihari T. Potential correlation between periodontitis and coronary heart disease—an overview. Gen Dent. 2012;60(1):20–4.

    PubMed  Google Scholar 

  5. Xu W, Zhou W, Wang H, Liang S. Roles of Porphyromonas gingivalis and its virulence factors in periodontitis. Adv Protein Chem Struct Biol. 2020;120:45–84.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Hajishengallis G. Immunomicrobial pathogenesis of periodontitis: keystones, pathobionts, and host response. Trends Immunol. 2014;35(1):3–11.

    Article  PubMed  Google Scholar 

  7. Mysak J, Podzimek S, Sommerova P, Lyuya-Mi Y, Bartova J, Janatova T, Prochazkova J, Duskova J. Porphyromonas gingivalis: major periodontopathic pathogen overview. J Immunol Res. 2014;2014:476068.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bramanti T, Holt S. Roles of porphyrins and host iron transport proteins in regulation of growth of Porphyromonas gingivalis W50. J Bacteriol. 1991;173(22):7330–9.

    Article  PubMed  PubMed Central  Google Scholar 

  9. DeCarlo A, Paramaesvaran M, Yun P, Collyer C, Hunter N. Porphyrin-mediated binding to hemoglobin by the HA2 domain of cysteine proteinases (gingipains) and hemagglutinins from the periodontal pathogen Porphyromonas gingivalis. J Bacteriol. 1999;181(12):3784–91.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Smalley J, Olczak T. Heme acquisition mechanisms of Porphyromonas gingivalis—strategies used in a polymicrobial community in a heme-limited host environment. Mol Oral Microbiol. 2017;32(1):1–23.

    Article  PubMed  Google Scholar 

  11. Hasegawa Y, Nagano K, Yoshida YF. A major fimbrilin variant of Mfa1 fimbriae in Porphyromonas gingivalis. J Dental Res Off Publ Int Assoc Dental Res. 2015;94(8):1143–8.

    Google Scholar 

  12. Hasegawa Y, Iijima Y, Persson K, Nagano K, Yoshida Y, Lamont R, Kikuchi T, Mitani A, Yoshimura F. Role of Mfa5 in expression of Mfa1 fimbriae in Porphyromonas gingivalis. J Dental Res. 2016;95(11):1291–7.

    Article  Google Scholar 

  13. How K, Song K, Chan K. Porphyromonas gingivalis: an overview of periodontopathic pathogen below the gum line. Front Microbiol. 2016;7:53.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Wang H, Zhang W, Wang W, Zhang L. The prevalence of fimA genotypes of Porphyromonas gingivalis in patients with chronic periodontitis: a meta-analysis. PLoS ONE. 2020;15(10):e0240251.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Bai G, Chen J, Miao C, Yang L, Tian Y, Liu J. The study on the construction and expression of the recombinant plasmids of Porphyromonas gingivalis HA2 gene and interleukin IL-15 gene. Genom Appl Biol. 2019;38(2):675–664.

    Google Scholar 

  16. Bai G, Miao C, Jing C, Zeng F, Yuan T, Liu J. The study of construction and expression of periodontitis gene vaccine against Porphyromonas gingivalis. Genom Appl Biol. 2018;37(11):5165–73.

    Google Scholar 

  17. Bai G, Zeng F, Yang L, Chen J, Liu J, Tian Y. Experimental study on gene vaccine pVAX1-HA2-FimA and pVAX1-HA2-FimA/IL-15 by intranasal immunization in rat. J Pract Stomatol. 2020;36(2):275–9.

    Google Scholar 

  18. Yu H, Yang Z, Zeng F, Chen J, Liu J, Bai P, Bai G. Protective effects of periodontitis gene vaccine pVAX1-HA2-FimA/IL-15 and pVAX1-HA2-FimA in rats with experimental periodontitis. J Nanjing Med Univ (Nat Sci). 2020;40(2):195–9.

    Google Scholar 

  19. Kataoka K, Kawabata S, Koyanagi K, Hashimoto Y, Miyake T, Fujihashi K. Porphyromonas gingivalis respiratory FimA-specific secretory IgA antibodies upregulated by DC-targeting nasal double DNA adjuvant are essential for elimination of. Front Immunol. 2021;12:634923.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Khodadadi M, Ghaffarifar F, Dalimi A, Ahmadpour E. Immunogenicity of in-silico designed multi-epitope DNA vaccine encoding SAG1, SAG3 and SAG5 of Toxoplasma gondii adjuvanted with CpG-ODN against acute toxoplasmosis in BALB/c mice. Acta Trop. 2021;216:105836.

    Article  PubMed  Google Scholar 

  21. Ribes S, Zacke L, Nessler S, Saiepour N, Avendaño-Guzmán E, Ballüer M, Hanisch U, Nau R. Oligodeoxynucleotides containing unmethylated cytosine-guanine motifs are effective immunostimulants against pneumococcal meningitis in the immunocompetent and neutropenic host. J Neuroinflammation. 2021;18(1):39.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Scheiermann J, Klinman D. Clinical evaluation of CpG oligonucleotides as adjuvants for vaccines targeting infectious diseases and cancer. Vaccine. 2014;32(48):6377–89.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Shirota H, Klinman D. Recent progress concerning CpG DNA and its use as a vaccine adjuvant. Expert Rev Vaccines. 2014;13(2):299–312.

    Article  PubMed  Google Scholar 

  24. Tateishi K, Fujihashi K, Yamamoto N, Hasegawa H, Ainai A, Sato K, Iho S, Yamamoto S, Maeyama J, Odagiri T, et al. CpG ODN G91 as a novel nasal ODN adjuvant elicits complete protection from influenza virus infection without causing inflammatory immune responses. Vaccine. 2019;37(36):5382–9.

    Article  PubMed  Google Scholar 

  25. Pohar J, Lainšček D, Kunšek A, Cajnko M, Jerala R, Benčina M. Phosphodiester backbone of the CpG motif within immunostimulatory oligodeoxynucleotides augments activation of Toll-like receptor 9. Sci Rep. 2017;7(1):14598.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Krieg A. CpG still rocks! Update on an accidental drug. Nucleic Acid Ther. 2012;22(2):77–89.

    Article  PubMed  Google Scholar 

  27. Jie J, Zhang Y, Zhou H, Zhai X, Zhang N, Yuan H, Ni W, Tai G. CpG ODN1826 as a promising mucin1-maltose-binding protein vaccine adjuvant induced DC maturation and enhanced antitumor immunity. Int J Mol Sci. 2018;19(3):920.

    Article  PubMed Central  Google Scholar 

  28. Kaewraemruaen C, Sermswan R, Wongratanacheewin S. CpG oligodeoxynucleotides with crude parasite antigens reduce worm recovery in Opisthorchis viverrini infected hamsters. Acta Trop. 2016;164:395–401.

    Article  PubMed  Google Scholar 

  29. Müller T, Becker E, Stallmann S, Waldhuber A, Römmler-Dreher F, Albrecht S, Mohr F, Hegemann J, Miethke T. Vaccination with the polymorphic membrane protein A reduces Chlamydia muridarum induced genital tract pathology. Vaccine. 2017;35(21):2801–10.

    Article  PubMed  Google Scholar 

  30. Percie du Sert N, Hurst V, Ahluwalia A, Alam S, Avey M, Baker M, Browne W, Clark A, Cuthill I, Dirnagl U, et al. The ARRIVE guidelines 2.0: updated guidelines for reporting animal research. J Physiol. 2020;598(18):3793–801.

    Article  PubMed  Google Scholar 

  31. Zeng F, Yang L, Liu J, Yu H, Chen J, Bai G (2019) Experiment of the periodontitis gene vaccine pVAX1-HA2-FimA and pVAX1-HA2-FimA/IL-15 by intranasal immunization in SD rats. Chongqing Med 48(10):1621–1624, 1629.

  32. Luo D, Dong X, Huang J, Huang C, Fang G, Huang Y. Pueraria lobata root polysaccharide alleviates glucose and lipid metabolic dysfunction in diabetic db/db mice. Pharm Biol. 2021;59(1):382–90.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Yang S, Cheng J, Man C, Jiang L, Long G, Zhao W, Zheng D. Effects of exogenous nerve growth factor on the expression of BMP-9 and VEGF in the healing of rabbit mandible fracture with local nerve injury. J Orthop Surg Res. 2021;16(1):74.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Hajishengallis G. Periodontitis: from microbial immune subversion to systemic inflammation. Nat Rev Immunol. 2015;15(1):30–44.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Hajishengallis G, Darveau R, Curtis M. The keystone-pathogen hypothesis. Nat Rev Microbiol. 2012;10(10):717–25.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Meyle J. Chapple I (2015) Molecular aspects of the pathogenesis of periodontitis. Periodontol. 2000;69(1):7–17.

    Article  Google Scholar 

  37. Jia L, Han N, Du J, Guo L, Luo Z, Liu Y. Porphyromonas gingivalis pathogenesis of important virulence factors of via toll-like receptors. Front Cell Infect Microbiol. 2019;9:262.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Kong F, Zheng D, She P, Ni P, Zhu H, Xu H, Su Z. Porphyromonas gingivalis B cell antigen epitope vaccine, pIRES-ragB’-mGITRL, promoted RagB-specific antibody production and Tfh cells expansion. Scand J Immunol. 2015;81(6):476–82.

    Article  PubMed  Google Scholar 

  39. Nakao R, Hasegawa H, Dongying B, Ohnishi M, Senpuku H. Assessment of outer membrane vesicles of periodontopathic bacterium Porphyromonas gingivalis as possible mucosal immunogen. Vaccine. 2016;34(38):4626–34.

    Article  PubMed  Google Scholar 

  40. O’Brien-Simpson N, Holden J, Lenzo J, Tan Y, Brammar G, Walsh K, Singleton W, Orth R, Slakeski N, Cross K, et al. Porphyromonas gingivalis A therapeutic gingipain vaccine induces neutralising IgG1 antibodies that protect against experimental periodontitis. NPJ Vaccines. 2016;1:16022.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Puth S, Hong S, Na H, Lee H, Lee Y, Kim S, Tan W, Hwang H, Sivasamy S, Jeong K, et al. A built-in adjuvant-engineered mucosal vaccine against dysbiotic periodontal diseases. Mucosal Immunol. 2019;12(2):565–79.

    Article  PubMed  Google Scholar 

  42. Sharma A, Honma K, Evans R, Hruby D, Genco R. Oral immunization with recombinant Streptococcus gordonii expressing Porphyromonas gingivalis FimA domains. Infect Immunity. 2001;69(5):2928–34.

    Article  Google Scholar 

  43. Ishii K, Coban C, Akira S. Manifold mechanisms of Toll-like receptor-ligand recognition. J Clin Immunol. 2005;25(6):511–21.

    Article  PubMed  Google Scholar 

  44. Liu Z, Lei X, Li X, Cai J, Gao F, Yang Y. Toll-like receptors and radiation protection. Eur Rev Med Pharmacol Sci. 2018;22(1):31–9.

    PubMed  Google Scholar 

  45. Makita Y, Suzuki H, Kano T, Takahata A, Julian B, Novak J, Suzuki Y. TLR9 activation induces aberrant IgA glycosylation via APRIL- and IL-6-mediated pathways in IgA nephropathy. Kidney Int. 2020;97(2):340–9.

    Article  PubMed  Google Scholar 

  46. Corthésy B. Multi-faceted functions of secretory IgA at mucosal surfaces. Front Immunol. 2013;4:185.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Hu Y, Smith D, Frazier E, Zhao Z, Zhang C. Toll-like receptor 9 agonists as adjuvants for nanoparticle-based nicotine vaccine. Mol Pharm. 2021;18(3):1293–304.

    Article  PubMed  Google Scholar 

  48. Liu C, Hashizume T, Kurita-Ochiai T, Fujihashi K, Yamamoto M. Oral immunization with Porphyromonas gingivalis outer membrane protein and CpGoligodeoxynucleotides elicits T helper 1 and 2 cytokines for enhanced protective immunity. Mol Oral Microbiol. 2010;25(3):178–89.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Guimarães M, Melo I, Adriano Araújo V, Tenazoa Wong D, Roriz Fonteles C, Moreira Leal L, Ribeiro R, Lima V. Dry extract of Matricaria recutita L. (Chamomile) prevents ligature-induced alveolar bone resorption in rats via inhibition of tumor necrosis factor-α and interleukin-1β. J Periodontol. 2016;87(6):706–15.

    Article  PubMed  Google Scholar 

  50. Ricciotti E, FitzGerald G. Prostaglandins and inflammation. Arterioscler Thrombosi Vasc Biol. 2011;31(5):986–1000.

    Article  Google Scholar 

  51. Jagadish R, Mehta D. Comparative evaluation of the efficacy of the cyclooxygenase pathway inhibitor and nitric oxide synthase inhibitor in the reduction of alveolar bone loss in ligature induced periodontitis in rats: an experimental study. J Indian Soc Periodontol. 2014;18(1):59–64.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Moro M, Oliveira M, Oliveira L, Teixeira S, Muscará M, Spolidorio L, Holzhausen M. Effects of selective versus non-selective COX-2 inhibition on experimental periodontitis. Braz Dental J. 2019;30(2):133–8.

    Article  Google Scholar 

  53. Chen B, Wu W, Sun W, Zhang Q, Yan F, Xiao Y. RANKL expression in periodontal disease: where does RANKL come from? BioMed Res Int. 2014;2014:731039.

    PubMed  PubMed Central  Google Scholar 

  54. Kim K, Cho M, Lee S, Oh H, Kang C, Ju J, Min S, Cho Y, Park S, Kim H. Human rheumatoid synovial fibroblasts promote osteoclastogenic activity by activating RANKL via TLR-2 and TLR-4 activation. Immunol Lett. 2007;110(1):54–64.

    Article  PubMed  Google Scholar 

  55. Han X, Lin X, Yu X, Lin J, Kawai T, Larosa KB, Taubman MA. Porphyromonas gingivalis infection-associated periodontal bone resorption is dependent on receptor activator of NF-κB ligand. Infect Immun. 2013;81(5):1502–9.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Sikora A, Gomez C, Le Van A, Baarda B, Darnell S, Martinez F, Zielke R, Bonventre J, Jerse A. A novel gonorrhea vaccine composed of MetQ lipoprotein formulated with CpG shortens experimental murine infection. Vaccine. 2020;38(51):8175–84.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Blake S, Bremer P, Zhou B, Petrovsky N, Smith L, Hwang C, Janda K. Developing translational vaccines against heroin and fentanyl through investigation of adjuvants and stability. Mol Pharm. 2021;18(1):228–35.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the participants in the study and members of the periodontitis vaccine study team for their dedication and contributions to the trial. We also acknowledge the experimental platform provided by Zunyi Medical University.

Funding

Data collection was supported by the Guizhou Province Science and Technology Program (Qianke Heji-ZK[2021] General 439), Guizhou Province Science and Technology Project (Qianke Heji [2019] No. 1333), Special project for the cultivation of new academic seedlings and innovative exploration of Zunyi Medical University (Talents of Qianke Heping Platform [2017]5733-037), Experimental implementation was supported by the Zunyi City Science and Technology Support Project (Zunshi Kehe HZ (2020) No. 297), Construction Projects of Medical Biomaterial Research and Development Talent Base in Guizhou Province and Zunyi City (Nos. [2018]3, and [2019]69) and Zunyi City Science and Technology Support Plan Project (Zunyi Kehe HZ (2020) No. 293).

Author information

Authors and Affiliations

Authors

Contributions

GB was the lead investigator. FZ and XL analyzed the data, HY was responsible for the immunogenicity assays, YT and XG contributed to study supervision, and JL, BC interpreted the data. The article was drafted by HY with input from YT, JL, XG, and BC. All authors contributed to the review and editing of the manuscript and approved the final version for submission. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Jianguo Liu or Yuan Tian.

Ethics declarations

Ethics approval and consent to participate

Animal studies were approved by the medical ethics committee of Zunyi Medical University (Approval No. YJSKTLS-2018-2021-034A) and all procedures were performed by the Regulations of the Animal Management Regulations and Administrative Measures on Experimental Animal. All studies involving animals were reported in accordance with the ARRIVE guidelines for reporting experiments involving animals.

Consent for publication

Not applicable.

Competing interests

There are no conflicts of interest to declare.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bai, G., Yu, H., Guan, X. et al. CpG immunostimulatory oligodeoxynucleotide 1826 as a novel nasal ODN adjuvant enhanced the protective efficacy of the periodontitis gene vaccine in a periodontitis model in SD rats. BMC Oral Health 21, 403 (2021). https://doi.org/10.1186/s12903-021-01763-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12903-021-01763-1

Keywords