Reliability and diagnostic validity of a joint vibration analysis device
© The Author(s). 2017
Received: 3 August 2016
Accepted: 9 February 2017
Published: 16 February 2017
This observational study was designed to evaluate the reliability and diagnostic validity of Joint Vibration Analysis (JVA) in subjects with bilateral disc displacement with reduction and in subjects with bilateral normal disc position.
The reliability of selecting the traces was assessed by reading the same traces at an interval of 30 days. The reliability of the vibrations provided by the subjects was assessed by obtaining two tracings from each individual at an interval of 30 min. The validity compared the Joint Vibration Analysis parameters against magnetic resonance imaging as the reference standard. The data were analyzed with exploratory factor analysis.
The short- term reliability of the Joint Vibration Analysis outcome variables showed excellent results. Implementing factor analysis and a receiver operating characteristic as analytical methods showed that six items of the Joint Vibration Analysis outcome variables could be scaled and normalized to a composite score which presented acceptable levels of sensitivity and specificity with a receiver operating characteristic of 0.8.
This study demonstrated that the composite score generated from the Joint Vibration Analysis variables could discriminate between subjects with bilateral normal versus bilateral displaced discs.
KeywordsJoint vibration Temporomandibular disorders Reliability Diagnostic validity Factor analysis
Temporomandibular disorders (TMD) encompass a group of musculoskeletal and neuromuscular conditions that involve the TMJ, the masticatory muscles and all associated tissues; the major symptoms are pain which is often localized in the muscles of mastication or pre-auricular area; joint noises, and limitation in jaw function may be present as additional complaints . Based on the current Diagnostic Criteria, TMD can be classified into three major groups: pain-related; intra-articular; and degenerative joint disease and subluxation disorders . Within the intra-articular group, disc displacement with reduction defines a subgroup in which diagnosis has often been based on clinical finding of joint sounds . Several studies have concluded that TMJ sounds are highly variable [3–5]. Thus, the use of joint sounds as a diagnostic parameter has been questioned . The reliability among calibrated examiners of such sounds has been reported to have a Kappa value of 0.63 . The correct identification of intra-articular conditions using joint sounds has shown a sensitivity of 0.38 and specificity of 0.88, using the Magnetic Resonance Imaging (MRI) as the reference standard [8, 9].
Joint vibration analysis is based on principles of motion and friction by surfaces, which can be captured by accelerometers. Human joints in proper biomechanical relationship, in theory, should produce little friction and little vibration [10–14]; surface changes within the joint could cause greater friction and greater vibration. It has been postulated that different disorders can produce different vibration patterns or signatures in joint including the TMJs [15–17]. Vibration analysis of the TMJ is thus a quantitative process that measures the absolute intensity and frequency distribution of vibratory waves emanating from the joint during jaw motion.
Since there is controversy regarding the utilization of joint vibrations to characterize joint status and consequently diagnosis as presented in a recent systematic review , the diagnostic validity of such instrumentation used to measure and characterize this phenomenon must be tested using research designs with strong foundations including reliability evidence, blinded examiners, an acceptable reference standard such as MRI, and acceptable psychometric properties.
Furthermore the progression of joint status in participants with displaced discs has been controversial. While one report postulates a progression from disc displacement to osteoarthritis  there is substantial clinical evidence that most untreated patients improve and do not progress over time [20–25]. In addition there is MRI evidence that no change occurs in disc displacement over 22–80 months . More recently the authors of a prospective study that assessed the stability of the temporomandibular joint in disc displacement using MRIs, found that over 8 years of follow-up, 76% of the 789 baseline joint-specific soft-tissue diagnoses did not change .
A systematic review  reported several limitations in previous reports: (1) lack of blinndness, (2) nonvalidated classification systems, (3) different imaging techniques to identify control and test groups, (4) use of joint sounds per se as evidence of pathology or as a reference standard, and (5) use of joint vibration analysis (JVA) as the reference standard even though it was the device investigated.
The premise of this research was that a more technically accurate instrument and more sophisticated analysis by using factor analysis to select variables might provide more accurate information, compared to auscultation, and more inexpensive, compared to MRI, to assess the phenomenon of joint sounds. Therefore the assessment of vibrations using instrumentation such as Joint Vibration Analysis (JVA) could have the potential to provide data that could be used to assess the phenomenon and to indicate the status of the joint. We focused on the BioJVA produced by BioResearch Associates.
The objectives of this research were, first, to determine if the data associated with joint vibrations could be selected and recorded reliably, second, to analyze the multiple correlated variables with factor analysis to determine if a smaller number of variables could represent the data, and third, to determine if the sensitivity and specificity as represented by the area under the receiver operating characteristic curve were sufficiently large for potential clinical use.
The overall goal of this research was to test the diagnostic validity of the joint vibration output variables against the reference standard of the MRI evaluation by a calibrated radiologist. The underlying analytical strategy was to examine the data with exploratory factor analysis to see (1) how many latent variables, that is, factors, were in the data, (2) whether these latent factors could be interpreted in a reasonable way, and (3) whether a composite score based on the items that survived into the interpretation could be merged into a composite score with adequate sensitivity and specificity as described by a receiver operating characteristic [28, 29].
Thirty-six subjects who had undergone an MRI for their TMJs within the last two years agreed to participate in the study. Characterization of bilateral disc displacement or bilateral normal disc position was provided by a calibrated radiologist  based on MRI interpretation. The study was approved by the University at Buffalo’s Health Sciences Institutional Review Board and each subject gave informed consent.
The joint vibration analysis (JVA) in the BioPAK© system  was leased from Bioresearch Corporation and consisted of a headset encompassing accelerometers on each side, an amplifier, and software for a computer. The signals from the accelerometers were amplified by the small amplifier, which was placed around the subjects’ neck. The amplified signals were transmitted to a PC computer where they were recorded and later analyzed with the software program. Each accelerometer consists of a metal case containing a piezoelectric crystal that has a mass resting on it. This crystal reacts to acceleration by producing a minute electric charge due to compression produced by the mass, which is directly proportional to the acceleration. This is then put into an amplifier of high input impedance prior to being recorded as a vibration signal.
The subjects sat in an upright position. Their maximum unassisted opening and lateral deflections were recorded clinically and entered into the computer with the BioPAK software program. The headset device was then placed on the subject’s head with the sensors positioned over the TMJs; the subjects were instructed to watch the monitor where they observed an animation illustrating opening and closing mouth movement, synchronized to a metronome. They were then instructed to open their mouth as wide as they could and close, tapping their teeth together following and matching the animation and the metronome, which they observed on the screen. As the subject performed the opening and closing with the JVA the characteristic vibrations produced by the condyles were detected by the accelerometers and recorded in the computer.
After the first set of JVA tracings were recorded the Research Diagnostic Criteria examination  was performed, then a second set of JVA tracings were recorded. The interval between the two sets of tracings was about 30 min.
The variables [4, 30, 32] obtained were: Total Integral I (T), representing a measure of the total amount of energy in the vibration; Integral <300 Hz which is the amount of energy in the vibration that is below 300 Hz; Integral >300 Hz which is the amount of energy in the vibration that is above 300 Hz; >300/<300 Ratio which is the ratio of the high-frequency to low-frequency energy; Peak Amplitude which indicates the highest intensity of the vibration; Peak Frequency which is the frequency at which the highest intensity of the vibration occurred and Median Frequency which is the frequency such that half of the energy is below it and half is above it. These data are provided in an Additional file 1.
Reliability was assessed in three ways. First, the reliability of the examiners for range of motion data between the two clinical examiners was assessed by computing the intraclass correlation coefficient while lateral deviation was assessed with kappa. Second, the ability of two clinicians as a consensus to select the same traces after a three-month interval was assessed by comparing the JVA variables from those two sets of traces. Third, a test-retest protocol assessed the ability of the subjects to provide consistent data by comparing data obtained at a 30-min interval. The examiners were calibrated for Research Diagnostic Criteria for TMD .
Reliability of range of motion assessment
The two clinical examiners in this study were blinded to the MRI diagnosis avoiding bias to the instrumentation under evaluation; examiners were RDC/TMD calibrated  and provided the clinical parameters such as range of motion and deflection, which were required by the BioPAK software program to analyze the joint vibrations.
Reliability of trace selection
The selection of vibration data was done as a consensus by the two clinical examiners following the manufacturer’s protocol, which included the selection of the five largest vibration amplitudes in a trace of six to eight open-close cycles. To determine if the examiners could reliably select the JVA traces with the largest time-based signals, 15 traces were randomly selected and the traces were read at two times 3 months apart.
The recorded JVA traces were then analyed for the largest vibration amplitude that consistently occurred in each joint recording from the JVA sweep. Five large vibration amplitudes were selected from each trace by both examiners and were used to calculate frequency spectrum computed by the Fast Fourier Transform algorithm. These spectra were used for this estimation of reliability.
Data from the first recordings from the subject were compared with the recordings made 30 min later.
The number of latent variables underlying the data was investigated by exploratory factor analysis. The (log) data for each item was scaled by subtracting its mean and dividing by its standard deviation to form a z-score. The mean across the six items was taken as a composite score for each subject and a receiver operating curve was generated.
Reliability of dichotomous variables was assessed by percent agreement and Kappa values. Reliability of continuous variables was assessed by intraclass correlation coefficients. Validity was assessed by calculating the Receiver Operating Characteristic (ROC) using the composite score identified with the factor analysis.
The data were analysed using the R statistical and graphics package .
A total of 36 subjects (21 females, 15 males) participated in this study. The mean age was 39.03 ± 13.6 years. There were no statistically significant differences in age by gender. Twenty-one subjects (11 males and 10 females) had normal bilateral joints and 15 subjects (4 males and 11 females) had bilateral joints with disc displacement with reduction.
Reliability of range of motion assessment
ICC or Kappa
Pain Free Opening
0.67 – 0.99
Maximum Unassisted Opening
0.40 – 0.98
Maximum Assisted Opening
0.89 – 1.0
Test-Retest Reliability of Selection of JVA Traces
0.98 – 1.0
0.97 – 0.99
Integral > 300
0.99 – 1.0
> 300/< 300 Ratio
0.82 – 0.96
Test-Retest Reliability of JVA traces provided by subject at 30 min
0.84 – 0.93
0.83 – 0.93
Integral > 300
0.87 – 0.94
Ratio >300/< 300
0.44 – 0.76
0.81 – 0.92
0.65 – 0.85
0.54 – 0.80
The ICCs from traces selected at the three months interval by consensus of the two clinical examiners also showed excellent values (Table 1). These data suggest that the examiners reliably identified the joint vibrations in the traces three months apart and therefore the results obtained at the validity stage would not be biased by the ability of the examiners to identify the phenomenon using the instrumentation.
Reliability of joint vibrations by test-retest
The reliability of the joint vibrations as a phenomenon was evaluated over a period of 30 min. The ICCs for the JVA variables showed excellent values except for the Ratio >300/<300 item (Table 1). Based on the excellent reliability results, the mean between trace 1 and trace 2 was taken as the outcome variable for further analysis.
Graphical inspection of the raw data suggested that they were strongly non-Gaussian so the logarithm to the base 10 was taken of each data point. The box plot based on these logarithms suggested a better distribution for each variable (Fig. 1) and Shapiro-Wilks tests of each item within each group supported this. Due to doubts about the independence of data from the right and left joints, only the data from the right side were analysed.
Data from exploratory factor analysis
Integral > 300
Median Freq. Frequency
A scree plot (not shown) suggested that one or two factors might be allowed. Two factors led to several cross-loadings in the pattern matrix coefficients, some communalities greater than one, and no interpretation, so one factor was used.
Composite scores of all participants by group
The main findings of this research were that clinicians can reliably identify the tracings generated by the JVA instrumentation, that the vibration generated by the TMJs are reliable within a 30 min time period, that the data have good psychometric properties, and that exploratory factor analysis led to a composite score which had a good receiver operating characteristic.
The strengths of this research include clinical diagnostic criteria with trained and calibrated examiners, MRI TMJ soft tissue characterization by a calibrated radiologist who was blinded assessment of the data, and the use of exploratory factor analysis to assess the properties of the data and to retain relevant items from the vibration instrumentation.
We recognize that there are limitations associated with this investigation. First, this sample only included individuals with either bilateral disc displacements with reduction or bilateral normal position of the disc. This design made the results easier to interpret since there are reports that the vibration from the TMJ on one side might be detected on the other side [34, 36–38]. Clearly, unilateral disc displacement subjects need to be studied in the future, as well individuals with other intra-articular conditions in order to have a better representation of the TMD population.
Second, the imaging data and the vibration data were not concurrent. While some reports postulate a model of progression from disc displacement to osteoarthritis there are four lines of evidence that argue against the progression model. First, a large, recent, cross-sectional study failed to find evidence in favor of progression . Second, several longitudinal clinical studies failed to find evidence of progression [20–25]. Third, a study with pre and post MRI imaging failed to find evidence of progression . And fourth, a prospective 8 year follow-up study found that 76% of the joint diagnoses were stable  Therefore, although it would be preferable to have a fully parallel data set for the imaging and vibration assessment, there is no evidence that the current design jeopardized the results.
Our reliability results confirmed recent results , extended the short-term reliability from 3 min to 30 min, and extended the study population from healthy participants to a group of individuals with bilateral disc displacement with reduction.
While we believe that our approach is innovative, we want to clearly express that in its current format the approach is not ready for clinical diagnostic application. Future research could lead to the potential utility for characterization of disc position of the TMJs and to better understand the potential role of such vibrations in the intracapsular TMJ status and its impact in jaw function.
The excellent reliability obtained by the examiners reading the JVA data demonstrates that examiners can be properly trained and they can reliably identify and interpret the pertinent data produced by this technological device. In addition, the assessment of the joint vibration as phenomena can be reliably assessed within a short period of time.
Using a six-item composite score a receiver operating curve was generated (value of 0.82) suggesting that this composite score based on the vibration characterization can be used to discriminate between normal disc position and displaced disc position.
Nevertheless, the authors would like to emphasize that the results must be interpreted with caution due to the fact that the composite score is not generated by the instrumentation software, the independence of signals from each TMJ is not yet established, and because the study sample does not represent the entire spectrum of disc displacements and degenerative joint disease.
Intraclass correlation coefficient
Joint vibration analysis
Vmagnetic resonance imaging
This Research was in part supported by NIH grant# 5R01DE016417, which had no role in any part of this project.
Availability of data and materials
A file containing the joint vibration data is attached.
SS contributed to data collection, statistics, and development and editing of the manuscript. HCC contributed to conception and design, supervision of data gathering, interpretation of results, and editing of the manuscript. KK interpreted the MRI data. WDM contributed to performing and interpreting statistics, and to editing the manuscript.YMG was responsible for the study design, development of the research infrastructure, and direct supervision of the data gathering by the first author. Also, she was directly involved in the data analysis, and contributed to the development and editing of the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study was approved by the University at Buffalo’s Health Sciences Institutional Review Board (SIS0050203A) and each subject gave informed consent.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- de Leeuw R, Klasser GD. Guidelines for assessment, diagnosis, and management. In: Temporomandibular disorders. Fifthth ed. Hanover Park: Quintessence Publishing Co; 2013. p. 129–204.Google Scholar
- Schiffman E, Ohrbach R, Truelove E, Look J, Anderson G, Goulet JP, List T, Svensson P, Gonzalez Y, Lobbezoo F, et al. Diagnostic criteria for temporomandibular disorders (DC/TMD) for clinical and research applications: recommendations of the international RDC/TMD consortium network* and orofacial pain special interest groupdagger. J Oral Facial Pain Headache. 2014;28(1):6–27.View ArticlePubMedPubMed CentralGoogle Scholar
- Brown DT, Cox 2nd LK, Hafez AA, Cox CF. True normal" TMD control subjects: a rare clinical finding. Cranio. 1998;16(2):84–9.View ArticlePubMedGoogle Scholar
- Christensen LV, Orloff J. Reproducibility of temporomandibular joint vibrations (electrovibratography). J Oral Rehabil. 1992;19(3):253–63.View ArticlePubMedGoogle Scholar
- Tallents RH, Hatala M, Katzberg RW, Westesson PL. Temporomandibular joint sounds in asymptomatic volunteers. J Prosthet Dent. 1993;69(3):298–304.View ArticlePubMedGoogle Scholar
- Greene CS. Managing the care of patients with temporomandibular disorders: a new guideline for care. JADA. 2010;141(9):1086–8.PubMedGoogle Scholar
- Look JO, Schiffman EL, Truelove EL, Ahmad M. Reliability and validity of axis I of the research diagnostic criteria for temporomandibular disorders (RDC/TMD) with proposed revisions. J Oral Rehabil. 2010;37(10):744–59.View ArticlePubMedPubMed CentralGoogle Scholar
- Ahmad M, Hollender L, Anderson Q, Kartha K, Ohrbach R, Truelove EL, John MT, Schiffman EL. Research diagnostic criteria for temporomandibular disorders (RDC/TMD): development of image analysis criteria and examiner reliability for image analysis. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2009;107(6):844–60.View ArticlePubMedPubMed CentralGoogle Scholar
- Truelove E, Pan W, Look JO, Mancl LA, Ohrbach RK, Velly AM, Huggins KH, Lenton P, Shiffman EL. The research diagnostic criteria for temporomandibular disorders. III: validity of axis I diagnoses. J Orofac Pain. 2010;24(1):35–47.PubMedPubMed CentralGoogle Scholar
- Ateshian GA. A theoretical formulation for boundary friction in articular cartilage. J Biomech Eng. 1997;119(1):81–6.View ArticlePubMedGoogle Scholar
- Nitzan DW. The process of lubrication impairment and its involvement in temporomandibular joint disc displacement: a theoretical concept. J Oral Maxillofac Surg. 2001;59(1):36–45.View ArticlePubMedGoogle Scholar
- Tanaka E, Dalla-Bona DA, Iwabe T, Kawai N, Yamano E, van Eijden T, Tanaka M, Miyauchi M, Takata T, Tanne K. The effect of removal of the disc on the friction in the temporomandibular joint. J Oral Maxillofac Surg. 2006;64(8):1221–4.View ArticlePubMedGoogle Scholar
- Tanaka E, Iwabe T, Dalla-Bona DA, Kawai N, van Eijden T, Tanaka M, Kitagawa S, Takata T, Tanne K. The effect of experimental cartilage damage and impairment and restoration of synovial lubrication on friction in the temporomandibular joint. J Orofac Pain. 2005;19(4):331–6.PubMedGoogle Scholar
- Tanaka E, Kawai N, Tanaka M, Todoh M, van Eijden T, Hanaoka K, Dalla-Bona DA, Takata T, Tanne K. The frictional coefficient of the temporomandibular joint and its dependency on the magnitude and duration of joint loading. J Dent Res. 2004;83(5):404–7.View ArticlePubMedGoogle Scholar
- Chu M, Gradisar I, Mostardi R. A noninvasive electroacoustical evaluation technique of cartilage damage in pathological knee joint. Med Biol Eng Comput. 1978;16(4):437–42.View ArticlePubMedGoogle Scholar
- Chu ML, Gradisar IA, Railey MR, Bowling GF. Detection of knee joint diseases using acoustical pattern recognition technique. J Biomech. 1976;9(3):111–4.View ArticlePubMedGoogle Scholar
- Chu ML, Gradisar IA, Railey MR, Bowling GF. An electro-acoustical technique for the detection of knee joint noise. Med Res Eng. 1976;12(1):18–20.PubMedGoogle Scholar
- Sharma S, Crow HC, McCall Jr WD, Gonzalez YM. Systematic review of reliability and diagnostic validity of joint vibration analysis for diagnosis of temporomandibular disorders. J Orofac Pain. 2013;27(1):51–60.View ArticlePubMedGoogle Scholar
- Rasmussen OC. Description of population and progress of symptoms in a longitudinal study of temporomandibular arthropathy. Scand J Dent Res. 1981;89(2):196–203.PubMedGoogle Scholar
- Kalaykova S, Lobbezoo F, Naeije M. Two-year natural course of anterior disc displacement with reduction. J Orofac Pain. 2010;24(4):373–8.PubMedGoogle Scholar
- Kurita K, Westesson PL, Yuasa H, Toyama M, Machida J, Ogi N. Natural course of untreated symptomatic temporomandibular joint disc displacement without reduction. J Dent Res. 1998;77(2):361–5.View ArticlePubMedGoogle Scholar
- Manfredini D, Favero L, Gregorini G, Cocilovo F, Guarda-Nardini L. Natural course of temporomandibular disorders with low pain-related impairment: a 2-to-3-year follow-up study. J Oral Rehabil. 2013;40(6):436–42.View ArticlePubMedGoogle Scholar
- Sato S, Goto S, Kawamura H, Motegi K. The natural course of nonreducing disc displacement of the TMJ: relationship of clinical findings at initial visit to outcome after 12 months without treatment. J Orofac Pain. 1997;11(4):315–20.PubMedGoogle Scholar
- Sato S, Goto S, Nasu F, Motegi K. Natural course of disc displacement with reduction of the temporomandibular joint: changes in clinical signs and symptoms. J Oral Maxillofac Surg. 2003;61(1):32–4.View ArticlePubMedGoogle Scholar
- Yura S. Natural course of acute closed lock of the temporomandibular joint. Br J Oral Maxillofac Surg. 2012;50(7):646–9.View ArticlePubMedGoogle Scholar
- Imirzalioglu P, Biler N, Agildere AM. Clinical and radiological follow-up results of patients with untreated TMJ closed lock. J Oral Rehabil. 2005;32(5):326–31.View ArticlePubMedGoogle Scholar
- Schiffman EL, Ahmad M, Hollender L, Kartha K, Ohrbach R, Truelove EL, Zhang L, Hodges JS, Sommers E, Anderson GC, et al. Longitudinal Stability of Common TMJ Structural Disorders. J Dent Res. 2016. https://doi.org/10.1177/0022034516679396.
- Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem. 1993;39(4):561–77.PubMedGoogle Scholar
- Altman DG. Problems in dichotomizing continuous variables [letter; comment]. Am J Epidemiol. 1994;139:442–5.View ArticlePubMedGoogle Scholar
- [https://www.bioresearchinc.com/]. Accessed May 20, 2016
- Dworkin SF, LeResche L. Research diagnostic criteria for temporomandibular disorders: review, criteria, examinations and specifications, critique. J Craniomand Disord. 1992;6:301–55.Google Scholar
- Ishigaki S, Bessette RW, Maruyama T. Vibration analysis of the temporomandibular joints with degenerative joint disease. J Craniomandib Prac. 1993;11:276–83.Google Scholar
- Diagnostic criteria for temporomandibular disorders (DC/TMD) clinical examination protocol: version 02June2013 [www.rdc-tmdinternational.org]. Accessed Nov 29, 2016.
- Radke JC, Kull RS. Distribution of temporomandibular joint vibration transfer to the opposite side. Cranio. 2012;30(3):194–200.View ArticlePubMedGoogle Scholar
- R: A language and environment for statistical computing. [http://www.R-project.org/]. Accessed 14 Feb 2017.
- Took CC, Sanei S, Rickard S, Chambers J, Dunne S. Fractional delay estimation for blind source separation and localization of temporomandibular joint sounds. IEEE Trans Biomed Eng. 2008;55(3):949–56.View ArticlePubMedGoogle Scholar
- Widmalm SE, Williams WJ, Ang BK, McKay DC. Localization of TMJ sounds to side. J Oral Rehabil. 2002;29(10):911–7.View ArticlePubMedGoogle Scholar
- Widmalm SE, Williams WJ, Yang KP. False localization of TMJ sounds to side is an important source of error in TMD diagnosis. J Oral Rehabil. 1999;26(3):213–4.View ArticlePubMedGoogle Scholar
- Zhang J, Whittle T, Wang L, Murray GM. The reproducibility of temporomandibular joint vibrations over time in the human. J Oral Rehabil. 2014;41(3):206–17.View ArticlePubMedGoogle Scholar