Journal of Contemporary Orthodontics

Official Publication of Indian Orthodontic Society


Pragya, Sood, Mahajan, Chainta, and Negi: Evaluation of reliability & reproducibility of cephalometric measurements obtained from computerised software (CS8100SC) compared with manual tracing


Introduction

Broadbent1 and Hofrath2 introduced cephalometry in 1931 which is an indispensible tool used in diagnosis and treatment of dental and skeletal malocclusions. Conventionally, manual tracing is considered as benchmark in cephalometric analysis.3 Early 1990s witnessed advancement in digital radiography with the transfer of landmarks on conventional radiographs to video monitors using digitized pads4, 5 and more direct and indirect forms of digitization were available, such as charged couple device6 (CCD) and storage phosphor plates7 respectively. These reduced radiation exposures,8, 9 but direct digitization of radiographs was found to be more reproducible and accurate than indirect digitization.10 In digital images, landmarks can either be marked manually or by automated computerized identification,3 however automated computerized identification of cephalometric landmarks does not compete with manual identification in terms of accuracy of landmark position.3, 4, 5, 6, 7, 8, 9, 10, 11

Both manual and digital cephalometrics have their own advantages and disadvantages. Manual tracing is tiresome, time taking and associated with human errors like inaccurate landmark identification, measurement and calculation problems.12 Digital imaging offers several advantages over manual tracing by reducing the time needed for data acquisition and analysis.13 These are also easy to store and multiple analysis can be done over a very short period of time but has the disadvantages of both projection and tracing errors.14 Interpretation of the various types of errors are necessary in cephalometric analysis to reach correct conclusion. Both Reliability 15, 16 and Reproducibility15, 16 are crucial in the investigations for determining errors in measurement.

CS8100SC imaging software is a recently introduced cephalometric software. We did not come across any study in the literature that shows its reliability and reproducibility. So, the purpose of our study was to compare and assess the reliability and reproducibility of cehalometric measurements with digital computerized software in comparison to manual tracing.

Materials and Methods

Institutional review board approval was obtained from Ethical committee of Govt. Dental College and Hospital, Shimla, Himachal Pradesh, India with letter approval noHFW(GDC)B(12)44/2009-6097. We enrolled 50 orthodontic patients in the age group 15-30 years having Angle’s class I malocclusion undergoing treatment in the Department of Orthodontics and Dentofacial Orthopedics at H. P Govt. Dental College and Hospital, Shimla, Himachal Pradesh, India For Digital tracing, lateral cephalogram of the subjects were taken in the Natural Head Position with seated condyle. Standardized 8” ×10” dry view laser imaging film was used for each subject. All cephalograms were linked to the computer with Windows 10 operating system. The image was saved and then transferred into CS8100SC Imaging software (Figure 1). The dentofacial relationships and landmarks was identified using tool from CS8100SC toolbar after calibration of the image on a 1:1 scale. To assist landmark identification wherever necessary, the images were zoomed, enhanced for contrast and adapted for auto grey levels whereas for Manual tracing, hard copy of digital image was taken with the help of Dry View 5700 laser image printer and landmarks were identified manually (Figure 2) on acetate tracing paper 0.36mm using 4H pencil on an X-ray view box. Tracing was done by same operator to minimize error. The digital and manual tracing were then compared to evaluate differences in any of the measurements. 5 cephalograms were analyzed daily to avoid the human fatigue errors. To determine reproducibility,10 randomly selected cephalograms were retraced manually and digitally after 7 weeks of interval. Out of the 14 Parameters selected for the study 6 were linear (Figure 3) and 8 were angular (Figure 4). A total of 700 readings were recorded from the 50 patients who were enrolled in the study. Statistical significance was set at P value<0.05. Mean and standard deviations were calculated for all the data. Paired t- test was used to evaluate statistical significance for comparing mean values between corresponding data sets. Intraclass correlation coefficients (ICC) was used to determine in reliability as well as to evaluate reproducibility for each cephalometric parameter. ICC value of 0.75 was indicative of low agreement whereas ICC values of >0.75 indicated of a good agreement. All continuous variables were calculated as Mean ± SD (Table 1).

Results

The manual and digital cephalometric readings were compared (Table 1) and no statistical differences were found for ANS-Me, Co-Pt. A, Co-Gn, Facial axis, FMIA and IMPA whereas significant differences were found for N-ANS, A-Pog, S-N, FMA, SNA, SNB, ANB and Facial angle. Intraclass correlation coefficient value for Reliability (Table 2) showed high agreement for all the parameters except ANB. Intraclass correlation coefficient values for Reproducibility (Table 3) showed high agreement for all the parameters except Facial axis, Facial angle, ANB and FMIA which showed less reproducibility.

Figure 1

Digital tracing

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/ee39eab0-2995-4e6a-861c-0bd864ae40beimage1.png
Figure 2

Manual tracing

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/ee39eab0-2995-4e6a-861c-0bd864ae40beimage2.png
Figure 3

Linear parameters 1. N-ANS: Nasion to Anterior nasal spine 2. ANS –Me: Anterior nasal spine to Menton 3. S-N: Sella to Nasion 4. A-Pog: Point A to Pgo 5. Co- pt.A: Condylion to point A 6. Co-Gn: Condylion to Gnathion

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/ee39eab0-2995-4e6a-861c-0bd864ae40beimage3.png
Figure 4

1.Angular Parameters FMA: Angle between Frankfort Horizontal plane and mandibular plane 2. SNA: Angle between Sella, Nasion and Point A 3. SNB: Angle between Sella, Nasion and Point B 4. ANB: Angle between Point A, Nasion and Point B 5. FMIA: Angle between Frankfort Horizontal plane and long axis of mandibular incisor 6. IMPA: Angle between mandibular plane and long axis of mandibular incisor 7. Facial axis: Angle between Basion- Nasion and Ptm to Gnathion 8. Facial angle: Angle between Nasion, Pogonion and FHP

https://s3-us-west-2.amazonaws.com/typeset-prod-media-server/ee39eab0-2995-4e6a-861c-0bd864ae40beimage4.png

Table 1

Mean, Standard deviation, t-value and p-value of both digital and manual cephalometric measurements

Parameters

Digital

Manual

p value

Mean

SD

Mean

SD

N-ANS (mm)

49.41

2.81

49.88

2.88

0.000**

ANS- Me(mm)

60.89

5.30

60.86

5.30

0.790

A- Pog (mm)

49.52

4.62

49.92

4.57

0.002**

S-N (mm)

65.72

3.66

66.02

3.55

0.008**

Co-Pt. A(mm)

82.49

4.75

82.28

4.80

0.159

Co-Gn (mm)

108.42

6.90

108.20

6.55

0.171

FMA (degree)

23.68

4.92

24.10

4.91

0.023*

SNA (degree)

82.62

3.36

81.80

3.27

0.000**

SNB (degree)

79.56

3.18

78.98

3.12

0.000**

ANB (degree)

3.04

0.89

2.84

0.76

0.023*

Facial Axis (degree)

90.54

3.24

90.20

2.83

0.183

Facial Angle (degree)

88.90

2.40

88.22

2.21

0.000**

FMIA (degree)

60.30

5.00

61.02

6.75

0.215

IMPA (degree)

95.46

5.78

94.62

7.52

0.167

N-ANS (mm)

49.41

2.81

49.88

2.88

0.000**

[i] SD- Standard deviation, *p< 0.05,**p<0.01,**p<0.001

Table 2

Infraclass correlation coefficient for reliability

Parameters

ICC

CI

N-ANS (mm)

0.962

0.846-0.990

ANS-Me (mm)

0.972

0.886-0.993

A-Pog (mm)

0.974

0.894-0.993

S-N (mm)

0.996

0.983-0.999

Co-Pt. A (mm)

0.976

0.902-0.994

Co-Gn (mm)

0.979

0.916-0.995

FMA (degree)

0.939

0.753-0.985

SNA (degree)

0.952

0.806-0.988

SNB (degree)

0.946

0.784-0.987

ANB (degree)

-0.531

-5.163-0.620

Facial axis (degree)

0.964

0.855-0.991

Facial angle (degree)

0.872

0.486-0.968

FMIA (degree)

0.955

0.820-0.989

IMPA(degree)

0.979

0.914-0.995

[i] ICC (Intraclass correlation coefficient), CI (Confidence Interval)

Table 3

Intraclass correlation coefficient for reproducibility

Parameters

1st reading ICC

2nd reading ICC

N-ANS (mm)

0.960

0.981

ANS-Me (mm)

0.948

0.956

A-Pog (mm)

0.974

0.966

S-N (mm)

0.995

0.991

Co-Pt.A (mm)

0.962

0.984

Co-Gn (mm)

0.984

0.961

FMA (degree)

0.973

0.952

SNA (degree)

0.960

0.959

SNB (degree)

0.956

0.967

ANB (degree)

0.621

0.633

Facial axis (degree)

0.760

0.924

Facial angle (degree)

0.946

0.787

FMIA (degree)

0.700

0.760

IMPA (degree)

0.856

0.891

[i] ICC (Intraclass correlation coefficient), ICC - <0.7 low agreement, >0.9 high agreement

Discussion

This study was done to compare 14 commonly used cephalometric parameters obtained from digital tracing followed by hand tracing to check the reliability and reproducibility. Inaccuracy in landmark identification is a major source of error in cephalometric analysis and it is greatly affected by operator experience. For digital method mouse-driven cursor was used to identify the landmarks and the measurements were determined automatically whereas in manual tracing landmarks identification and measurements were both done manually. According to Gravely and Benzies et al.17 when the landmarks are traced manually on digital radiographs it results in less measurement errors, so it may be the best strategy.

In our study we found that there was no statistically significant difference in 6 parameters (ANS-Me, CO-Pt. A, Co-Gn, Facial axis, FMIA and IMPA) thereby implying that there is no difference in readings between manual and digital tracings and CS8100SC software was found to be acceptable for recording the values of these parameters. Similar non-significant findings were reported by Shahakbari et al.18 for the value of ANS-Me, Mahto et al.3 for Co-Pt. A, Ganna et al.19 for Co-Gn, Cavdar et al.20for facial axis, Farooq et al.21 for FMIA and Gregston et al.5 for IMPA. However contrary to our findings regarding these six parameters, Izgi et al.22 found significant value for ANS-Me, Co-Pt.A, Co-Gn and found that problem in landmark identification was the reason behind this. Similarly, Ganna et al.19 found significant value for FMIA, IMPA and found problem in identifying lower incisor apex due to superimposition of structures and FH plane. Remaining 8 parameters (N-ANS, A-Pog, S-N, FMA, SNA, SNB, ANB and Facial angle) were statistically significant in our study. These parameters came significant because of difficulty in identification of landmarks. During manual tracing different reference planes were constructed to assist in identifying points such as Gn and Go which were not possible with on screen digitization. Regarding N-ANS, we found difficulty in identification of point N similar to the finding reported by Sekiguchi and Savara et al.23 who also found difficulty in marking point N due to inaccurate visualization of nasofrontal suture. In our study A-Pog was also found significant due to problem in identification of point A and Pog and Prabhakar et al.24 also found difficulty in identification of point A in their studies. S-N was found to be significant due to difficulty in locating point N and similar finding was reported by Agrawal et al.25 but contrary finding was reported by Albarkati et al.15 We also observed FMA value to be significant due to difficulty in locating point Gonion because of poorly defined anatomical outline, a double image and localization away from the mid-sagittal plane. Similar finding was reported by Santoro et al.26 whereas contrary to this, Mahto et al.3 did not find this to be significant. The values of SNA, SNB and ANB was found significant due to problem in identification of point nasion and point A. Albarkati et al.15 and Gregston et al.5 have also reported significant value of SNA and SNB. Contrary to this finding Ganna et al.,19 Mahto et al.3 and Khan et al.27 found non-significant value of SNA and SNB. Santoro et al.26 also found significant value of ANB due to difficulty in identification of landmarks like point A and nasion but contrary to this, Izgi et al.22 and Mahto et al.3 found non-significant value of ANB. Facial angle was also found significant in our study due to difficulty in locating Nasion, Pog and FH plane, similar findings were reported by Baumrind et al.12 and Santoro et al.26 for facial angle. Contrary to this, Agrawal et al.25 found non significant value of facial angle. In our study we found good reliability of all the parameters except for ANB (Table 2). Previous studies by Santoro et al.26 also found trouble in identification of point A. Sekiguchi and Savara et al.23 found nasion to be difficult to identify when the nasofrontal suture is not accurately visualized. These findings support the less reliability of ANB, whereas Facial axis, Facial angle ANB and FMIA showed less reproducibility in comparison to other parameters investigated in this study (Table 3). According to Chen et al.11 porion, orbitale and gonion shows great variation and thus demonstrates low level of reproducibility. According to Santoro et al.,26 point A is notorious for its poor reproducibility. The values of Facial axis, Facial angle, ANB showed less reproducibility in our study probably because landmarks like point A, Porion, Orbitale having poor reproducibility were included in them. In our study the measurement difference was less than 2 units (Table 1) and according to Schultze et al.28 when the measurement difference is less than 2 units (mm or degree) that is within the one standard deviation of norm values of conventional cephalometric analysis between the two techniques, it is considered to be clinically insignificant or clinically acceptable.

Conclusion

Digital tracing using CS8100SC Imaging software significantly correlates with traditional manual tracing technique for 8 out of 14 parameters. No statistical differences were found for ANS-Me, Co-Pt. A, Co-Gn, FMIA, Facial axis and IMPA. Whereas significant differences were found for N-ANS, S-N, A-Pog, FMA, SNA, SNB, ANB and Facial angle but were clinically acceptable. Digital measurements obtained from software CS8100SC are reliable except for the ANB which showed low agreement. Whereas Reproducibility between manual and digital tracing is good except for ANB, Facial axis, Facial angle and FMIA. Hence, it is concluded that CS8100SC software can be used for the cephalometric measurements of the parameters included in the study.

Source of Funding

None.

Conflict of Interest

There is no conflict of interest in our study.

References

1 

BH Broadbent A new x-ray technique and its application to orthodontiaAngle Orthod1931124566

2 

H Hofrath The importance of X-ray distance and distance imaging for the diagnosis of jaw aneomalisProgress Orthod1931123258

3 

RK Mahto OP Kharbanda R Duggal A comparison of cephalometric measurements obtained from two computerized cephalometric softwares with manual tracingJ Indian Orthod Soc201650316270

4 

DB Forsyth WC Shaw S Richmond Digital imaging of cephalometric radiography. Part I: Advantages and limitation of digital imagingAngle Orthod19966613742

5 

MD Gregston T Kula P Hardman A Glaros K Kula Comparison of conventional and digital radiographic methods and cephalometric analysis software: I. Hard tissueSemin Orthod200410320415

6 

WS Boyle GE Smith Charge couple semiconductor devices Bell Syst Tech J19704958793

7 

HV Seggern Photostimulable x-ray storage phosphorus. A review of the present understandingBrazilian J Phys199929225468

8 

H Visser Dose reduction by direct digital cephalometrics radiographyAngle Orthod200171315963

9 

K Seki T Okano Exposure reduction in cephalography with a digital photostimulable phosphor imaging systemDentomaxillofac Radiol199322312757

10 

A Richardson Comparison of traditional and computerised method of cephalometric analysisEur J Orthod1981311520

11 

YJ Chen SK Chen HF Chang KC Chen Comparison of landmark identification in traditional versus computer- aided digital cephalometryAngle Orthod200070538792

12 

S Baumrind RC Frantz The reliability of head film measurements 2. Conventional angular and linear measuresAm J Orthod197160550522

13 

M Erkan HG Gurel M Nur B Demirel Reliability of four different computerized cephalometric analysis programsEur J Orthod201234331839

14 

JF Gravely PM Benzies The clinical significance of tracing error in cephalometryBrit J Orthod19741395101

15 

SF Albarakati KS Kula AA Ghoneima The reliability and reproducibility of cephalometric measurements a comparison of conventional and digital methodDentomaxillofac Radiol2012411117

16 

G Power J Breckon M Sherriff F Mcdonald Dolphin Imaging Software: Analysis of the accuracy of cephalometric digitization and orthognathic predictionInt J Oral Maxillofac Surg200534661945

17 

JF Gravely PM Benzies The clinical significance of tracing error in cephalometryBrit J Orthod198413448

18 

R Shahakbari M Pahlevankashi M Eshghpour A Ataii Comparison of Digital Cephalometric Tracing by Onyx Ceph Software versus Manual MethodInt J Contemp Dent Med Rev2018115

19 

PS Ganna SK Shetty MK Yethadka A Ansari An Evaluation of the errors in cehalometric measurement on scanned lateral cephalometric measurement on scanned lateral cephalometric images using computerised cephalometric program and conventional tracingJ Ind Orthod Soc20144838892

20 

K Cavdar S Ciger A Zeynep A comparison of conventional and computerised cephalometric methodsClin Dent Res2011353340

21 

MU Farooq MA Khan S Imran A Sameera A Qureshi SA Ahmed Assessing the reliability digitalized cephalometric analysis in comparison with manual cephalometric analysisJ Clin Diagn Res20161010203

22 

E Izgi FN Pekiner Comparative Evaluation of Conventional and Onyx Ceph Dental Software Measurements on Cephalometric RadiographyTurk J Orthod20193228795

23 

T Sekiguchi BS Savara Variability of cephalometric landmarks used for face growth studiesAm J Orthod197261660321

24 

R Prabhakar P Rajakumar MK Karthikeyan R Saravanan NR Vikram A Reddy A hard tissue cephalometric comparative study between hand tracing and computerized tracingJ Pharm Bioall Sci2014611017

25 

N Agarwal DK Bagga P Sharma A Comparative study of Cephalometric Measurements with Digital versus Manual MethodsJ Ind Orthod Soc20114528493

26 

M Santoro K Jarjoura J Thomas Accuracy of digital and analogue cephalometric measurements assessed with sandwich techniqueAm J Orthod Dentofac Orthop2006129334551

27 

FA Khan P Joneja DS Choudhary R Ahmed S Tikekar Differentiation of evaluation of reliability of cephalometric analysis of cephalometrically diagnosed skeletal class I malocclusion using available digital imaging software such as IMAGE J and ICY and traditional manual tracingIndian J Dent Sci2021132806

28 

R Schultze M Dent MB Gloede GM Doll Landmark identification on direct digital versus film based cephalometric radiographs- A human skull studyAm J Orthod Dentofac Orthop2002122663577



jats-html.xsl


This is an Open Access (OA) journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International, which allows others to remix, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.

  • Article highlights
  • Article tables
  • Article images

Article History

Received : 10-08-2022

Accepted : 01-03-2023


View Article

PDF File   Full Text Article


Downlaod

PDF File   XML File   ePub File


Digital Object Identifier (DOI)

Article DOI

https://doi.org/10.18231/j.jco.2023.005


Article Metrics






Article Access statistics

Viewed: 577

PDF Downloaded: 175