Ankle Paper International Publication

Background

Visual analogue scale foot and ankle (VAS-FA score) is a new score, validated in previous studies, but never compared to AOFAS score.

Objective

Analysis of the two scores using Indian language questionnaire.

Methods

Fifty patients with Malleolar fractures were assessed for functional outcome, time for calculation of scores, difficulty in correlation and comprehension of the questionnaire, in Malayalam language. The score parameters were compared by SSPSS.

Results

There was similarity in pattern of score values in both systems but also a difference between values in each category, with VAS-FA having lower values, reflecting its efficacy. There was significant correlation, similar sensitivity and agreement between the scoring systems. VAS-FA correlated better with patient’s outcome and required less time for assessment.

Conclusion

This study shows that Indian language VAS-FA has a similar pattern of extracting scores as AOFAS and can be an efficient tool in ankle outcome assessment in Indian patients.
Introduction

Ankle injuries after either conservative or surgical treatment are sometimes followed by complications like pain, stiffness, instability and secondary osteoarthritis [1]. A wide variety of outcome measures have been proposed for use in conditions affecting the foot and ankle. Evaluation after ankle injuries can be subjective, objective or combined and in combination with radiological parameters [2]. The American Orthopaedic Foot and Ankle Society’s (AOFAS score) is the most widely used system in foot and ankle but has some drawbacks in practical application, objective assessment [3] and inadequate validation have been pointed by various authors [4,5]. This study compares a new scoring system VAS-FA, by Dr. Martines Richter from The Hannover Medical School, to the AOFAS score, and check the efficacy of the score and to see its correlation and to elicit the drawbacks of each scoring system. previous studies have validated VAS-FA with SF-36 but never has the VAS-FA and the AOFAS been correlated [5,6]. We did this study in the Indian language of Malayalam spoken by around 38 million people [7]. Translation was done using the Guillemin’s guidelines [8].

Methodology

The inclusion criteria were: 1. The study subjects are patients with malleolar fractures who have been admitted in the Department of Orthopaedics, Pushpagiri Medical College Hospital between January 2007 and January 2010. 2. Only inpatients during this period were randomly selected for this study. 3. Skeletally mature patients were selected. The exclusion criterion was: 1. Patients with other fractures of the lower limb and pelvis. 2. Patients with other debilitating conditions of spine – fracture dislocation with neurological deficits or severe head injury. 3. Patients who were not ambulant prior to injury due to any medical and surgical condition. 4. Positive medical history concerning the entire lower extremity, diabetes mellitus, drug abuse, metabolic disorder, psychiatric diseases and rheumatoid arthritis.

  • Patient selection and assessment

Fifty patients were randomly selected from the inclusion group. Old medical records were assessed; patients contacted and follow up functional status ascertained. Information regarding the nature of injury, classification, treatment protocol followed, old X-rays and history were verified from medical records. All ankle fractures were classified using Lauge-Hansen (LH) classification [9]. After eliciting history, these patients assessed for their ankle function with the AOFAS and VAS-FA scores Malayalam version made using the Guillemin’s guidelines [6,8] using the technique followed by Angthong et al. [6].

The VAS-FA score was marked by the patient on a sheet of paper with 10 cm long straight lines, in which the right end of the line indicated maximum score (1 0 0), and left end of the line indicated minimum score (0). We used a 10-cm ruler for measurement that was positioned on the score form for valuation of each question unlike the template method used in the original article [3]. The score was entered on the Microsoft excel calculation table and the pain, function and total score was elicited [3].

Time for calculation of scores in both systems was noted. Patients were also asked if they found any difficulties in correlation or comprehension while using the scores. They were also asked if time delay was a hindrance while using the systems. The number of questions unanswered was also noted. Measures like alignment and range of movement were observed and documented.The AOFAS being a subjective as well as objective score the objective parameters were done by the following method. Alignment was done by goniometric method using a caliper for finding the axis of the calcaneum. The mid axis of the leg was also drawn in a similar way and the angle between them was calculated. 0–58 valgus was considered normal, 5–108 as mild, >108 was taken as severe valgus deformity, while 0–58 varus was considered mild and 5–108 varus was severe. Foot was considered to be plantigrade when great toe, little toe and heel touched the ground. Hindfoot motion was calculated with the same method drawing the axis and comparing the range of motion to the contralateral side to decide on the degree of restriction. Sagittal motion was calculated with a goniometer and the range compared to the contralateral side to estimate the restriction. Gait was considered to be normal when patient walked without a lurch and the step length was equal, it was considered as an obvious gait abnormality when the there was a lurch of the shoulder but the step length was equal and was as a marked abnormality when lurch was associated with an unequal step length. In this study the demographic data were looked into, along with percentage of different mechanism of injury. The results were analyzed and correlated to the scores. The time spent for evaluating the different scores was recorded and compared. The correlation of pain and function scores were also looked into.

  • Statistical analysis

Data were analyzed using statistical package for social sciences (SPSS). Data were expressed in its frequency and percentage as well as mean and standard deviation. For the associations and comparisons between different parameters, Chi square (x2) test was used as nonparametric test. Student’s t test was used to compare the mean values between two groups. Multivariate Pearson correlation analysis was employed to find out relationship between various parameters. Receiver operated characteristic (ROC) analysis was carried out to conclude upon the cut-off value and the ROC curve was drawn. To compare different groups each other, non-parametric Mann Whitney’s U test was employed. Cohen’s kappa was estimated for tables that have the same categories to estimate the agreement between variables. For all statistical evaluations, a two-tailed probability of value, <0.05 was considered significant. 3. Observations and results The distribution of data in different age groups, the side of fracture, the type of fracture (open/closed), classification according to LH system, mechanism of injury and the occupa-tional distribution are noted in Tables 1–3. Varied distribution was noted with maximum number of cases in 40 – 49 age group at 24% and least incidence in less than 20 years (Fig. 1). According to LH classification 46% fractures were supination external rotation type, followed by pronation external rotation at 34%, and supination adduction and pronation abduction at 10% each. There were no pronation dorsiflexion injuries (Fig. 2). According to stage of injury maximum number of cases were noted in stage 4 at 26% followed by stage 5–22%, stage 1–20%, stage 2–18%, least was in stage 3–14% In different mechanism under LH classification (Fig. 3). 4. Comparison of scoring systems 4.1. Pain scores Pain score was divided into 3 groups and number of patients in each group noted with their scores according to AOFAS and VAS-FA systems. Maximum distribution of patients were noted in the (higher group >80%) followed by the (second 60–80%) group and then by the (third 60%) in both systems (Fig. 4).

Function score
Function score was divided into 4 groups and number of patients in each group noted with their scores according to

Table 1
Comparison of mean total score values in mild (Stages 1 and 2) with severe stages (3–5).
Total score Stage Mean SD t value P value
AOFAS Mild stage 92.37 10.83 1.809 >0.05
Severe stage 84.90 15.83
VAS-FA Mild stage 93.13 9.55 4.087 <0.001 Severe stage 75.89 16.74

Table 2

Comparison of mean function score values in closed and open fractures. Function score Type Mean SD t value P value AOFAS Closed 88.97 17.87 2.481 <0.05 Open 69.56 33.46 VAS-FA Closed 79.12 21.31 1.551 >0.05
Open 66.41 26.21

Table 3
Comparison of mean total score values in closed and open fractures.

Total score Compound Mean SD t value P value
AOFAS Closed 89.60 12.22 2.231 <0.05 Open 78.11 20.41, VAS-FA Closed 83.57 15.76 1.334 >0.05 Open 75.47 19.57

AOFAS and VAS-FA systems. Most number of patients were noted to be in the (higher group 80%) followed by (60–79), then by (40–59) and least no of patients were noted in (20–39), in both scoring systems (Fig. 5).

 Distribution of patients according to total score groups

The total scores were also divided into 3 groups and patients in each group were noted. There was maximum number of cases in (>80%) category followed by (60–79%) category and the least number of cases were noted in (40–59%) (Fig. 6).

Mann Whitney U test

Score parameters of pain, function and the total scores in both systems were compared. It was observed that, the mean VAS-FA score was persistently lower in category of pain, function with a significant P value <0.05. There was also a more significant difference in total score with VAS-FA system. Having a highly significant P value <0.01 (Fig. 7). 4.5. Student t-test 4.5.1. Comparison of mean and score values in mild (stages 1 and 2) with severe stage (3, 4 and 5) Comparison was done for total scores. And there was a significantly lower total score in severe stage compared to milder stage in both systems P < 0.01 VAS-FA and P < 0.05 AOFAS (Table 1). 4.5.2. Comparison of mean function score values in closed and open fractures Student t-test was used to compare mean scores in open and closed fractures. There was a significantly lower score in compound compared to closed in both systems though VAS-FA being less significant (Tables 2 and 3). 4.6. Multivariate correlation analysis (MCA) MCA for two score systems was done. The correlation between pain – 0.692, function – 0.788 and total – 0.801 scores in VAS-FA and AOFAS systems were very highly significant. *P < 0.05; **P < 0.001 (Table 4). 4.7. Measure of sensitivity and specificity using ROC curve Measure of sensitivity and specificity using ROC curve was done. Cut-off value for AOFAS under ROC curve was 72.0 with a sensitivity of 0.88 and specificity of 0.44. For VAS-FA the cut-off value was 64.45, sensitivity 0.88 and specificity was 0.22 (Figs. 8 and 9, Table 5). 4.8. Cohen’ kappa Measure of agreement between two scoring systems using Cohen’ kappa was done and there was very highly significant agreement between the pain, function and total scores in AOFAS and VAS-FA systems (Table 6). 4.9. TIme for assessment Average time AOFAS system requires is less, 6 min, for assessment when compared to VAS-FA system’s 9 min.

Discussion

There have been several scoring systems used for evaluation in foot and ankle [10–15]. Some evaluation schemes incorporate subjective and objective clinical variables into a numerical scale, such as the forefoot score for bunionette, forefoot score for bunion, ankle scores, heel score, tarsometatarsal or resection arthroplasty score, or ankle inversion injury scale, or into a graded nonnumerical scale, such as excellent, good, fair, and poor [10–22]. Some scores also have radiological and clinical parameters. VAS-FA is the adequate technique for data acquisition regarding objectivity and reliability in numerous studies [23,24]. Considering the limitations of existing scoring systems it was hypothesized by various authors that a new scoring system was required like Halasi et al. who used Tegner score for evaluating ankle-related activity changes [3–5,25].

The AOFAS score

It is the most popular score [2,3,5,26,27] but has some disadvantages as it is not validated, it cannot be obtained if answers are missing, and contains problematic pseudo-objective assessment [3–5] Richter et al. also defines difficulties because of non- or pseudo-objective assessment pattern of the AOFAS-score [3].

The VAS-FA score

Martinus Richter et al. constructed and validated a new score taking into consideration the flaws of existing scores, the VAS-FA score with the following features was constructed: questionnaire based on 20 subjective questions, visual-analogue-scale (VAS-FA) based rating, computerized evaluation [3]. The three different question categories pain, function, and other complaints compa-rable to the AOFAS score were included. These categories were weighed differently, because function was considered to be more important for the clinical outcome than pain alone or other complaints. More questions were included for function (n = 11) than for pain (n = 4) and other complaints (n = 5). Therefore, function is weighed higher for the final score than pain or other complaints. All questions, all categories and the entire score were designed to have the same range of possible points (0–100) for easy and distinct evaluation. Moreover, a high ‘‘stability’’ of the score against missing answers was expected. This makes it possible to obtain the entire score result and the result of the different score categories if questions are unanswered [3]. It was validated with SF-36 and Hannover questionnaire with good correlation and further the time needed for evaluating the scores was significantly lower for VAS-FA than for SF-36 and Q [3].

There have been previous studies comparing ankle scoring systems in search of a better and comprehensive system. Nilsson et al. evaluated the functional outcome in ankle fractures after surgery using Olerud and Molander ankle score (OMAS), SF 36, linear analogue scale and self rated ankle function and found that only SF-36 scores indicated that females had functional status below the age- and gender matched normative data of the Swedish population [28]. Nilsson et al. in another study on effects of a training program after surgically treated ankle fracture in a prospective randomized controlled trial using OMAS and SF-36 and found that there was a correlation between these two scores in three out of nine outcome measures [29]. Van Der Wees et al. studied the validity and responsiveness of the ankle function score (AFS) after acute ankle injury, AFS was compared with OMAS, patient-specific complaints (PSC), and global perceived effect. This study found limited evidence for the AFS as a prognostic and evaluative instrument [30]. The ankle osteoarthritis score (AOS) is another instrument that was developed for the assessment of pain in patients with ankle osteoarthritis [31,32]. The score demon-strated a high ‘‘vulnerability’’ regarding other musculoskeletal problems than at the ankle resulting in a questionable specificity for foot and ankle disorders [31]. The foot function index (FFI), was validated at the 21st Annual Summer Meeting, Boston, MA, USA, 15–17 July, 2005 and was correlated with the SF-36 for validation Budiman-Mak et al, Kuyvenhoven et al. [33–35]. Kurup et al. evaluated the function with AOFAS and visual analogue scale for pain following total ankle replacements and concluded that there was a correlation between the scores [36].
The most recent study with respect to VAS-FA score was by Angthong et al, they translated the original English version of VAS-FA into the Thai version and evaluated the validity and reliability of Thai VAS-FA in patients with foot and ankle-related problems and correlated with SF 36 score [6]. They found similar outcome as the study by Richter et al. [3].

Our study is unique in comparing the AOFAS and the VAS-FA scoring systems for the first time. A similar study is not available for comparison. Furthermore, in spite of the limitations, we have tried to correlate the various comparable parameters like pain and function. By testing the systems in a new language we have tried to assess the reproducibility and sensitivity. The drawback of this study is that AOFAS is a combined subjective and objective score and the VAS-FA is purely subjective score. Furthermore, only the pain and function parameters of the AOFAS could be compared
since the remaining variable of alignment was not present in VAS-FA.
Alignment and objective parameters were checked but could not be compared since such parameter was not present in VAS-FA. Pain and function were comparable entities along with total score. Comparing pain and function categories gave specific correlation in theses assessment categories along with total score.

Interpretations of results

  • In comparison of AOFAS with VAS-FA

The distribution of patients in the three Pain score groups was similar and this suggested that there was a similarity in distribution of patients in both scores. Similarly, distribution of patients in the four Function score groups indicated similarity between the two scores. The total scores were divided into three groups and patient distribution in each was similar.

  • Mann Whitney U test

In Score parameters of pain, function the VAS-FA score was persistently lower with a significant P value <0.05. And total score in with VAS-FA system having a highly significant P value <0.01. These persistent lower values suggested that VAS-FA score was more sensitive different parameters. 5.3.3. Students t test with LH stages Pain scores in Mild stage in both AOFAS and VAS-FA were identical at 92.11 and 93.03. Severe stages also showed an identical score 83.87 and 81.31. There was also a significantly lower score in severe stage compared to milder stage in both systems P < 0.05. Comparison was also done for function and total scores. There was a significantly lower function and total score in severe stage compared to milder stage in both systems P < 0.01 VAS-FA and P < 0.05 AOFAS. This indicates the authenticity of both scores and also a similarity in both. 5.3.4. Student t test in open and closed fractures Student t test used to compare mean scores in open and closed fractures suggested a good correlation or similarity between the systems. 5.3.5. MCA A MCA for two score systems was done. The correlation between pain – 0.692, function – 0.788 and total – 0.801 scores in VAS-FA and AOFAS systems were very highly significant. 5.3.6. ROC curve Measure of sensitivity and specificity using ROC curve showed that VAS-FA system was as sensitive as AOFAS even though, less specific. Cohen’ kappa showed very high significant agreement between the pain, function and total scores in AOFAS and VAS-FA systems. 6. Conclusion AOFAS is combined clinical and functional score while VAS-FA is purely functional score. Any questions unanswered makes the AOFAS score invalid, while this does not affect total score value in VAS-FA system. More patients found VAS-FA system correlating better with their outcome. AOFAS system requires less time for assessment when compared to VAS-FA system. VAS-FA system has more questions which help in a more comprehensive assessment of parameters. Certain questions like walking distance in AOFAS score was expressed in blocks which made assessment difficult. Our study has shown that there is a similarity in the pattern of score values in both systems. There is also a pattern in the difference between the values in each category, with VAS-FA system always having lower values, reflecting its efficacy. The MCA shows highly significant correlation but ROC curve showed a lower cut-off value for VAS-FA score with a similar sensitivity as AOFAS system but slightly less specificity. There was also highly significant agreement between the scoring systems. 7. Recommendation This study shows that VAS-FA system has a similar pattern of extracting functional outcome scores as AOFAS system. It is more comprehensive than AOFAS system because it covers a larger spectrum of daily activities. Hence the VAS-FA score can effectively be used in assessment of ankle function in place of AOFAS system, since it is equal or more efficient than AOFAS. Conflict of interest The authors declare that there is no conflict of interest. Acknowledgement I thank my institution, Dr. Pinky, and Prof. Chandrababu K.K. for all their support. There was no external source of funding in this project. References [1] Koval KJ, Zhou W, Sparks MJ, Cantu RV, Hecht P, Lurie J. Complications after ankle fracture in elderly patients. Foot Ankle Int 2007;28(12):1249–55. [2] Kitaoka HB, Alexander IJ, Adelaar RS, Nunley JA, Myerson MS, Sanders M. Clinical rating systems for the ankle-hindfoot, midfoot, hallux, and lesser toes. Foot Ankle Int 1994;15(7):349–53. [3] Richter M, Zech S, Geerling J, Frink M, Knobloch K, Krettek C. A new foot and ankle outcome score: questionnaire based, subjective, visual-analogue-scale, validated and computerized. Foot Ankle Surg 2006;12(4):191–9. [4] Symposium X—outcomes assessment in foot and ankle surgery – what instru-ment should we use? In: American Orthropaedic Foot and Ankle Society (AOFAS). 19th Annual Summer Meeting; 2003. [5] SooHoo NF, Shuler M, Fleming LL, American Orthopaedic F, Ankle S. Evaluation of the validity of the AOFAS clinical rating systems by correlation to the SF-36. Foot Ankle Int 2003;24(1):50–5. [6] Angthong C, Chernchujit B, Suntharapa T, Harnroongroj T. Visual analogue scale foot and ankle: validity and reliability of Thai version of the new outcome score in subjective form. J Med Assoc Thai 2011;94(8):952–7. [7] The world’s 100 largest languages. Sweden: Nationalencyklopedin; 2007. [8] Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1993;46(12):1417–32. [9] Lauge-Hansen N, Ankelbrud I. Genetisk Diagnosis og Reposition [dissertation]. Copenhagen, Denmark: Bispebjerg Hospital; 1942. [10] Kitaoka HB. Salvage of nonunion following ankle arthrodesis for failed total ankle arthroplasty. Clin Orthop Relat Res 1991;(268):37–43. [11] Kitaoka HB, Franco MG, Weaver AL, Ilstrup DM. Simple bunionectomy with medial capsulorrhaphy. Foot Ankle 1991;12(2):86–91. [12] Kitaoka HB, Holiday Jr AD. Metatarsal head resection for bunionette: long-term follow-up. Foot Ankle 1991;11(6):345–9. [13] Linde F, HVAS-FAs I, Jurgensen U, Madsen F. Compression bandage in the treatment of ankle sprains. A comparative prospective study. Scand J Rehabil Med 1984;16(4):177–9. [14] Buechel FF, Pappas MJ, Iorio LJ. New Jersey low contact stress total ankle replacement: biomechanical rationale and review of 23 cementless cases. Foot Ankle 1988;8(6):279–90. [15] Daly PJ, Kitaoka HB, Chao EY. Plantar fasciotomy for intractable plantar fasciitis: clinical results and biomechanical evaluation. Foot Ankle 1992;13(4):188–95. [16] Kitaoka HB, Anderson PJ, Morrey BF. Revision of ankle arthrodesis with external fixation for non-union. J Bone Joint Surg Am 1992;74(8):1191– 200. [17] Kitaoka HB, Holiday Jr AD. Lateral condylar resection for bunionette. Clin Orthop Relat Res 1992;(278):183–92. [18] Kitaoka HB, Holiday Jr AD, Campbell II DC. Distal Chevron metatarsal osteot-omy for bunionette. Foot Ankle 1991;12(2):80–5. [19] Kitaoka HB, Romness DW. Arthrodesis for failed ankle arthroplasty. J Arthro-plast 1992;7(3):277–84.

© Copyright 2022 Bangalore Shoulder Institute