Lietuvos chirurgija ISSN 1392–0995 eISSN 1648–9942
2020, vol. 19(3–4), pp. 109–119 DOI: https://doi.org/10.15388/LietChirur.2020.19.30

Predictive Value of Alvarado, Acute Inflammatory Response, Tzanakis and RIPASA Scores in the Diagnosis of Acute Appendicitis

Senol Tahir
University Clinic for Surgical Diseases “St. Naum Ohridski”, Skopje, Republic of North Macedonia
E-mail:
senol_tahir2002@yahoo.com

Andrej Nikolovski
University Clinic for Surgical Diseases “St. Naum Ohridski”, Skopje, Republic of North Macedoniа
E-mail: andrejnikolovski@ymail.com

Martina Ambardjieva
University Clinic for Surgical Diseases “St. Naum Ohridski”, Skopje, Republic of North Macedonia
E-mail:
martina.ambardzieva@gmail.com

Petar Markov
University Clinic for Surgical Diseases “St. Naum Ohridski”, Skopje, Republic of North Macedonia
E-mail:
petar.markov@ymail.com

Dragoslav Mladenovik
University Clinic for Surgical Diseases “St. Naum Ohridski”, Skopje, Republic of North Macedonia
E-mail:
d.mladenovik@hotmail.com

Gjulsen Selim
University Clinic for Nephrology, Ss. Cyril and Methodius University in Skopje, Republic of North Macedonia
E-mail:
gjulsen_selim@yahoo.com

Beti Zafirova-Ivanovska
Institute of Epidemiology and Biostatistics, Ss. Cyril and Methodius University in Skopje, Republic of North Macedonia
E-mail:
betizafirova@yahoo.com

Vlado Janevski
University Clinic for Digestive Surgery, Ss. Cyril and Methodius University in Skopje, Republic of North Macedonia
E-mail:
dr.janevski@gmail.com


Abstract. Introduction. The diagnosis of acute appendicitis (AA), as the most common cause of acute abdominal pain, has changed in the past decade by introducing scoring systems in addition to the use of clinical, laboratory parameters, and radiological examinations. This study aimed to assess the significance of the four scoring systems (Alvarado, Appendicitis Inflammatory Response (AIR), Raya Isteri Pengiran Anak Saleha Appendicitis (RIPASA) and Tzanakis) in the prediction of delayed appendectomy. Materials and methods. The study included 100 respondents, who were diagnosed with AA in the period from January 2018 to February 2019 and were also operated on. In addition to the clinical, laboratory, and ultrasonographic examinations, four scoring systems (Alvarado, AIR, RIPASA, and Tzanakis) were used to diagnose AA. According to the obtained histopathological (HP) findings, the patients were divided into 3 groups: timely appendectomy, delayed appendectomy and unnecessary appendectomy. Using the sensitivity and specificity of all 4 scoring systems, ROC analysis was performed to predict delayed appendectomy. Results. In the study that included 100 patients (58% men, 42% women), after the appendectomy was performed, the resulting HP showed that 74% had a timely appendectomy, while 16% had delayed and 10% had an unnecessary appendectomy. For the prediction of delayed appendectomy, the area under the ROC curve showed a value of 0.577 for the Alvarado score, 0.504 for the AIR, 0.651 for the RIPASA, and 0.696 for the Tzanakis. Sensitivity and specificity for the Alvarado score was 54% and 62%, for RIPASA 62.5% and 63.5%, for Tzanakis 69% and 60.8%, respectively. Combining the three scoring systems (Alvarado, RIPASA, and Tzanakis), the surface area under the ROC curve was 0.762 (95% CI 0.521–0.783), with a sensitivity of 85% and a specificity of 62%. Conclusion. In our study, the diagnostic accuracy of RIPASA and Tzanakis showed better results than Alvarado, while AIR cannot be used to predict delayed appendectomy in our population. However, the simultaneous application of all three scoring systems, RIPASA, Tzanakis and Alvarado, has shown much better discriminatory ability, with higher sensitivity and specificity, as opposed to their use alone. Combining scoring systems should help in proper diagnosis to avoid negative appendectomy, but additional studies with a larger number of patients are needed to support these results.

Key words: acute appendicitis, scoring systems, diagnosis, appendectomy.

Received: 2020/07/09. Accepted: 2020/09/01.
Copyright © 2020 Senol Tahir, Andrej Nikolovski, Martina Ambardjieva, Petar Markov, Dragoslav Mladenovik, Gjulsen Selim, Beti Zafirova-Ivanovska, Vlado Janevski. Published by Vilnius University Press. This is an Open Access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Introduction

Acute appendicitis (AA) is the most common cause of acute abdominal pain, occurring in 7 to 10% of the general population. It is an inflammation of the vermiform deformity of the appendix in the right lower quadrant of the abdomen and often the pain increases and migrates proportionally with increased inflammation [1, 2]. The therapy of AA can be conservative and surgical [3]. Delayed treatment of these patients is associated with an increased percentage of complications, so timely surgery is the gold standard for preventing blind perforations [4]. Despite advances in the diagnosis of other diseases, the diagnosis of AA remains a challenge and a dilemma for any surgeons [5].

The improvement of the accuracy of the diagnosis and reducing negative appendectomies can be achieved with diagnostic tools such as clinical signs and symptoms, laboratory findings, and radiological examinations (ultrasonography (US) and magnetic resonance imaging (MRI)). Computed tomography (CT), on the other hand, has high sensitivity (94%) and specificity (95%), but the cost of the procedure is high, and an additional problem is its availability in routine diagnostics [6, 7]. Due to all this, recently, scoring systems with their clinical diagnostic scoring have become an important part of AA diagnostic tools. These scoring systems should be non-invasive, understandable, easy to use and effective in diagnosing AA, to reduce the rate of negative appendectomy [8]. Today, multiple scoring systems are used to diagnose AA, the most common of which are Alvarado, Tzanakis, RIPASA, AIR, but new scores are constantly appearing. Scoring systems incorporate a variety of parameters: demographic data, clinical symptoms and signs, laboratory values, and radiological examinations.

Alvarado score is the most well-known and widely used, which includes 8 clinical and laboratory parameters [9], while AIR as newer also includes the C-reactive protein (CRP) [10]. The RIPASA score, which includes 18 clinical and laboratory parameters, has higher specificity in the Asian population [11], while the Tzanakis score also uses the US review, which can provide a better and faster differential diagnosis of AA [12].

This study aimed to assess the diagnostic accuracy (specificity and sensitivity) of Alvarado, AIR, Tzanakis and RIPASA scores for assessment of timely, delayed or unnecessary appendectomy and ROC analysis for prediction of delayed appendectomy.

Materials and methods

In this prospective cohort study that was conducted at the University Clinic for Surgical Diseases “St. Naum Ohridski” in Skopje, N. Macedonia 100 respondents were included. Before the study, ethical consent was obtained in accordance with the international Helsinki Protocol. All respondents signed an informed consent. Patients between the ages of 15 and 77 who received pain in the lower right quadrant (RLQ) on suspicion of AA were included in the period from January 2018 to February 2019. The study excluded pregnant patients, patients with a history of urolithiasis, patients with suspected pelvic disease, patients with tumor formation in the right inguinal region, immunocompromised patients, and patients with elective appendectomy. In all patients, in addition to clinical and laboratory tests, ultrasonography was performed preoperatively.

 

Table 1. Alvarado, AIR, RIPASA and Tzanakis scores

Parameters

 

Alvarado

AIR

RIPASA

Tzanakis

 

 

 

Female

 

 

0.5

 

Male

 

 

1.0

 

Age / under 39.9

 

 

1.0

 

Age / over 40

 

 

0.5

 

Symptoms 
signs

Pain in the right iliac fossa

 

 

0.5

 

Migratory pain in the RLQ

1

 

0.5

 

Palpatory pain in the RLQ

2

1

1.0

4

Rebound pain in the RLQ

1

 

2.0

3

Rigidity in RLQ

 

 

1.0

 

Rovsing sign / positive

 

 

2.0

 

Muscle defense

Light

 

1

 

 

Medium

 

2

 

 

Strong

 

3

 

 

Nausea / Vomiting

1

1

1.0

 

Anorexia

1

 

1.0

 

Body temperature

Elevated

1

 

 

 

>38.5 C°

 

1

 

 

37–39.5 C°

 

 

1.0

 

Duration of symptoms

<48 hours

 

 

1.0

 

>48 hours

 

 

0.5

 

Laboratory
Values

Polymorphonuclear leukocytes (%)

74–84

 

1

 

 

≥85

 

2

 

 

Left shift of neutrophils >75%

1

 

 

 

Elevation of white blood cell count

>10 000

2

 

1.0

 

10 000–14 999

 

1

 

 

>12 000

 

 

 

2

≥15 000 ce/cu

 

2

 

 

C – reactive protein

10–49 gr/l

 

1

 

 

≥50 gr/l

 

2

 

 

Urine analysis

Negative

 

 

1.0

 

Radiological m.

Ultrasonography

Positive

 

 

 

6

 

Total score

10

12

16.5

15

*Guidance and interpretation of the scores

Alvarado:

<4 – low probability of AA; 4–7 – suspect AA; >7 – definitive AA.

AIR:

0–4 – low probability of AA; 5–8 – moderate probability of AA; 9–12 – high probability of AA.

RIPASA:

<5 – probably not an AA; 5–7 – low probability of AA; 7.5–11.5 – probably an AA; >12 – definitively an AA.

Tzanakis:

<5 – low probability for AA; 6–10 – probable AA; >10 – high probability of AA.

All patients were screened with the four scoring systems: Alvarado, Tzanakis, AIR and RIPASA. Table 1 shows clinical, laboratory, and diagnostic parameters incorporated in all 4 scoring systems examined. All patients included in the study had an appendectomy, regardless of the values of the scoring systems. Patients were examined from the time of admission until discharge from the hospital, including the necessary postoperative controls, as well as obtaining a histopathological (HP) finding from the material obtained from the surgery. According to the received HP results, the patients were divided into three groups: patients with timely, delayed and unnecessary appendectomy.

The statistical program SPSS for Windows 23.0 was used for the statistical analysis of the results. A bivariate analysis was used for comparison of the three groups with timely, delayed, and unnecessary appendectomy. The Pearson Chi-square test and the Fisher exact test were used for comparison of the groups in terms of quality parameters, while the Analysis of Variance and Kruskal-Wallis tests were used as quantitative parameters. ROC analysis was used to determine the discriminatory ability of scores, Alvarado, RIPASA, AIR, Tzanakis, and their combinations for patients with appendectomy.

Results

In our study of 100 operated patients, 58% were men and 42% were women, with a mean age of 34.7±14.9 years, and the mean age of patients in the group with delayed appendectomy was 42.87±16.3 years (p = 0.017). The most common symptom was nausea (97%), while the most common clinical sign was palpable reflex sensitivity (85%), and the presence of this symptom was up to 93.75% in patients with delayed appendectomy, but there was no significant difference between the symptoms and the signs among the groups. From the laboratory tests, the most significant levels of leukocytes and neutrophilia were higher in patients with timely appendectomy (p = 0.002; p = 0.00), while CRP was reported to be the highest in patients with delayed appendectomy (p = 0.032). A positive US finding was diagnosed in 76% of respondents; significantly the highest percentage of positive findings in the group of timely and the highest percentage of negative findings in delayed appendectomy (p = 0.000) (Table 2).

In our study based on HP, 74% of patients were found to be timely appendectomies and 16% were in the late appendectomy group. Using the Alvarado, RIPASA, and the Tzanakis Scoring System, most respondents had a score higher than 8, and also the highest percentage of timely appendectomies. In the AIR score the values were 7–8. Using the Alvarado, the group score of delayed and unnecessary appendectomy was 7–8 among the majority, and using the RIPASA and Tzanakis the score was higher than 8 (Table 3).

Table 2. Description of the analyzed groups of respondents

 

Appendectomy

timely
(n = 74)

late
(n = 16)

unnecessary
(n = 10)

Age, years (mean±SD)

34.05±14.8

42.87±16.3

26.40±7.8

Sex (n (%))

male

44 (59.46)

10 (62.50)

4 (40)

female

30 (40.54)

6 (37.50)

6 (60)

Symptoms (n (%))

MP

42 (56.76)

9 (56.25)

6 (60)

RLQ

14 (18.92)

3 (18.75)

1 (10)

DP

18 (24.32)

4 (25)

3 (30)

Time after admition (mean±SD)

40.66±38.2

39.87±30.1

36.40±17.6

Anorexia (n (%))

Yes

45 (60.81)

10 (62.5)

5 (50)

No

29 (39.19)

6 (37.5)

5 (50)

Nausea (n (%))

Yes

72 (97.3)

16 (100)

9 (90)

No

2 (2.7)

0

1 (10)

Rebound

Yes

61 (82.43)

15 (93.75)

9 (90)

No

13 (17.57)

1 (6.25)

1 (10)

Body temperature (mean±SD)

37.16±0.5

37.16±0.7

36.95±0.6

WBC (mean±SD)

14.75±4.0

13.81±3.4

11.11±2.8

Leukoc. lev Shift (mean±SD)

80.19±7.6

77.49±7.5

65.11±25.6

CRP (mean±SD)

72.64±82.0

95.97±65.1

28.74±41.2

Ultrasound (n (%))

Positive

62 (83.78)

7 (43.75)

7 (70)

Negative

12 (16.22)

9 (56.25)

3 (30)

Postoperative day (mean±SD)

4.74±2.9

4.63±1.5

2.80±0.6

Complications (n (%))

No complications

70 (94.59)

14 (87.5)

10 (100)

Wound infection

3 (4.05)

2 (12.5)

0

MP – migratory pain; RLQ – right lower quadrant; DP – diffuse pain.

Table 3. Distribution of patients in relation to the height of scores with timely, delayed and unnecessary appendectomy

 

Appendectomy

Alvarado

total n
(%)

timely
n (%)

late
n (%)

unnecessary
n (%)

<7

7

3 (4.05)

1 (6.25)

3 (30)

7–8

44

31 (41.8)

9 (56.2)

4 (40)

>8

49

40 (54.0)

6 (37.5)

3 (30)

AIR

<7

20

11 (14.8)

3 (18.7)

6 (60)

7–8

45

35 (47.3)

7 (43.7)

3 (30)

>8

35

28 (37.8)

6 (37.5)

1 (10)

RIPASA

<7

0

0

0

0

7–8

8

4 (5.41)

1 (6.25)

3 (30)

>8

92

70 (94.5)

15 (93.7)

7 (70)

Tzanakis

<7

1

0

0

1 (10)

7–8

4

2 (2.7)

2 (12.5)

0

>8

95

72 (97.3)

14 (87.5)

9 (90)

Table 4 shows that in all 4 scores there was a statistically significant difference between the three groups, timely, delayed and unnecessary appendectomies (Alvarado, p = 0.027; AIR, p = 0.003; RIPASA, p = 0.000; Tzanakis, p = 0.000). In terms of intergroup comparisons, the Alvarado score found a statistically significant difference between timely and unnecessary appendectomies (p = 0.035), the AII score between the time needed (p = 0.003) and the late time needed (p = 0.019), in RIPASA scores between timely and unnecessary appendectomies (p = 0.000), and in Tzanakis the scores between late and delayed (p = 0.032) and between timely and unnecessary appendectomies (p = 0.014).

Table 4. Mean values of scores and tested differences in scores between Alvarado, AIR, RIPASA and Tzanakis scoring systems

 

timely

late

unnecessary

p

Alvarado

8.53±1.0*

8.25±1.2

7.40±1.3*

0.027

AIR

8.08±1.5*

8.0±1.2**

6.20±1.4*/**

0.003

RIPASA

11.03±1.9*

10.09±1.4

8.60±0.9*

0.000

Tzanakis

13.31±2.5*/**

11.12±3.1*

10.80±2.4**

0.000

Alvarado – *(p = 0.035); AIO – *(p = 0.003), **(p = 0.019); RIPASA – *(p = 0.000); Tzanakis – *(p = 0.32), **(p = 0.014).

ROC analysis for prediction of delayed appendectomy showed that the surface area below the ROC curve for the Alvarado score was 0.577, with a sensitivity of 54% and a specificity of 62%; for the RIPASA score the value was 0.651, with a sensitivity of 62.5% and a specificity of 63.5%, and for the Tzanakis score the value was 0.696, with a sensitivity of 69% and a specificity of 60.8%. Regarding the AIR score, the ROC analysis showed that the size of the area under the ROC curve was 0.504, so this scoring system was not useful in isolating patients with delayed and timely appendectomy (Table 5, Figures 1 and 2).

Table 5. AUC, sensitivity and specificity of scores when predicting late appendectomy

 

AUC

95% CI

sensitivity
%

specificity
%

Alvarado

0.577

0.411–0.745

54

62

AIR

0.504

0.362–0.647

 

 

RIPASA

0.651

0.521–0.781

62.5

63.5

Tzanakis

0.696

0.541–0.850

69

60.8

Alvarado, RIPASA, Tzanakis

0.762

0.618–0.907

85

62

Combining the three scoring systems (Alvarado, RIPASA and Tzanakis), the surface area under the ROC curve was 0.762 (95% CI 0.521–0.783), with a sensitivity of 85% and a specificity of 62% (Table 5, Figure 3).

 

1-99.png 1-88.png 

Figure 1. ROC curve for prediction of delayed appendectomy with Alvarado and AIR score

 

2-77.png 2-66.png 

Figure 2. ROC curve for predisposition to delayed appendectomy with RIPASA and Tzanakis score

 

3-11.png 

Figure 3. ROC curve for prediction of delayed appendectomy in combination with Alvarado, RIPASA and Tzanakis score

Discussion

Acute appendicitis is one of the most common causes of emergency surgery, and despite the high prevalence, its diagnosis is still a challenge [1, 2]. In practice, surgeons often encounter a dilemma whether to perform an unnecessary appendectomy or delay it, and hence the decision requires diagnostic accuracy. The rate of removal of normal appendixes, which ranges between 15–30%, is still high [13]. According to the literature, the criteria for diagnostic quality is considered to be: a 15% rate for negative appendectomies, 10% for negative laparotomies, 35% for threatening perforations, and 15% for perforated appendectomies [3–6, 14, 15]. In our study, according to the obtained HP findings, 90% were positive for AA, of which 74% had a timely and 16% had a delayed appendectomy, while 10% had an unnecessary appendectomy. Similar results were presented in the study of Kalliakmaniset et al., which included a representative number of respondents (717 operated patients), and HP findings showed that 11% of appendectomies were unnecessary [16]. Of the total number of patients operated on in our study, 58% were men and 42% were women, and the mean age of patients in the group with delayed appendectomy was 42.87±16.3 years. Men did not differ significantly from women in the outcome after obtaining the HP finding. In addition to the known clinical signs and symptoms present in the examined population, no significant difference was found between the three groups. From laboratory tests, the most significant levels of leukocytes and neutrophilia were significantly higher in patients with timely appendectomy (p = 0.002; p = 0.00), while CRP was observed with the highest value in patients with delayed appendectomy (p = 0.032). In comparison, there are several studies in the literature that have similarities in the values obtained [17] and it is considered that the differences that occur in the demographic characteristics are due in part to the different exclusion criteria.

Recently, however, scoring systems with their clinical diagnostic scoring have become an important part of AAs diagnostic tools. These scoring systems should be non-invasive, understandable, easy to use, and effective in diagnosing AA to reduce the rate of negative appendectomy [8]. The importance of this study consists in examining the four most used scores in our population.

The Alvarado Scoring system is the first and most widespread score based on clinical signs and laboratory values, with precision and clinical approval. In our study, 49% of respondents had a score of >8, followed by the highest percentage of timely appendectomies (54.0%). The mean value of patients with timely, delayed, and unnecessary appendectomy was 8.53±1.0, 8.25±1.2, 7.40±1.3 (p = 0.027), with a significant difference between timely and unnecessary appendectomies (p = 0.035). With values obtained for the area under the ROC curve of 0.577, and with a sensitivity of 54% and a specificity of 62%, the Alvarado score proved to be a weak discriminator in isolating patients with delayed and timely appendectomy. However, the systematic review of Ohle et al. [18] where 42 studies were analyzed, showed that Alvarado score could be calibrated in men, inconsistent in children, and was useful for excluding the diagnosis of AA with a threshold value of 5 in all patient groups, and for scores 9 and 10, an appendectomy without additional examinations was recommended, and between scores, there was a need for additional examinations (CRP, US), while in older patients CT diagnostics was also necessary [19–21].

Regarding the AIR score, which includes CRP as an important inflammatory parameter [10], in our study 45% of respondents had a score of 7–8, while only 35% had a score of >8. The mean value of patients with timely, delayed, and unnecessary appendectomy was 8.08±1.5, 8.0±1.2, 6.20±1.4 (p = 0.003), with a significant difference between timely and unnecessary (p = 0.003) and between delayed and unnecessary appendectomies (p = 0.01). In our patients with a value of 0.50 for AUC, this scoring system did not show validity for use in appendectomy decisions. Our result does not correlate with the studies where the AIR score is used, has great discriminatory power, and exceeds the result of Alvarado. This result obtained in our respondents may be due to a different subjective assessment of the value of clinical signs, primarily on painful sensitivity to palpation because patients were examined by different surgeons, but also by the fact that using only inflammatory parameters without urinalysis patients with other differential diagnoses were excluded, such as patients with a urinary tract infection as well as patients with pelvic disease [22–23].

The newer RIPASA score includes 18 clinical and laboratory parameters, has greater sensitivity and specificity than the Alvarado score, especially in the Asian population [11, 24]. In this study, 92% of patients had a score higher than 8. The mean value of the respondents for timely (11.03±1.9), delayed (10.09±1.4) and unnecessary (8.60±0.9) appendectomy was significantly different (0.000), with a significant difference between timely and unnecessary appendectomies (p = 0.000). The ROC analysis for the prevention of delayed RIPASA appendectomy has shown to have sufficient discriminatory ability (AUC of 0.65), with a sensitivity of 62.5% and a specificity of 63.5%. There are publications in the literature with high specificity and sensitivity; such are the studies of Chong et al. and of Chee Fui Chong [11, 24–26].

In addition to the clinical and laboratory parameters, the Tzanakis score uses ultrasonography (US) to provide better diagnostics, especially in regions where computed tomography is not available 24 hours a day. A score of ≥8 is considered valid in diagnosing AA and the need for performing a surgery [12]. Our study found that 95% of respondents had a score higher than 8. Tzanakis score had the highest value in the group with timely (mean 15), lower in the group with unnecessary (mean 11), and lowest in the group with delayed appendectomy (mean 9). For p = 0.0007, a overall statistical significance between the three groups concerning the value of Tzanakis was confirmed, which was due to a significantly higher score in the group with timely versus delayed and unnecessary intervention (p = 0.032, p = 0.014, consequently). ROC analysis for prediction of delayed appendectomy has shown that with an AUC value of 0.696 and a sensiti­vity of 69% and a specificity of 60.8%, this score has sufficient discriminatory ability to distinguish patients with delayed and timely appendectomy. This coincides with data from the literature where this test shows the greatest sensitivity and specificity, even up to 99% sensitivity, 91% specificity, and an average diagnostic accuracy of 95% [27–29].

Several studies in the literature suggest that some of these systems are made for Western countries, but when placed in different environments, sensitivity and specificity change [11]. Some studies show an improvement in diagnostic accuracy when the threshold is reduced to 6.0, with a sensitivity of 88.3% and a specificity of 94.5% [29–33].

In our study about the use of each of the scoring systems, except of AIR, we obtained values of sensitivity and specificity that were lower than those presented in the literature, and using them individually we concluded that they were not sufficient for complete diagnosis and surgical treatment. But, when combining the three scoring systems (Alvarado, RIPASA, and Tzanakis), the size of the surface under the ROC curve had a value of 0.762, with a sensitivity of 85% and a specificity of 62. This suggests the conclusion that simultaneous application of the three scoring systems, Alvarado, RIPASA, and Tzanakis, has a good discriminatory ability in isolating patients with delayed and timely appendectomy.

Limiting factors in our study are the following: (a) the relatively small size of the sample despite the potential nature of the study and (b) the different physicians who decided on an appendectomy for different cases.

Conclusion

In our study, the diagnostic accuracy of RIPASA and Tzanakis showed better results than Alvarado, while AIR cannot be used to predict delayed appendectomy in our population. However, the simultaneous application of all three scoring systems, RIPASA, Tzanakis and Alvarado, has shown much better discriminatory ability, with higher sensitivity and specificity, as opposed to their use alone. Combining scoring systems should help in proper diagnosis to avoid negative appendectomy, but additional studies with a larger number of patients are needed to support these results.

References

1. D’Souza N, Nugent K. Appendicitis. Am Fam Physician 2016; 93(2): 142–143.

2. Cervellin G, Mora R, Ticinesi A, Meschi T, Comelli I, Catena F, Lippi G. Epidemiology and outcomes of acute abdominal pain in a large urban Emergency Department: retrospective analysis of 5,340 cases. Ann Transl Med 2016; 4(19): 362.

3. Podda M, Gerardi C, Cillara N, Fearnhead N, Gomes CA, Birindelli A, Mulliri A, Davies RJ, Di Saverio S. Antibiotic treatment and appendectomy for uncomplicated acute appendicitis in adults and children: a systematic review and meta-analysis. Ann Surg 2019; 270(6): 1028–1040.

4. Livingston EH, Woodward WA, Sarosi GA, Haley RW. Disconnect between incidence of nonperforated and perforated appendicitis: implications for pathophysiology and management. Ann Surg 2007; 245(6): 886–892.

5. Bhangu A, Søreide K, Di Saverio S, Hansson Assarsson J, Thurston Drake F. Acute appendicitis: modern understanding of pathogenesis, diagnosis, and management. Lancet 2015; 386(10000): 1278–1287.

6. Gregory S, Kuntz K, Sainfort F, Kharbanda A. Cost-effectiveness of integrating a clinical decision rule and staged imaging protocol for diagnosis of appendicitis. Value Health 2016; 19(1): 28–35.

7. Toorenvliet BR, Wiersma F, Bakker RFR, Merkus JWS, Breslau PJ, Hamming JF. Routine ultrasound and mimited computed tomography for the diagnosis of acute appendicitis. World J Surg 2010: 34(10): 2278–2285.

8. Atema JJ, van Rossem CC, Leeuwenburgh MM, Stoker J, Boermeester MA. Scoring system to distinguish uncomplicated from complicated acute appendicitis. Br J Surg 2015; 102(8): 979–990.

9. Alvarado A. A practical score for the early diagnosis of acute appendicitis. Ann Emerg Med 1986; 15(5): 557–564.

10. Andersson M, Andersson RE. The appendicitis inflammatory response score: a tool for the diagnosis of acute appendicitis that outperforms the Alvarado score. World J Surg 2008; 32(8): 1843–1849.

11. Chong CF, Adi MIW, Thien A, Suyoi A, Mackie AJ, Tin AS, Tripathi S, Jaman NH, Tan KK, Kok KY, Mathew VV, Paw O, Chua HB, Yapp SK. Development of the RIPASA score: a new appendicitis scoring system for the diagnosis of acute appendicitis. Singapore Med J 2010; 51(3): 220–225.

12. Tzanakis NE, Efstathiou SP, Danulidis K, Rallis GE, Tsioulos DI, Chatzivasiliou A, Peros G, Nikiteas NI. A new approach to accurate diagnosis of acute appendicitis. World J Surg 2005; 29(9): 1151–1156.

13. Jangjoo A, Varasteh AR, Mehrabi Bahar M, Tayyebi Meibodi N, Aliakbarian M, Hoseininejad M, Esmaili H, Amouzeshi A. Is C-reactive protein helpful for early diagnosis of acute appendicitis? Acta Chir Belg 2011; 111(4), 219–222. 

14. Kim JW, Shin DW, Kim DJ, Kim JY, Park SG, Park JH. Effects of Timing of Appendectomy on the Risks of Perforation and Postoperative Complications of Acute Appendicitis. World J Surg 2018; 42(5): 1295–1303.

15. van Dijk ST, van Dijk AH, Dijkgraaf MG, Boermeester MA. Meta-analysis of in-hospital delay before surgery as a risk factor for complications in patients with acute appendicitis: In-hospital delay before surgery and complications after appendicectomy. Br J Surg 2018; 105(8): 933–945.

16. Kalliakmanis V, Pikoulis E, Karavokyros IG, Felekouras E, Morfaki P, Haralambopoulou G, Panogiorgou T, Gougoudi E, Diamantis T, Leppäniemi A, Tsigris C. Acute appendicitis: the reliability of diagnosis by clinical assessment alone. Scand J Surg 2005; 94(3): 201–206.

17. Yilma Y, Gemechu L. Management Outcomes of Acute Appendicitis at Mettu Karl Hospital, Ethiopia. Clin Surg 2019; 4: 2676.

18. Ohle R, O’Reilly F, O’Brien KK, Fahey T, Dimitrov BD. The Alvarado score for predicting acute appendicitis: a systematic review. BMC Med 2011; 9: 139.

19. Coleman JJ, Carr BW, Rogers T, Field MS, Zarzaur BL, Savage SA, Hammer PM, Brewer BL, Feliciano DV, Rozycki GS. The Alvarado score should be used to reduce emergency department length of stay and radiation exposure in select patients with abdominal pain. J Traum Acute Care Surg 2018; 84(6): 946–950.

20. Deiters A, Drozd A, Parikh P, Markert R, Shim JK. Use of the Alvarado score in elderly patients with complicated and uncomplicated appendicitis. Am Surg 2019; 85(4): 397–402.

21. Di Saverio S, Podda M, De Simone B, Ceresoli M, Augustin G, Gori A, Boermeester M, Sartelli M, Coccolini F, Tarasconi A, de’ Angelis N, Weber DG, Tolonen M, Birindelli A, Biffl W, Moore EE, Kelly M, Soreide K, Kashuk J, Ten Broek R, Gomes CA, Sugrue M, Davies RJ, Damaskos D, Leppäniemi A, Kirkpatrick A, Peitzman AB, Fraga GP, Maier RV, Coimbra R, Chiarugi M, Sganga G, Pisanu A, de’ Angelis GL, Tan E, Van Goor H, Pata F, Di Carlo I, Chiara O, Litvin A, Campanile FC, Sakakushev B, Tomadze G, Demetrashvili Z, Latifi R, Abu-Zidan F, Romeo O, Segovia-Lohse H, Baiocchi G, Costa D, Rizoli S, Balogh ZJ, Bendinelli C, Scalea T, Ivatury R, Velmahos G, Andersson R, Kluger Y, Ansaloni L, Catena F. Diagnosis and treatment of acute appendicitis: 2020 update of the WSES Jerusalem guidelines. World Journal of Emergency Surgery 2020; 15: 27.

22. Andersson M, Kolodziej B, Andersson RE, STRAPPSCORE Study Group. Randomized clinical trial of Appendicitis Inflammatory Response score-based management of patients with suspected appendicitis. Br J Surg 2017; 104(11): 1451–1461.

23. de Castro SMM, Ünlü Ç, Steller EP,  van Wagensveld BA, Vrouenraets BC. Evaluation of the Appendicitis Inflammatory Response Score for Patients with Acute Appendicitis. World J Surg 2012; 36(7): 1540–1545.

24. Karapolat B. Can RIPASA Scoring System Predict the Pathological Stage of Acute Appendicitis? Emerg Med Int 2019; 8140839.

25. Malik MU, Connelly TM, Awan F, Pretorius F, Fiuza-Castineira C, El Faedy O, Balfe P. The RIPASA score is sensitive and specific for the diagnosis of acute appendicitis in a western population. Int J Colorectal Dis 2017; 32(4): 491–497.

26. Chong CF, Thien A, Mackie AJA, Tin AS, Tripathi S, Ahmad MAA, Tan LT, Mat Daud FM, Tan C, Telisinghe PU, Ang SH. Evaluation of the RIPASA Score: a new scoring system for the diagnosis of acute appendicitis. Brunei Int Med J 2010; 6(1): 17–26.

27. Lakshminarasimhaiah AKS, Nagaraja AL, Srinivasaiah M. Evaluation of Tzanakis scoring system in acute appendicitis: a prospective study. Int Surg J 2017; 4(10): 3338–3343.

28. Shashikala V, Hegde H, Victor AJ. Comparative study of Tzanakis score vs Alvarado score in the effective diagnosis of acute appendicitis. IJBAR 2016; 7(9): 418–420.

29. Malik AA, Mir MF, Khurshid SU, Wani I, Dagga R. Modified Alvarado score versus Tzanakis score for diagnosing cute appendicitis in changing clinical practice. Int J Clin Exp Med Sci 2016; 2(5): 90–93.

30. Kularatna M, Lauti M, Haran C, MacFater W, Sheikh L, Huang Y, McCall J, MacCormick AD. Clinical prediction rules for appendicitis in adults: which is best? World J Surg 2017; 41(7): 1769–1781.

31. Karami MY, Niakan H, Zadebagheri N, Mardani P, Shayan Z, Deilami I. Which One is Better? Comparison of the Acute Inflammatory Response, Raja Isteri Pengiran Anak Saleha Appendicitis and Alvarado Scoring Systems. Ann Coloproctol 2017; 33(6): 227–231.

32. Korkut M, Bedel C,  Karanci Y,  Avci A,  Duyan M. Accuracy of Alvarado, Eskelinen, Ohmann, RIPASA and Tzanakis Scores in Diagnosis of Acute Appendicitis; a Cross-sectional Study. Arch Acad Emerg Med 2020; 8(1): e20.

33. Frountzas M, Stergios K, Kopsini D, Schizas D, Kontzoglou K, Toutouzas K. Alvarado or RIPASA Score for Diagnosis of Acute Appendicitis? A Meta-Analysis of Randomized Trials. Int J Surg 2018; 56: 307–314.