Document Type : Original article
Subjects
Abstract
Background: Comparing and determining the accuracy of -urolo gists and STONE nomogram prediction about the Percutaneous Nephrolithotomy (PCNL) outcomes in urolithiasis patients.
Methods: This retrospective cohort study was performed on 70 patients who underwent PCNL in Firoozgar Hospital (Tehran, Iran) from March 2019 to April 2020. Two expert urologists, who were not informed about the actual result of the procedure and did not have access to the post-operative data, were asked to predict the success rate of PCNL based on pre-operative imaging. The remaining stone size of less than 4 mm was considered as stone-free in PCNL. On the other hand, the STONE nomogram calculated the stone-free rate, and if the predicted success rate was over 60%, PCNL was considered successful based on the STONE nomogram.
Results: The accuracy of the urologist’s prediction was 76.42%. The STONE nomogram correctly predicted the PCNL result in 59 cases (84.28%). There was a significant correlation between the actual success rate of the PCNL and the nomogram’s prediction (p-value= 1.013×10-5). There was no significant difference between the surgeons and the nomogram’s prediction (p-value=0.336). The number of stones did not significantly affect the correct prediction of surgical results (p-value<0.05). Upper calyx stones caused a significant difference between correct prediction of surgical results by surgeons and nomograms (p-value<0.05).
Conclusion: No significant difference was found between surgeons’ prediction and STONE nomogram, but only in patients with kidney stones in the upper calyx; the nomogram’s prediction accuracy was higher.
Keywords: Kidney calculi, Nomograms, Percutaneous nephro-lithotomy, Urologists
Introduction
As one of the most common urological disorders, kidney stones have approximately 10% prevalence in males and 7% in females, leading to one-third of urological surgeries allocated to nephrolithiasis treatment (1–3). Percutaneous Nephrolithotomy (PCNL) is the standard treatment of large kidney stones, which has a post-operative stone-free rate of about 85 to 93% (4).
Nowadays, to predict the outcome of PCNL, nomograms have been created that can predict the stone-free rate of a patient with kidney stones to a great extent. Guy’s Stone Score (GSS), Stone-Tract Length-Obstruction-Number of involved calyces-Essence of stone density (STONE) nephrolithometry, and Clinical Research Office of the Endourological Society nephrolithometric nomogram (CROES) are the frequently used prognostic nomograms with high reliability and accuracy (5–7). The STONE nomogram is one of the scoring systems that is easy to calculate with a high accuracy of about 83% to predict the stone-free rate after PCNL. In addition to the stone-free rate, the STONE nomogram using the stone size, tract length, obstruction, number of stones, and stone density can predict the estimated blood loss, operation time, and length of hospital stay (6).
On the other hand, a urologist can predict the result of the surgery by relying on experience and imaging findings without using nomograms. The present study compares the accuracy of a pre-operative urologist’s evaluation and STONE nomogram to predict the post-operative stone-free rate after PCNL surgery.
Materials and Methods
This retrospective cohort study was performed on 70 patients who underwent PCNL in Firoozgar Hospital (Tehran, Iran) from March 2019 to April 2020. Patients data were obtained by reviewing the patients documents. Iran University of Medical Sciences (IUMS) ethics committee approved this study. All over 16 years patients who underwent PCNL by an expert urologist due to larger than 20 mm kidney stones, staghorn, and partial staghorn calculi with complete pre-operative and post-operative information, including laboratory tests, non-contrast Computed Tomography (CT) imaging, etc., were included in this study. Patients with incomplete hospital documents and renal anomalies (horseshoe kidney, kidney with rotation, or single kidney) were excluded.
Information and patient characteristics, including age, gender, history of kidney stones, and imaging, were extracted by reviewing the patient’s documents. By reviewing pre-operative non-contrast enhanced CT-scan, kidney stone data, including stone’s type, stone’s size (dimensions), number of stones (single stone, multiple or staghorn), and stone’s location (upper calyx, middle calyx, lower calyx, kidney pelvis), were achieved and analyzed.
Patients with completely removed stones and patients with post-operative remaining stone sizes less than 4 mm were considered as having successful PCNL surgery. Otherwise, the surgery was considered unsuccessful (3). If the predicted success rate was over 60%, PCNL was considered successful based on the STONE nomogram. PCNLs with a predicted success rate of less than 60% were considered unsuccessful.The pre-operative non-contrast CT scan, stone morphology, and kidney anatomy of the patient were given to two expert urologists, who did not know the result of the surgery and did not have access to the post-operative images and information. Urologists were asked to predict the PCNL’s success rate based on their experience and not using nomograms.
STONE nomogram predicts the success rate of PCNL based on stone size, tract length, obstruction, number of stones, and stone’s Hounsfield. The stone size is scored from 1 to 4 based on the estimated size. Tract length is defined as the mean of the mean vertical distance between the skin and the center of the stone in the supine position, which non-contrast CT-scan estimates in 3 different angles (0°,45°, and 90°). For patients who have a Body Mass Index (BMI) ≥30 kg/m2 The tract length is scored 1 for 100 mm and less and 2 for distances above 100 mm. The obstruction is scored based on the degree of hydronephrosis. Patients who do not have hydronephrosis and mild dilation are scored 1, and patients with moderate to severe dilation are scored 2. In cases of only one calyx involvement, patients get 1 point, patients with 2 or 3 calyx involvement get 2 points, and patients with staghorn calculi get 3 points. The last variable is stone essence, defined as the stone density. Patients with stone’s Hounsfield unit of 950 or less scored 1, and those with denser stones (higher than 950 Hounsfield units) scored 2. As the sum of each variable, patients get 5 to 13 scores. As shown in table 1, patients with higher scores are predisposed to have more complex surgery with a lower post-operative stone-free rate.
Ethics
Iran University of Medical Sciences Ethics Committee approved the study protocol (IR.IUMS.FMD.REC.1401.196).
Statistical analysis
Patients were divided into two groups by gender (male and female group) and two groups by age (16 to 64 and ≥65 years). After analyzing the data and comparing the prediction of the STONE nomogram and the urologists with the final result of the surgery, the accuracy of the surgeon’s prediction without using the nomogram and the STONE nomogram prediction was measured.
The information extracted from the patient’s documents was converted into an Excel file, then entered as a data frame in Python 3.8 software and cleaned by the Pandas library. Statistical tests were performed by the SciPy library, and graphs were drawn using Mat-Plot-Lib and Seaborn libraries. The analysis results were reported as values and percentages for qualitative variables and mean and Standard Deviation (SD) for quantitative variables. The Shapiro test was used to check the normality of data distribution. The p-value < 0.05 was considered statistically significant.
Results
Data from 70 patients who fulfilled the study inclusion criteria were analyzed. The mean age was 49.97 with an SD of ±12.32. Fifty-three patients (75.71%) were male, and 17 (24.28%) were female. 48.57% had left kidney involvement, and 51.42% had right. Forty-nine patients (70%) had successful PCNL according to the mentioned criteria, and 21 (30%) had unsuccessful PCNL. Twenty-eight patients (40%) had single stones, 29(41.42%) had multiple stones, and 13(18.57%) had staghorn calculi. Upper calyx was involved in 18 patients (25.71%), 26(37.14%) had middle calyx, and 45(64.28%) had lower calyx involvement. Also, 61 patients (87.14 %) had renal pelvis involvement. Patient’s and stone characteristics are summarized in table 2.
As shown in table 3, the STONE nomogram predicted a stone-free rate of 72.95 % (SD:±21.29) after PCNL. The first urologist estimated that 44 patients (62.85 %) had successful PCNL, while the second surgeon predicted a successful PCNL for 59 (84.28%). On the other hand, the STONE nomogram for 17.14% of cases predicted an unsuccessful PCNL and 82.86% predicted a successful procedure.
Comparison of the accuracy of surgeons and STONE nomogram in predicting the outcome of PCNL surgery
The first surgeon predicted the results of 53 surgeries (75.71%), and the second correctly predicted the results of 54 surgeries (77.14%). The average of correct prediction of surgery results among the two urologists was 76.42%. For 44 patients (62.85%), both surgeons correctly predicted the outcome of the procedures simultaneously. STONE nomogram predicted the result of the PCNL in 59 cases (84.28 %) correctly. There was a significant correlation between the actual success rate of the PCNL and the nomogram’s prediction (p-value<0.001). There was no significant difference between the surgeons and the nomogram’s prediction (p-value=0.336) (Table 3). As shown in table 4, the number of stones did not significantly affect the correct prediction of surgical results by surgeons and nomograms (p-value=0.478 for single stone, 0.315 for multiple stones, and 0.248 for staghorn calculi). Nevertheless, the presence of stones in the upper calyx caused a significant difference between correct prediction of surgical results by surgeons and nomograms (p-value=0.035) (Table 5).
Table 1. STONE nomogram predictor
|
Score |
1 |
2 |
3 |
4 |
|||||||
|
Stone size (mm2) |
0-399 |
400-799 |
800-1599 |
≥1600 |
|||||||
|
Access length (mm) |
≤100 |
>100 |
|
|
|||||||
|
Obstruction (hydronephrosis) |
None or mild |
Moderate to severe |
|
|
|||||||
|
Stone number |
1 - 2 |
3 |
Staghorn calculi |
|
|||||||
|
Essence (Hounsfield units) |
≤950 |
>950 |
|
|
|||||||
|
Success rate of the surgery based on overall score |
|||||||||||
|
Score |
5 |
6 |
7 |
8 |
9 |
10 |
11 |
12 |
13 |
||
|
Success rate (%) |
94 |
88 |
92 |
83 |
64 |
42 |
27 |
27 |
25 |
||
Table 2. Patient’s and stone characteristics
|
Variable |
N (%) |
|
Age (years) 16 – 64 65 ≤ |
63(90) 7(10) |
|
Gender Male Female |
53(75.71) 17(18.57) |
|
Stone laterality Left Right |
34(48.57) 36(51.42) |
|
Stone location Upper C Middle C Lower C Pelvis |
18(25.71) 26(37.14) 45(64.28) 61(87.14) |
|
Stone number Single Multiple Staghorn |
28(40) 29(41.42) 13(18.57) |
Footnote:SD= Standard Deviation; C= Calyx
Table 3. Surgeon’s and nomogram predictions
|
Correct prediction(%) |
N(%) |
Result |
|
|
75.71 |
44(62.85) |
Successful |
First surgeon prediction |
|
26(37.14) |
Unsuccessful |
||
|
77.14 |
59(84.28) |
Successful |
Second surgeon prediction |
|
11(15.81) |
Unsuccessful |
||
|
76.42 |
|
|
Average of two surgeons |
|
62.85 |
|
|
Simultaneous correct prediction by surgeons |
|
|
49(70) |
Successful |
Surgery result |
|
|
21(30) |
Unsuccessful |
|
|
84.28
|
3(4.28) |
94% |
Prediction of STONE nomogram |
|
16(22.85) |
92% |
||
|
8(11.42) |
88% |
||
|
14(20) |
83% |
||
|
17(24.28) |
64% |
||
|
5(7.14) |
42% |
||
|
7(10) |
27% |
||
|
0(0) |
25% |
||
|
|
72.95 |
Mean |
|
|
|
±21.29 |
SD |
Footnote: SD= Standard deviation
Table 4. Accuracy of predictions based on stone number
|
|
Single stone |
Multiple stones |
Staghorn calculi |
|
|
Prediction of surgeons |
Correct |
22 |
17 |
5 |
|
Incorrect |
6 |
12 |
8 |
|
|
Accuracy |
78.57% |
58.62% |
38.46% |
|
|
Prediction of nomogram |
Correct |
27 |
21 |
11 |
|
Incorrect |
1 |
8 |
2 |
|
|
Accuracy |
96.42% |
72.41% |
86.61% |
|
|
p-value |
0.478 |
0.315 |
0.248 |
|
Table 5. Accuracy of predictions based on stone location
|
|
Upper calyx |
Middle calyx |
Lower calyx |
Pelvis |
|
|
Prediction of surgeons |
Correct |
9 |
12 |
26 |
40 |
|
Incorrect |
9 |
14 |
19 |
21 |
|
|
Accuracy |
50% |
46.15% |
57.77% |
65.57% |
|
|
Prediction of nomogram |
Correct |
13 |
20 |
35 |
52 |
|
Incorrect |
15 |
6 |
10 |
9 |
|
|
Accuracy |
72.22% |
76.92% |
63.63% |
85.24% |
|
|
p-value |
0.035 |
0.106 |
0.840 |
0.068 |
|
Discussion
This study revealed that the accuracy of the urologist’s prediction about PCNL’s outcomes is about 76% based on pre-operative assessments. Also, in this study, for approximately 62 patients, both surgeons correctly predicted the outcome of the procedures simultaneously. In comparison, the STONE nomogram prediction’s accuracy is about 84.28. There was a significant correlation between the actual success rate of the PCNL and the nomogram’s prediction. However, there was no significant difference between the surgeons and the nomogram’s predictions. The number of stones did not affect the correct prediction of surgical results. However, the presence of stones in the upper calyx caused a significant difference between the correct prediction of surgical results by surgeons and nomograms. In patients with kidney stones in the upper calyx, nomogram prediction accuracy was higher. Based on our comprehensive review, this study appears to be the inaugural investigation within the existing body of literature to evaluate the comparative accuracy of nomograms and surgeons’ predictions regarding PCNL outcomes.
PCNL can be a complex or easy procedure based on the patient’s and stone characteristics. So, predicting the surgical results and complications can be challenging (7). Several predictors scoring systems were previously introduced for predicting the success rate and the procedure’s complications, such as Guy’s stone score (GSS), Stone-Tract Length-Obstruction-Number of involved calyces-Essence of stone density (STONE) nephrolithometry, and Clinical Research Office of the Endourological Society nephrolithometric nomogram (CROES) (5–7).
Bibi M et al revealed that Guy’s stone score, STONE nephrolithometry, and CROES score are significant factors for stone-free rate prediction (8). Kumar U et al reported the accuracy of the STONE nomogram about 86.29% (9). However, Sfoungaristos S et al found the STONE nomogram to be the only predictor of atone-free rate in staghorn calculi (10).
Labadie et al analyzed the 246 patient’s data retrospectively (11). Their study revealed that GSS, STONE nephrolithometry, and CROES can predict stone-free rate accurately (p-value=0.02, 0.004, and <0.001). However, GSS and STONE nephrolithometry are superior to CROES in estimating estimated blood loss and length of hospital stay. Ayranciet al revealed that the CROES and STONE nomograms can predict mini-PCNL stone-free rate (p=0.043, p=0.018) in contrast with Guy’s stone score (p=0.415). However, none of these scoring systems and nomograms can predict post-operative complications (p=0.584, p= 0.823, p = 0.189) (12). There are new scoring systems for predicting PCNL complications and stone-free rate. Sahan et al introduced a scoring system based on parenchymal thickness, nephroscopy length, and hydronephrosis to predict urinary leakage after PCNL (13). Seoul National University Renal Stone Complexity (S-ReSC) scoring system predicts the stone-free rate based on the stone’s portion and does not consider the stone’s size and number. Choo et al assessed the reliability and validity of the S-ReSC and revealed that this scoring system is useful for stone-free rate prediction (14).
Conclusion
To the best of our knowledge, this study is the first study that compares a urologist’s prediction and STONE nomogram. This study revealed no significant difference between surgeons’ prediction and STONE nomogram, but only in patients with kidney stones in the upper calyx nomogram prediction accuracy was higher. This study acknowledges a number of limitations. It is confined to a single-center analysis and restricts its comparison to one currently established nomogram against the prognostications of surgeons. For a more comprehensive understanding, it is imperative that future research undertakes multicenter studies to compare various nomograms to enhance the predictive precision for PCNL outcomes.
Acknowledgement
The Firoozgar Clinical Research Development Center, Iran University of Medical Sciences, Tehran, Iran, supported this study.