info@biomedres.us   +1 (502) 904-2126   One Westbrook Corporate Center, Suite 300, Westchester, IL 60154, USA   Site Map
ISSN: 2574 -1241

Impact Factor : 0.548

  Submit Manuscript

Research ArticleOpen Access

Breast Cancer: The Accuracy of The Paus in Detecting pN2 and Factors that Lead to the True- and False-Negative Results Volume 12 - Issue 5

Dalia Artmoniene*1, Algirdas Bogusevicius2, Egle Jonaitiene2, Renata Paukstaitiene3, Vincentas Veikutis3, Milda Baseviciute3 and Karolina Stasiukynaite3

  • 1Lithuanian University of Health Sciences, Lithuania
  • 2The Hospital of Lithuanian University of Health Sciences (LSMU) Kauno klinikos, Lithuania
  • 3Lithuanian University of Health Sciences, Lithuania

Received:December 10, 2018;   Published: January 03, 2019

*Corresponding author: Dalia Artmoniene, Lithuanian University of Health Sciences, Lithuania

DOI: 10.26717/BJSTR.2019.12.002301

Abstract PDF

Abstract

About 70% of early breast cancer cases axillary lymph nodes are intact and surgical axillary intervention is unnecessary. There is an ongoing search for non-invasive methods to evaluate the status of axillary lymph nodes in order to prevent Axillary Lymph Node Dissection (ALND) or Sentinel Lymph Node Biopsy (SLNB). Patients with normal axillary physical exam and ultrasound rarely harbor a large nodal disease burden (pN2). There are studies suggesting that the Preoperative Axillary Ultrasound (PAUS) can replace SLNB when the axillary surgery is no longer curative and only biomarkers are important for adjuvant chemotherapy. The purpose of this study was to determine the accuracy and reliability of the ultrasound examination in detecting more than three metastatic axillary lymph nodes (pN2) and to assess the clinicopathological factors that lead to the true-negative and false-negative results of the ultrasound study. All patients underwent the PAUS as part of their staging. The nodal status assessed by PAUS was compared with histological findings. Determining pN2, the accuracy of PAUS was 91.2% and the NPV - 96.5%. False-negative results of PAUS were 18.7 %. On bivariate analysis, primary Tumor Size (T), the tumor spreading in blood and Lymphatic Vessels (LV), Tumor Grade (G) and patient age were found to be significantly different between true- and false-negative PAUS. We found that PAUS is sufficiently accurate to detect a heavy nodal disease burden and in most cases an additional axillary surgery can be avoided. PAUS findings may be less accurate in young age and in patients with T2, G3 and LV1.

Keywords: Breast Cancer; Axillary Lymph Node; Ultrasound

Abbrevations: PAUS: Preoperative Axillary Ultrasound; ALND: Axillary Lymph Node Dissection; SLNB: Sentinel Lymph Node Biopsy; pN2: >3 Metastatic Lymph Nodes; NPV: Negative Prognostic Value; T: Tumor Size; LV1: Tumor Spreading in blood and Lymphatic Vessels; G: Tumor Grade

Introduction

The condition of Axillary Lymph Nodes (ALN) is the most important prognostic factor in breast cancer and is relevant to the choice of breast cancer treatment tactics [1,2]. There is a strong correlation between the number of damaged axillary lymph nodes and the risk of breast cancer regeneration [3]. Since 1994, Sentinel Lymph Node Biopsy (SLNB) has become a gold standard for assessing the status of the axillary lymph nodes. The sentinel lymph node is hypothetically the lymph node or group of lymph nodes that the primary cancer cells reach first. If the sentinel lymph node is intact, the probability that the tumor will not spread is high. According to several studies, when metastases are detected and the secondary Axillary Lymph Nodes Dissection (ALND) is performed, in 40-70% of cases, additionally removed lymph nodes were healthy [4]. When isolated tumor cells or micrometastases are found after SLNB, the removal of other lymph nodes in the axilla is not recommended [5]. A randomized ACOSOG Z0011 study was presented at the annual conference of the American Society of Oncology (ASCO) in 2010, which found that survival and the risk of recurrence was very similar in patients with T1 or T2 tumors and during SLNB 1 or 2 damaged lymph nodes who had ALND and those who did not [5].

About 70% of the early breast cancer cases have intact axillary lymph nodes and surgical axillary intervention is unnecesAbstractsary [6]. Although SLNB complications are rare and less damaged than ALND, this is a risky procedure. Several prospective studies (ACOSOG Z0010, NSABP B-32, ALMANAC) identified the incidence and frequency of SLNB complications: allergic reactions (0.1-1.0%), wound infection (1.0-10%), seroma (7.1 %), paresthesia (8.6-11%) and hematoma (1.4%) [7]. Accordingly, there is an ongoing search for non-invasive methods to evaluate the status of axillary lymph nodes in order to prevent ALND or SLNB [6]. In the guidelines of the European Union, Preoperative Axillary Ultrasound (PAUS) is a routine examination for all breast cancer patients with palpable or impalpable axillary lymph nodes [4]. It is possible to assess whether the lymph node is damaged by ultrasound (PAUS-positive) according to the morphological features of the axillary lymph node [7]. In different studies, the sensitivity and accuracy of the ultrasound examination varied between 23% to 87% and 67.9% to 90.2% [2,5,6-18]. One of the weaknesses in the ultrasound examination is the false-negative results (~21%) [15], but in the determination of metastases in three or more axillary lymph nodes, false negative tests are found to account for about 4% [2].

Symptoms of the disease are less favorable and the prognosis is poorer in patients who are PAUS- positive [4] versus patients who are PAUS negative and metastases were found rarely in more than three axillary lymph nodes [2]. There are studies suggesting that an ultrasound examination can replace SLNB when the axillary surgery is no longer curative and only biomarkers are important for adjuvant chemotherapy [7]. The purpose of this study was to determine the accuracy and reliability of the ultrasound examination in detecting more than three metastatic axillary lymph nodes (pN2) and to assess the clinicopathological factors that lead to the true-negative and false-negative results of the ultrasound study.

Materials and Methods

The present study is a retrospective analysis of the medical documentation of all newly diagnosed breast cancer patients between 1 January 2011 and 31 December 2012 in the Hospital of Lithuanian University of Health Sciences Kauno klinikos. The study included women (n=667) who underwent a preoperative axillary ultrasound examination. When normal-appearing or suspicious axillary lymph nodes were found during the ultrasound study, SLNB was performed. If there were definitely pathological axillary lymph nodes by ultrasound examination, an immediate ALND was performed or treatment started with neoadjuvant chemotherapy (these women were not included in the study). The criteria for assessing the lymph nodes are shown in Table 1. The cases of breast cancer found on both breasts were analyzed as two separate cases. Rejection criteria: Neoadjuvant chemotherapy, recurrent breast cancer, non-invasive breast cancer, unexplored or poorly documented PAUS study. PAUS study data were compared to the results of postoperative histological examination. The study design is shown in Figure 1). PAUS was performed using an Acuson S2000 ultrasound unit with a 14MHz linear Siemens transducer.

Figure 1: Study design - axillary assessment protocol.

biomedres-openaccess-journal-bjstr

Table 1: PAUS lymph node evaluation criteria.

biomedres-openaccess-journal-bjstr

The sentinel lymph nodes were marked by injection periareolarly of 0.2ml - 50MBq of 99mTC- labeled nanocole one day before surgery. The location of the sentinel lymph node was detected using the 2010 Philips BrightView Gamma Camera and detected during the operation with the Crystal Probe-automatic-handheld gamma detector. Surgically removed radioactive lymph nodes were sent for pathological examination (hematoxylin and eosin staining and immunohistochemistry). PAUS data were compared with histological examination results. The following histopathological data were analyzed: Tumor Size (T), Tumor Grade (G), Lymphovascular Invasion (LV), the presence of Estrogen (ER) or Progesterone (PR) receptors, Human Epidermal Growth Factor (HER2) status and Lymph Nodes (pN) status.

Statistical Analyses

Statistical analysis was performed using IBM SPSS Statistics 24 package. Descriptive statistics methods were used to systemize the research data. The accuracy, sensitivity, specificity, Positive Predictive Value (PPV) and Negative Predictive Value (NPV) of the ultrasound examination were evaluated and the estimates of these characteristics were given along with their 95% confidence intervals. The Chi-square test was used to compare effects of clinicopathological factors and the correlation of outcomes from PAUS and SLNB pathology. The results were considered statistically significant if p< 0.05.

Results

The study analyzed 667 females aged from 27 to 88 years old, with an average age of 60.07 (SD=12.451). By age, patients were divided into three groups: young (< 40 years, n=30 (4.5%)), middle age (40-69 years, n=476 (71.4%)) and elderly (≥70 years, n=161 (24.1%)). Patient demographic and tumor clinopathological data are presented in Table 2. Small tumors were found more frequently (T1 - 52.2%). The majority of tumors were moderately- differentiated (G2), in 63.7% of cases. Tumor spreading in blood vessels and lymphatic vessels was found in 36.2% and 49.6% of cases. More frequently, ER (+) (43.3%), PR (-) (44.7%) and HER2 (-) (57.0%) tumors were detected (Table 2). By PAUS, pathological lymph nodes were found in 86 cases and lymphodectomy was performed; for all remaining cases (N=581), SLNB was performed. Metastatic lymph nodes (node-positive) were diagnosed in 230 cases (34.5%) (pN1 - 28.4%, pN2 - 6.1%), and the axillary lymph nodes were undamaged (node-negative) (pN0) in 437 cases (65.5%). After SLB, metastases were detected in three sentinel lymph nodes in 68 cases (11.7%) and secondary ALND was performed. Of all of the additional removed lymph nodes, metastases were found in one or two lymph nodes (pN2) in 24 (35.3%) cases, while the additional removed nodes were undamaged in the remaining 44 cases (64.7%). Therefore, of the 581 SLB, heavy nodal disease burden (pN2) was only found in 24 cases (4.1%) (Figure 1).

Table 2: PAUS true-false-negative and true-false-positive results according to patient and tumor characteristics.

biomedres-openaccess-journal-bjstr

PAUS-negative axillary lymph nodes were found in 535 cases, of which heavy nodal disease burden (pN2) was detected in only 15 cases (2.8%). PAUS-positive axillary lymph nodes were evaluated in 132 cases: 86 as pathological (3 cases were node-negative, 83 cases were node-positive), and 46 as suspicious (24 cases were node-negative, 22 cases were node-positive) (Figure 2). In general, PAUS was not very sensitive (45.7%) but was very specific (93.8%), sufficiently accurate (77.2%) and had rather high positive and negative predictive values (79.5% and 76.6%). According to age groups, metastases were most commonly found in young women (60%), but the accuracy of PAUS was the lowest (53.3%); in middle and older women, metastases in the axillary lymph nodes were found less frequently (33.4% and 32.9%) and the PAUS was quite accurate (78.8% and 77.0%). Determining more than three metastatic lymph nodes (pN2), the accuracy of PAUS was 91.2% (95% confidence interval [CI]=88.7-93.8), sensitivity was 63.4% (95% CI=48.7- 78.2) and NPV was 96.5% (95% CI=94.7-98.2) (Table 3). Of the 535 patients who were PAUS-negative, metastases were detected in 125 cases (18.7%) in the histological examination (false-negative results).

Figure 2: PAUS and pathological results scheme.

biomedres-openaccess-journal-bjstr

Table 3: PAUS statistical results according to lymph node status and patient’s age.

biomedres-openaccess-journal-bjstr

In younger patients, false-negative PAUS results (10.4%) were more frequently found than true-negative (2.7%) (p=0.006). In cases when the tumor size was larger (T2), false-negative (57.3%) and true-positive (69.9%) results of the study were more often detected (p< 0.0001), in contrast to cases when the Tumor Size was smaller (T1), when true-negative (70.5%) results were more often detected. Statistically significantly more frequent false-negative results of ultrasound examination were obtained in cases with poorly-differentiated tumors (G3), in 23.4% of cases (p=0.034). In cases with tumor spreading in blood vessels and lymphatic vessels, false-negative and true-positive PAUS results were higher (V1 54.6% and 77.3%, L1 98.3% and 97.9%), otherwise true-negative PAUS results were lower (V1 - 23.5%, L1 - 29.6%) (p< 0.0001). Expression of the estrogen (ER), progestin (PR) and human epidermal growth factor (HER2)) was not statistically significant for PAUS results (Table 2). After surgery in PAUS-positive cases, heavy nodal disease burden (pN2), larger tumor (T2) (p< 0.0001), and poorly-differentiated tumors (G3) (p=0.034) were more frequently found and tumor spreading in the blood and Lymphatic Vessels (LV1) was more often detected (p< 0.0001) (Table 2).

Discussion

According to the literature, metastatic lymph nodes are detected in about 30-40% cases of newly diagnosed breast cancer [18]. In order to evaluate the status of axillary lymph nodes, all patients undergo surgical intervention (SLNB or ALND) to this day. Although SLNB is less risky than ALND, about 60-70% cases of newly diagnosed breast cancer are node-negative and axillary surgical intervention is unnecessary. In our study, metastatic lymph nodes were detected in 230 patients (34.5%), but in all 667 cases, either SLNB or primary ALND, or SLNB and secondary ALND were performed; however, for 437 patients (65.5%), axillary surgical interventions were unnecessary. In the guidelines of the European Union, PAUS is a routine examination for all breast cancer patients with palpable or impalpable axillary lymph nodes [4]. Recently, if there is definitely pathological axillary lymph nodes by ultrasound examination, neoadjuvant chemotherapy has been initiated. During the study period, our clinic had two possible solutions: either primary ALND or neoadjuvant chemotherapy; therefore, in 86 cases, primary ALND was performed. Patients with normal-appearing or suspicious lymph nodes on PAUS (n=581) underwent SLNB.

According to the ACOSOG Z0011 study [5], after SLNB in 68 cases (11.7%) metastases were found in three sentinel lymph nodes and the secondary ALND was performed; however, metastases were found in one or two lymph nodes (pN2) in only 24 (35.3%) cases, while the additional removed nodes were undamaged in the remaining 44 cases (64.7%). Other studies [19-22] also found that in about 40-70% cases of all additional removed lymph nodes metastases were not detected. The question of what is widespread lymph node damage is still asked? According to the ACOSOG Z0011 study, extensive lymph node damage occurs when metastases are found in three or more lymph nodes. However, according to international recommendations, extensive lymph node damage, which requires the additional treatment of the axilla, is when metastases are found in four or more lymph nodes (pN2 according to TNM classification) [23]. One of the goals of our study was to evaluate the reliability of PAUS in detecting metastatic disease in more than three axillary lymph nodes (pN2). For detecting pN2, the accuracy of PAUS was 91.2% and NPV 96.5%, with pN1 being 78.1% and 78.8%, respectively. In the study by Schipper et al., heavy nodal disease burden (pN2- pN3) was found in 4.4% of the 577 PAUS-negative cases, and NPV was 95.5% [18].

In the study by Abe and others (N=37), for the determination of pN2 or pN3, false-negative results of PAUS were found in 3% cases, and NPV was 96.7% [8]. Based on these results, it can be argued that the PAUS study is sufficiently precise in detecting a heavy nodal disease burden (pN2) and additional axillary surgery could be avoided in most cases. Perhaps in these cases, a PAUS study could replace the SLNB and these patients could avoid an axillary surgery, meaning that the surgery time would be shorter, and treatment costs and postoperative complications would be reduced. A large number of studies were performed to evaluate the diagnostic parameters of the PAUS: accuracy 67.9% to 90.2%, sensitivity 23% to 87%, specificity 76.9% to 100%, and NPV 60% to 89.2% (Table 4). In the study by Dihge et al., the sensitivity of PAUS was only 23% [5], while the study by Tillman et al. reported a sensitivity of 87% [10]. In our study, the PAUS study in all patients was not very sensitive (45.7%), but was very specific (93.8%), sufficiently accurate (77.2%) and had relatively high positive and negative predictive values (79.5% and 76.6%) (Table 3).

Table 4: PAUS statistical results of several studies.

biomedres-openaccess-journal-bjstr

(PAUS: preoperative axillary lymph node; PPV: positive prognostic value; NPV: negative prognostic value)

Most often, metastases were found in young women (60%), but the accuracy of PAUS was the lowest (53.3%), while metastases were found less often in the axillary lymph nodes in middle-aged and older women (33.4% and 32.9%), and the PAUS study was quite accurate (78.8% and 77.0%). These results suggest that the PAUS study can be more reliable for middle-aged and elderly women, but should be considered more cautiously when it is performed in young women (Table 3). Few studies have been conducted to analyze the causes of false-negative results of an ultrasound examination. Jalin’s study suggests that the negative results of PAUS study should be evaluated with caution when the tumor is larger (≥ T2), poorly differentiated (G3), or when tumor spreading in blood vessels and lymphatic vessels is detected, as that increases the probability of false-negative results [3]. Nwaugu’s study also suggests that the probability of false-negative outcomes increases when the tumor is larger and the tumor spreading in blood vessels and lymph nodes is diagnosed, but the tumor differentiation degree is not statistically significant [15]. In our study, false-negative PAUS results were found in 18.7% of cases (Table 5).

Table 5.

biomedres-openaccess-journal-bjstr

(US: Ultrasound; CNB: Core Needle Biopsy; FNA: Fine Needle Aspiration; PPV: Positive Predictive Value; NPV: Negative Predictive Value)

In the young age group, the false-negative results of the PAUS study were statistically significantly more frequent (10.4%) than the true-negative (2.7%) (p=0.006), and there were no statistically significant differences in other age groups. In our study, in the case of a larger tumor (T2), false-negative (57.3%) and true-positive (69.9%) PAUS results were statistically significantly more frequent (p< 0.0001); in the case of smaller tumors (T1), true- negative study results were more often received (70.5%). Also, false-negative results of the PAUS study were found statistically significantly more frequently (p=0.034) in poorly-differentiated tumors (G3) (23.4%) than in well-differentiated tumors (G1) (10.2%). In the presence of tumor spreading in blood vessels and lymphatic vessels, false-negative and true-positive PAUS study results were statistically significantly (p< 0.0001) more frequent (V1 - 54.6% and 77.3%, L1 - 98.3% and 97.9%) than true-negative results (V1 - 23.5%, L1 - 29.6%). ER, PR and HER2 expression were not statistically significant for PAUS study results.

In assessing these results, it can be argued that in the middle- aged and elderly patients, when the tumor is small (T1), well-differentiated (G1) and tumor spreading in Blood Vessels (V0) and Lymphatic Vessels (L0) is not detected, we could rely on PAUS study results and avoid SLNB. On the contrary, in the younger age group with a larger (T2), poorly-differentiated (G3) tumor, and the detection of tumor spreading in Blood Vessels (V1) and Lymphatic Vessels (L1), the probability of false-negative results is increased; therefore, in these cases, the results of the PAUS study should be evaluated more cautiously. Several studies identified that a heavy nodal disease burden (pN2) and worse prognostic factors of disease (T2, G3, VL1) were detected more frequently in the PAUS-positive group [1,3-5,7,22,24]. Also in our study, in the PAUS-positive group after surgery, a heavy nodal disease burden (pN2) and worse prognostic factors of disease (T2 (p< 0.0001), G3 (p=0.034), LV1 (p< 0.0001)) were detected more frequently. These results indicate that when pathological or suspicious axillary lymph nodes are found by PAUS, there is a higher possibility that the tumor will be more aggressive and more widespread, so these patients require more aggressive treatment of the axillary lymph nodes (operational or radiotherapy).

Conclusion

An ultrasound examination is sufficiently accurate to detect a heavy nodal disease burden (pN2) and an additional axillary surgery can be avoided in most cases. Ultrasound examination is more accurate and more sensitive to middle-aged and older women and the sensitivity of the young women’s ultrasound examination is rather low. In the middle-aged and elderly patients, when the tumor is small (T1), well-differentiated (G1) and the tumor spreading in blood vessels (V0) and lymphatic vessels (L0) is not detected, we can rely on PAUS study results and avoid SLNB. On the contrary, in the younger age group with larger (T2), poorly-differentiated (G3) tumors, and with the detection of tumor spreading in blood vessels (V1) and lymphatic vessels (L1), the probability of false-negative results is increased. Therefore, in these cases, the results of the PAUS study should be evaluated more cautiously. In PAUS-positive patients there is a greater possibility that the tumor will be more aggressive and more widespread, so these patients require more aggressive treatment of the axillary lymph nodes (operational or radiotherapy).

References

  1. Boone BA, Huynh C, Spangler ML, Sumkin J, Johnson R, et al. (2015) Axillary lymph node burden in invasive breast cancer: a comparison of the predictive value of ultrasound-guided needle biopsy and sentinel lymph node biopsy. Clin Breast Cancer 15(5): 243-248.
  2. Jackson RS, Mylander Ch, Rosman M, Andrade R, Sawyer K, et al. (2015) Normal axillary ultrasound excludes heavy nodal disease burden in patients with breast cancer. Ann Surg Oncol 22(10): 3289-3295.
  3. Jalini L, Fung DFN, Dasgupta KK, Kurup V (2016) Clinicopathological factors associted with positive preoperative axillary ultrasound scanning in breast cancer patients. Intern J Surg Med 2(1): 23-29.
  4. Verheuvel NC, Hoven I, Ooms HWA, Voogd AC, Roumen RMH (2015) The role of ultrasound- guided lymph node biopsy in axillary staging of invasive breast cancer in the post-ACOSOG Z0011 trial era. Ann Surg Oncol 22(2): 409-415.
  5. Dihge L, Grabau DA, Rasmussen RW, Bendahl PO, Ryden L (2016) The accuracy of preoperative axillary nodal staging in primary breast cancer by ultrasound is modified by nodal metastatic load and tumor biology. Acta Oncologica 55(8): 976-982.
  6. Barco I, Chabrera C, Garcia FA, Fraile M, Gonzalez S, et al. (2016) Role fo axillary ultrasound, magnetic resonance imaging, and ultrasoundguided fine-needle aspiration biopsy in the preoperative triage of breast cancer patients. Clin Transl Oncol 19(6): 704-710.
  7. Gipponi M, Fregatti P, Garlaschi A, Murelli F, Margarino C, et al. (2016) Axillary ultrasound and fine-needle aspiration cytology in the preoperative staging of axillary node metastasis in breast cancer patients. Breast 30: 146-150.
  8. Abe H, Schach D, Sennett ChA, Newstead GM, Schmidt RA (2013) Utility of preoperative ultrasound for predicting pN2 or higher stage axillary lymph node involvement in patients with newly diagnosed breast cancer. AJR 200(3): 696-702.
  9. Farrell TPJ, Adams NC, Stenson M, Carroll PA, Griffin M, et al. (2015) The Z0011 trial: is this the end of axillary ultrasound in the pre-operative assessment of breast cancer patients? Eur Radiol 25(9): 2682-2687.
  10. Henry TR, Glover CK, Preston M, Gallagher K, Tummel E, et al. (2015) The save review: Sonographic analysis versus excision for axillary staging in breast cancer. J Am Coll Surg 220(4): 560-567.
  11. Lee B, Lim AK, Krell J, Satchithananda K, Coombes RCH, et al. (2013) The efficacy of axillary ultrasound in the detection of nodal metastasis in breast cancer. AJR 200(3): 314- 320.
  12. Nijnatten TJA, Ploumen EH, Schipper RJ, Goorts B, Andriessen EH, et al. (2016) Routine use of standart breast MRI compared to axillary ultrasound for differentiating between no, limited and advanced axillary nodal disease in newly diagnosed breast cancer patients. Eur J Radiol 85(12): 2288- 2294.
  13. Berckelaer Ch, Huizing M, Goethem M, Vervaecke A, Papadimitriou K, et al. (2016) Preoperative ultrasound staging of the axilla make’s preoperative examination of the sentinel node redundant in breast cancer: Saving tissue, time and money. Eur J Obst Gyn Reprod Biol 206: 164-171.
  14. Cools LJ, Sinclair A, Trabulsi N, Meguerditchian A, Mesurolle B, et al. (2013) Preoperative axillary ultrasound and fine-needle aspiration biopsy in the diagnosis of axillary metastases in patients with breast cancer: predictors of accuracy and future implications. Ann Surg Oncol 20(3): 819-827.
  15. Nwaogu IY, Yan Y, Appleton CM, Cyr AE, Margenthaler JA (2015) Predictors of false negative axillary ultrasound in breast cancer. J. Surg. Research 198(2): 351-354.
  16. Feng Y, Huang R, He Y, Lu A, Fan Z, et al. (2015) Efficacy of physical examination, ultrasound, and ultrasound combined with fine-needle aspiration for axilla staging of primary breast cancer. Breast cancer Res Treat 149(3): 761-765.
  17. Black D (2017) Axillary ultrasound:for all, for none, to diagnose positive nodes, or to support avoiding sentinel lymph node biopsy altogether. Ann Surg Oncol 24(1): 64-69.
  18. Shipper RJ, Roozendaal LM, Vries B, Pijnappel RM, Beets Tan RGH, et al. (2013) Axillary ultrasound for preoperative nodal staging in breast cancer patients: Is it of added value? Breast 22(6): 1108-1113.
  19. Gur AS, Unal B, Ozbek U, Ozmen V, Aydogan F, et al. (2010) Validation of breast cancer nomograms for predicting the non-sentinel lymph node metastases after a positive sentinel lymph node biopsy in a multi-center study. Eur J Surg Oncol 36(1): 30-35.
  20. Coufal O, Pavlik T, Fabian P, Bori R, Boross G, et al. (2009) Predicting non-sentinel lymph node status after positive sentinel biopsy in breast cancer: what model performs the best in a czech population? Patrol Oncol Res15(4): 733-740.
  21. Coutant C, Rouzier R, Fondrinier E, Marchal F, Guillemin F, et al. (2009) Validation of the tenon breast cancer score for predicting non-sentinel lymph node status in breast cancer patients with sentinel lymph node metastasis: A prospective multi center study. Breast Cancer Res Treat 113(3): 537-543.
  22. Nath J, Sami N, Massey J, Donnelly J, Corder AP (2013) Selection for axillary clearance in breast cancer (ultrasound negative, sentinel node positive patients have low rates of further metastases. EJSO 39(5): 450- 454.
  23. Verheuvel NC, Ooms HWA, Tjan Heijnen VCG, Roumen RMH, Voogd AC (2016) Predictors for extensive nodal involvement in breast cancer patients with axillary lymph node metastases. Breast 27: 175-181.
  24. Saffar B, Bennett M, Metcalf C, Burrows S (2015) Retrospective preoperative assessment of the axillary lymph nodes in patients with breast cancer and literature review. Clinical radiology 70(9): 954-959.