Most cited article - PubMed ID 33915001
Interobserver agreement of transvaginal ultrasound and magnetic resonance imaging in local staging of cervical cancer
OBJECTIVES: To assess the ability, as well as factors affecting the ability, of ultrasound examiners with different levels of ultrasound experience to detect correctly infiltration of ovarian cancer in predefined anatomical locations, and to evaluate the inter-rater agreement regarding the presence or absence of cancer infiltration, using preacquired ultrasound videoclips obtained in a selected patient sample with a high prevalence of cancer spread. METHODS: This study forms part of the Imaging Study in Advanced ovArian Cancer multicenter observational study (NCT03808792). Ultrasound videoclips showing assessment of infiltration of ovarian cancer were obtained by the principal investigator (an ultrasound expert, who did not participate in rating) at 19 predefined anatomical sites in the abdomen and pelvis, including five sites that, if infiltrated, would indicate tumor non-resectability. For each site, there were 10 videoclips showing cancer infiltration and 10 showing no cancer infiltration. The reference standard was either findings at surgery with histological confirmation or response to chemotherapy. For statistical analysis, the 19 sites were grouped into four anatomical regions: pelvis, middle abdomen, upper abdomen and lymph nodes. The videoclips were assessed by raters comprising both senior gynecologists (mainly self-trained expert ultrasound examiners who perform preoperative ultrasound assessment of ovarian cancer spread almost daily) and gynecologists who had undergone a minimum of 6 months' supervised training in the preoperative ultrasound assessment of ovarian cancer spread in a gynecological oncology center. The raters were classified as highly experienced or less experienced based on annual individual caseload and the number of years that they had been performing ultrasound evaluation of ovarian cancer spread. Raters were aware that for each site there would be 10 videoclips with and 10 without cancer infiltration. Each rater independently classified every videoclip as showing or not showing cancer infiltration and rated the image quality (on a scale from 0 to 10) and their diagnostic confidence (on a scale from 0 to 10). A generalized linear mixed model with random effects was used to estimate which factors (including level of experience, image quality, diagnostic confidence and anatomical region) affected the likelihood of a correct classification of cancer infiltration. We assessed the observed percentage of videoclips classified correctly, the expected percentage of videoclips classified correctly based on the generalized linear mixed model and inter-rater agreement (reliability) in classifying anatomical sites as being infiltrated by cancer. RESULTS: Twenty-five raters participated in the study, of whom 13 were highly experienced and 12 were less experienced. The observed percentage of correct classification of cancer infiltration ranged from 70% to 100% depending on rater and anatomical site, and the median percentage of correct classification for the 25 raters ranged from 90% to 100%. The probability of correct classification of all 380 videoclips ranged from 0.956 to 0.975 and was not affected by the rater's level of ultrasound experience. The likelihood of correct classification increased with increased image quality and diagnostic confidence and was affected by anatomical region. It was highest for sites in the pelvis, second highest for those in the middle abdomen, third highest for lymph nodes and lowest for sites in the upper abdomen. The inter-rater agreement of all 25 raters regarding the presence of cancer infiltration ranged from substantial (Fleiss kappa, 0.68 (95% CI, 0.66-0.71)) to very good (Fleiss kappa, 0.99 (95% CI, 0.97-1.00)) depending on the anatomical site. It was lowest for sites in the upper abdomen (Fleiss kappa, 0.68 (95% CI, 0.66-0.71) to 0.97 (95% CI, 0.94-0.99)) and highest for sites in the pelvis (Fleiss kappa, 0.94 (95% CI, 0.92-0.97) to 0.99 (95% CI, 0.97-1.00)). CONCLUSIONS: Ultrasound examiners with different levels of ultrasound experience can classify correctly predefined anatomical sites as being infiltrated or not infiltrated by ovarian cancer based on video recordings obtained by an experienced ultrasound examiner, and the inter-rater agreement is substantial. The likelihood of correct classification as well as the inter-rater agreement is highest for sites in the pelvis and lowest for sites in the upper abdomen. However, owing to the study design, our results regarding diagnostic accuracy and inter-rater agreement are likely to be overoptimistic. © 2025 The Author(s). Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.
- Keywords
- diagnostic imaging, education, gynecology, inter‐rater agreement, ovarian cancer, reliability, staging, training, ultrasound, video recordings,
- MeSH
- Video Recording MeSH
- Abdomen diagnostic imaging pathology MeSH
- Neoplasm Invasiveness diagnostic imaging MeSH
- Clinical Competence * MeSH
- Middle Aged MeSH
- Humans MeSH
- Ovarian Neoplasms * diagnostic imaging pathology MeSH
- Observer Variation MeSH
- Pelvis diagnostic imaging pathology MeSH
- Prevalence MeSH
- Aged MeSH
- Ultrasonography methods MeSH
- Check Tag
- Middle Aged MeSH
- Humans MeSH
- Aged MeSH
- Female MeSH
- Publication type
- Journal Article MeSH
- Multicenter Study MeSH
- Observational Study MeSH
- Research Support, Non-U.S. Gov't MeSH
OBJECTIVES: SENTIX was a prospective, single-arm, international multicenter study that evaluated sentinel lymph node biopsy without pelvic lymph node dissection in patients with early-stage cervical cancer. We aimed to evaluate the concordance between preoperative imaging modalities (magnetic resonance imaging (MRI) and ultrasound) and final pathology in the clinical staging of early-stage cervical cancer by post-hoc analysis of the SENTIX study data. METHODS: In total, 47 sites across 18 countries participated in the SENTIX study. Patients with Stage IA1/lymphovascular space invasion-positive to IB2 (International Federation of Gynecology and Obstetrics (FIGO) classification (2018)) cervical cancer, with usual histological types and no suspicious lymph nodes on imaging, were prospectively enrolled between May 2016 and October 2020. Preoperative pelvic clinical staging on either pelvic MRI or ultrasound examination was mandatory. Tumor size discrepancy (< 10 mm vs ≥ 10 mm) between imaging and pathology, as well as the negative predictive value (NPV) of MRI and ultrasound for parametrial involvement and lymph node macrometastasis, were analyzed. RESULTS: Among 690 eligible prospectively enrolled patients, MRI and ultrasound were used as the staging imaging modality in 322 (46.7%) and 298 (43.2%) patients, respectively. A discrepancy of tumor size ≥ 10 mm was reported between ultrasound and final pathology in 39/298 (13.1%) patients and between MRI and pathology in 53/322 (16.5%), with no significant difference in the accuracy of tumor measurement between the two imaging modalities. The NPV of ultrasound in assessing parametrial infiltration and lymph node involvement was 97.0% (95% CI, 0.95-0.99%) and 94.0% (95% CI, 0.91-0.97%), respectively, and that of MRI was 95.3% (95% CI, 0.93-0.98%) and 94.1% (95% CI, 0.92-0.97%), respectively, with no significant differences between the parameters. Ultrasound and MRI were comparable regarding the tumor size measurement (P = 0.452), failure to detect parametrial involvement (P = 0.624) and failure to detect macrometastases in sentinel lymph node (P = 0.876). CONCLUSIONS: Pelvic ultrasound examination and MRI had similar concordance with histology in the assessment of tumor size and of parametrial and lymph node invasion in early-stage cervical cancer. Ultrasound examination should be considered part of preoperative pelvic clinical staging in early-stage cervical cancer, especially in limited-resource regions where MRI is unavailable. © 2025 The Author(s). Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.
- Keywords
- FIGO, MRI, cervical cancer, clinical staging, imaging, ultrasound,
- MeSH
- Sentinel Lymph Node Biopsy MeSH
- Adult MeSH
- Middle Aged MeSH
- Humans MeSH
- Lymphatic Metastasis diagnostic imaging MeSH
- Lymph Nodes pathology diagnostic imaging MeSH
- Magnetic Resonance Imaging * methods MeSH
- Uterine Cervical Neoplasms * pathology diagnostic imaging MeSH
- Pelvis diagnostic imaging pathology MeSH
- Predictive Value of Tests MeSH
- Preoperative Care methods MeSH
- Prospective Studies MeSH
- Aged MeSH
- Neoplasm Staging methods MeSH
- Ultrasonography methods MeSH
- Check Tag
- Adult MeSH
- Middle Aged MeSH
- Humans MeSH
- Aged MeSH
- Female MeSH
- Publication type
- Journal Article MeSH
- Multicenter Study MeSH
- Research Support, Non-U.S. Gov't MeSH
In recent years the role of diagnostic imaging by pelvic ultrasound in the diagnosis and staging of gynecological cancers has been growing exponentially. Evidence from recent prospective multicenter studies has demonstrated high accuracy for pre-operative locoregional ultrasound staging in gynecological cancers. Therefore, in many leading gynecologic oncology units, ultrasound is implemented next to pelvic MRI as the first-line imaging modality for gynecological cancer. The work herein is a consensus statement on the role of pre-operative imaging by ultrasound and other imaging modalities in gynecological cancer, following European Society guidelines.
- Keywords
- cervical cancer, cross-sectional studies, ovarian cancer, uterine cancer, vulvar and vaginal cancer,
- MeSH
- Gynecology * MeSH
- Consensus MeSH
- Humans MeSH
- Genital Neoplasms, Female * diagnostic imaging MeSH
- Pelvis MeSH
- Ultrasonography MeSH
- Check Tag
- Humans MeSH
- Female MeSH
- Publication type
- Journal Article MeSH
- Review MeSH
Following the European Society of Gynaecological Oncology (ESGO), the European Society for Radiotherapy and Oncology (ESTRO), and the European Society of Pathology (ESP) joint guidelines (2018) for the management of patients with cervical cancer, treatment decisions should be guided by modern imaging techniques. After five years (2023), an update of the ESGO-ESTRO-ESP recommendations was performed, further confirming this statement. Transvaginal/transrectal ultrasound (TRS/TVS) or pelvic magnetic resonance (MRI) enables tumor delineation and precise assessment of its local extent, including the evaluation of the depth of infiltration in the bladder- or rectal wall. Additionally, both techniques have very high specificity to confirm the presence of metastatic pelvic lymph nodes but fail to exclude them due to insufficient sensitivity to detect small-volume metastases, as in any other currently available imaging modality. In early-stage disease (T1a to T2a1, except T1b3) with negative lymph nodes on TVS/TRS or MRI, surgicopathological staging should be performed. In all other situations, contrast-enhanced computed tomography (CECT) or 18F-fluorodeoxyglucose positron emission tomography combined with CT (PET-CT) is recommended to assess extrapelvic spread. This paper aims to review the evidence supporting the implementation of diagnostic imaging with a focus on ultrasound at primary diagnostic workup of cervical cancer.
- Keywords
- CT, MRI, PET-CT, cervical cancer, diagnostic imaging, neoplasm, staging, ultrasound,
- Publication type
- Journal Article MeSH
- Review MeSH