Advertisement
Original article| Volume 10, 100480, 2023

Value of pre-treatment 18F-FDG PET/CT radiomics in predicting the prognosis of stage III-IV colorectal cancer

  • Na Wang
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
  • Meng Dai
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
  • Yan Zhao
    Affiliations
    Department of Oncology, The Fourth Hospital of Hebei Medical University, Shijiazhuang 050011, China
    Search for articles by this author
  • Zhaoqi Zhang
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
  • Jianfang Wang
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
  • Jingmian Zhang
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
  • Yingchen Wang
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China
    Search for articles by this author
  • Yunuan Liu
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China
    Search for articles by this author
  • Fenglian Jing
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China
    Search for articles by this author
  • Xinming Zhao
    Correspondence
    Correspondence to: Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, 12 Jiankang Road, Shijiazhuang, Hebei 050011, China.
    Affiliations
    Department of Nuclear Medicine, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei 050011, China

    Hebei Provincial Key Laboratory of Tumor Microenvironment and Drug Resistance, Shijiazhuang 050011, China
    Search for articles by this author
Open AccessPublished:February 08, 2023DOI:https://doi.org/10.1016/j.ejro.2023.100480

      Abstract

      Background and purpose

      To investigate the value of radiomics features extracted from pre-treatment 18F-FDG PET/CT in predicting the outcomes of stage III-IV colorectal cancer (CRC), which may assist in clinical management strategies and precise treatment of stage III-IV CRC.

      Materials and methods

      124 patients with pathologically confirmed stage III-IV CRC who underwent pre-treatment 18F-FDG PET/CT scans were enrolled in this study. The least absolute shrinkage and selection operator Cox regression (LASSO-Cox) was used to select radiomics features, and the radiomics scores (Rad-scores) were calculated to build radiomics models. The performance of radiomics models was represented by the concordance index (C-index) and compared with clinical models and complex model. The bootstrap resampling method was used to create validation sets. Additionally, nomograms were developed based on complex models.

      Results

      The C-indices of the radiomics model for predicting PFS and OS were 0.712 (95%CI: 0.680–0.744) and 0.758 (0.728–0.789), respectively. In the clinical model, these values were 0.690 (0.664–0.0.717) and 0.738 (0.709–0.767), respectively. However, in the complex model were 0.734 (0.705–0.762) and 0.780 (0.754–0.807), respectively. The Kaplan–Meier curves demonstrated that the radiomics model could effectively separate patients with stage III-IV stage CRC into high- and low-risk groups (p < 0.001). Multivariate Cox regression analysis confirmed the independent prognostic value of Rad-scores.

      Conclusion

      Pre-treatment 18F-FDG PET/CT radiomics features can stratify the risk of patients with stage III-IV CRC and accurately predict their outcomes. These findings could be clinically valuable for precision treatment and management decisions in stage III-IV CRC.

      Keywords

      1. Introduction

      Colorectal cancer (CRC) has become the third most common cancer and the second most common cause of cancer-related deaths worldwide [
      • Sung H.
      • Ferlay J.
      • Siegel R.L.
      • Laversanne M.
      • Soerjomataram I.
      • Jemal A.
      • Bray F.
      Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.
      ]. Approximately 60% of patients with CRC have already locally advanced disease or experience distant metastases at the time of diagnosis, and their 5-year survival rate is relatively low [
      • Siegel R.L.
      • Miller K.D.
      • Goding Sauer A.
      • Fedewa S.A.
      • Butterly L.F.
      • Anderson J.C.
      • Cercek A.
      • Smith R.A.
      • Jemal A.
      Colorectal cancer statistics.
      ]. Although targeted agents combined with chemotherapy regimens used for the treatment of metastatic CRC have significantly improved survival, the prognosis of patients with CRC remains an important factor in clinical patient management and selection of treatment decisions [
      • Gunderson L.L.
      • Jessup J.M.
      • Sargent D.J.
      • Greene F.L.
      • Stewart A.
      Revised tumor and node categorization for rectal cancer based on surveillance, epidemiology, and end results and rectal pooled analysis outcomes.
      ]. Therefore, the choice of treatment options and accurate assessments are crucial for predicting patients with III-IV stage CRC prognosis and individual treatment strategy decisions.
      The tumor-node-metastasis (TNM) staging classification system plays an important role in predicting patients with III-IV CRC prognosis [
      • Tong G.J.
      • Zhang G.Y.
      • Liu J.
      • Zheng Z.Z.
      • Chen Y.
      • Niu P.P.
      • Xu X.T.
      Comparison of the eighth version of the American Joint Committee on Cancer manual to the seventh version for colorectal cancer: A retrospective review of our data.
      ]. Tumor heterogeneity in pre-treatment 18F-FDG PET/CT images may contribute to better characterization and improved prediction of malignant tumor survival outcomes[
      • Ko K.Y.
      • Liu C.J.
      • Ko C.L.
      • Yen R.F.
      Intratumoral Heterogeneity of Pretreatment 18F-FDG PET Images Predict Disease Progression in Patients With Nasal Type Extranodal Natural Killer/T-cell Lymphoma.
      ]. Recently, radiomics has become the primary trend in medical imaging studies and has shown significant potential for the analysis of lesion characterization and intratumoral heterogeneity (ITH) [
      • Kuo M.D.
      • Jamshidi N.
      Behind the numbers: Decoding molecular phenotypes with radiogenomics--guiding principles and technical considerations.
      ,
      • Bera K.
      • Braman N.
      • Gupta A.
      • Velcheti V.
      • Madabhushi A.
      Predicting cancer outcomes with radiomics and artificial intelligence in radiology.
      ]. It can extract large numbers of quantitative multidimensional and subvisual image features and excavate a large amount of image information to evaluate the biological characteristics of tumors [
      • Huang Y.Q.
      • Liang C.H.
      • He L.
      • Tian J.
      • Liang C.S.
      • Chen X.
      • Ma Z.L.
      • Liu Z.Y.
      Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer.
      ,
      • Kim J.Y.
      • Park J.E.
      • Jo Y.
      • Shim W.H.
      • Nam S.J.
      • Kim J.H.
      • Yoo R.E.
      • Choi S.H.
      • Kim H.S.
      Incorporating diffusion- and perfusion-weighted MRI into a radiomics model improves diagnostic performance for pseudoprogression in glioblastoma patients.
      ,
      • Lovinfosse P.
      • Ferreira M.
      • Withofs N.
      • Jadoul A.
      • Derwael C.
      • Frix A.N.
      • Guiot J.
      • Bernard C.
      • Diep A.N.
      • Donneau A.F.
      • Lejeune M.
      • Bonnet C.
      • Vos W.
      • Meyer P.E.
      • Hustinx R.
      Distinction of lymphoma from sarcoidosis at FDG PET/CT - evaluation of radiomic-feature guided machine learning versus human reader performance.
      ]. Radiomics studies for CRC prognosis are mostly based on computed tomography (CT) or magnetic resonance imaging (MRI) [
      • Dai W.
      • Mo S.
      • Han L.
      • Xiang W.
      • Li M.
      • Wang R.
      • Tong T.
      • Cai G.
      Prognostic and predictive value of radiomics signatures in stage I-III colon cancer.
      ,
      • Dohan A.
      • Gallix B.
      • Guiu B.
      • Le Malicot K.
      • Reinhold C.
      • Soyer P.
      • Bennouna J.
      • Ghiringhelli F.
      • Barbier E.
      • Boige V.
      • Taieb J.
      • Bouché O.
      • François E.
      • Phelip J.M.
      • Borel C.
      • Faroux R.
      • Seitz J.F.
      • Jacquot S.
      • Ben Abdelghani M.
      • Khemissa-Akouz F.
      • Genet D.
      • Jouve J.L.
      • Rinaldi Y.
      • Desseigne F.
      • Texereau P.
      • Suc E.
      • Lepage C.
      • Aparicio T.
      • Hoeffel C.
      Early evaluation using a radiomic signature of unresectable hepatic metastases to predict outcome in patients with colorectal cancer treated with FOLFIRI and bevacizumab.
      ,
      • Liu Z.
      • Meng X.
      • Zhang H.
      • Li Z.
      • Liu J.
      • Sun K.
      • Meng Y.
      • Dai W.
      • Xie P.
      • Ding Y.
      • Wang M.
      • Cai G.
      • Tian J.
      Predicting distant metastasis and chemotherapy benefit in locally advanced rectal cancer.
      ,
      • Daye D.
      • Tabari A.
      • Kim H.
      • Chang K.
      • Kamran S.C.
      • Hong T.S.
      • Kalpathy-Cramer J.
      • Gee M.S.
      Quantitative tumor heterogeneity MRI profiling improves machine learning-based prognostication in patients with metastatic colon cancer.
      ]. However, there are few reports on the prediction of stage III-IV CRC using 18F-fluorodeoxyglucose positron emission tomography/computed tomography (18F-FDG PET/CT) radiomics. Thus, this study aimed to develop and validate a baseline 18F-FDG PET/CT radiomics model to predict patients with stage III-IV CRC outcomes; the findings may have a potential application value in clinical management strategies and precise treatment of stage III-IV CRC.

      2. Materials and methods

      2.1 Patient selection

      This retrospective, single-institution study was approved by the institutional ethics committee (approval no. 2021KY292), which waived the requirement for informed consent from patients. A database of 124 patients with stage III-IV CRC who underwent pre-treatment 18F-FDG PET/CT screening between February 2014 and September 2020 in our department was assessed.
      The inclusion criteria were as follows: (1) primary lesions of stage III-IV CRC pathologically confirmed as adenocarcinoma, (2) 18F-FDG PET/CT examination within 1 month of pathological examination and 2 weeks before initial treatment, (3) no history of other malignant tumors, (4) complete clinical data, and (5) no loss to follow-up. The exclusion criteria were as follows: (1) patients with stage I-II CRC, (2) antitumor therapy before 18F-FDG PET/CT screening, (3) double or multiple primary CRC, (4) pathological diagnosis not obtained from the primary CRC lesions, and (5) tumor metabolic volume on PET/CT images < 5 cm3.
      Of the 124 patients with CRC enrolled based on the above criteria, 82 were male and 42 were female, with an average age of 58.69 ± 12.16 (range, 26–83) years. Moreover, 36 and 88 patients were diagnosed with CRC in the colon and rectum, respectively. The patient screening process is shown in Fig. 1.
      Fig. 1
      Fig. 1The flowchart shows the process of selection.

      2.2 Positron emission tomography/computed tomography imaging and acquisition parameters

      Each patient underwent 18F-FDG PET/CT examination using GEMINI GXL PET/CT (PHILIPS) scanner equipped with a 16-slice CT 1 month before treatment. After fasting 6 h, 18F-FDG was injected intravenously with 3.7–5.5 MBq/kg (0.1–0.15 mCi/kg). Blood glucose level was maintained at 11 mmol/L. Whole-body PET/CT examination was performed 60 min after 18F-FDG injection.
      According to the Image Biomarker Standardization Initiative reporting guidelines [
      • Zwanenburg A.
      • Vallières M.
      • Abdalah M.A.
      • Aerts H.
      • Andrearczyk V.
      • Apte A.
      • Ashrafinia S.
      • Bakas S.
      • Beukinga R.J.
      • Boellaard R.
      • Bogowicz M.
      • Boldrini L.
      • Buvat I.
      • Cook G.
      • Davatzikos C.
      • Depeursinge A.
      • Desseroit M.C.
      • Dinapoli N.
      • Dinh C.V.
      • Echegaray S.
      • El Naqa I.
      • Fedorov A.Y.
      • Gatta R.
      • Gillies R.J.
      • Goh V.
      • Götz M.
      • Guckenberger M.
      • Ha S.M.
      • Hatt M.
      • Isensee F.
      • Lambin P.
      • Leger S.
      • Leijenaar R.
      • Lenkowicz J.
      • Lippert F.
      • Losnegård A.
      • Maier-Hein K.H.
      • Morin O.
      • Müller H.
      • Napel S.
      • Nioche C.
      • Orlhac F.
      • Pati S.
      • Pfaehler E.
      • Rahmim A.
      • Rao A.
      • Scherer J.
      • Siddique M.M.
      • Sijtsema N.M.
      • Socarras Fernandez J.
      • Spezi E.
      • Steenbakkers R.
      • Tanadini-Lang S.
      • Thorwarth D.
      • Troost E.
      • Upadhaya T.
      • Valentini V.
      • van Dijk L.V.
      • van Griethuysen J.
      • van Velden F.
      • Whybra P.
      • Richter C.
      • Löck S.
      The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping.
      ], the scan parameters are shown in Table S1.

      2.3 Segmentation and radiomics feature extraction

      PET/CT images of all patients in the Digital Imaging and Communications in Medicine format were successively imported to the Local Image Features Extraction (LIFEx) package (version 7.0.0, http://www.lifexsoft.org) [
      • Nioche C.
      • Orlhac F.
      • Boughdad S.
      • Reuzé S.
      • Goya-Outi J.
      • Robert C.
      • Pellot-Barakat C.
      • Soussan M.
      • Frouin F.
      • Buvat I.
      LIFEx: a freeware for radiomic feature calculation in multimodality imaging to accelerate advances in the characterization of tumor heterogeneity.
      ]. Two experienced nuclear medicine physicians independently used 40% of the maximum standardized uptake value (SUVmax) [
      • Wang H.
      • Zhao S.
      • Li L.
      • Tian R.
      Development and validation of an (18)F-FDG PET radiomic model for prognosis prediction in patients with nasal-type extranodal natural killer/T cell lymphoma.
      ] as an optimization threshold to delineate the region of interest (ROI) of the CRC primary lesions using the LIFEx package. Manual segmentation was performed along the contour of the tumor during delineation to avoid the inclusion of intestinal gas, fatty tissue around the intestinal wall, and surrounding cords into the scope of the ROI. When it was difficult to determine the boundary of lesions, the boundary was determined by adjusting the window width and position or by combining coronal and sagittal images. The spatial resampling intervals X, Y, and Z on the PET/CT images were 2 mm × 2 mm × 2 mm for all patients [
      • Nioche C.
      • Orlhac F.
      • Boughdad S.
      • Reuzé S.
      • Goya-Outi J.
      • Robert C.
      • Pellot-Barakat C.
      • Soussan M.
      • Frouin F.
      • Buvat I.
      LIFEx: a freeware for radiomic feature calculation in multimodality imaging to accelerate advances in the characterization of tumor heterogeneity.
      ,
      • Du Z.
      • Zhang X.
      • Tang Z.
      More evidence for prediction model of radiosensitivity.
      ]. Absolute intensity resampling setting are as follows: absolute value range: CT images were set as − 1000–3000HU, PET image were set as 0–25SUV. Intensity discretization setting: CT images were set as 0–400bins, PET images were set as 0–64bins.

      2.4 Radiomics feature selection and model building

      First, we standardized the radiomics features extracted from 18F-FDG PET/CT. Then, the PET/CT radiomics features predicting progression-free survival (PFS) and overall survival (OS) were screened using least absolute shrinkage and selection operator Cox regression (LASSO-Cox), and linear fitting was conducted according to their respective coefficient weights [
      • Wang H.
      • Zhao S.
      • Li L.
      • Tian R.
      Development and validation of an (18)F-FDG PET radiomic model for prognosis prediction in patients with nasal-type extranodal natural killer/T cell lymphoma.
      ]. Cross-validation was applied to select radiomics features with nonzero coefficients. The radiomics score (Rad-score) of each patient was calculated using the formula used to construct the radiomics models. We determined the optimal threshold of the Rad-score on the Youden index of the receiver operating characteristic curve and divided patients into high- and low-risk groups based on the optimal threshold of the Rad-score. Kaplan–Meier (K–M) analysis and log-rank test were used to evaluate the potential association between the radiomics model and PFS and OS.
      Univariate and multivariate Cox regression analyses were performed to select significant clinical variables that predicted the prognosis of PFS and OS in stage III-IV CRC to build a clinical model. The Rad-score and significant clinical variables were entered into a multivariate Cox regression to construct the complex model.

      2.5 Model validation

      The Harrell concordance index (C-index) was used to evaluate the performance of the three models [
      • Weiss A.
      • Chavez-MacGregor M.
      • Lichtensztajn D.Y.
      • Yi M.
      • Tadros A.
      • Hortobagyi G.N.
      • Giordano S.H.
      • Hunt K.K.
      • Mittendorf E.A.
      Validation Study of the American Joint Committee on Cancer Eighth Edition Prognostic Stage Compared With the Anatomic Stage in Breast Cancer.
      ,
      • Amit M.
      • Liu C.
      • Netto Gleber F.O.
      • Kini S.
      • Tam S.
      • Benov A.
      • Aashiq M.
      • El-Naggar A.K.
      • Moreno A.C.
      • Rosenthal D.I.
      • Glisson B.S.
      • Ferrarotto R.
      • Wong M.K.
      • Migden M.R.
      • Li G.
      • Khanna A.
      • Goepfert R.P.
      • Nagarajan P.
      • Weber R.S.
      • Myers J.N.
      • Gross N.D.
      Integrating depth of invasion in T classification improves the prognostic performance of the American Joint Committee on Cancer primary tumor staging system for cutaneous squamous cell carcinoma of the head and neck.
      ]. Bootstrap resampling 1000 times was used to obtain the corrected C-index of the three models for internal verification. Based on the best prediction model, a nomogram was developed that could intuitively and effectively predict the risk probability of each patient. In addition, the accuracy and repeatability of the model were visually evaluated using the Hosmer–Lemeshow test and calibration curves, and the deviation from the theoretical perfect calibration was not significant (p > 0.05) [
      • Pencina M.J.
      • Sr D.R.B.
      • Steyerberg E.W.
      Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers.
      ].

      2.6 Follow-up of patients

      All patients were followed every 3–6 months after treatment during the first 2 years and every 6 months thereafter. In this study, PFS was defined as the time from the date of pathological diagnosis of CRC to the follow-up confirmation of tumor progression, death, or follow-up cutoff. OS was defined as the time from the date of pathological diagnosis of CRC to the confirmation of death or the cut-off date of follow-up. The follow-up period ended on September 30, 2021.

      2.7 Statistical analyses

      Statistical analyses were performed using the International Business Machines Statistical Package for the Social Sciences Statistics version 26.0 and R 4.2.1 software packages (http://www.R-project.org). The C-index values of radiomic model, clinical model and complex model were compared by compareC software in R language. All results were considered statistically significant at p < 0.05.

      3. Results

      3.1 Follow-up patients

      The median follow-up times of PFS and OS were 20.5 and 28.6 (range, 1.1–60.5) months, respectively. Of the 124 patients, 70 (56.45%) experienced relapse, and 61 (49.19%) died during the follow-up period. At the follow-up date, the PFS rates at 1, 2, and 3 years were 62.10%, 50.55%, and 39.52%, respectively, and the OS rates were 83.06%, 66.93%, and 53.23%, respectively.

      3.2 Clinical characteristics of patients and Cox analysis of prognostic factors

      The basic clinical characteristics of the enrolled patients and the univariate and multivariate Cox regression analyses for predicting PFS and OS are summarized in Table 1, Table 2, respectively. For PFS, Tumor location (p = 0.009), Tumor diameter (p = 0.042), Lymphatic metastasis (p < 0.001), Distant metastasis (p < 0.001), Therapy method (p < 0.001), and carbohydrate antigen 199 (CA199) level (p = 0.012) were statistically significant in the univariate Cox regression analysis. However, multivariate Cox analysis showed that only Distant metastasis (p < 0.001) was an independent prognostic factor for PFS. The Tumor location (p < 0.001), Distant metastasis (p < 0.001), Lymphatic metastasis (p < 0.001), Distant metastasis (p < 0.001), Therapy method (p < 0.001), and CA199 level (p = 0.024) were prognostic factors for OS in univariate Cox regression analysis. But only Distant metastasis (p < 0.001) and Therapy method (p = 0.013) were independent prognostic factors for OS in multivariate Cox regression analysis.
      Table 1Baseline clinical characteristics of stage III-IV CRC patients, univariate and multivariate Cox regression analysis for predicting PFS in stage III-IV CRC patients.
      CharacteristicsAll patients(N = 124)Univariate analysisMultivariate analysis
      HR95%CIP-valueHR95%CIP-value
      Gender, n (%)1.290.80–2.090.292
      Male82 (66.1%)
      Female42 (33.9%)
      Age, n (%)1.140.72–1.810.585
      <6161(49.2%)
      ≥ 6163(50.8%)
      Tumor location, n (%)0.520.32–0.850.009*1.290.76–2.200.341
      Colon36(29.0%)
      Rectum88(71.0%)
      Tumor diameter, n (%)0.620.38–0.980.042*0.970.58–1.610.904
      <5.0 cm61(49.2%)
      ≥ 5.0 cm63(50.8%)
      T stage, n (%)1.240.77–2.010.384
      T2–381(65.3%)
      T443(34.7%)
      Lymphatic metastasis, n (%)0.390.24–0.63< 0.001*1.180.65–2.140.596
      No32(25.8%)
      Yes92(74.2%)
      Distant metastasis, n (%)5.263.07–9.00< 0.001*4.362.44–7.81< 0.001*
      No62(50.0%)
      Yes62(50.0%)
      Therapy method, n (%)2.811.75–4.53< 0.001*1.570.94–2.640.087
      Comprehensive surgical treatment69(55.6%)
      Nonoperative comprehensive treatment55(44.4%)
      BMI, n (%)0.790.49–1.270.327
      <24.968(54.8%)
      ≥ 24.956(45.2%)
      CEA, n (%)1.270.73–2.180.398
      <5 ng/mL33(26.6%)
      ≥ 5 ng/mL91(73.4%)
      CA199, n (%)1.821.14–2.890.012*1.250.77–2.040.370
      < 27.0 ng/mL74(59.7%)
      ≥ 27.0 ng/mL50(40.3%)
      Rad_score////2.561.46–4.480.001*
      BMI, body mass index; CEA, carcinoembryonic antigen; CA199, carbohydrate antigen199; / not apply. * P<0.05.
      Table 2Baseline clinical characteristics of stage III-IV CRC patients, univariate and multivariate Cox regression analysis for predicting OS in stage III-IV CRC patients.
      CharacteristicsAll patients(N = 124)Univariate analysisMultivariate analysis
      HR95%CIP-valueHR95%CIP-value
      Gender, n (%)1.420.85–2.380.182
      Male82 (66.1%)
      Female42 (33.9%)
      Age, n (%)1.310.79–2.120.298
      <6161(49.2%)
      ≥ 6163(50.8%)
      Tumor location, n (%)0.390.23–0.65< 0.001*0.920.50–1.690.786
      Colon36(29.0%)
      Rectum88(71.0%)
      Tumor diameter, n (%)0.630.38–1.050.074
      <5.0 cm61(49.2%)
      ≥ 5.0 cm63(50.8%)
      T stage, n (%)1.390.83–2.340.215
      T1–381(65.3%)
      T443(34.7%)
      Lymphatic metastasis, n (%)0.260.15–0.44< 0.001*0.770.42–1.410.389
      No32(25.8%)
      Yes92(74.2%)
      Distant metastasis, n (%)6.043.27–11.17< 0.001*4.882.55–9.34< 0.001*
      No62(50.0%)
      Yes62(50.0%)
      Therapy method, n (%)3.251.93–5.49< 0.001*2.011.16–3.500.013*
      Comprehensive surgical treatment69(55.6%)
      Nonoperative comprehensive treatment55(44.4%)
      BMI, n (%)0.620.37–1.040.070
      <24.968(54.8%)
      ≥ 24.956(45.2%)
      CEA, n (%)1.210.68–2.170.519
      <5 ng/mL33(26.6%)
      ≥ 5 ng/mL91(73.4%)
      CA199, n (%)1.791.08–2.960.024*1.180.70–1.980.542
      < 27.0 ng/mL74(59.7%)
      ≥ 27.0 ng/mL50(40.3%)
      Rad_score////2.901.65–5.11< 0.001*
      BMI, body mass index; CEA, carcinoembryonic antigen; CA199, carbohydrate antigen199; / not apply. * P<0.05.

      3.3 Radiomics features analysis and model establishment

      A total of 196 PET/CT radiomics features (98 PET and 98 CT features) were extracted (Table S2). According to the LASSO-Cox results (Fig. 2), Eleven and twelve PET/CT radiomics features with nonzero coefficients for predicting PFS and OS were obtained, respectively, to construct radiomics models.
      Fig. 2
      Fig. 2The LASSO-Cox were used to select radiomic features to predicting PFS and OS. 10-fold cross-validation with the minimum criteria were used in the LASSO-Cox to select λ (A) PFS and 11 nonzero coefficients produced with the optimal λ (B) PFS. 10-fold cross-validation with the minimum criteria were used in the LASSO-Cox to select λ (C) OS and 12 nonzero coefficients produced with the optimal λ (D) OS.
      For PFS, the screened 11 PET/CT radiomic features include 3 PET and 8 CT imaging features. The three PET radiomic features were as follows: Conventional_SUVKurtosis, Discretized_SUVKurtosis, Grey-Level Size Zone Matrix_Small Zone Low Grey Emphasis (GLZLM_SZLGE), the eight CT radiomic features were Conventional_HUKurtosis, Discretized_HUmax, Discretized_HUQ2, Discretized_HUQ3, SHAPE_Compacity, Grey-Level Co-occurrence Matrix_Homogeneity (GLCM_Homogeneity), Grey-Level Run Length Mrtrix_Short Run Gray-Level Emphasis (GLRLM_SRHGE), Grey-Level Size Zone Matrix_Small Zone High Gray Emphasis (GLZLM_SZHGE). The Rad_score of each patient for predicting PFS was calculated using the following formula.
      Rad_scorePFS=0.125×Conventional_SUVKurtosis0.292×Discretized_SUVKurtosis0.159×GLZLM_SZLGE0.014×Conventional_HUKurtosis+0.359×Discretized_HUmax0.112×Discretized_HUQ20.084×Discretized_HUQ30.129×SHAPE_Compacity+0.184×GLCM_Homogeneity0.284×GLRLM_SRHGE+0.031×GLZLM_SZHGE


      The selected 12 radiomics features which including five PET and seven CT radiomic features for predicting OS were: Conventional_SUVKurtosis, Discretized_SUVKurtosis, Discretized_HISTO_Energy, GLZLM_SZLGE, Grey-Level Size Zone Matrix_Zone Percentage (GLZLM_ZP) (PET radiomic features), Conventional_HUKurtosis, Discretized_HUmax, Discretized_HUQ2, Discretized_HUQ3, SHAPE_Sphericity, SHAPE_Compacity, GLRLM_SRHGE (CT radiomic features). For OS, the Rad-score formula for each patient was as follows:
      Rad_socreOS=0.090×Conventional_SUVKurtosis0.149×Discretized_SUVKurtosis0.018×Discretized_HISTO_Energy0.026×GLZLM_SZLGE+0.090×GLZLM_ZP0.006×Conventional_HUKurtosis+0.363×Discretized_HUmax0.228×Discretized_HUQ20.007×Discretized_HUQ30.105×SHAPE_Sphericity0.144×SHAPE_Compacity0.650×GLRLM_SRHGE Regardless of the radiomics model used for predicting PFS and OS, the Rad-score in the high- and low-risk groups was statistically significant (p < 0.001). Stage III-IV CRC Patients with high Rad-scores had poor survival outcomes.

      3.4 Performance of the radiomics features, clinical variables, and complex model

      The results of the C-index and Hosmer–Lemeshow test are shown in Table 3. The C-indices of the radiomics model for predicting PFS and OS were 0.712 (95% CI: 0.680–0.744) and 0.758 (0.728–0.789), respectively, which were 0.690 (0.664–0.717) and 0.738 (0.709–0.767), respectively, in the clinical model. However, the complex models based on Rad-score and clinical variables had higher C-indices (i.e., 0.734, 95% CI: 0.705–0.762, and 0.780, 95% CI: 0.754–0.807, respectively). The C-indices between complex model and radiomics model in predicting PFS and OS were statistically different (both p < 0.001). And there was a statistically significant difference in the C-index for predicting PFS and OS between the complex and the clinical model ( PFS: p = 0.003; OS: p = 0.011). The findings were confirmed by bootstrap resampling (n = 1000).
      Table 3The results of the C-index and the Hosmer-Lemeshow.
      C-index(95CI%)corected C-index (Bootstrap, B=1000)χ2 valuep valuea
      PFS
      Radiomics model0.712 (0.680–0.744)0.671 (0.723–0.834)6.7410.565
      Clinical model0.690 (0.664–0.717)0.689 (0.639–0.744)0.0001.000
      Complex model0.734 (0.705–0.762)0.730 (0.678–0.788)0.1500.928
      OS
      Radiomics model0.758 (0.728–0.789)0.718 (0.682–0.795)7.2860.506
      Clinical model0.738 (0.709–0.767)0.736 (0.680–0.794)2.4700.291
      Complex model0.780 (0.754–0.807)0.772 (0.723–0.834)11.6050.071
      χ2 and ap value for the Hosmer-Lemeshow test.

      3.5 Individualized nomogram construction and calibration curve

      We divided the patients into high- and low-risk groups according to the optimum cutoff point of the Rad-score (Rad-scorePFS = −0.0031, Rad-scoreOS = 0.0612). In the relapse risk stratification, 71 (57.5%) patients were classified into the high-risk group, and 58 (81.7%) of these patients experienced recurrence at the overall endpoint. A total of 53 (42.7%) patients were assigned to the low-risk group, of which 18 (34.0%) developed recurrence by the overall endpoint. The K–M curve demonstrated that the risk of recurrence was significantly higher in the high-risk group than in the low-risk group (p < 0.001) (Fig. 3A). For OS, 52 (41.9%) patients were in the high-risk group, and 42 (80.8%) had fatal events. In total, 72 (58.1%) patients were assigned to the low-risk group, and among them, 19 (26.4%) died. The K–M curve indicated that the risk of death in the high-risk group was significantly different from that in the low-risk group (p < 0.001) (Fig. 3B).
      Fig. 3
      Fig. 3The Kaplan-Meier survival analysis stratified the risk of recurrence or death based on the radiomics (A) PFS and (B) OS. The log-rank test was used to calculate p value.
      The median and interquad distances Conventional_SUVkurtosis PET radiomic feature to predict PFS into high- and low risk group were − 0.219 (−0.270, −0.154) and − 0.126 (−0.226, 0.031), respectively (p < 0.001). Discretized_SUVkurtosis has a median and interquartile interval of 0.245 (−0.303, −0.175) and 0.147 (−0.254, 0.124) in the high- and low-risk group, respectively (p < 0.001). The median and interquinqual intervals of Conventional_SUVkurtosis were − 0.215 (−0.269, −0.132) and − 0.180 (−0.251, −0.061), respectively to the predicted high- and low-risk groups (p = 0.072). Discretized_SUVkurtosis has a median and interquartile interval of − 0.244 (−0.302, −0.152) and − 0.192 (−0.277, −0.063), respectively, in the high-risk and low-risk groups for predicting deaths (p = 0.035).
      Considering that the complex model based on independent predictive factors, including Rad-score and clinical variables (Distant metastasis and Therapy method), had a better ability to predict PFS and OS, we developed a nomogram that could intuitively predict the risk proportion of each factor and individually predict the prognosis of patients (Fig. 4A, E). The calibration curves of the nomogram for predicting PFS and OS are shown in Fig. 4B–D and F–H and visually evaluated the consistency between the predicted and actual survival probabilities. The Hosmer–Lemeshow test was not statistically significant in either the complex model for predicting PFS (χ2 = 0.150, p = 0.928) or OS (χ2 = 11.605, p = 0.071).
      Fig. 4
      Fig. 4The nomograms were developed combined Rad_score and clinical variables, A is for PFS and E is for OS. Calibration curves based on complex model for 1–3 year PFS (B-D) and OS (F-H).

      4. Discussion

      In this study, we developed and validated a baseline 18F-FDG PET/CT radiomics model with moderate predictive ability for PFS and OS in patients with stage III-IV CRC. The radiomics signature is an independent risk factor for prognosis and provides a noninvasive method for stratifying the risk of recurrence or death in patients with stage III-IV CRC. Furthermore, complex models that combine Rad-score and optimal clinical variables to predict CRC outcomes were developed, and they showed significantly better predictive ability than a single radiomics or clinical model. The visualized nomogram based on complex models can identify patients at a high risk of early progression or death and provide individualized treatment strategies that are beneficial for these patients. The K–M curve indicated that our radiomics models could effectively distinguish between high- and low-risk groups in patients with stage III-IV CRC.
      In this retrospective study, among the 18F-FDG PET/CT radiomics features associated with PFS and OS, SUVkurtosis was a basic PET feature of the area under the curve of the cumulative SUV volume histogram. The SUVkurtosis was lower in the high-risk group than in the low-risk group. Compared with SUVmean, SUVkurtosis improves data fluctuation caused by statistical noise and is less susceptible to variations caused by subjective factors, and the data are more objective, to facilitate data comparison between different studies. Wagner et al. showed that the kurtosis of 18F-FDG PET/CT parameters was significantly different between primary colon cancer lesions and hepatic metastases, which plays an important role in evaluating the heterogeneity of colon cancer [
      • Wagner F.
      • Hakami Y.A.
      • Warnock G.
      • Fischer G.
      • Huellner M.W.
      • Veit-Haibach P.
      Comparison of Contrast-Enhanced CT and [(18)F]FDG PET/CT Analysis Using Kurtosis and Skewness in Patients with Primary Colorectal Cancer.
      ]. Other studies have shown that the absolute gradient (GrKurtosis) is significantly associated with the 3-year disease-free survival (DFS) of locally advanced rectal cancer (LARC) and is an independent prognostic indicator of the outcome of LARC [
      • Bang J.I.
      • Ha S.
      • Kang S.B.
      • Lee K.W.
      • Lee H.S.
      • Kim J.S.
      • Oh H.K.
      • Lee H.Y.
      • Kim S.E.
      Prediction of neoadjuvant radiation chemotherapy response and survival using pretreatment [(18)F]FDG PET/CT scans in locally advanced rectal cancer.
      ]. In our study, we found that patients with stage III-IV CRC with low SUVkurtosis had a higher risk of recurrence or death, which is consistent with the above findings.
      The PET/CT first-order radiomics features that we screened to predict the prognosis in stage III-IV CRC also included Histogram based feature, Discretized_HISTO_Energy (PET feature), and two shape-based features, SHAPE_Compacity and SHAPE_Sphericity (CT features). The HISTO_Energy feature mainly describe the intensity of changes in the gray intensity information (or brightness information) of the lesions. In general, the smaller the change, the larger the HISTO_energy value. Some studies have shown that HISTO_Energy which extracted from 18F-FDG PET/CT can predict disease-free survival (DFS) in patients with non-small cell lung cancer (NSCLC) [
      • Kirienko M.
      • Gallivanone F.
      • Sollini M.
      • Veronesi G.
      • Voulaz E.
      • Antunovic L.
      • Leonardi L.
      • Testanera G.
      • Castiglioni I.
      • Chiti A.
      FDG PET/CT as theranostic imaging in diagnosis of non-small cell lung cancer.
      ] and OS in patients with esophageal cancer [
      • Foley K.G.
      • Hills R.K.
      • Berthon B.
      • Marshall C.
      • Parkinson C.
      • Lewis W.G.
      • Crosby T.
      • Spezi E.
      • Roberts S.A.
      Development and validation of a prognostic model incorporating texture analysis derived from standardised segmentation of PET in patients with oesophageal cancer.
      ]. SHAPE_Compacity describes the degree of sphericity of the lesion, that is, it reflects the Compactness of the lesion. SHAPE_Sphericity is a feature that describes how similar an ROI is to a sphere, ideally with a sphericity of 1. Both are important factors for predicting the response of rectal cancer to nCRT [
      • Park H.
      • Kim K.A.
      • Jung J.H.
      • Rhie J.
      • Choi S.Y.
      MRI features and texture analysis for the early prediction of therapeutic response to neoadjuvant chemoradiotherapy and tumor recurrence of locally advanced rectal cancer.
      ,
      • Karahan Şen N.P.
      • Aksu A.
      • Kaya G.Ç.
      Value of volumetric and textural analysis in predicting the treatment response in patients with locally advanced rectal cancer.
      ], and have significant correlation with clinical prognostic factors [
      • Davey A.
      • van Herk M.
      • Faivre-Finn C.
      • Mistry H.
      • McWilliam A.
      Is tumour sphericity an important prognostic factor in patients with lung cancer.
      ]. Some studies reported that the three radiomics features showed good repeatability[
      • Park H.
      • Kim K.A.
      • Jung J.H.
      • Rhie J.
      • Choi S.Y.
      MRI features and texture analysis for the early prediction of therapeutic response to neoadjuvant chemoradiotherapy and tumor recurrence of locally advanced rectal cancer.
      ,
      • Yan M.
      • Wang W.
      A non-invasive method to diagnose lung adenocarcinoma.
      ]. In our study, the three radiomics features could predict PFS or OS in patients with stage III-IV CRC.
      Among the eleven and twelve 18F-FDG PET/CT radiomics features associated with PFS and OS, there were four (one PET texture features GLZLM_SZLGE, and three CT texture feature, including GLCM_homogeneity, GLRLM_SRHGE and GLZLM_SZHGE) and three (two PET texture feature, including GLZLM_SZLGE and GLZLM_ZP, and one CT texture features GLRLM_SRHGE) second-order texture features, respectively. GLRLM, GLZLM, and GLCM are second-order texture parameters commonly used to quantify ITH. However, tumors with higher heterogeneity have poor prognosis [
      • Gillies R.J.
      • Kinahan P.E.
      • Hricak H.
      Radiomics: images are more than pictures, they are data.
      ]. In this study, patients with stage III-IV CRC with a high risk of recurrence or death had higher ITH. PET or multimodal imaging enables fine characterization of ITH in a noninvasive manner [
      • Bailly C.
      • Bodet-Milin C.
      • Bourgeois M.
      • Gouard S.
      • Ansquer C.
      • Barbaud M.
      • Sébille J.C.
      • Chérel M.
      • Kraeber-Bodéré F.
      • Carlier T.
      Exploring Tumor Heterogeneity Using PET Imaging: The Big Picture.
      ]. Previous studies have also shown that texture features based on GLCM, GLRLM, and GLZLM can capture spatial relations between adjacent pixels of a given image, which is a hot topic in radiomics and is closely related to prognosis [
      • Jensen G.L.
      • Yost C.M.
      • Mackin D.S.
      • Fried D.V.
      • Zhou S.
      • Court L.E.
      • Gomez D.R.
      Prognostic value of combining a quantitative image feature from positron emission tomography with clinical factors in oligometastatic non-small cell lung cancer.
      ]. Kang et al. established a prognostic prediction model for 381 patients with CRC using preoperative 18F-FDG PET/CT radiomics features and found that GLRLM_LRE and GLZLM_SZLGE were independent factors of PFS [
      • Kang J.
      • Lee J.H.
      • Lee H.S.
      • Cho E.S.
      • Park E.J.
      • Baik S.H.
      • Lee K.Y.
      • Park C.
      • Yeu Y.
      • Clemenceau J.R.
      • Park S.
      • Xu H.
      • Hong C.
      • Hwang T.H.
      Radiomics Features of 18F-Fluorodeoxyglucose Positron-Emission Tomography as a Novel Prognostic Signature in Colorectal Cancer.
      ]. Our study also showed that the texture features GLRLM and GLZLM were independent indicators of PFS and OS. The selected texture parameters differ among different studies, which may be attributed to the stability of texture features affected by imaging equipment, imaging technology, and reconstruction parameters.
      Some scholars have attempted to predict the prognosis of patients with CRC using radiomics based on CT or MRI. Xue et al. found that the C-index of the nomogram, which was built by combining the Rad-score with clinical factors to predict OS was 0.782, 0.721 and 0.677. These findings might affect treatment strategies of CRC [
      • Xue T.
      • Peng H.
      • Chen Q.
      • Li M.
      • Duan S.
      • Feng F.
      A CT-based radiomics nomogram in predicting the postoperative prognosis of colorectal cancer: a two-center study.
      ]. Other scholars have developed a comprehensive model combining MRI radiomics features, morphological imaging models, and clinicopathological models to predict the 3-year OS of 206 patients with rectal cancer who underwent radical surgery, with a C-index of 0.872, which has a good predictive ability for OS [
      • Chuanji Z.
      • Zheng W.
      • Shaolv L.
      • Linghou M.
      • Yixin L.
      • Xinhui L.
      • Ling L.
      • Yunjing T.
      • Shilai Z.
      • Shaozhou M.
      • Boyang Z.
      Comparative study of radiomics, tumor morphology, and clinicopathological factors in predicting overall survival of patients with rectal cancer before surgery.
      ]. However, there have been few studies on the application of imaging features extracted from PET/CT to predict the prognosis of CRC. Recently, a radiomics nomogram has been developed using 18F-FDG PET/CT radiomics features, lymph node staging, and lymphovascular invasion and has shown good predictive power in patients with CRC, comparable to American Joint Committee on Cancer’s staging systems in calibration. Their C-indices were 0.737 and 0.64, respectively, and the study demonstrated that 18F-FDG PET/CT radiomics features may enable detailed stratification of outcomes in patients with CRC [
      • Kang J.
      • Lee J.H.
      • Lee H.S.
      • Cho E.S.
      • Park E.J.
      • Baik S.H.
      • Lee K.Y.
      • Park C.
      • Yeu Y.
      • Clemenceau J.R.
      • Park S.
      • Xu H.
      • Hong C.
      • Hwang T.H.
      Radiomics Features of 18F-Fluorodeoxyglucose Positron-Emission Tomography as a Novel Prognostic Signature in Colorectal Cancer.
      ]. Another study used machine learning to develop and validate an integrated clinico-biological model based on 18F-FDG PET/CT radiomics features had good predictive performance in predicting recurrence-free survival RFS in 196 patients with stage I–IV CRC. A previous study showed that 18F-FDG PET/CT radiomics provides the possibility for precision treatment of CRC [
      • Lv L.
      • Xin B.
      • Hao Y.
      • Yang Z.
      • Xu J.
      • Wang L.
      • Wang X.
      • Song S.
      • Guo X.
      Radiomic analysis for predicting prognosis of colorectal cancer from preoperative (18)F-FDG PET/CT.
      ]. However, none of these studies demonstrated the predictive performance of a single18F-FDG PET/CT radiomics model in predicting the outcomes of patients with CRC. In this study, we established pre-treatment 18F-FDG PET/CT radiomics, clinical, and complex models to predict the outcomes of patients with stage III-IV CRC. The results demonstrated that the radiomics model had good predictive ability in predicting PFS and OS, but the complex model showed the best predictive ability, which was consistent with the results of the above two studies. Therefore, our classifier was able to predict the prognosis and stratify the risk of patients with CRC.
      Although 18F-FDG PET/CT radimoic features can be applied to a variety of diseases, its application in colorectal cancer is increasing, and it has formed a relatively complete theoretical system and workflow, but it still faces some challenges. First, most of the current studies on 18F-FDG PET/CT radiomic are single-center, small-sample retrospective studies, and large-sample, multi-center, randomized controlled prospective studies are needed for model validation, so as to verify the robustness and reproducibility of the model. Second, the potential relationship between some 18F-FDG PET/CT radiomic features and tumor heterogeneity, such as anatomical, physiological or metabolic levels, is unknown and lack of explanation.

      5. Conclusion

      In conclusion, the establishment of a pre-treatment 18F-FDG PET/CT radiomics model provides significant prognostic information about PFS and OS in patients with stage III-IV CRC and demonstrates important stratification power in predicting PFS and OS in CRC. Therefore, it may be helpful to guide precision treatment and clinical management decisions for patients with stage III-IV CRC.

      Funding statement

      This study was supported by the Senile disease Prevention and control Progject of Hebei Provincial Finance Department and Hebei Provincial Health Committee [grant number, 2020459]; the Key Project of Medical Science Research of Hebei Provincial Health Commission [grant number 20221345].

      CRediT authorship contribution statement

      Na Wang: Data curation, Formal analysis, Methodology, Project administration, Resources, Software, Validation, Writing − original draft. Meng Dai: Data curation, Methodology, Resources, Supervision, Validation, Writing − review & editing. Yan Zhao: Formal analysis, Methodology, Software, Visualization, Writing − review & editing. Zhaoqi Zhang: Data curation, Formal analysis, Supervision, Visualization, Writing − review & editing. Jianfang Wang: Formal analysis, Investigation, Supervision, Visualization. Jingmian Zhang: Investigation, Validation, Visualization, Writing − review & editing. Yingchen Wang: Data curation, Software, Validation. Yunuan Liu: Investigation, Software. Fenglian Jing: Methodology, Software. Xinming Zhao: Conceptualization, Formal analysis, Funding acquisition, Investigation, Project administration, Resources, Supervision, Writing − original draft.

      Declaration of Competing Interest

      The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

      Acknowledgments

      The authors thank all their participants involved in the study for their assistance and support.

      Ethical statement

      This retrospective, single-institution study was approved by the Ethics Committee of the Fourth Hospital of Hebei Medical University(approval no. 2021KY292), which waived the requirement for informed consent from patients. The patient data used in this study are confidential and anonymous.

      Appendix A. Supplementary material

      References

        • Sung H.
        • Ferlay J.
        • Siegel R.L.
        • Laversanne M.
        • Soerjomataram I.
        • Jemal A.
        • Bray F.
        Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries.
        CA Cancer J. Clin. 2021; 71: 209-249https://doi.org/10.3322/caac.21660
        • Siegel R.L.
        • Miller K.D.
        • Goding Sauer A.
        • Fedewa S.A.
        • Butterly L.F.
        • Anderson J.C.
        • Cercek A.
        • Smith R.A.
        • Jemal A.
        Colorectal cancer statistics.
        CA Cancer J. Clin. 2020; 70: 145-164https://doi.org/10.3322/caac.21601
        • Gunderson L.L.
        • Jessup J.M.
        • Sargent D.J.
        • Greene F.L.
        • Stewart A.
        Revised tumor and node categorization for rectal cancer based on surveillance, epidemiology, and end results and rectal pooled analysis outcomes.
        J. Clin. Oncol. 2010; 28: 256-263https://doi.org/10.1200/JCO.2009.23.9194
        • Tong G.J.
        • Zhang G.Y.
        • Liu J.
        • Zheng Z.Z.
        • Chen Y.
        • Niu P.P.
        • Xu X.T.
        Comparison of the eighth version of the American Joint Committee on Cancer manual to the seventh version for colorectal cancer: A retrospective review of our data.
        World J. Clin. Oncol. 2018; 9: 148-161https://doi.org/10.5306/wjco.v9.i7.148
        • Ko K.Y.
        • Liu C.J.
        • Ko C.L.
        • Yen R.F.
        Intratumoral Heterogeneity of Pretreatment 18F-FDG PET Images Predict Disease Progression in Patients With Nasal Type Extranodal Natural Killer/T-cell Lymphoma.
        Clin. Nucl. Med. 2016; 41: 922-926https://doi.org/10.1097/RLU.0000000000001375
        • Kuo M.D.
        • Jamshidi N.
        Behind the numbers: Decoding molecular phenotypes with radiogenomics--guiding principles and technical considerations.
        Radiology. 2014; 270: 320-325https://doi.org/10.1148/radiol.13132195
        • Bera K.
        • Braman N.
        • Gupta A.
        • Velcheti V.
        • Madabhushi A.
        Predicting cancer outcomes with radiomics and artificial intelligence in radiology.
        Nat. Rev. Clin. Oncol. 2022; 19: 132-146https://doi.org/10.1038/s41571-021-00560-7
        • Huang Y.Q.
        • Liang C.H.
        • He L.
        • Tian J.
        • Liang C.S.
        • Chen X.
        • Ma Z.L.
        • Liu Z.Y.
        Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer.
        J. Clin. Oncol. 2016; 34: 2157-2164https://doi.org/10.1200/JCO.2015.65.9128
        • Kim J.Y.
        • Park J.E.
        • Jo Y.
        • Shim W.H.
        • Nam S.J.
        • Kim J.H.
        • Yoo R.E.
        • Choi S.H.
        • Kim H.S.
        Incorporating diffusion- and perfusion-weighted MRI into a radiomics model improves diagnostic performance for pseudoprogression in glioblastoma patients.
        Neuro-Oncol. 2019; 21: 404-414https://doi.org/10.1093/neuonc/noy133
        • Lovinfosse P.
        • Ferreira M.
        • Withofs N.
        • Jadoul A.
        • Derwael C.
        • Frix A.N.
        • Guiot J.
        • Bernard C.
        • Diep A.N.
        • Donneau A.F.
        • Lejeune M.
        • Bonnet C.
        • Vos W.
        • Meyer P.E.
        • Hustinx R.
        Distinction of lymphoma from sarcoidosis at FDG PET/CT - evaluation of radiomic-feature guided machine learning versus human reader performance.
        J. Nucl. Med. 2022; https://doi.org/10.2967/jnumed.121.263598
        • Dai W.
        • Mo S.
        • Han L.
        • Xiang W.
        • Li M.
        • Wang R.
        • Tong T.
        • Cai G.
        Prognostic and predictive value of radiomics signatures in stage I-III colon cancer.
        Clin. Transl. Med. 2020; 10: 288-293https://doi.org/10.1002/ctm2.31
        • Dohan A.
        • Gallix B.
        • Guiu B.
        • Le Malicot K.
        • Reinhold C.
        • Soyer P.
        • Bennouna J.
        • Ghiringhelli F.
        • Barbier E.
        • Boige V.
        • Taieb J.
        • Bouché O.
        • François E.
        • Phelip J.M.
        • Borel C.
        • Faroux R.
        • Seitz J.F.
        • Jacquot S.
        • Ben Abdelghani M.
        • Khemissa-Akouz F.
        • Genet D.
        • Jouve J.L.
        • Rinaldi Y.
        • Desseigne F.
        • Texereau P.
        • Suc E.
        • Lepage C.
        • Aparicio T.
        • Hoeffel C.
        Early evaluation using a radiomic signature of unresectable hepatic metastases to predict outcome in patients with colorectal cancer treated with FOLFIRI and bevacizumab.
        Gut. 2020; 69: 531-539https://doi.org/10.1136/gutjnl-2018-316407
        • Liu Z.
        • Meng X.
        • Zhang H.
        • Li Z.
        • Liu J.
        • Sun K.
        • Meng Y.
        • Dai W.
        • Xie P.
        • Ding Y.
        • Wang M.
        • Cai G.
        • Tian J.
        Predicting distant metastasis and chemotherapy benefit in locally advanced rectal cancer.
        Nat. Commun. 2020; 11: 4308https://doi.org/10.1038/s41467-020-18162-9
        • Daye D.
        • Tabari A.
        • Kim H.
        • Chang K.
        • Kamran S.C.
        • Hong T.S.
        • Kalpathy-Cramer J.
        • Gee M.S.
        Quantitative tumor heterogeneity MRI profiling improves machine learning-based prognostication in patients with metastatic colon cancer.
        Eur. Radio. 2021; 31: 5759-5767https://doi.org/10.1007/s00330-020-07673-0
        • Zwanenburg A.
        • Vallières M.
        • Abdalah M.A.
        • Aerts H.
        • Andrearczyk V.
        • Apte A.
        • Ashrafinia S.
        • Bakas S.
        • Beukinga R.J.
        • Boellaard R.
        • Bogowicz M.
        • Boldrini L.
        • Buvat I.
        • Cook G.
        • Davatzikos C.
        • Depeursinge A.
        • Desseroit M.C.
        • Dinapoli N.
        • Dinh C.V.
        • Echegaray S.
        • El Naqa I.
        • Fedorov A.Y.
        • Gatta R.
        • Gillies R.J.
        • Goh V.
        • Götz M.
        • Guckenberger M.
        • Ha S.M.
        • Hatt M.
        • Isensee F.
        • Lambin P.
        • Leger S.
        • Leijenaar R.
        • Lenkowicz J.
        • Lippert F.
        • Losnegård A.
        • Maier-Hein K.H.
        • Morin O.
        • Müller H.
        • Napel S.
        • Nioche C.
        • Orlhac F.
        • Pati S.
        • Pfaehler E.
        • Rahmim A.
        • Rao A.
        • Scherer J.
        • Siddique M.M.
        • Sijtsema N.M.
        • Socarras Fernandez J.
        • Spezi E.
        • Steenbakkers R.
        • Tanadini-Lang S.
        • Thorwarth D.
        • Troost E.
        • Upadhaya T.
        • Valentini V.
        • van Dijk L.V.
        • van Griethuysen J.
        • van Velden F.
        • Whybra P.
        • Richter C.
        • Löck S.
        The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping.
        Radiology. 2020; 295: 328-338https://doi.org/10.1148/radiol.2020191145
        • Nioche C.
        • Orlhac F.
        • Boughdad S.
        • Reuzé S.
        • Goya-Outi J.
        • Robert C.
        • Pellot-Barakat C.
        • Soussan M.
        • Frouin F.
        • Buvat I.
        LIFEx: a freeware for radiomic feature calculation in multimodality imaging to accelerate advances in the characterization of tumor heterogeneity.
        Cancer Res. 2018; 78: 4786-4789https://doi.org/10.1158/0008-5472.CAN-18-0125
        • Wang H.
        • Zhao S.
        • Li L.
        • Tian R.
        Development and validation of an (18)F-FDG PET radiomic model for prognosis prediction in patients with nasal-type extranodal natural killer/T cell lymphoma.
        Eur. Radio. 2020; 30: 5578-5587https://doi.org/10.1007/s00330-020-06943-1
        • Du Z.
        • Zhang X.
        • Tang Z.
        More evidence for prediction model of radiosensitivity.
        Biosci. Rep. 2021; 41https://doi.org/10.1042/BSR20210034
        • Weiss A.
        • Chavez-MacGregor M.
        • Lichtensztajn D.Y.
        • Yi M.
        • Tadros A.
        • Hortobagyi G.N.
        • Giordano S.H.
        • Hunt K.K.
        • Mittendorf E.A.
        Validation Study of the American Joint Committee on Cancer Eighth Edition Prognostic Stage Compared With the Anatomic Stage in Breast Cancer.
        JAMA Oncol. 2018; 4: 203-209https://doi.org/10.1001/jamaoncol.2017.4298
        • Amit M.
        • Liu C.
        • Netto Gleber F.O.
        • Kini S.
        • Tam S.
        • Benov A.
        • Aashiq M.
        • El-Naggar A.K.
        • Moreno A.C.
        • Rosenthal D.I.
        • Glisson B.S.
        • Ferrarotto R.
        • Wong M.K.
        • Migden M.R.
        • Li G.
        • Khanna A.
        • Goepfert R.P.
        • Nagarajan P.
        • Weber R.S.
        • Myers J.N.
        • Gross N.D.
        Integrating depth of invasion in T classification improves the prognostic performance of the American Joint Committee on Cancer primary tumor staging system for cutaneous squamous cell carcinoma of the head and neck.
        Eur. J. Cancer (Oxf., Engl.: 1990). 2021; 144: 169-177https://doi.org/10.1016/j.ejca.2020.11.019
        • Pencina M.J.
        • Sr D.R.B.
        • Steyerberg E.W.
        Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers.
        Stat. Med. 2011; 30: 11-21https://doi.org/10.1002/sim.4085
        • Wagner F.
        • Hakami Y.A.
        • Warnock G.
        • Fischer G.
        • Huellner M.W.
        • Veit-Haibach P.
        Comparison of Contrast-Enhanced CT and [(18)F]FDG PET/CT Analysis Using Kurtosis and Skewness in Patients with Primary Colorectal Cancer.
        Mol. Imaging Biol. 2017; 19: 795-803https://doi.org/10.1007/s11307-017-1066-x
        • Bang J.I.
        • Ha S.
        • Kang S.B.
        • Lee K.W.
        • Lee H.S.
        • Kim J.S.
        • Oh H.K.
        • Lee H.Y.
        • Kim S.E.
        Prediction of neoadjuvant radiation chemotherapy response and survival using pretreatment [(18)F]FDG PET/CT scans in locally advanced rectal cancer.
        Eur. J. Nucl. Med. Mol. Imaging. 2016; 43: 422-431https://doi.org/10.1007/s00259-015-3180-9
        • Kirienko M.
        • Gallivanone F.
        • Sollini M.
        • Veronesi G.
        • Voulaz E.
        • Antunovic L.
        • Leonardi L.
        • Testanera G.
        • Castiglioni I.
        • Chiti A.
        FDG PET/CT as theranostic imaging in diagnosis of non-small cell lung cancer.
        Front Biosci. (Landmark Ed. ). 2017; 22: 1713-1723https://doi.org/10.2741/4567
        • Foley K.G.
        • Hills R.K.
        • Berthon B.
        • Marshall C.
        • Parkinson C.
        • Lewis W.G.
        • Crosby T.
        • Spezi E.
        • Roberts S.A.
        Development and validation of a prognostic model incorporating texture analysis derived from standardised segmentation of PET in patients with oesophageal cancer.
        Eur. Radio. 2018; 28: 428-436https://doi.org/10.1007/s00330-017-4973-y
        • Park H.
        • Kim K.A.
        • Jung J.H.
        • Rhie J.
        • Choi S.Y.
        MRI features and texture analysis for the early prediction of therapeutic response to neoadjuvant chemoradiotherapy and tumor recurrence of locally advanced rectal cancer.
        Eur. Radio. 2020; 30: 4201-4211https://doi.org/10.1007/s00330-020-06835-4
        • Karahan Şen N.P.
        • Aksu A.
        • Kaya G.Ç.
        Value of volumetric and textural analysis in predicting the treatment response in patients with locally advanced rectal cancer.
        Ann. Nucl. Med. 2020; 34: 960-967https://doi.org/10.1007/s12149-020-01527-x
        • Davey A.
        • van Herk M.
        • Faivre-Finn C.
        • Mistry H.
        • McWilliam A.
        Is tumour sphericity an important prognostic factor in patients with lung cancer.
        Radio. Oncol. 2020; 143: 73-80https://doi.org/10.1016/j.radonc.2019.08.003
        • Yan M.
        • Wang W.
        A non-invasive method to diagnose lung adenocarcinoma.
        Front Oncol. 2020; 10: 602https://doi.org/10.3389/fonc.2020.00602
        • Gillies R.J.
        • Kinahan P.E.
        • Hricak H.
        Radiomics: images are more than pictures, they are data.
        Radiology. 2016; 278: 563-577https://doi.org/10.1148/radiol.2015151169
        • Bailly C.
        • Bodet-Milin C.
        • Bourgeois M.
        • Gouard S.
        • Ansquer C.
        • Barbaud M.
        • Sébille J.C.
        • Chérel M.
        • Kraeber-Bodéré F.
        • Carlier T.
        Exploring Tumor Heterogeneity Using PET Imaging: The Big Picture.
        Cancers (Basel). 2019; 11https://doi.org/10.3390/cancers11091282
        • Jensen G.L.
        • Yost C.M.
        • Mackin D.S.
        • Fried D.V.
        • Zhou S.
        • Court L.E.
        • Gomez D.R.
        Prognostic value of combining a quantitative image feature from positron emission tomography with clinical factors in oligometastatic non-small cell lung cancer.
        Radio. Oncol. 2018; 126: 362-367https://doi.org/10.1016/j.radonc.2017.11.006
        • Kang J.
        • Lee J.H.
        • Lee H.S.
        • Cho E.S.
        • Park E.J.
        • Baik S.H.
        • Lee K.Y.
        • Park C.
        • Yeu Y.
        • Clemenceau J.R.
        • Park S.
        • Xu H.
        • Hong C.
        • Hwang T.H.
        Radiomics Features of 18F-Fluorodeoxyglucose Positron-Emission Tomography as a Novel Prognostic Signature in Colorectal Cancer.
        Cancers (Basel). 2021; 13https://doi.org/10.3390/cancers13030392
        • Xue T.
        • Peng H.
        • Chen Q.
        • Li M.
        • Duan S.
        • Feng F.
        A CT-based radiomics nomogram in predicting the postoperative prognosis of colorectal cancer: a two-center study.
        Acad. Radio. 2022; https://doi.org/10.1016/j.acra.2022.02.006
        • Chuanji Z.
        • Zheng W.
        • Shaolv L.
        • Linghou M.
        • Yixin L.
        • Xinhui L.
        • Ling L.
        • Yunjing T.
        • Shilai Z.
        • Shaozhou M.
        • Boyang Z.
        Comparative study of radiomics, tumor morphology, and clinicopathological factors in predicting overall survival of patients with rectal cancer before surgery.
        Transl. Oncol. 2022; 18101352https://doi.org/10.1016/j.tranon.2022.101352
        • Lv L.
        • Xin B.
        • Hao Y.
        • Yang Z.
        • Xu J.
        • Wang L.
        • Wang X.
        • Song S.
        • Guo X.
        Radiomic analysis for predicting prognosis of colorectal cancer from preoperative (18)F-FDG PET/CT.
        J. Transl. Med. 2022; 20: 66https://doi.org/10.1186/s12967-022-03262-5