Advertisement
Original paper| Volume 110, 102606, June 2023

Download started.

Ok

Knowledge-based plan optimization for prostate SBRT delivered with CyberKnife according to RTOG0938 protocol

      Highlights

      • KB planning was applied to SBRT prostate cancer with CyberKnife.
      • The KB model generated DVH prediction for the bladder, the rectum and femoral heads.
      • A KB-based template was efficiently tuned for both sequential and VOLO algorithms.
      • The KB-model was able to generate high-quality automatic plans for both modalities.

      Abstract

      Purpose

      To extend the knowledge-based (KB) automatic planning approach to CyberKnife in the case of Stereotactic Body Radiation Therapy (SBRT) for prostate cancer.

      Methods

      Seventy-two clinical plans of patients treated according to the RTOG0938 protocol (36.25 Gy/5fr) with CyberKnife were exported from the CyberKnife system to Eclipse to train a KB-model using the Rapid Plan tool. The KB approach provided dose-volume objectives for specific OARs only and not PTV. Bladder, rectum and femoral heads were considered in the model. The KB-model was successfully trained on 51 plans and then validated on 20 new patients. A KB-based template was tuned in the Precision system for both sequential optimization (SO) and VOLO optimization algorithms. Plans of the validation group were re-optimized (KB-TP) using both algorithms without any operator intervention and compared against the original plans (TP) in terms of OARs/PTV dose-volume parameters. Paired Wilcoxon signed-rank tests were performed to assess statistically significant differences (p < 0.05).

      Results

      Regarding SO, automatic KB-TP plans were generally better than or equivalent to TP plans. PTVs V95% was slightly worse while OARs sparing for KB-TP was significantly improved. Regarding VOLO optimization, the PTVs coverage was significantly better for KB-TP while there was a limited worsening in the rectum. A significant improvement was observed in the bladder in the range of low-intermediate doses.

      Conclusions

      An extension of the KB optimization approach to the CyberKnife system has been successfully developed and validated in the case of SBRT prostate cancer.

      Keywords

      1. Introduction

      The increasing complexity of radiotherapy treatment planning has made it very challenging in generating consistent and high-quality treatment plans. Even more in the case of Stereotactic Body Radiation Therapy (SBRT), where high-precision delivery of few high-dose fractions with very high dose fall-off around the target is required [
      • Martin A.
      • Gaya A.
      Stereotactic body radiotherapy: A Review.
      ,
      • Ma L.
      • Wang L.
      • Tseng C.-L.
      • Sahgal A.
      Emerging technologies in stereotactic body radiotherapy.
      ,
      • Brand D.H.
      • Tree A.C.
      • Ostler P.
      • van der Voet H.
      • Loblaw A.
      • Chu W.
      • et al.
      Intensity-modulated fractionated radiotherapy versus stereotactic body radiotherapy for prostate cancer (PACE-B): acute toxicity findings from an international, randomised, open-label, phase 3, non-inferiority trial.
      ,
      • Lehrer E.J.
      • Kishan A.U.
      • Yu J.B.
      • Trifiletti D.M.
      • Showalter T.N.
      • Ellis R.
      • et al.
      Ultrahypofractionated versus hypofractionated and conventionally fractionated radiation therapy for localized prostate cancer: A systematic review and meta-analysis of phase III randomized trials.
      ,
      • Jackson W.C.
      • Silva J.
      • Hartman H.E.
      • Dess R.T.
      • Kishan A.U.
      • Beeler W.H.
      • et al.
      Stereotactic Body Radiation Therapy for Localized Prostate Cancer: A Systematic Review and Meta-Analysis of Over 6,000 Patients Treated On Prospective Studies.
      ,
      • Widmark A.
      • Gunnlaugsson A.
      • Beckman L.
      • Thellenberg-Karlsson C.
      • Hoyer M.
      • Lagerlund M.
      • et al.
      Ultra-hypofractionated versus conventionally fractionated radiotherapy for prostate cancer: 5-year outcomes of the HYPO-RT-PC randomised, non-inferiority, phase 3 trial.
      ].
      Automatic plan solutions were largely investigated [
      • Moore K.L.
      Automated Radiotherapy Treatment Planning.
      ,
      • Hussein M.
      • Heijmen B.J.M.
      • Verellen D.
      • Nisbet A.
      Automation in intensity modulated radiotherapy treatment planning-a review of recent innovations.
      ,

      Ge Y, Wu QJ. Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Med Phys 2019;46:2760–75. https://doi.org/ 10.1002/mp.13526.

      ,
      • Momin S.
      • Fu Y.
      • Lei Y.
      • Roper J.
      • Bradley J.D.
      • Curran W.J.
      • et al.
      Knowledge-based Radiation Treatment Planning: A Data-driven Method Survey.
      ,
      • Pallotta S.
      • Marrazzo L.
      • Calusi S.
      • Castriconi R.
      • Fiorino C.
      • Loi G.
      • et al.
      Implementation of automatic plan optimization in Italy: Status and perspectives.
      ,
      • Scaggion A.
      • Fusella M.
      • Cavinato S.
      • Dusi F.
      • El Khouzai B.
      • Germani A.
      • et al.
      Updating a clinical Knowledge-Based Planning prediction model for prostate radiotherapy.
      ,
      • Lou Z.
      • Cheng C.
      • Mao R.
      • Li D.
      • Tian L.
      • Li B.
      • et al.
      A novel automated planning approach for multi-anatomical sites cancer in Raystation treatment planning system.
      ] and implemented during recent years in order to make radiation therapy planning optimization more efficient by reducing the time for planning, limiting the intra/inter-operator variability and possibly improving the quality of plans regardless of the planner’s experience [
      • Villaggi E.
      • Hernandez V.
      • Fusella M.
      • Moretti E.
      • Russo S.
      • Vaccara E.M.L.
      • et al.
      Plan quality improvement by DVH sharing and planner’s experience: Results of a SBRT multicentric planning study on prostate.
      ]. One of the most consolidated solutions for automated planning is the knowledge-based (KB) method. Several approaches for KB-planning applications have been proposed [

      Ge Y, Wu QJ. Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Med Phys 2019;46:2760–75. https://doi.org/ 10.1002/mp.13526.

      ]. Good et al. assessed the capability of a mutual information method based on a dataset of treated patient to predict the dose-volume histogram (DVH) [
      • Good D.
      • Lo J.
      • Lee W.R.
      • Wu Q.J.
      • Yin F.F.
      • Das S.K.
      A knowledge-based approach to improving and homogenizing intensity modulated radiation therapy planning quality among treatment centers: An example application to prostate cancer planning.
      ]. Other studies investigated the feasibility of a principal-component-analysis (PCA) based model to estimate the expected organ at risk (OAR) sparing [
      • Yuan L.
      • Ge Y.
      • Lee W.R.
      • Yin F.F.
      • Kirkpatrick J.P.
      • Wu Q.J.
      Quantitative analysis of the factors which affect the interpatient organ-at-risk dose sparing variation in IMRT plans.
      ,
      • Zhu X.
      • Ge Y.
      • Li T.
      • Thongphiew D.
      • Yin F.F.
      • Wu Q.J.
      A planning quality evaluation tool for prostate adaptive IMRT based on machine learning.
      ]. Nwankwo et al. developed a predicted model based on the geometric position relative to the target [
      • Nwankwo O.
      • Mekdash H.
      • Sihono D.S.K.
      • Wenz F.
      • Glatting G.
      Knowledge-based radiation therapy (KBRT) treatment planning versus planning by experts: validation of a KBRT algorithm for prostate cancer treatment planning.
      ]. The key characteristic of any KB approach is that for each new patient, the achievable dosimetric features are predicted using a training dataset of delivered clinical plans, considering the individual anatomical characteristics of each specific patient. One of the most important aspects of any KB approach is the population of the training set. The training set should be as much as possible representative of the clinical scenario and possibly free of sub-optimal plans, in order to avoid the phenomenon of the so-called ‘garbage in - garbage out’. Training a KB model with sub-optimal plans would weaken the performance of the model which is based on the quality of the plans used to train the model. Among several suggested KB approaches, RapidPlan (RP) is the most widespread commercial tool (Varian Medical System, Inc., Palo Alto, USA) incorporated in the Varian Eclipse planning system; RP allows to generate a KB model based on the training of a data set of available clinical plans, thus obtaining a representative model of the planning institute approach. This tool combines PCA and regression techniques to generate an estimated OAR’s DVH range for a new patient [

      Varian Medical System. Treatment Planning 13.5 New Features - Treatment Planning 13.5 Workbook.

      ]. The resulting DVH prediction model may be used to build a template for automatic plan optimization. No PTV’s DVH prediction is available for RP tool.
      Generally, RP-based optimization was found to be able to generate acceptable plans, at least comparable to previously optimized clinical plans [

      Ge Y, Wu QJ. Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Med Phys 2019;46:2760–75. https://doi.org/ 10.1002/mp.13526.

      ,
      • Castriconi R.
      • Fiorino C.
      • Passoni P.
      • Broggi S.
      • Di Muzio N.G.
      • Cattaneo G.M.
      • et al.
      Knowledge-based automatic optimization of adaptive early-regression-guided VMAT for rectal cancer.
      ,
      • Hussein M.
      • South C.P.
      • Barry M.A.
      • Adams E.J.
      • Jordan T.J.
      • Stewart A.J.
      • et al.
      Clinical validation and benchmarking of knowledge-based IMRT and VMAT treatment planning in pelvic anatomy.
      ,
      • Castriconi R.
      • Fiorino C.
      • Broggi S.
      • Cozzarini C.
      • Di Muzio N.
      • Calandrino R.
      • et al.
      Comprehensive Intra-Institution stepping validation of knowledge-based models for automatic plan optimization.
      ,
      • Gysen K.
      • O'Toole J.
      • Le A.
      • Wu K.
      • Schuler T.
      • Porter B.
      • et al.
      Rolling out RapidPlan: What we’ve learnt.
      ,
      • Rusu I.
      • Roeske J.
      • Solanki A.
      • Kang H.
      Fully automated planning and delivery of hippocampal-sparing whole brain irradiation.
      ,
      • Frederick A.
      • Roumeliotis M.
      • Grendarova P.
      • Quirk S.
      Performance of a knowledge-based planning model for optimizing intensity-modulated radiotherapy plans for partial breast irradiation.
      ,
      • Scaggion A.
      • Fusella M.
      • Roggio A.
      • Bacco S.
      • Pivato N.
      • Rossato M.A.
      • et al.
      Reducing inter- and intra-planner variability in radiotherapy plan output with a commercial knowledge-based planning solution.
      ,
      • Rago M.
      • Placidi L.
      • Polsoni M.
      • Rambaldi G.
      • Cusumano D.
      • Greco F.
      • et al.
      Evaluation of a generalized knowledge-based planning performance for VMAT irradiation of breast and locoregional lymph nodes—Internal mammary and/or supraclavicular regions.
      ]. There are also few examples showing that the KB model trained with plans based on a certain delivery technique can be efficiently adapted to another one [
      • Wu H.
      • Jiang F.
      • Yue H.
      • Zhang H.
      • Wang K.
      • Zhang Y.
      Applying a RapidPlan model trained on a technique and orientation to another: a feasibility and dosimetric evaluation.
      ,
      • Lian J.
      • Yuan L.
      • Ge Y.
      • Chera B.S.
      • Yoo D.P.
      • Chang S.
      • et al.
      Modeling the dosimetry of organ-at-risk in head and neck IMRT planning: An intertechnique and interinstitutional study.
      ] or that RP can also be trained within the Varian environment with plans optimized and delivered using other technologies, such as helical tomotherapy [
      • Cagni E.
      • Botti A.
      • Micera R.
      • Galeandro M.
      • Sghedoni R.
      • Orlandi M.
      • et al.
      Knowledge-based treatment planning: An inter-technique and inter-system feasibility study for prostate cancer.
      ,

      Castriconi R, Cattaneo GM, Mangili P, Esposito PG, Broggi S, Cozzarini C, et al. Clinical Implementation of Knowledge-Based Automatic Plan Optimization for Helical Tomotherapy. Pract Radiat Oncol 2021;11:e236–44. https://doi.org/10.1016/j.prro.2020.09.012.

      ]. However, there are no available commercial solutions regarding automated planning for the CyberKnife system. Furthermore, to our knowledge, there are no examples in literature about KB-model applied to the CyberKnife system in the prostate district. Few papers investigated the use of KB-model for SBRT treatments in districts other than the prostate. Foy et al. [

      Foy JJ, Marsh R, ten Haken RK, Younge KC, Schipper M, Sun Y, et al. An analysis of knowledge-based planning for stereotactic body radiation therapy of the spine. Pract Radiat Oncol 2017;7:e355–60. https://doi.org/10.1016/j.prro.2017.02.007.

      ] validated the use of fully automated VMAT plans for spinal metastasis, Visak et al. [
      • Visak J.
      • McGarry R.C.
      • Randall M.E.
      • Pokhrel D.
      Development and clinical validation of a robust knowledge-based planning model for stereotactic body radiotherapy treatment of centrally located lung tumors.
      ,
      • Visak J.
      • Ge G.Y.
      • McGarry R.C.
      • Randall M.
      • Pokhrel D.
      An Automated knowledge-based planning routine for stereotactic body radiotherapy of peripheral lung tumors via DCA-based volumetric modulated arc therapy.
      ], Snyder et al. [
      • Chin Snyder K.
      • Kim J.
      • Reding A.
      • Fraser C.
      • Gordon J.
      • Ajlouni M.
      • et al.
      Development and evaluation of a clinical model for lung cancer patients using stereotactic body radiotherapy (SBRT) within a knowledge-based algorithm for treatment planning.
      ] and Delaney et al. [
      • Delaney A.R.
      • Dahele M.
      • Tol J.P.
      • Slotman B.J.
      • Verbakel W.F.A.R.
      Knowledge-based planning for stereotactic radiotherapy of peripheral early-stage lung cancer.
      ] investigated the use of a KB-model for early-stage lung cancer while Hardcastle et al. [
      • Hardcastle N.
      • Cook O.
      • Ray X.
      • Moore A.
      • Moore K.L.
      • Pryor D.
      • et al.
      Personalising treatment plan quality review with knowledge-based planning in the TROG 15.03 trial for stereotactic ablative body radiotherapy in primary kidney cancer.
      ] reported the results of prospective use of KB-model for real-time quality assurance of treatment plan quality in the kidney district. The aim of the present work was to extend the KB-planning approach using RP to CyberKnife in the case of SBRT prostate treatment.

      2. Methods and materials

      2.1 Clinical protocol and planning optimization

      Current study considered patients treated at our institute between 2017 and 2021 for prostate cancer with CyberKnife, according to the RTOG0938 protocol [

      A Randomized Phase II Trial Of Hypofractionated Radiotherapy For Favorable Risk Prostate Cancer-RTOG CCOP Study. NRG ONCOLOGY. https://www.nrgoncology.org/Clinical-Trials/Protocol/rtog-0938?filter=rtog-0938 [accessed 3 May 2023].

      ]. The dose prescription is 36.25 Gy to PTV delivered in 5 fractions normalized at the peripheral isodose (range 75%-84%), so that 100% of the prescribed dose covers at least the 95% of the PTV volume, satisfying in the meantime dose-volume constraints for the OAR. Table 1 shows the constraints of the protocol for OARs. The PTV was defined as the CTV expanded by 3 mm in all directions. In our clinical practice no dose – volume constraints were considered in planning optimization for the urethra.
      Table 1Dose-volume constraints according to the RTOG0938 protocol. For ‘Maximum point dose’ we considered a point that is 0.03 cc in size. * In our clinical practice no dose-volume constraints were considered in planning optimization for the urethra.
      OrganVolumeDose (Gy)
      PTVMinimum dose received by 95% of PTV≥ 36.25

      100% of prescription dose
      Minimum dose received by 100% of PTV≥ 34.40

      95% of prescription dose
      Urethra*Maximum point dose≤ 38.78
      107% of prescription dose
      RectumMaximum point dose≤ 38.06
      ≤ 3 cc34.40

      95% of prescription dose
      10%≤ 32.625

      90% of prescription dose
      20%≤ 29

      80% of prescription dose
      50%≤ 18.125

      50% of prescription dose
      BladderMaximum point dose≤ 38.06
      10%≤ 32.625

      90% of prescription dose
      50%≤ 18.125

      50% of prescription dose
      Penile BulbMaximum point dose≤ 100% prescription dose
      ≤ 3 cc20

      54% of prescription dose
      Femoral HeadsMaximum point dose30

      81% of prescription dose
      ≤ 10 cc20

      54% of prescription dose
      Two optimization algorithms are implemented in the CyberKnife treatment planning system (Accuray Precision v 3.3): the sequential optimization (SO) and the VOLO optimization [

      Accuray Precision® Treatment Planning System. Treatment Planning Manual Version 3.3.x.

      ,
      • Calusi S.
      • Doro R.
      • Di Cataldo V.
      • Cipressi S.
      • Francolini G.
      • Bonucci I.
      • et al.
      Performance assessment of a new optimization system for robotic SBRT MLC-based plans.
      ,
      • Zeverino M.
      • Marguet M.
      • Zulliger C.
      • Durham A.
      • Jumeau R.
      • Herrera F.
      • et al.
      Novel inverse planning optimization algorithm for robotic radiosurgery: First clinical implementation and dosimetric evaluation.
      ,
      • Giżyńska M.K.
      • Rossi L.
      • Toom W.
      • Milder M.T.W.
      • Vries K.C.
      • Nuyttens J.
      • et al.
      Largely reduced OAR doses, and planning and delivery times for challenging robotic SBRT cases, obtained with a novel optimizer.
      ]. SO consists of a series of individual optimization steps defined by the user. Each step corresponds to a hard constraint (that must not be violated) or a soft constraint (i.e. a clinical goal with a relaxation value, the acceptable violation limit of clinical goal). At the end of the SO process, manual time reduction and segment reduction are required.
      The VOLO optimization system was recently implemented to overcome some limitations of the sequential algorithm, using GPU memory to speed up calculation processes and minimize a single cost function during the optimization. The cost function combines all DVH constraints and delivery efficiency parameters with user-defined weights, so that the optimized plan is already a deliverable plan. All the clinical plans included in this study were previously optimized with the SO algorithm. The majority of the plans were optimized with the multileaf collimator (MLC) while 15/72 plans were optimized with the IRIS collimator.

      2.2 KB Model setting

      The clinical plans of 72 previously treated patients were available. All plans, including DICOM 3D dose distributions, computed tomography images and geometric structures, were exported from the CyberKnife system (Accuray Precision v. 3.3) to Eclipse (Varian v.13.6).
      Fifty-two randomly chosen plans were selected to train a KB-model using the RapidPlan tool and the remaining twenty plans were used to build an external validation cohort. 9/52 plans of the training set and 6/20 plans of the validation set were clinically optimized with IRIS while most plans were optimized with MLC. All plans were calculated with the Ray Tracing algorithm using high resolution for the dose calculation grid.
      Each plan was linked to a virtual arc plan consisting of two fully reverse arcs with a collimator inclination angle of 15° and with field size of 10x10 cm, in order to assess the association between the dosimetric and the geometric features. The prescribed dose was normalized at the same peripheral isodose defined in the CyberKnife treatment planning system. It is important to notice that the geometry setting between model training cohort and validation test set for DVH prediction should be the same, especially when dose distributions come from other TPS and/or delivery modalities. As the same geometry for configuration is used for the DVH prediction in a new patient, the relationship between geometric and dosimetric features has been maintained. Hence, the same virtual arc geometry used for the training of the model was adopted also for the DVH prediction of the validation patients set.
      The OARs considered for the model were the bladder, the rectum and the femoral heads. In the model, femoral heads were considered as a paired structure even if left and right femoral heads were separately contoured in the original plan. The penile bulb was also included in the model for the trained plans where the structure was contoured; however, due to the limited number of plans with the penile bulb drawn (only 21 plans), we decided to avoid the use of the resulting prediction due to the poor statistics and related problem of estimate robustness [
      • Boutilier J.J.
      • Craig T.
      • Sharpe M.B.
      • Chan T.C.Y.
      Sample size requirements for knowledge-based treatment planning.
      ,
      • Cagni E.
      • Botti A.
      • Wang Y.
      • Iori M.
      • Petit S.F.
      • Heijmen B.J.M.
      Pareto-optimal plans as ground truth for validation of a commercial system for knowledge-based DVH-prediction.
      ]. Of note, the dose received by the penile bulb was always very small (mean dose range: 2.81–18.83 Gy), being this OAR always not overlapped and relatively far from PTV.
      The training-model process is well explained in literature [

      Varian Medical System. Eclipse Photon and Electron Algorithms Reference Guide. 2015.

      ,
      • Fogliata A.
      • Belosi F.
      • Clivio A.
      • Navarria P.
      • Nicolini G.
      • Scorsetti M.
      • et al.
      On the pre-clinical validation of a commercial model-based optimisation engine: Application to volumetric modulated arc therapy for patients with lung or prostate cancer.
      ]. The result was the generation of a set of coefficients for each OARs providing an evaluation of the principal component scores of the DVH based on the geometric and anatomic characteristics of OARs and PTV. The tuning of the model was performed by using statistical tools available in the RP system and the so called “Model Analytic platform”, that permit to evaluate and eliminate potential outliers. The latter are expected to deviate from the general trend of the model because they do not meet the clinical goal of dosimetric parameters (dosimetric outliers) or show a geometry that largely differs from the rest of the training set (geometric outliers). The second category should not be removed from the model since it represents a scarcely present, but still possible geometry. In total one plan and some OAR structures were excluded from the model. In particular the Cook’s distance, which describes influential data points in a regression model, and the DVH prediction for each OAR structure, have been of primary importance to discriminate potential outliers.
      After the tuning of the model, an internal and external validation should be performed [
      • Castriconi R.
      • Fiorino C.
      • Passoni P.
      • Broggi S.
      • Di Muzio N.G.
      • Cattaneo G.M.
      • et al.
      Knowledge-based automatic optimization of adaptive early-regression-guided VMAT for rectal cancer.
      ,
      • Castriconi R.
      • Fiorino C.
      • Broggi S.
      • Cozzarini C.
      • Di Muzio N.
      • Calandrino R.
      • et al.
      Comprehensive Intra-Institution stepping validation of knowledge-based models for automatic plan optimization.
      ,
      • Fogliata A.
      • Reggiori G.
      • Stravato A.
      • Lobefalo F.
      • Franzese C.
      • Franceschini D.
      • et al.
      RapidPlan head and neck model: the objectives and possible clinical benefit.
      ,
      • Fogliata A.
      • Wang P.M.
      • Belosi F.
      • Clivio A.
      • Nicolini G.
      • Vanetti E.
      • et al.
      Assessment of a model based optimization engine for volumetric modulated arc therapy for patients with advanced hepatocellular cancer.
      ].

      2.3 Validation tests

      Regarding the internal validation, for each OAR structure trained in the model, the residual and regression plots in terms of principal component parameters were considered. Moreover, a KB prediction on selected dose-volume parameters was made and the prediction was compared with the respective clinical plan parameter, checking if the planned clinical value fell within the estimated range. The dose-volume parameters considered were: V95%, V90%, V80%, V50% for the rectum, V90% and V50% for the bladder. Of note, Vx% means the volume (in cc or % as specified in brackets) receiving at least the ‘x’ percentage of the prescribed dose.
      Concerning the external validation, a KB prediction on randomly twenty plans not included in the model was performed to assess the goodness of the model. The dose-volume parameters considered were the same as the internal validation. Dose-volume parameters for the femoral heads were not considered both for internal and external validation because they were far below the V54% constraint of the protocol.

      2.4 Automatic KB plan optimization

      Selected DVH constraints may be extracted from the KB prediction model to generate an individually optimized template for plan optimization. The generated constraints were based on the lower band’s value predicted by RP. The translation of the DVH prediction into an optimized template is not an easy task and requires an adequate fine-tuning. For this reason the process was carried out by two expert planners of our institute. All the plans of the external validation set were re-optimized based on the KB-templates (supplementary material: table S1 and table S2) both with SO and VOLO optimization algorithms, using MLC type collimator. Automatic plans (KB-TP) were compared against the original clinical plans (TP) in terms of selected OARs and target dose-volume parameters. In particular, V100% and V95% were considered for PTV and CTV, V95%, V90%, V80%, V50% and V10Gy for the rectum, V90%, V50% and V10Gy for the bladder, V30% and V10% for the femoral heads even though these parameters had not a clinical impact. Paired Wilcoxon signed-rank tests were performed to assess statistically significant differences (p < 0.05). Of note, all original clinical plans were optimized with SO and the same isodose normalization was maintained also with the VOLO re-optimized plans, in order to consistently compare the plans.
      Moreover, one more template was tuned both for SO and VOLO by considering urethra sparing, based on RTOG protocol, useful for the optimization of treatment patients where the urethra delineation is available. A hard maximum dose constraint for urethra was added in SO (Table S3); a target goal was added for the overlap urethra region (overlap between the planning urethra and the PTV) together with a dose maximum critical goal for the urethra (Table S4). The “urethra sparing” template was tested on five extra-patients for which urethra delineations were available and compared with the plans optimized with the original template.

      3. Results

      3.1 Validation tests

      3.1.1 Internal Validation

      After the fine-tuning, the final KB-model consisted of 51 trained plans and as many as 50 OAR structures for the rectum, 48 for the bladder and 52 for the femoral heads. The average PTV was 96.3 ± 24.9 cm3 (range: 42.6–166.6 cm3) for the patients in the training group. The distribution of PTV and OARs volumes are shown in supplementary materials (Fig. 1S). Fig. 1 shows the regression and residual plots for each OAR considered. The regression plot shows the correlation between the dosimetric and the geometric components, as parameterized during the training phase. Meanwhile, the residual plot shows the correlation between the true dosimetric component parameterized during the training phase and the component estimated by the model after the training phase. For each graph, the trend line (dash lines) and the two standard deviations (SD) of the plot (straight lines) were reported. The correlation R2 values for both regression and residual plots are shown in Table 2 for the respective organ. Of note, even if the penile bulb showed the highest value for both the correlation parameters (probably due to an overfitting of the model), we decided to avoid the use of the resulting prediction considering the poor number of plans available for this structure (only 21). The size of the training sets is an issue. As well reported by Cagni et al. [
      • Cagni E.
      • Botti A.
      • Wang Y.
      • Iori M.
      • Petit S.F.
      • Heijmen B.J.M.
      Pareto-optimal plans as ground truth for validation of a commercial system for knowledge-based DVH-prediction.
      ], training sets with ≤ 30 plans need to be avoided also for the considered highly consistent treatment plans (pareto-optimal like). Based on this analysis, training sets with ≥ 45 plans resulted in accurate DVH predictions.
      Figure thumbnail gr1
      Fig. 1Residual and regression plots for each OAR trained in the model: the trend lines (dash lines) with the two standard deviations of the regression (straight lines) are also shown.
      Table 2R2 values of regression and residual for each OAR.
      OARR2
      RegressionResidual
      Rectum0.430.70
      Bladder0.460.55
      Femoral heads0.350.56
      Penile bulb0.560.91
      Moreover, the KB prediction on selected dose-volume parameters of the clinical plans used to train the model, are shown in supplementary materials (Figure S2).

      3.1.2 External Validation

      Figure S3 shows the comparison between rectum and bladder volumes of the validation and the training cohort sets; no significant differences were observed.
      Fig. 2 shows the dose-volume parameters for the rectum and the bladder, analyzed for the twenty validation plans, in terms of clinical DVH values and model estimated lower and upper bands. Regarding the rectum, 6/20, 5/20, 5/20, 4/20 clinical plans are lower than the estimated DVH bands (meaning the clinical are better than the estimated), when considering V95%, V90%, V80% and V50% dose-volume points, respectively. Generally, the lower estimated bands and the clinical plans were within the constraints (black lines, Fig. 2), except for the V95% parameter, where six plans are slightly above the limit even if they are inside the predicted bands. This is the case also in some clinical situations because of the small volumes that receive more than 95% of the prescribed dose and the compromise with the target coverage.
      Figure thumbnail gr2
      Fig. 2Dose-volume parameters for the rectum and the bladder in terms of DVH values (blue dot) and model estimated lower and upper bands (orange lines). The constraints are also shown (black lines). (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.)
      Regarding the bladder, 6/20 and 5/20 clinical plans are out of the estimated DVH bands, respectively for V90% and V50% dose-volume points. Three out of twenty plans for both parameters are lower than the estimated bands and only a few points are over the constraints.

      3.2 KB Optimization

      Several fine-tuning tests based on repetitive planning of five sample patients were done, testing the impact of the position of DVH constraints and their weights. The best templates were chosen. Once the KB-based templates were tuned, the automatic re-optimization of the twenty validation plans was successfully carried out both for SO and VOLO optimization and acceptable clinical plans were obtained.
      Fig. 3 shows the mean DVH of the original clinical plans (TP) and automatic KB plans (KB-TP) for the validation set referring to SO (A) and VOLO optimization (B). Fig. 4 shows the average percentage differences of volumes (TP values minus KB-TP values) as a function of the dose for both OARs and PTV for SO (A) and VOLO optimization (B). The dose ranges corresponding to statistically significant differences are filled (p < 0.05). Quantitative analyses are shown in Table 3.
      Figure thumbnail gr3
      Fig. 3Mean DVH comparison between KB-TP (dash lines) and TP (straight lines) for SO (A) and VOLO (B) optimization.
      Figure thumbnail gr4
      Fig. 4The mean differences of the volume as a function of the dose for OARs and target for SO (A) and VOLO (B); in green is highlighted the portion of graph where the differences are statistically significant (p < 0.05). (For interpretation of the references to colour in this figure legend, the reader is referred to the web version of this article.)
      Table 3Mean values (TP and KB-TP) and differences ΔTP for targets and OAR parameters for external validation; in bold the values with statistically significant differences (p-value < 0.05).
      OrgansDose-volume parametersTPKB-TP SOΔTPKB-TP VOLOΔTP
      PTVV100% (%)93.61 ± 2.7093.05 ± 4.100.56 ± 4.1595.19 ± 4.65−1.58 ± 4.81
      V95% (%)98.75 ± 0.9497.40 ± 1.841.35 ± 1.8399.57 ± 0.64−0.82 ± 1.14
      CTVV100% (%)98.62 ± 1.6198.05 ± 2.590.58 ± 3.1199.61 ± 1.00−0.99 ± 2.04
      V95% (%)99.94 ± 0.1899.64 ± 0.560.31 ± 0.61100 ± 0.00−0.06 ± 0.16
      RectumV95% (cc)2.50 ± 0.951.55 ± 1.450.95 ± 1.293.68 ± 1.68−1.19 ± 1.35
      V90% (%)6.79 ± 2.615.06 ± 3.621.73 ± 2.248.44 ± 3.27−1.65 ± 2.02
      V80% (%)11.94 ± 3.979.67 ± 4.842.27 ± 2.6813.61 ± 4.76−1.67 ± 2.37
      V50% (%)31.15 ± 9.1525.20 ± 7.935.95 ± 6.2933.17 ± 8.38−2.02 ± 6.08
      V10Gy (%)59.82 ± 10.5451.86 ± 11.397.96 ± 8.7357.22 ± 9.842.60 ± 6.72
      BladderV90% (%)6.78 ± 2.785.39 ± 3.081.40 ± 2.237.64 ± 4.14−0.86 ± 3.15
      V50% (%)33.72 ± 12.7424.72 ± 11.609.00 ± 6.2728.16 ± 14.275.56 ± 9.45
      V10Gy (%)71.20 ± 16.3951.81 ± 17.8819.39 ± 11.4557.45 ± 19.7513.76 ± 12.13
      Femoral headsV30% (%)10.29 ± 9.2516.98 ± 14.52−6.69 ± 9.0314.84 ± 9.94−4.55 ± 9.83
      V10% (%)80.80 ± 14.9176.20 ± 14.544.60 ± 14.8971.69 ± 14.099.11 ± 14.03
      Regarding SO, on average, the reported cases show slightly lower PTV coverage in the range of V95% and V100% due to a better sparing of the rectum and the bladder (Fig. 3A and 4A). All dose-volume parameters considered both for the rectum and the bladder are significantly better in KB-TP plans (Table 3). The femoral heads are worse for KB-TP plans in the range of V20% and V50%. Of note, only one constraint on the maximum dose was added in the template and no prediction was considered. Regarding PTV there is a significant positive difference in the V95%-V100% range (Fig. 4A) meaning that the coverage is better for the TP plans as said before.
      Concerning VOLO optimization, on average, the reported cases show greater target coverage in the V95% and V100% range while the rectum is significantly worse in the region of higher doses due to the soft nature of the objectives in the template (Fig. 4B), although the differences are small and of likely null clinical meaning. The femoral heads, similar to the SO, are worse for the KB-TP plan in the range V20%- V50%. Of note, V95%, V90%, V80% for the rectum are significantly worse in KB-TP plans, while V10Gy is significantly better. For the bladder, V50% and V10Gy are significantly better in KB-TP plans whereas V90% is worse but with no significance (Table 3). Regarding PTV there is a significant negative difference in V95%-V100% range meaning that the coverage is better for KB-TP plans (Fig. 4B). VOLO optimization allows a decrease of treatment time; the average KB-VOLO delivery time was 18.55 ± 1.70 min compared to 36.05 ± 7.91 min of clinical TP and 34.10 ± 2.59 min of the SO automatic plan.
      In Figs. S4 and S5 the mean DVHs for extra five patients automatically optimized with “urethra sparing” and “no urethra sparing” templates were compared, respectively for SO and VOLO optimization approach. The urethra maximum dose constraint (≤38.8 Gy) is well respected in both approaches. No significant differences were reported for all considered OARs (rectum, bladder and femoral head), while there is an expected slight decrease in the mean dose delivered to the PTV with the urethra-sparing approach. However, the PTV V95% is still comparable (97% with SO and 100% with VOLO).

      4. Discussion

      The present work represents the first attempt of implementing a KB approach to automate the plan optimization process in the prostate district using the CyberKnife system. Two algorithms implemented in the treatment planning system were considered: the sequential and the VOLO optimization. Optimized planning templates based on the KB-model were able to generate high-quality automatic plans for both modalities, at least comparable to clinical plans, without any further intervention of the planner. In order to use the KB-predicted DVH to automatically optimize treatment plans, selected DVH constraints were extracted from the KB-prediction model to generate an individually optimized template. The generated constraints were based on the lower band values predicted by the KB model. The translation of the DVH prediction into an optimized template requires an adequate fine tuning. Several fine-tuning tests based on repetitive planning of five sample patients were done, testing the impact of several DVH constraints and relative weights. The template that was able to automatically generate clinical acceptable plans satisfying all the dose-volume constraints was chosen as the definitive.
      Regarding SO, OARs sparing was significantly better, mostly at lower doses. On the other hand, on average, the target coverage was slightly lower than the TP even if it was still acceptable. To solve this problem, a user intervention could improve PTV coverage to make it comparable with that one of manual plans.
      Concerning VOLO optimization, the coverage was significantly better than TP while for the rectum there was significant, although limited, worsening mostly at higher doses. Instead, the bladder was better spared than TP, especially at low and intermediate doses. A plan re-normalization could improve the OARs sparing, by keeping acceptable PTV coverage. A limit of this work is that the VOLO KB-model was created based on manual CyberKnife plans optimized with the sequential algorithm. A proper KB-model, based on plans originally optimized with VOLO, could in principle give different and better results for the automatic optimization. Further investigations are needed concerning this issue. The biggest advantages of VOLO optimization consist in the reduction of the delivery time [
      • Schüler E.
      • Lo A.
      • Chuang C.F.
      • Soltys S.G.
      • Pollom E.L.
      • Wang L.
      Clinical impact of the VOLO optimizer on treatment plan quality and clinical treatment efficiency for CyberKnife.
      ], which makes it more suitable to the clinical implementation. In fact, the average KB-VOLO delivery time was 18.55 ± 1.70 min compared to 36.05 ± 7.91 min of clinical TP and 34.10 ± 2.59 min of the SO automatic plan.
      The prostate clinical plans used to train and then to validate the KB model were based on RTOG0938 protocol (36.25 Gy /5fr), excluding the maximum dose constraint (≤38.8 Gy) to the urethra. In our clinical practice the maximum dose constraint to the urethra region was considered too much restrictive, supported by Fuller et al. [
      • Fuller D.B.
      • Naitoh J.
      • Lee C.
      • Hardy S.
      • Jin H.
      Virtual HDR CyberKnife treatment for localized prostatic carcinoma: dosimetry comparison with HDR brachytherapy and preliminary clinical observations.
      ,
      • Fuller D.B.
      • Naitoh J.
      • Mardirossian G.
      Virtual HDR CyberKnife SBRT for Localized Prostatic Carcinoma: 5-Year Disease-Free Survival and Toxicity Observations.
      ] experience giving a limit of 45.6 Gy in 4 fractions to Dmax, as well as D50% < 39.9 Gy. Therefore, for all patients treated at our institute based on RTOG protocol (5 fractions) included in this study, the urethra delineation wasn’t considered in planning optimization, differently from patients treated in 4 fractions (Fuller approach), where the urethra region is delineated and included in the planning optimization. To try to generalize and make useful our approach to be fully compliant with the RTOG protocol (including the urethra constraints), two different optimization templates were defined, both for SO and VOLO optimization algorithms. In the original template, based on our clinical experience, no urethra sparing was considered; in the generalized template, the sparing of the urethra region was included and optimized. To take urethra sparing into account, the original template was slightly modified. In SO approach a hard dose maximum constraint to the urethra was added. While a target goal for the overlap urethra region (overlap between the planning urethra and the PTV) together with a dose maximum critical goal for the urethra were added in VOLO approach. Even with available urethra contours, the urethra DVH prediction with KB model approach could not have considered. Rapid Plan doesn’t perform DVH prediction of target structures and the urethra sparing should be considered a trade-off between the maximum dose constraint and the PTV coverage; for this reason, the adding of “ad-hoc” urethra/PTV constraints should be considered the optimal choice for the planning optimization approach.
      Few experiences are reported in literature regarding the implementation of automatic planning for SBRT approaches [

      Foy JJ, Marsh R, ten Haken RK, Younge KC, Schipper M, Sun Y, et al. An analysis of knowledge-based planning for stereotactic body radiation therapy of the spine. Pract Radiat Oncol 2017;7:e355–60. https://doi.org/10.1016/j.prro.2017.02.007.

      ,
      • Visak J.
      • McGarry R.C.
      • Randall M.E.
      • Pokhrel D.
      Development and clinical validation of a robust knowledge-based planning model for stereotactic body radiotherapy treatment of centrally located lung tumors.
      ,
      • Visak J.
      • Ge G.Y.
      • McGarry R.C.
      • Randall M.
      • Pokhrel D.
      An Automated knowledge-based planning routine for stereotactic body radiotherapy of peripheral lung tumors via DCA-based volumetric modulated arc therapy.
      ,
      • Chin Snyder K.
      • Kim J.
      • Reding A.
      • Fraser C.
      • Gordon J.
      • Ajlouni M.
      • et al.
      Development and evaluation of a clinical model for lung cancer patients using stereotactic body radiotherapy (SBRT) within a knowledge-based algorithm for treatment planning.
      ,
      • Delaney A.R.
      • Dahele M.
      • Tol J.P.
      • Slotman B.J.
      • Verbakel W.F.A.R.
      Knowledge-based planning for stereotactic radiotherapy of peripheral early-stage lung cancer.
      ,
      • Geng H.
      • Giaddui T.G.
      • Zhong H.
      • Rosenthal D.I.
      • Galvin J.M.
      • Xiao Y.
      • et al.
      Knowledge Engineering-Based Quality Evaluation of NRG Oncology RTOG 0522 Treatment Plans.
      ]. Moreover, there are not yet specific commercial solutions able to automatize treatment plans for the CyberKnife system. The possibility to extend the use of the RapidPlan tool and to apply RP models to other techniques and delivery machines is not new and has been already demonstrated in the tomotherapy environment [

      Castriconi R, Cattaneo GM, Mangili P, Esposito PG, Broggi S, Cozzarini C, et al. Clinical Implementation of Knowledge-Based Automatic Plan Optimization for Helical Tomotherapy. Pract Radiat Oncol 2021;11:e236–44. https://doi.org/10.1016/j.prro.2020.09.012.

      ,
      • Cagni E.
      • Botti A.
      • Micera R.
      • Galeandro M.
      • Sghedoni R.
      • Orlandi M.
      • et al.
      Knowledge-based treatment planning: An inter-technique and inter-system feasibility study for prostate cancer.
      ,
      • Esposito P.G.
      • Castriconi R.
      • Mangili P.
      • Broggi S.
      • Fodor A.
      • Pasetti M.
      • et al.
      Knowledge-based automatic plan optimization for left-sided whole breast tomotherapy.
      ]. Currently, there are no studies in literature about KB-models applied to CyberKnife in the prostate district. Importantly, the Erasmus MC Cancer Institute group has proposed different fully automated planning solutions using Multicriteria Optimization implemented in the “Erasmus-iCycle” software [

      Rossi L, Wahab Sharfo A, Aluwini S, Dirkx M, Breedveld S, Heijmen B. First fully automated planning solution for robotic radiosurgery-comparison with automatically planned volumetric arc therapy for prostate cancer. Acta Oncologica 2018;57:1490-98. https://doi.org/10.1080/0284186X.2018.1479068.

      ,
      • Schipaanboord B.W.K.
      • Giżyńska M.K.
      • Rossi L.
      • de Vries K.C.
      • Heijmen B.J.M.
      • Breedveld S.
      Fully automated treatment planning for MLC-based robotic radiotherapy.
      ], showing significant improvements compared to previously delivered clinical plans. Their results cannot be directly compared with our findings due to the different aims of the two approaches. In fact, the major aim of any KB approach is to “translate” the past experience into a model, with possibly only little quality improvement; the auto-plan approach followed by the Rotterdam group was explicitly intended to improve plan quality based on an optimized template set to find the “best” Pareto solution.
      It will be interesting to test our KB-model performance outside our institution. While plan quality may vary between planners of the same institute, larger variations may be expected among different institutions mainly due to possible differences in planning technique, dose prescription, contouring and sparing OARs approach. The implementation of a model outside the institution where has been generated requires a careful evaluation, often adaptation to the local situation, and extensive validation. This issue will be focused within an ongoing project for large-scale implementation of automatic KB plan optimization (MIKAPOCo, Multi-Institutional Knowledge-based Approach to Plan Optimization for the Community). Tudda et al. [
      • Tudda A.
      • Castriconi R.
      • Benecchi G.
      • Cagni E.
      • Cicchetti A.
      • Dusi F.
      • et al.
      Knowledge-based multi-institution plan prediction of whole breast irradiation with tangential fields.
      ], in this context, investigated the inter-variability of KB-models for right breast cancer patients treated with tangential field whole breast irradiation. Results showed limited inter-institute variability of plan prediction models translating in high inter-institute interchangeability, except for one institute.

      5. Conclusions

      In conclusion, a fully automatic extension of the KB-approach to the CyberKnife system has been successfully proved. Even though automatic plans were generally better than, or equivalent to manual planning, the clinical impact was “low” in the majority of cases, especially at higher doses. This is expected, being that the KB approach based on the past experience, so dramatic improvements in plan quality were not expected. On the other hand, optimization time was dramatically reduced: although a careful quantitative estimate was not possible because the time spent for manual planning was not previously registered, typical values of the time necessary for planning such patients with CK (with both SO and VOLO) are in the range of 2–4 h. This operator time may in principle be almost completely spared once the system is run to automatically generate the KB plan.

      Funding

      This work was supported by AIRC ‘Associazione Italiana per la Ricerca sul Cancro’ (grant IG23150).

      Declaration of Competing Interest

      The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

      Appendix A. Supplementary data

      The following are the Supplementary data to this article:

      References

        • Martin A.
        • Gaya A.
        Stereotactic body radiotherapy: A Review.
        Clin Oncol. 2010; 22: 157-172https://doi.org/10.1016/j.clon.2009.12.003
        • Ma L.
        • Wang L.
        • Tseng C.-L.
        • Sahgal A.
        Emerging technologies in stereotactic body radiotherapy.
        Chin Clin Oncol. 2017; 6: S12-S
        • Brand D.H.
        • Tree A.C.
        • Ostler P.
        • van der Voet H.
        • Loblaw A.
        • Chu W.
        • et al.
        Intensity-modulated fractionated radiotherapy versus stereotactic body radiotherapy for prostate cancer (PACE-B): acute toxicity findings from an international, randomised, open-label, phase 3, non-inferiority trial.
        Lancet Oncol. 2019; 20: 1531-1543
        • Lehrer E.J.
        • Kishan A.U.
        • Yu J.B.
        • Trifiletti D.M.
        • Showalter T.N.
        • Ellis R.
        • et al.
        Ultrahypofractionated versus hypofractionated and conventionally fractionated radiation therapy for localized prostate cancer: A systematic review and meta-analysis of phase III randomized trials.
        Radiother Oncol. 2020; 148: 235-242
        • Jackson W.C.
        • Silva J.
        • Hartman H.E.
        • Dess R.T.
        • Kishan A.U.
        • Beeler W.H.
        • et al.
        Stereotactic Body Radiation Therapy for Localized Prostate Cancer: A Systematic Review and Meta-Analysis of Over 6,000 Patients Treated On Prospective Studies.
        Int J Radiat Oncol*Biol*Phys. 2019; 104: 778-789
        • Widmark A.
        • Gunnlaugsson A.
        • Beckman L.
        • Thellenberg-Karlsson C.
        • Hoyer M.
        • Lagerlund M.
        • et al.
        Ultra-hypofractionated versus conventionally fractionated radiotherapy for prostate cancer: 5-year outcomes of the HYPO-RT-PC randomised, non-inferiority, phase 3 trial.
        Lancet. 2019; 394: 385-395
        • Moore K.L.
        Automated Radiotherapy Treatment Planning.
        Semin Radiat Oncol. 2019; 29: 209-218
        • Hussein M.
        • Heijmen B.J.M.
        • Verellen D.
        • Nisbet A.
        Automation in intensity modulated radiotherapy treatment planning-a review of recent innovations.
        Br J Radiol. 2018; 91: 20180270
      1. Ge Y, Wu QJ. Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Med Phys 2019;46:2760–75. https://doi.org/ 10.1002/mp.13526.

        • Momin S.
        • Fu Y.
        • Lei Y.
        • Roper J.
        • Bradley J.D.
        • Curran W.J.
        • et al.
        Knowledge-based Radiation Treatment Planning: A Data-driven Method Survey.
        J Appl Clin Med Phys. 2021; 22: 16-44
        • Pallotta S.
        • Marrazzo L.
        • Calusi S.
        • Castriconi R.
        • Fiorino C.
        • Loi G.
        • et al.
        Implementation of automatic plan optimization in Italy: Status and perspectives.
        Phys Med. 2021; 92: 86-94
        • Scaggion A.
        • Fusella M.
        • Cavinato S.
        • Dusi F.
        • El Khouzai B.
        • Germani A.
        • et al.
        Updating a clinical Knowledge-Based Planning prediction model for prostate radiotherapy.
        Phys Med. 2023; 107: 102542
        • Lou Z.
        • Cheng C.
        • Mao R.
        • Li D.
        • Tian L.
        • Li B.
        • et al.
        A novel automated planning approach for multi-anatomical sites cancer in Raystation treatment planning system.
        Phys Med. 2023; 109: 102586
        • Villaggi E.
        • Hernandez V.
        • Fusella M.
        • Moretti E.
        • Russo S.
        • Vaccara E.M.L.
        • et al.
        Plan quality improvement by DVH sharing and planner’s experience: Results of a SBRT multicentric planning study on prostate.
        Phys Med. 2019; 62: 73-82
        • Good D.
        • Lo J.
        • Lee W.R.
        • Wu Q.J.
        • Yin F.F.
        • Das S.K.
        A knowledge-based approach to improving and homogenizing intensity modulated radiation therapy planning quality among treatment centers: An example application to prostate cancer planning.
        Int J Radiat Oncol Biol Phys. 2013; 87: 176-181https://doi.org/10.1016/j.ijrobp.2013.03.015
        • Yuan L.
        • Ge Y.
        • Lee W.R.
        • Yin F.F.
        • Kirkpatrick J.P.
        • Wu Q.J.
        Quantitative analysis of the factors which affect the interpatient organ-at-risk dose sparing variation in IMRT plans.
        Med Phys. 2012; 39: 6868-6878https://doi.org/10.1118/1.4757927
        • Zhu X.
        • Ge Y.
        • Li T.
        • Thongphiew D.
        • Yin F.F.
        • Wu Q.J.
        A planning quality evaluation tool for prostate adaptive IMRT based on machine learning.
        Med Phys. 2011; 38: 719-726https://doi.org/10.1118/1.3539749
        • Nwankwo O.
        • Mekdash H.
        • Sihono D.S.K.
        • Wenz F.
        • Glatting G.
        Knowledge-based radiation therapy (KBRT) treatment planning versus planning by experts: validation of a KBRT algorithm for prostate cancer treatment planning.
        Radiat Oncol. 2015; 10https://doi.org/10.1186/S13014-015-0416-6
      2. Varian Medical System. Treatment Planning 13.5 New Features - Treatment Planning 13.5 Workbook.

        • Castriconi R.
        • Fiorino C.
        • Passoni P.
        • Broggi S.
        • Di Muzio N.G.
        • Cattaneo G.M.
        • et al.
        Knowledge-based automatic optimization of adaptive early-regression-guided VMAT for rectal cancer.
        Phys Med. 2020; 70: 58-64
        • Hussein M.
        • South C.P.
        • Barry M.A.
        • Adams E.J.
        • Jordan T.J.
        • Stewart A.J.
        • et al.
        Clinical validation and benchmarking of knowledge-based IMRT and VMAT treatment planning in pelvic anatomy.
        Radiother Oncol. 2016; 120: 473-479
        • Castriconi R.
        • Fiorino C.
        • Broggi S.
        • Cozzarini C.
        • Di Muzio N.
        • Calandrino R.
        • et al.
        Comprehensive Intra-Institution stepping validation of knowledge-based models for automatic plan optimization.
        Phys Med. 2019; 57: 231-237
        • Gysen K.
        • O'Toole J.
        • Le A.
        • Wu K.
        • Schuler T.
        • Porter B.
        • et al.
        Rolling out RapidPlan: What we’ve learnt.
        J Med Radiat Sci. 2020; 67: 310-317
        • Rusu I.
        • Roeske J.
        • Solanki A.
        • Kang H.
        Fully automated planning and delivery of hippocampal-sparing whole brain irradiation.
        Med Dosim. 2022; 47: 8-13https://doi.org/10.1016/J.MEDDOS.2021.06.004
        • Frederick A.
        • Roumeliotis M.
        • Grendarova P.
        • Quirk S.
        Performance of a knowledge-based planning model for optimizing intensity-modulated radiotherapy plans for partial breast irradiation.
        J Appl Clin Med Phys. 2022; 23: e13506
        • Scaggion A.
        • Fusella M.
        • Roggio A.
        • Bacco S.
        • Pivato N.
        • Rossato M.A.
        • et al.
        Reducing inter- and intra-planner variability in radiotherapy plan output with a commercial knowledge-based planning solution.
        Phys Med. 2018; 53: 86-93
        • Rago M.
        • Placidi L.
        • Polsoni M.
        • Rambaldi G.
        • Cusumano D.
        • Greco F.
        • et al.
        Evaluation of a generalized knowledge-based planning performance for VMAT irradiation of breast and locoregional lymph nodes—Internal mammary and/or supraclavicular regions.
        PLoS One. 2021; 16: e0245305
        • Wu H.
        • Jiang F.
        • Yue H.
        • Zhang H.
        • Wang K.
        • Zhang Y.
        Applying a RapidPlan model trained on a technique and orientation to another: a feasibility and dosimetric evaluation.
        Radiat Oncol. 2016; 11https://doi.org/10.1186/S13014-016-0684-9
        • Lian J.
        • Yuan L.
        • Ge Y.
        • Chera B.S.
        • Yoo D.P.
        • Chang S.
        • et al.
        Modeling the dosimetry of organ-at-risk in head and neck IMRT planning: An intertechnique and interinstitutional study.
        Med Phys. 2013; 40: 121704
        • Cagni E.
        • Botti A.
        • Micera R.
        • Galeandro M.
        • Sghedoni R.
        • Orlandi M.
        • et al.
        Knowledge-based treatment planning: An inter-technique and inter-system feasibility study for prostate cancer.
        Phys Med. 2017; 36: 38-45
      3. Castriconi R, Cattaneo GM, Mangili P, Esposito PG, Broggi S, Cozzarini C, et al. Clinical Implementation of Knowledge-Based Automatic Plan Optimization for Helical Tomotherapy. Pract Radiat Oncol 2021;11:e236–44. https://doi.org/10.1016/j.prro.2020.09.012.

      4. Foy JJ, Marsh R, ten Haken RK, Younge KC, Schipper M, Sun Y, et al. An analysis of knowledge-based planning for stereotactic body radiation therapy of the spine. Pract Radiat Oncol 2017;7:e355–60. https://doi.org/10.1016/j.prro.2017.02.007.

        • Visak J.
        • McGarry R.C.
        • Randall M.E.
        • Pokhrel D.
        Development and clinical validation of a robust knowledge-based planning model for stereotactic body radiotherapy treatment of centrally located lung tumors.
        J Appl Clin Med Phys. 2021; 22: 146-155https://doi.org/10.1002/ACM2.13120
        • Visak J.
        • Ge G.Y.
        • McGarry R.C.
        • Randall M.
        • Pokhrel D.
        An Automated knowledge-based planning routine for stereotactic body radiotherapy of peripheral lung tumors via DCA-based volumetric modulated arc therapy.
        J Appl Clin Med Phys. 2021; 22: 109-116https://doi.org/10.1002/acm2.13114
        • Chin Snyder K.
        • Kim J.
        • Reding A.
        • Fraser C.
        • Gordon J.
        • Ajlouni M.
        • et al.
        Development and evaluation of a clinical model for lung cancer patients using stereotactic body radiotherapy (SBRT) within a knowledge-based algorithm for treatment planning.
        J Appl Clin Med Phys. 2016; 17: 263-275
        • Delaney A.R.
        • Dahele M.
        • Tol J.P.
        • Slotman B.J.
        • Verbakel W.F.A.R.
        Knowledge-based planning for stereotactic radiotherapy of peripheral early-stage lung cancer.
        Acta Oncol (Madr). 2017; 56: 490-495https://doi.org/10.1080/0284186X.2016.1273544
        • Hardcastle N.
        • Cook O.
        • Ray X.
        • Moore A.
        • Moore K.L.
        • Pryor D.
        • et al.
        Personalising treatment plan quality review with knowledge-based planning in the TROG 15.03 trial for stereotactic ablative body radiotherapy in primary kidney cancer.
        Radiat Oncol. 2021; 16https://doi.org/10.1186/s13014-021-01820-7
      5. A Randomized Phase II Trial Of Hypofractionated Radiotherapy For Favorable Risk Prostate Cancer-RTOG CCOP Study. NRG ONCOLOGY. https://www.nrgoncology.org/Clinical-Trials/Protocol/rtog-0938?filter=rtog-0938 [accessed 3 May 2023].

      6. Accuray Precision® Treatment Planning System. Treatment Planning Manual Version 3.3.x.

        • Calusi S.
        • Doro R.
        • Di Cataldo V.
        • Cipressi S.
        • Francolini G.
        • Bonucci I.
        • et al.
        Performance assessment of a new optimization system for robotic SBRT MLC-based plans.
        Phys Med. 2020; 71: 31-38
        • Zeverino M.
        • Marguet M.
        • Zulliger C.
        • Durham A.
        • Jumeau R.
        • Herrera F.
        • et al.
        Novel inverse planning optimization algorithm for robotic radiosurgery: First clinical implementation and dosimetric evaluation.
        Phys Med. 2019; 64: 230-237
        • Giżyńska M.K.
        • Rossi L.
        • Toom W.
        • Milder M.T.W.
        • Vries K.C.
        • Nuyttens J.
        • et al.
        Largely reduced OAR doses, and planning and delivery times for challenging robotic SBRT cases, obtained with a novel optimizer.
        J Appl Clin Med Phys. 2021; 22: 35-47
        • Boutilier J.J.
        • Craig T.
        • Sharpe M.B.
        • Chan T.C.Y.
        Sample size requirements for knowledge-based treatment planning.
        Med Phys. 2016; 43: 1212-1221https://doi.org/10.1118/1.4941363
        • Cagni E.
        • Botti A.
        • Wang Y.
        • Iori M.
        • Petit S.F.
        • Heijmen B.J.M.
        Pareto-optimal plans as ground truth for validation of a commercial system for knowledge-based DVH-prediction.
        Phys Med. 2018; 55: 98-106https://doi.org/10.1016/J.EJMP.2018.11.002
      7. Varian Medical System. Eclipse Photon and Electron Algorithms Reference Guide. 2015.

        • Fogliata A.
        • Belosi F.
        • Clivio A.
        • Navarria P.
        • Nicolini G.
        • Scorsetti M.
        • et al.
        On the pre-clinical validation of a commercial model-based optimisation engine: Application to volumetric modulated arc therapy for patients with lung or prostate cancer.
        Radiother Oncol. 2014; 113: 385-391
        • Fogliata A.
        • Reggiori G.
        • Stravato A.
        • Lobefalo F.
        • Franzese C.
        • Franceschini D.
        • et al.
        RapidPlan head and neck model: the objectives and possible clinical benefit.
        Radiat Oncol. 2017; 12https://doi.org/10.1186/S13014-017-0808-X
        • Fogliata A.
        • Wang P.M.
        • Belosi F.
        • Clivio A.
        • Nicolini G.
        • Vanetti E.
        • et al.
        Assessment of a model based optimization engine for volumetric modulated arc therapy for patients with advanced hepatocellular cancer.
        Radiat Oncol. 2014; 9: 236https://doi.org/10.1186/S13014-014-0236-0
        • Schüler E.
        • Lo A.
        • Chuang C.F.
        • Soltys S.G.
        • Pollom E.L.
        • Wang L.
        Clinical impact of the VOLO optimizer on treatment plan quality and clinical treatment efficiency for CyberKnife.
        J Appl Clin Med Phys. 2020; 21: 38-47https://doi.org/10.1002/ACM2.12851
        • Fuller D.B.
        • Naitoh J.
        • Lee C.
        • Hardy S.
        • Jin H.
        Virtual HDR CyberKnife treatment for localized prostatic carcinoma: dosimetry comparison with HDR brachytherapy and preliminary clinical observations.
        Int J Radiat Oncol Biol Phys. 2008; 70: 1588-1597https://doi.org/10.1016/J.IJROBP.2007.11.067
        • Fuller D.B.
        • Naitoh J.
        • Mardirossian G.
        Virtual HDR CyberKnife SBRT for Localized Prostatic Carcinoma: 5-Year Disease-Free Survival and Toxicity Observations.
        Front Oncol. 2014; : 4https://doi.org/10.3389/FONC.2014.00321
        • Geng H.
        • Giaddui T.G.
        • Zhong H.
        • Rosenthal D.I.
        • Galvin J.M.
        • Xiao Y.
        • et al.
        Knowledge Engineering-Based Quality Evaluation of NRG Oncology RTOG 0522 Treatment Plans.
        Int J Radiat Oncol*Biol*Phys. 2017; 99: S174
        • Esposito P.G.
        • Castriconi R.
        • Mangili P.
        • Broggi S.
        • Fodor A.
        • Pasetti M.
        • et al.
        Knowledge-based automatic plan optimization for left-sided whole breast tomotherapy.
        Phys Imaging Radiat Oncol. 2022; 23: 54-59
      8. Rossi L, Wahab Sharfo A, Aluwini S, Dirkx M, Breedveld S, Heijmen B. First fully automated planning solution for robotic radiosurgery-comparison with automatically planned volumetric arc therapy for prostate cancer. Acta Oncologica 2018;57:1490-98. https://doi.org/10.1080/0284186X.2018.1479068.

        • Schipaanboord B.W.K.
        • Giżyńska M.K.
        • Rossi L.
        • de Vries K.C.
        • Heijmen B.J.M.
        • Breedveld S.
        Fully automated treatment planning for MLC-based robotic radiotherapy.
        Med Phys. 2021; 48: 4139-4147https://doi.org/10.1002/MP.14993
        • Tudda A.
        • Castriconi R.
        • Benecchi G.
        • Cagni E.
        • Cicchetti A.
        • Dusi F.
        • et al.
        Knowledge-based multi-institution plan prediction of whole breast irradiation with tangential fields.
        Radiother Oncol. 2022; 175: 10-16