Advertisement
Original paper| Volume 67, P132-140, November 2019

Inter-planner variation in treatment-plan quality of plans created with a knowledge-based treatment planning system

Published:November 06, 2019DOI:https://doi.org/10.1016/j.ejmp.2019.10.032

      Highlights

      • Clarify the inter-planner variation of knowledge-based plan (KBP) quality.
      • Ninety VMAT plans were created using the RapidPlan by nine planners.
      • Single optimization with only priority modification was performed.
      • Large variation of plan quality was observed in beginner planners.
      • Inter-planner variation remains for complicated plans even though using KBP.

      Abstract

      Purpose

      This study aimed to clarify the inter-planner variation of plan quality in knowledge-based plans created by nine planners.

      Methods

      Five hypofractionated prostate-only (HPO) volumetric modulated arc therapy (VMAT) plans and five whole-pelvis (WP) VMAT plans were created by each planner using a knowledge-based planning (KBP) system. Nine planners were divided into three groups of three planners each: Senior, Junior, and Beginner. Single optimization with only priority modification for all objectives was performed to stay within the dose constraints. The coefficients of variation (CVs) for dosimetric parameters were evaluated, and a plan quality metric (PQM) was used to evaluate comprehensive plan quality.

      Results

      Lower CVs (<0.05) were observed at dosimetric parameters in the planning target volume for both HPO and WP plans, while the CVs in the rectum and bladder for WP plans (<0.91) were greater than those for HPO plans (<0.17). The PQM values of HPO plans for Cases1–5 (average ± standard deviation) were 41.2 ± 7.1, 40.9 ± 5.6, and 39.9 ± 4.6 in the Senior, Junior, and Beginner groups, respectively. For the WP plans, the PQM values were 51.9 ± 6.3, 47.5 ± 4.3, and 40.0 ± 6.6, respectively. The number of clinically acceptable HPO and WP plans were 13/15 and 11/15 in the Senior group, 13/15 and 10/15 plans in the Junior group, and 8/15 and 2/15 plans in the Beginner group, respectively.

      Conclusion

      Inter-planner variation in the plan quality with RapidPlan remains, especially for the complicated VMAT plans, due to planners’ heuristics.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Physica Medica: European Journal of Medical Physics
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Nelms B.E.
        • Robinson G.
        • Markham J.
        • Velasco K.
        • Boyd S.
        • Narayan S.
        • et al.
        Variation in external beam treatment plan quality: an inter-institutional study of planners and planning systems.
        Pract Radiat Oncol. 2012; 2: 296-305https://doi.org/10.1016/j.prro.2011.11.012
        • Chung H.T.
        • Lee B.
        • Park E.
        • Lu J.J.
        • Xia P.
        Can all centers plan intensity-modulated radiotherapy (IMRT) effectively? An external audit of dosimetric comparisons between three-dimensional conformal radiotherapy and IMRT for adjuvant chemoradiation for gastric cancer.
        Int J Radiat Oncol Biol Phys. 2008; 71: 1167-1174https://doi.org/10.1016/j.ijrobp.2007.11.040
        • Batumalai V.
        • Jameson M.G.
        • Forstner D.F.
        • Vial P.
        • Holloway L.C.
        How important is dosimetrist experience for intensity modulated radiation therapy? A comparative analysis of a head and neck case.
        Pract Radiat Oncol. 2013; 3: e99-e106https://doi.org/10.1016/j.prro.2012.06.009
        • Villaggi E.
        • Hernandez V.
        • Fusella M.
        • Moretti E.
        • Russo S.
        • Vaccara E.M.L.
        • et al.
        Plan quality improvement by DVH sharing and planner’s experience: results of a SBRT multicentric planning study on prostate.
        Phys Med. 2019; 62: 73-82https://doi.org/10.1016/j.ejmp.2019.05.003
        • Fogliata A.
        • Wang P.M.
        • Francesca B.
        • Clivio A.
        • Nicolini G.
        • Vanetti E.
        • et al.
        Assessment of a model based optimization engine for volumetric modulated arc therapy for patients with advanced hepatocellular cancer.
        Radiat Oncol. 2014; 9: 236https://doi.org/10.1186/s13014-014-0236-0
        • Good D.
        • Lo J.
        • Lee W.R.
        • Wu J.
        • Yin F.F.
        • Das S.K.
        A knowledge-based approach to improving and homogenizing intensity modulated radiation therapy planning quality among treatment centers: an example application to prostate cancer planning.
        Int J Radiat Oncol Biol Phys. 2013; 87: 176-181https://doi.org/10.1016/j.ijrobp.2013.03.015
        • Nwankwo O.
        • Mekdash H.
        • Sihono D.S.K.
        • Wenz F.
        • Glatting G.
        Knowledge-based radiation therapy (KBRT) treatment planning versus planning by experts: validation of a KBRT algorithm for prostate cancer treatment planning.
        Radiat Oncol. 2015; 10: 111https://doi.org/10.1186/s13014-015-0416-6
        • Tol J.P.
        • Delaney A.R.
        • Dahele M.
        • Slotman B.J.
        • Verbakel W.F.
        Evaluation of a knowledge-based planning solution for head and neck cancer.
        Int J Radiat Oncol Biol Phys. 2015; 91: 612-620https://doi.org/10.1016/j.ijrobp.2014.11.014
        • Fogliata A.
        • Nicolini G.
        • Clivio A.
        • Vanetti E.
        • Laksar S.
        • Tozzi A.
        • et al.
        A broad scope knowledge based model for optimization of VMAT in esophageal cancer: validation and assessment of plan quality among different treatment centers.
        Radiat Oncol. 2015; 10: 220https://doi.org/10.1186/s13014-015-0530-5
        • Kubo K.
        • Monzen H.
        • Ishii K.
        • Tamura M.
        • Kawamorita R.
        • Sumida I.
        • et al.
        Dosimetric comparison of RapidPlan and manually optimized plans in volumetric modulated arc therapy for prostate cancer.
        Phys Med. 2017; 44: 199-204https://doi.org/10.1016/j.ejmp.2017.06.026
        • Fogliata A.
        • Reggiori G.
        • Stravato A.
        • Lobefalo F.
        • Franzese C.
        • Franceschini D.
        • et al.
        RapidPlan head and neck model: the objectives and possible clinical benefit.
        Radiat Oncol. 2017; 12: 73https://doi.org/10.1186/s13014-017-0808-x
        • Wang J.
        • Hu W.
        • Yang Z.
        • Chen X.
        • Wu Z.
        • Yu X.
        • et al.
        Is it possible for knowledge-based planning to improve intensity modulated radiation therapy plan quality for planners with different planning experiences in left-sided breast cancer patients?.
        Radiat Oncol. 2017; 12: 85https://doi.org/10.1186/s13014-017-0822-z
        • Tamura M.
        • Monzen H.
        • Matsumoto K.
        • Kubo K.
        • Otsuka M.
        • Inada M.
        • et al.
        Mechanical performance of a commercial knowledge-based VMAT planning for prostate cancer.
        Radiat Oncol. 2018; 13: 163https://doi.org/10.1186/s13014-018-1114-y
        • Ueda Y.
        • Fukunaga J.
        • Kamima T.
        • Adachi Y.
        • Nakamatsu K.
        • Monzen H.
        Evaluation of multiple institutions’ models for knowledge-based planning of volumetric modulated arc therapy (VMAT) for prostate cancer.
        Radiat Oncol. 2018; 13: 46https://doi.org/10.1186/s13014-018-0994-1
        • Berry S.
        • Ma R.
        • Boczkowski A.
        • Jackson A.
        • Zhang P.
        • Hunt M.
        Evaluating inter-campus plan consistency using a knowledge based planning model.
        Radiother Oncol. 2016; 120: 349-355https://doi.org/10.1016/j.radonc.2016.06.010
        • Chang A.T.Y.
        • Hung A.W.M.
        • Cheung F.W.K.
        • Lee M.C.H.
        • Chan O.S.H.
        • Philips H.
        • et al.
        Comparison of planning quality and efficiency between conventional and knowledge-based algorithms in nasopharyngeal cancer patients using intensity modulated radiation therapy.
        Int J Radiat Oncol Biol Phys. 2016; 95: 981-990https://doi.org/10.1016/j.ijrobp.2016.02.017
        • Fogliata A.
        • Belosi F.
        • Clivio A.
        • Navarria P.
        • Nicolini G.
        • Scorsetti M.
        • et al.
        On the pre-clinical validation of a commercial model-based optimization engine: application to volumetric modulated arc therapy for patients with lung or prostate cancer.
        Radiother Oncol. 2014; 113: 385-391https://doi.org/10.1016/j.radonc.2014.11.009
        • Scaggion A.
        • Fusella M.
        • Roggio A.
        • Basso S.
        • Pivato N.
        • Rossato M.A.
        • et al.
        Reducing inter- and intra-planner variability in radiotherapy plan output with a commercial knowledge-based planning solution.
        Phys Med. 2018; 53: 86-93https://doi.org/10.1016/j.ejmp.2018.08.016
        • Ishii K.
        • Ogino R.
        • Hosokawa Y.
        • Fujioka C.
        • Okada W.
        • Nakahara R.
        • et al.
        Comparison of dosimetric parameters and acute toxicity after whole-pelvic vs prostate-only volumetric-modulated arc therapy with daily image guidance for prostate cancer.
        Br J Radiol. 2016; 89: 20150930https://doi.org/10.1259/bjr.20150930
        • Delaney A.R.
        • Tol J.P.
        • Dahele M.
        • Cuijpers J.
        • Slotman B.J.
        • Verbakel W.F.
        Effect of dosimetric outliers on the performance of a commercial knowledge-based planning solution.
        Int J Radiat Oncol Biol Phys. 2016; 94: 469-477https://doi.org/10.1016/j.ijrobp.2015.11.011
        • Kataria T.
        • Sharma K.
        • Subramani V.
        • Karrthick K.P.
        • Bisht S.S.
        Homogeneity index: an objective tool for assessment of conformal radiation treatments.
        J Med Phys. 2012; 37: 207-213https://doi.org/10.4103/0971-6203.103606
        • van’t Riet A.
        • Mak A.C.
        • Moerland M.A.
        • Elders L.H.
        • van der Zee W.
        A conformation number to quantify the degree of conformality in brachytherapy and external beam irradiation: application to the prostate.
        Int J Radiat Oncol Biol Phys. 1997; 37: 731-736https://doi.org/10.1016/S0360-3016(96)00601-3
        • Fusella M.
        • Scaggion A.
        • Pivato N.
        • Rossato M.A.
        • Zorz A.
        • Paiusco M.
        Efficiently train and validate a RapidPlan model through APQM scoring.
        Med Phys. 2018; 45: 2611-2619https://doi.org/10.1002/mp.12896
        • Castriconi R.
        • Fiorino C.
        • Broggi S.
        • Cozzarini C.
        • Muzio N.D.
        • Calandrino R.
        • et al.
        Comprehensive intra-institution stepping validation of knowledge-based models for automatic plan optimization.
        Phys Med. 2019; 57: 231-237https://doi.org/10.1016/j.ejmp.2018.12.002
        • Snyder K.C.
        • Kim J.
        • Reding A.
        • Fraser C.
        • Gordon J.
        • Ajiouni M.
        • et al.
        Development and evaluation of a clinical model for lung cancer patients using stereotactic body radiotherapy (SBRT) within a knowledge-based algorithm for treatment planning.
        J Appl Clin Med Phys. 2016; 17: 263-275https://doi.org/10.1120/jacmp.v17i6.6429
        • Yu G.
        • Li Y.
        • Feng Z.
        • Tao C.
        • Yu Z.
        • Li B.
        • et al.
        Knowledge-based IMRT planning for individual liver cancer patients using a novel specific model.
        Radiat Oncol. 2018; 13: 52https://doi.org/10.1186/s13014-018-0996-z
        • Kamima T.
        • Ueda Y.
        • Fukunaga J.
        • Shimizu Y.
        • Tamura M.
        • Ishikawa K.
        • et al.
        Multi-institutional evaluation of knowledge-based planning performance of volumetric modulated arc therapy (VMAT) for head and neck cancer.
        Phys Med. 2019; 64: 174-181https://doi.org/10.1016/j.ejmp.2019.07.004