Advertisement
Review paper| Volume 109, 102568, May 2023

Download started.

Ok

Practical and technical key challenges in head and neck adaptive radiotherapy: The GORTEC point of view

Published:April 02, 2023DOI:https://doi.org/10.1016/j.ejmp.2023.102568

      Highlights

      • Overview of Head and Neck adaptive radiotherapy key steps.
      • Presentation of adaptive radiotherapy tools and workflows.
      • Practical recommendations for H&N adaptive radiotherapy.
      • Challenges of H&N ART and current difficulties or limitations.

      Abstract

      Anatomical variations occur during head and neck (H&N) radiotherapy (RT) treatment. These variations may result in underdosage to the target volume or overdosage to the organ at risk. Replanning during the treatment course can be triggered to overcome this issue. Due to technological, methodological and clinical evolutions, tools for adaptive RT (ART) are becoming increasingly sophisticated.
      The aim of this paper is to give an overview of the key steps of an H&N ART workflow and tools from the point of view of a group of French-speaking medical physicists and physicians (from GORTEC). Focuses are made on image registration, segmentation, estimation of the delivered dose of the day, workflow and quality assurance for an implementation of H&N offline and online ART. Practical recommendations are given to assist physicians and medical physicists in a clinical workflow.

      Keywords

      1. Introduction

      Developments in intensity modulated (IMRT) and image-guided radiotherapy (IGRT) devices have allowed more precise and targeted head and neck (H&N) cancer treatments, with improved sparing of organs at risk (OARs) while covering target volumes. However, during H&N RT, some patients are typically subject to anatomical variations such as tumor shrinkage or weight loss. These changes are progressive during the treatment course and their amplitude depends on each patient [
      • Barker J.L.
      • Garden A.S.
      • Ang K.K.
      • O’Daniel J.C.
      • Wang H.
      • Court L.E.
      • et al.
      Quantification of volumetric and geometric changes occurring during fractionated radiotherapy for head-and-neck cancer using an integrated CT/linear accelerator system.
      ,
      • Nishi T.
      • Nishimura Y.
      • Shibata T.
      • Tamura M.
      • Nishigaito N.
      • Okumura M.
      Volume and dosimetric changes and initial clinical experience of a two-step adaptive intensity modulated radiation therapy (IMRT) scheme for head and neck cancer.
      ,
      • Marzi S.
      • Pinnarò P.
      • D’Alessio D.
      • Strigari L.
      • Bruzzaniti V.
      • Giordano C.
      • et al.
      Anatomical and Dose Changes of Gross Tumour Volume and Parotid Glands for Head and Neck Cancer Patients during Intensity-modulated Radiotherapy: Effect on the Probability of Xerostomia Incidence.
      ]. Due to steep dose gradients, anatomical changes (whether large or small) can induce discrepancies between planned and delivered doses [
      • Beltran M.
      • Ramos M.
      • Rovira J.J.
      • Perez-Hoyos S.
      • Sancho M.
      • Puertas E.
      • et al.
      Dose variations in tumor volumes and organs at risk during IMRT for head-and-neck cancer.
      ]. Adaptive radiotherapy (ART) permits correction for anatomical and dosimetric variations occurring during the treatment course [
      • Brouwer C.L.
      • Steenbakkers R.J.H.M.
      • Langendijk J.A.
      • Sijtsema N.M.
      Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?.
      ]. The main clinical goals of H&N ART are to decrease toxicity by sparing OARs (in particular the parotid glands), to maintain tumor coverage and, eventually, to increase local control using dose escalation [
      • Schwartz D.L.
      • Garden A.S.
      • Thomas J.
      • Chen Y.
      • Zhang Y.
      • Lewin J.
      • et al.
      Adaptive Radiotherapy for Head-and-Neck Cancer: Initial Clinical Outcomes From a Prospective Trial.
      ,
      • Castelli J.
      • Simon A.
      • Lafond C.
      • Perichon N.
      • Rigaud B.
      • Chajon E.
      • et al.
      Adaptive radiotherapy for head and neck cancer.
      ]. Indeed, it is possible with adaptive strategies to maintain an optimal protection of the surrounding OAR, and to deliver an additional dose to the tumor area targeted for example by functional imaging [
      • Pollom E.L.
      • Song J.
      • Durkee B.Y.
      • Aggarwal S.
      • Bui T.
      • von Eyben R.
      • et al.
      Prognostic value of midtreatment FDG-PET in oropharyngeal cancer.
      ,
      • Bahig H.
      • Yuan Y.
      • Mohamed A.S.R.
      • Brock K.K.
      • Ng S.P.
      • Wang J.
      • et al.
      Magnetic Resonance-based Response Assessment and Dose Adaptation in Human Papilloma Virus Positive Tumors of the Oropharynx treated with Radiotherapy (MR-ADAPTOR): An R-IDEAL stage 2a–2b/Bayesian phase II trial.
      ]. Several ART strategies can be used. During many years, offline ART with one or several replanning during treatment course was the usual H&N ART as anatomical variations are progressive and predictable. However, online ART strategies (using replanning based on image of the day, for each fraction), originally used for pelvic and abdominal sites, have become accessible for other sites such as H&N [
      • McDonald B.A.
      • Vedam S.
      • Yang J.
      • Wang J.
      • Castillo P.
      • Lee B.
      • et al.
      Initial Feasibility and Clinical Implementation of Daily MR-Guided Adaptive Head and Neck Cancer Radiation Therapy on a 1.5T MR-Linac System: Prospective R-IDEAL 2a/2b Systematic Clinical Evaluation of Technical Innovation.
      ]. We also could differentiate ART strategies by biological approaches based on functional variations observed during treatment with PET [
      • Lee N.
      • Schoder H.
      • Beattie B.
      • Lanning R.
      • Riaz N.
      • McBride S.
      • et al.
      A Strategy of Using Intra-treatment Hypoxia Imaging to Selectively and Safely Guide Radiation Dose Deescalation Concurrent with Chemotherapy for Loco-regionally Advanced Human Papillomavirus-Related Oropharyngeal Carcinoma.
      ] and MRI [
      • Bahig H.
      • Yuan Y.
      • Mohamed A.S.R.
      • Brock K.K.
      • Ng S.P.
      • Wang J.
      • et al.
      Magnetic Resonance-based Response Assessment and Dose Adaptation in Human Papilloma Virus Positive Tumors of the Oropharynx treated with Radiotherapy (MR-ADAPTOR): An R-IDEAL stage 2a–2b/Bayesian phase II trial.
      ]. The objective of integrating biological imaging into RT management is to detect early functional modification potentially linked to an anatomical modification in order to trigger a treatment adaptation. Moreover, the identification of patient profiles based on their response to treatment in relation to functional imaging is strongly correlated with metabolic changes [
      • Matuszak M.M.
      • Kashani R.
      • Green M.
      • Owen D.
      • Jolly S.
      • Mierzwa M.
      Functional Adaptation in Radiation Therapy.
      ]. Strategies are being developed to adapt more accurately by identifying responders (or poor-responders) to chemo-RT on the basis of functional images (MRI or TEP generally) obtained in most cases within the first 2–3 weeks of treatment [
      • Matuszak M.M.
      • Kashani R.
      • Green M.
      • Owen D.
      • Jolly S.
      • Mierzwa M.
      Functional Adaptation in Radiation Therapy.
      ,
      • Martens R.M.
      • Noij D.P.
      • Ali M.
      • Koopman T.
      • Marcus J.T.
      • Vergeer M.R.
      • et al.
      Functional imaging early during (chemo)radiotherapy for response prediction in head and neck squamous cell carcinoma; a systematic review.
      ,
      • Martens R.M.
      • Koopman T.
      • Lavini C.
      • van de Brug T.
      • Zwezerijnen G.J.C.
      • Marcus J.T.
      • et al.
      Early Response Prediction of Multiparametric Functional MRI and 18F-FDG-PET in Patients with Head and Neck Squamous Cell Carcinoma Treated with (Chemo)Radiation.
      ]. These strategies are currently being evaluated and tested in clinical trials [

      Galloway TJ, Zhang Q (Ed), Nguyen-Tan PF, Rosenthal DI, Soulieres D, Fortin A, et al. Prognostic Value of p16 Status on the Development of a Complete Response in Involved Oropharynx Cancer Neck Nodes After Cisplatin-Based Chemoradiation: A Secondary Analysis of NRG Oncology RTOG 0129. Int J Radiat Oncol Biol Phys 2016;96:362–71. https://doi.org/10.1016/j.ijrobp.2016.05.026.

      ,
      • Fu S.
      • Li Y.
      • Han Y.
      • Wang H.
      • Chen Y.
      • Yan O.
      • et al.
      Diffusion-Weighted Magnetic Resonance Imaging-Guided Dose Painting in Patients With Locoregionally Advanced Nasopharyngeal Carcinoma Treated With Induction Chemotherapy Plus Concurrent Chemoradiotherapy: A Randomized, Controlled Clinical Trial.
      ].
      ART provides a dosimetric benefit for a majority of clinical studies that used offline adaptation [
      • Schwartz D.L.
      • Garden A.S.
      • Thomas J.
      • Chen Y.
      • Zhang Y.
      • Lewin J.
      • et al.
      Adaptive Radiotherapy for Head-and-Neck Cancer: Initial Clinical Outcomes From a Prospective Trial.
      ] or for studies evaluating anatomical and/or dosimetric variations observed during RT [
      • Brouwer C.L.
      • Steenbakkers R.J.H.M.
      • Langendijk J.A.
      • Sijtsema N.M.
      Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?.
      ,
      • Castelli J.
      • Simon A.
      • Lafond C.
      • Perichon N.
      • Rigaud B.
      • Chajon E.
      • et al.
      Adaptive radiotherapy for head and neck cancer.
      ]. However, the clinical benefit has not yet been formally demonstrated for all patients [
      • Castelli J.
      • Simon A.
      • Lafond C.
      • Perichon N.
      • Rigaud B.
      • Chajon E.
      • et al.
      Adaptive radiotherapy for head and neck cancer.
      ] but rather for specific cohorts of patients [
      • Chen A.M.
      • Daly M.E.
      • Cui J.
      • Mathai M.
      • Benedict S.
      • Purdy J.A.
      Clinical outcomes among patients with head and neck cancer treated by intensity-modulated radiotherapy with and without adaptive replanning.
      ]. For these reasons, ongoing and future multi-centre clinical trials must be robust to prove the effectiveness of H&N ART strategies. However, practices and commercial tools can differ between participating centers. Thus, recommendations and/or quality control need to be set to homogenise practices. The implementation of ART strategies may induce additional uncertainties through new steps implemented during preparation and treatment delivery. These new features (especially for online strategies) imply the need to set up evaluations and rigour in the implementation to allow an efficient deployment in RT departments.
      A group of 26 medical physicists together with a group of 8 radiation oncologists have discussed the implementation of H&N ART within the GORTEC (Radiotherapy Oncology Group for Head and Neck). Created in 1999, the GORTEC involves 150 oncologists and 30 medical physicists. This network covers more than 100 oncology care institutions established in France, Switzerland, Belgium, Tunisia, Germany, and Spain.
      The aim of this paper is to give an overview of the key steps of an H&N ART workflow and tools from the point of view of a group of French-speaking medical physicists and physicians from GORTEC, to provide practical considerations for the implementation of an H&N ART process. Focuses were made on image registration, segmentation, estimation of the delivered dose of the day, dose monitoring, offline and online workflows and quality assurance for an implementation of H&N ART.

      2. Image registration

      Image registration is a key step in an ART workflow. The registration of two series of images consists, through geometric transformations, in matching their intrinsic elements. For RT, rigid image registration (RIR) is used typically to position the patient by registering images acquired each day to the planning kV-CT. Deformable image registration (DIR) can be performed for contour propagation, planning adaptation or dose accumulation during the treatment course [
      • Loi G.
      • Fusella M.
      • Vecchi C.
      • Menna S.
      • Rosica F.
      • Gino E.
      • et al.
      Computed Tomography to Cone Beam Computed Tomography Deformable Image Registration for Contour Propagation Using Head and Neck, Patient-Based Computational Phantoms: A Multicenter Study.
      ,
      • Zhang L.
      • Wang Z.
      • Shi C.
      • Long T.
      • Xu X.G.
      The impact of robustness of deformable image registration on contour propagation and dose accumulation for head and neck adaptive radiotherapy.
      ].

      2.1 Rigid image registration (RIR)

      In RT, RIR can be used at different steps of the patient's treatment, in particular to position the patient before irradiation. RIR is a transformation preserving the distance between all points in the image. RIR can be performed only with translations, or with translations and rotations, in 2D or 3D. RIR is subject to uncertainties evaluated with physical or numerical phantoms. Since RIR uncertainties depend on imaging modality, ideal physical phantoms would be compatible with all imaging modalities. Geometrical phantoms can be used to assess spatial integrity of RIR, and anthropomorphic phantoms to evaluate clinical RIR uncertainties. AAPM Task Group 132 (TG-132) provides data to assess RIR uncertainties with both geometrical and anthropomorphic phantoms for several imaging modalities (kV-CT, kV-CBCT, PET, MRI) [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. An evaluation of RIR is recommended before the first software use, and at each update.

      2.2 Deformable image registration (DIR)

      DIR is an essential tool used during the ART process to take into account and quantify changes in the shape and size of internal organs to adapt between initial planning images and daily images acquired during the treatment course. The transformation between two image series consists in applying a deformation matrix to the image to be registered with the target: each pixel of the reference image finds its corresponding pixel in the image to be registered. This produces a deformation vector field (DVF) which is the mathematical vector translation of the change between two sets of images. Some solutions propose to visualize DVF mapping either by static or dynamic representation. In an evaluation process, it is usually possible to export the DVF generated by a DIR algorithm in DICOM format.
      Traditionally, there are two main approaches in terms of functionality: feature-based and intensity-based methods. A third approach, called hybrid methods, combines the two previous ones [
      • Sotiras A.
      • Davatzikos C.
      • Paragios N.
      Deformable Medical Image Registration: A Survey.
      ,
      • Viergever M.A.
      • Maintz J.B.A.
      • Klein S.
      • Murphy K.
      • Staring M.
      • Pluim J.P.W.
      A survey of medical image registration - under review.
      ]. DIR tools are available in many TPS or commercial softwares with different algorithms. DIR algorithms are used on a case-by-case basis and according to the center background for offline strategies. For online ART, DIR is used for contour propagation, synthetic CT generation and dose accumulation.
      DIR performance is notably related to the input data, i.e. image quality of data to register, but also to DIR algorithm properties, the potential imprecision encountered and anatomical deformation magnitude observed. In case of vector fields smoothing use, it could be problematic for important anatomical changes. Artifacts and/or severe deformations between two image series will directly condition DIR quality. Indeed, larger errors were mostly encountered in regions around major shape changes, as well as areas with uniform contrast but large local motion discontinuity [
      • Kashani R.
      • Hub M.
      • Balter J.M.
      • Kessler M.L.
      • Dong L.
      • Zhang L.
      • et al.
      Objective assessment of deformable image registration in radiotherapy: A multi-institution study.
      ]. Geometric parameters like matrix size and z-slice thickness of image series to register have an impact on the integrity and size of the voxels (resolution, partial volume effect, sampling, etc.) [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. It is therefore important to assess the image quality beforehand and to work on image-guided (ART) protocol optimisation, particularly during acquisition and reconstruction. Moreover, DIR has several limitations: areas of artifacts, huge deformations, low contrast areas, sliding between tissues, matter appearance/disappearance, tumor shrinkage or multi-modal registration [
      • Liu F.
      • Hu Y.
      • Zhang Q.
      • Kincaid R.
      • Goodman K.
      • Mageras G.
      Evaluation of deformable image registration and motion model in CT images with limited features.
      ]. The uncertainty quantification associated with DIR algorithms is the subject of many works [
      • Castillo R.
      • Castillo E.
      • Fuentes D.
      • Ahmad M.
      • Wood A.M.
      • Ludwig M.S.
      • et al.
      A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive.
      ,
      • Kerdok A.E.
      • Cotin S.M.
      • Ottensmeyer M.P.
      • Galea A.M.
      • Howe R.D.
      • Dawson S.L.
      Truth cube: Establishing physical standards for soft tissue simulation.
      ]. Indeed, although the algorithms are based on complex mathematical models, they are not consistent with biological/physiological processes.
      For DIR evaluation, visual inspection is the first and simplest check that must be performed with split screen displays or regions of interest. Although it implies that the operator has the background to analyse this type of transformation. AAPM Task Group 132 (TG-132) have provided recommendations on qualitative and quantitative metrics for evaluating the DIR process [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. Numerical, geometrical, or anthropomorphic phantoms can be created and modified using dedicated software. They can mimic complex deformations observed in clinical practice. The deformed images can be compared to initial images. Filters and/or noise can be applied to approximate clinical conditions [
      • Nie K.
      • Chuang C.
      • Kirby N.
      • Braunstein S.
      • Pouliot J.
      Site-specific deformable imaging registration algorithm selection using patient-based simulated deformations: Site-specific DIR selection using patient-based simulated deformations.
      ]. Deformation Vector Field (DVF) can be used to assess DIR. Groundtruth data is used to evaluate the performance of DIR algorithms by comparison with DVF obtained, to determine error at each point of the image. Some authors provide access to this data for evaluation of their own DIR algorithm [
      • Pukala J.
      • Meeks S.L.
      • Staton R.J.
      • Bova F.J.
      • Mañon R.R.
      • Langen K.M.
      A virtual phantom library for the quantification of deformable image registration uncertainties in patients with cancers of the head and neck: Virtual phantoms for the quantification of DIR uncertainty.
      ,
      • Castadot P.
      • Lee J.A.
      • Parraga A.
      • Geets X.
      • Macq B.
      • Grégoire V.
      Comparison of 12 deformable registration strategies in adaptive radiation therapy for the treatment of head and neck tumors.
      ]. Qualitative methods include for example an operator visualisation, such as comparing images with structure overlays. Quantitative verification is one of the challenges of DIR. It is often not possible because of the lack of groundtruth. For contour propagation, when access to DVF analysis is not possible, the evaluation tools available to validate DIR solutions are: physical phantoms [
      • Singhrao K.
      • Kirby N.
      • Pouliot J.
      A three-dimensional head-and-neck phantom for validation of multimodality deformable image registration for adaptive radiotherapy: 3D H&N phantom for DIR validation.
      ,
      • Kirby N.
      • Chuang C.
      • Pouliot J.
      A two-dimensional deformable phantom for quantitatively verifying deformation algorithms.
      ] and numerical phantoms [
      • Pukala J.
      • Meeks S.L.
      • Staton R.J.
      • Bova F.J.
      • Mañon R.R.
      • Langen K.M.
      A virtual phantom library for the quantification of deformable image registration uncertainties in patients with cancers of the head and neck: Virtual phantoms for the quantification of DIR uncertainty.
      ] as well as patient images [
      • Castadot P.
      • Lee J.A.
      • Parraga A.
      • Geets X.
      • Macq B.
      • Grégoire V.
      Comparison of 12 deformable registration strategies in adaptive radiation therapy for the treatment of head and neck tumors.
      ]. Quantitative methods can require patient delineations or anatomical markers. For contouring, the deformed contours are compared with so-called reference contours, generally produced by an expert operator. Quantitative metrics such as DICE index, Jacobian matrix, target registration error (TRE), mean distance to agreement (MDA), and consistency can be used [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. None of these metrics are perfect, so a combination of several indexes, at least overlapping and distance evaluation metrics with complementary specificities, is recommended. TG-132 also provided recommendations on tolerances, based on the application and image voxel dimensions [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. In addition, subjective scoring methods for evaluating the mapped structures have been proposed [
      • Lustberg T.
      • van Soest J.
      • Gooding M.
      • Peressutti D.
      • Aljabar P.
      • van der Stoep J.
      • et al.
      Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer.
      ].
      Practical recommendations:
      • -
        An evaluation of RIR and DIR is recommended before the first software use, and at each update.
      • -
        Geometrical phantoms must be used to assess spatial integrity of RIR, and anthropomorphic phantoms to evaluate clinical RIR uncertainties.
      • -
        Create known deformations from physical, numerical phantoms or patient images is recommended to evaluate initial DIR algorithm performance.
      • -
        In case of automatic registration (RIR or DIR), it is recommended to perform it in a localised area of interest (with boxes) and where information from the two images are available.
      • -
        A patient-specific DIR review is required (at least visual, quantitative if possible). Systematic visual inspection is necessary to validate deformation and to identify areas of uncertainty such as large deformations or artifacts.
      • -
        For DIR evaluation with contours, a combination of several indexes, at least overlapping and distance evaluation metrics with complementary specificities, is recommended.

      3. Image segmentation for delineation

      The definition of contours is a key stage since it conditions the entire treatment management process. First of all, in order to control the management of many organs to be delineated, it is required to use lists of names and descriptions rigorously drawn up with a view to standardisation. Several American and European groups have proposed a standard list of names for target volumes and OARs in RT [
      • Santanam L.
      • Hurkmans C.
      • Mutic S.
      • van Vliet-Vroegindeweij C.
      • Brame S.
      • Straube W.
      • et al.
      Standardizing Naming Conventions in Radiation Oncology.
      ,
      • Mir R.
      • Kelly S.M.
      • Xiao Y.
      • Moore A.
      • Clark C.H.
      • Clementel E.
      • et al.
      Organ at risk delineation for radiation therapy clinical trials: Global Harmonization Group consensus guidelines.
      ,
      • Mayo C.S.
      • Moran J.M.
      • Bosch W.
      • Xiao Y.
      • McNutt T.
      • Popple R.
      • et al.
      American Association of Physicists in Medicine Task Group 263: Standardizing Nomenclatures in Radiation Oncology.
      ,
      • Brouwer C.L.
      • Steenbakkers R.J.H.M.
      • Bourhis J.
      • Budach W.
      • Grau C.
      • Grégoire V.
      • et al.
      CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG Oncology and TROG consensus guidelines.
      ]. Such standardisation may be necessary to ensure quality control of clinical trials.
      H&N segmentation can be performed on different imaging modalities: kV-CT [
      • van Dijk L.V.
      • Van den Bosch L.
      • Aljabar P.
      • Peressutti D.
      • Both S.
      • Steenbakkers J.H.M.
      • et al.
      Improving automatic delineation for head and neck organs at risk by Deep Learning Contouring.
      ], MR [
      • Močnik D.
      • Ibragimov B.
      • Xing L.
      • Strojan P.
      • Likar B.
      • Pernuš F.
      • et al.
      Segmentation of parotid glands from registered CT and MR images.
      ] or PET [
      • Zhao L.
      • Lu Z.
      • Jiang J.
      • Zhou Y.
      • Wu Y.
      • Feng Q.
      Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images.
      ], but also with in-room imaging modalities such as kV-CBCT [
      • van de Schoot A.J.
      • Schooneveldt G.
      • Wognum S.
      • Hoogeman M.S.
      • Chai X.
      • Stalpers L.J.A.
      • et al.
      Generic method for automatic bladder segmentation on cone beam CT using a patient-specific bladder shape model.
      ] or MV-CT [
      • Zhang J.
      • Huang L.
      • Wu F.
      • Wang G.
      • Wu L.
      • Huang B.
      • et al.
      Tailoring PTV expansion to improve the dosimetry of post modified radical mastectomy intensity-modulated radiotherapy for left-sided breast cancer patients by using 4D CT combined with cone beam CT.
      ,
      • Gering D.T.
      • Lu W.
      • Ruchala K.
      • Olivera G.
      Automatic Segmentation of KV-CT and MV-CT Images of Head and Neck Patients.
      ] or kV-CT [
      • Tegtmeier R.C.
      • Ferris W.S.
      • Bayouth J.E.
      • Miller J.R.
      • Culberson W.S.
      Characterization of imaging performance of a novel helical kVCT for use in image-guided and adaptive radiotherapy.
      ]. MR segmentation for H&N localisation is even more investigated with MR-Linac deployment in the radiotherapy departments [
      • Yang X.
      • Wu N.
      • Cheng G.
      • Zhou Z.
      • Yu D.S.
      • Beitler J.J.
      • et al.
      Automated Segmentation of the Parotid Gland Based on Atlas Registration and Machine Learning: A Longitudinal MRI Study in Head-and-Neck Radiation Therapy.
      ,
      • Boeke S.
      • Mönnich D.
      • van Timmeren J.E.
      • Balermpas P.
      MR-Guided Radiotherapy for Head and Neck Cancer: Current Developments, Perspectives, and Challenges.
      ] and MR simulation [
      • Kaza E.
      • Guenette J.P.
      • Guthier C.V.
      • Hatch S.
      • Marques A.
      • Singer L.
      • et al.
      Image quality comparisons of coil setups in 3T MRI for brain and head and neck radiotherapy simulations.
      ].
      Manual segmentation is time consuming and implies inter-operator variability, regardless of the image type [
      • Zukauskaite R.
      • Rumley C.N.
      • Hansen C.R.
      • Jameson M.G.
      • Trada Y.
      • Johansen J.
      • et al.
      Delineation uncertainties of tumour volumes on MRI of head and neck cancer patients.
      ] and tumor localisation [
      • Lorenzen E.L.
      • Kallehauge J.F.
      • Byskov C.S.
      • Dahlrot R.H.
      • Haslund C.A.
      • Guldberg T.L.
      • et al.
      A national study on the inter-observer variability in the delineation of organs at risk in the brain.
      ]. So, initial contouring, offline and online ART processes need segmentation automation [
      • Cardenas C.E.
      • Yang J.
      • Anderson B.M.
      • Court L.E.
      • Brock K.B.
      Advances in Auto-Segmentation.
      ].
      Automatic segmentation (AS) for delineation, provided from initial planning and in-room imaging, allows to obtain new contours for example for evaluation of anatomical and/or dosimetric difference to trigger a new treatment planning if necessary. AS methods are used to contour OAR [
      • van Dijk L.V.
      • Van den Bosch L.
      • Aljabar P.
      • Peressutti D.
      • Both S.
      • Steenbakkers J.H.M.
      • et al.
      Improving automatic delineation for head and neck organs at risk by Deep Learning Contouring.
      ,
      • Vaassen F.
      • Hazelaar C.
      • Vaniqui A.
      • Gooding M.
      • van der Heyden B.
      • Canters R.
      • et al.
      Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy.
      ,
      • van der Veen J.
      • Gulyban A.
      • Nuyts S.
      Interobserver variability in delineation of target volumes in head and neck cancer.
      ] and target volumes [
      • Stapleford L.J.
      • Lawson J.D.
      • Perkins C.
      • Edelman S.
      • Davis L.
      • McDonald M.W.
      • et al.
      Evaluation of automatic atlas-based lymph node segmentation for head-and-neck cancer.
      ] either differentially or jointly [
      • Lim J.Y.
      • Leech M.
      Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck.
      ,
      • Daisne J.-F.
      • Blumhofer A.
      Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation.
      ]. The efficiency of target volume segmentation is a current challenge. For tumor and lymph node areas [
      • Savjani R.R.
      • Lauria M.
      • Bose S.
      • Deng J.
      • Yuan Y.
      • Andrearczyk V.
      Automated Tumor Segmentation in Radiotherapy.
      ], MR images are preferred (mainly because of image contrast) [
      • Schouten J.P.E.
      • Noteboom S.
      • Martens R.M.
      • Mes S.W.
      • Leemans C.R.
      • de Graaf P.
      • et al.
      Automatic segmentation of head and neck primary tumors on MRI using a multi-view CNN.
      ].
      Historically, there have been two main types of automatic delineation methods: methods without prior knowledge, and methods with input data. AS methods without prior knowledge can be divided into 3 categories: segmentation by regions [

      Lalaoui L, Mohamadi T. A comparative study of Image Region-Based Segmentation Algorithms 2013. https://doi.org/10.14569/IJACSA.2013.040627.

      ], by contour detection, and by intensity threshold. AS methods with input data are atlas based auto segmentation (ABAS) [
      • Daisne J.-F.
      • Blumhofer A.
      Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation.
      ], statistic model methods, deep learning (DL) methods [
      • Boldrini L.
      • Bibault J.-E.
      • Masciocchi C.
      • Shen Y.
      • Bittner M.-I.
      Deep Learning: A Review for the Radiation Oncologist.
      ], or hybrid methods [
      • Qazi A.A.
      • Pekar V.
      • Kim J.
      • Xie J.
      • Breen S.L.
      • Jaffray D.A.
      Auto-segmentation of normal and target structures in head and neck CT images: A feature-driven model-based approach.
      ]. ABAS methods use prior knowledge that is provided by one or more atlas(es) typically using DIR to perform automatic delineation. The statistical model method uses shape variations and appearances of the structures of interest to train the statistical model to perform self-segmentation. DL methods extract features from an input database (images) using neural networks. A step of training (with reference delineated volumes) is needed for DL methods. DL algorithms are based on neural networks consisting of several layers [
      • Vandewinckele L.
      • Claessens M.
      • Dinkla A.
      • Brouwer C.
      • Crijns W.
      • Verellen D.
      • et al.
      Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance.
      ]. Hybrid methods can merge one or more algorithms to eliminate their weaknesses and improve the accuracy of the segmentation while having an optimised delineation time. Hybrid methods are frequently used because of their adaptability and flexibility [
      • Sharp G.
      • Fritscher K.D.
      • Pekar V.
      • Peroni M.
      • Shusharina N.
      • Veeraraghavan H.
      • et al.
      Vision 20/20: Perspectives on automated image segmentation for radiotherapy.
      ].
      Lim et al. compiled studies about ABAS algorithms performance from 2005 to 2015, in terms of contouring time and accuracy [
      • Stapleford L.J.
      • Lawson J.D.
      • Perkins C.
      • Edelman S.
      • Davis L.
      • McDonald M.W.
      • et al.
      Evaluation of automatic atlas-based lymph node segmentation for head-and-neck cancer.
      ,
      • Lim J.Y.
      • Leech M.
      Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck.
      ]. The majority of the identified work uses manual contouring as a benchmark, in comparison with segmented contours by ABAS algorithms. ABAS algorithms significantly reduced contouring time by 30–60% compared to manual segmentation in a majority of cases [
      • Lim J.Y.
      • Leech M.
      Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck.
      ,
      • Daisne J.-F.
      • Blumhofer A.
      Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation.
      ,
      • La Macchia M.
      • Fellin F.
      • Amichetti M.
      • Cianchetti M.
      • Gianolini S.
      • Paola V.
      • et al.
      Systematic evaluation of three different commercial software solutions for automatic segmentation for adaptive therapy in head-and-neck, prostate and pleural cancer.
      ]. Several publications evaluated the AS quality with DL methods [
      • Costea M.
      • Zlate A.
      • Durand M.
      • Baudier T.
      • Grégoire V.
      • Sarrut D.
      • et al.
      Comparison of atlas-based and deep learning methods for organs at risk delineation on head-and-neck CT images using an automated treatment planning system.
      ,

      Zhu W, Huang Y, Tang H, Qian Z, Du N, Fan W, et al. AnatomyNet: Deep 3D Squeeze-and-excitation U-Nets for fast and fully automated whole-volume anatomical segmentation. 2018.

      ]. With parotid gland segmentation they obtained an average DICE index value of 0.85 with a fully convolutional neural network (FCN) [
      • Nikolov S.
      • Blackwell S.
      • Zverovitch A.
      • Mendes R.
      • Livne M.
      • De Fauw J.
      • et al.
      Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy. ArXiv180904430 Phys.
      ], and 0.88 with a convolutional network (CNN) [

      Zhu W, Huang Y, Tang H, Qian Z, Du N, Fan W, et al. AnatomyNet: Deep 3D Squeeze-and-excitation U-Nets for fast and fully automated whole-volume anatomical segmentation. 2018.

      ]. Generated contour from any AS tool need to be validated (edited if necessary) by a human.
      Van Rooij et al. [
      • van Rooij W.
      • Dahele M.
      • Ribeiro Brandao H.
      • Delaney A.R.
      • Slotman B.J.
      • Verbakel W.F.
      Deep Learning-Based Delineation of Head and Neck Organs at Risk: Geometric and Dosimetric Evaluation.
      ] provided a new insight into the evaluation of segmentation methods. They compared DL methods to manual contouring. They carried out a geometric evaluation combined with an evaluation of the dosimetric impact with these two types of contours. Despite the variations observed with the DICE index, the effect on the final delivered dose was limited. Despite the need to systematically validate these contours, this raises the issue of performing minor correction operations on a quality segmented contour.
      AS could be particularly useful for ART strategies. Indeed, during RT large anatomical variation may occur during the treatment. For target volumes, a GTV shrinkage is quantified as between 17 % and 93 % at mid-treatment [
      • Barker J.L.
      • Garden A.S.
      • Ang K.K.
      • O’Daniel J.C.
      • Wang H.
      • Court L.E.
      • et al.
      Quantification of volumetric and geometric changes occurring during fractionated radiotherapy for head-and-neck cancer using an integrated CT/linear accelerator system.
      ,
      • Nishi T.
      • Nishimura Y.
      • Shibata T.
      • Tamura M.
      • Nishigaito N.
      • Okumura M.
      Volume and dosimetric changes and initial clinical experience of a two-step adaptive intensity modulated radiation therapy (IMRT) scheme for head and neck cancer.
      ,
      • Marzi S.
      • Pinnarò P.
      • D’Alessio D.
      • Strigari L.
      • Bruzzaniti V.
      • Giordano C.
      • et al.
      Anatomical and Dose Changes of Gross Tumour Volume and Parotid Glands for Head and Neck Cancer Patients during Intensity-modulated Radiotherapy: Effect on the Probability of Xerostomia Incidence.
      ,
      • Vásquez Osorio E.M.
      • Hoogeman M.S.
      • Al-Mamgani A.
      • Teguh D.N.
      • Levendag P.C.
      • Heijmen B.J.M.
      Local anatomic changes in parotid and submandibular glands during radiotherapy for oropharynx cancer and correlation with dose, studied in detail with nonrigid registration.
      ,
      • Castadot P.
      • Geets X.
      • Lee J.A.
      • Christian N.
      • Grégoire V.
      Assessment by a deformable registration method of the volumetric and positional changes of target volumes and organs at risk in pharyngo-laryngeal tumors treated with concomitant chemo-radiation.
      ,
      • Bhide S.A.
      • Davies M.
      • Burke K.
      • McNair H.A.
      • Hansen V.
      • Barbachano Y.
      • et al.
      Weekly volume and dosimetric changes during chemoradiotherapy with intensity-modulated radiation therapy for head and neck cancer: a prospective observational study.
      ,
      • Duprez F.
      • De Neve W.
      • De Gersem W.
      • Coghe M.
      • Madani I.
      Adaptive dose painting by numbers for head-and-neck cancer.
      ,
      • Jensen A.D.
      • Nill S.
      • Huber P.E.
      • Bendl R.
      • Debus J.
      • Münter M.W.
      A clinical concept for interfractional adaptive radiation therapy in the treatment of head and neck cancer.
      ,
      • Hunter K.U.
      • Fernandes L.L.
      • Vineberg K.A.
      • McShan D.
      • Antonuk A.E.
      • Cornwall C.
      • et al.
      Parotid glands dose-effect relationships based on their actually delivered doses: implications for adaptive replanning in radiation therapy of head-and-neck cancer.
      ] and nearly half of the volume (from 21 % to 75 %) at the end of the treatment [
      • Height R.
      • Khoo V.
      • Lawford C.
      • Cox J.
      • Joon D.L.
      • Rolfo A.
      • et al.
      The dosimetric consequences of anatomic changes in head and neck radiotherapy patients.
      ,
      • Olteanu L.A.M.
      • Berwouts D.
      • Madani I.
      • De Gersem W.
      • Vercauteren T.
      • Duprez F.
      • et al.
      Comparative dosimetry of three-phase adaptive and non-adaptive dose-painting IMRT for head-and-neck cancer.
      ,
      • Orban de Xivry J.
      • Castadot P.
      • Janssens G.
      • Lee J.A.
      • Geets X.
      • Grégoire V.
      • et al.
      Evaluation of the radiobiological impact of anatomic modifications during radiation therapy for head and neck cancer: can we simply summate the dose? Radiother Oncol J Eur Soc Ther Radiol.
      ]. To avoid unexpected recurrence, it is necessary to adapt the GTV and the CTV based on anatomical barriers, and not on a geometrical approach.
      AS methods allow contouring target volumes such as GTV or Biological Target Volume (BTV) from the information contained in functional imaging (MRI or PET). Foster et al. [
      • Foster B.
      • Bagci U.
      • Mansoor A.
      • Xu Z.
      • Mollura D.J.
      A review on segmentation of positron emission tomography images.
      ] highlighted the technical difficulties of evaluation between different AS methods using PET images. Image segmentation specific features from functional information need standardisation to obtain robust data for acquisition and reconstruction particularly in the context of multi-centric studies.
      The quality assurance of a clinical trial includes a beanchmark to assess the contouring quality and is essential to evaluate accuracy and robustness of methods used. Performance levels should be required using indexes and their associated tolerances [

      Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

      ]. Mattiucci et al. consider, as an example, that a mean DICE index value of 0.8 is acceptable to qualify a benchmark [
      • Mattiucci G.C.
      • Boldrini L.
      • Chiloiro G.
      • D’Agostino G.R.
      • Chiesa S.
      • De Rose F.
      • et al.
      Automatic delineation for replanning in nasopharynx radiotherapy: What is the agreement among experts to be considered as benchmark?.
      ]. We recommend to define the metric tolerance threshold used for contour comparison from literature, data according to the volume (OAR, CTV, etc.) evaluated and inter- and intra-operator variability when available. It is also necessary to rely on the geometric parameters of the image (matrix size, slice thickness, etc.) for distance metrics. We therefore recommend to use complementary metrics for pre-clinical evaluation of segmentation such the DICE index associated to a distance metric (Hausdorff distance maximum or mean distance conformity) [
      • Jena R.
      • Kirkby N.F.
      • Burton K.E.
      • Hoole A.C.F.
      • Tan L.T.
      • Burnet N.G.
      A novel algorithm for the morphometric assessment of radiotherapy treatment planning volumes.
      ]. We do not recommend using only the DICE metric, it has limitations due to its definition (overlap between two structures) and it is not adapted for small structures. In the current context where it is still difficult to obtain an acceptable common quality, Cardenas et al. proposed to use a second independent AS software as a secondary check [
      • Cardenas C.E.
      • Yang J.
      • Anderson B.M.
      • Court L.E.
      • Brock K.B.
      Advances in Auto-Segmentation.
      ].
      Practical recommendations:
      • -
        For AS initial commissioning, a geometric and dosimetric evaluation of segmented contours in comparison with reference contours is recommended.
      • -
        For AS evaluation, a combination of several indexes, at least overlapping and distance evaluation metrics with complementary specificities, is required.
      • -
        Acceptability threshold of metrics must be defined in function of segmented volume (taking into account inter and intra operator variability, geometric image parameter, etc.).
      • -
        Benchmarking AS solution is required to assess contouring quality to know the algorithm performance.
      • -
        A systematic verification and human validation by a skilled operator of the segmented contours is necessary.
      • -
        For OARs and target volumes, standardisation of structure names and rigorous descriptions are required.
      • -
        To avoid unexpected recurrence, it is necessary to adapt the GTV and the CTV based on anatomical barriers, and not on a geometrical approach.

      4. Estimation of the delivered dose of the day

      4.1 Dose calculation with a TPS

      3D imaging (kV-CT, kV-CBCT, MV-CT, or MRI) acquired for repositioning can be used for dose calculation purposes. Thus, recalculating the initial plan on a daily 3D image makes it possible to quantify the dosimetric impact of significant changes in patient anatomy during the treatment course.
      Dose calculation from in-room kV-CT can be performed in the same way as dose calculation based on planning kV-CT.
      kV-CBCT-based dose calculation is a complex issue compared to kV-CT-dose calculation (the current reference practice) because of three main features: the imaging quality, the limited acquisition field-of-view (FOV) and the HU consistency. Currently, kV-CBCT images are still prone to artefacts, caused by the lateral scatter, although some of them can be improved by more advanced scatter correction such as iterative reconstruction algorithms [
      • Washio H.
      • Ohira S.
      • Funama Y.
      • Morimoto M.
      • Wada K.
      • Yagi M.
      • et al.
      Metal artifact reduction using iterative CBCT reconstruction algorithm for head and neck radiation therapy: A phantom and clinical study.
      ]. Moreover, limited FOV sizes can lead to an incomplete acquisition of body contours which may be problematic for target volumes (nodes) or shoulders shape required for dose calculation. The major issue in kV-CBCT-based dose calculation is the HU consistency. Indeed, kV-CBCT HU can vary according to several parameters [
      • Barateau A.
      • Garlopeau C.
      • Cugny A.
      • De Figueiredo B.H.
      • Dupin C.
      • Caron J.
      • et al.
      Dose calculation accuracy of different image value to density tables for cone-beam CT planning in head & neck and pelvic localizations.
      ]. Several methods to perform kV-CBCT dose calculation have been proposed in the literature [
      • Barateau A.
      • Garlopeau C.
      • Cugny A.
      • De Figueiredo B.H.
      • Dupin C.
      • Caron J.
      • et al.
      Dose calculation accuracy of different image value to density tables for cone-beam CT planning in head & neck and pelvic localizations.
      ,
      • Giacometti V.
      • Hounsell A.R.
      • McGarry C.K.
      A review of dose calculation approaches with cone beam CT in photon and proton therapy.
      ]: (a) calibration curve between HU and electron or mass densities (HU-D curve), (b) density assignment method (DAM) (c) DIR between kV-CT and kV-CBCT and (d) machine learning to generate a pseudo-CT (pCT).
      (a) The HU-density curve established from a kV-CBCT image can be used to convert CBCT HUs to densities for dose calculation. This curve can be defined with either an “adapted” phantom (according to anatomical localisation) or patient kV-CBCT images. Although these methods are straightforward, they are sensitive to kV-CBCT artifacts and patient scattering. (b) The density assignment method (also known as the bulk density method) involves segmenting an image into two to six tissue classes (e.g., soft tissues, air and bones) before assigning density to each class. Nevertheless, this method depends on structure segmentation and provides an image with homogeneous tissues. (c) By deforming kV-CT to kV-CBCT, a “deformed” CT is generated and can be used for dose calculation. CT-CBCT DIR can be difficult due to intrinsic kV-CBCT limitations, such as noise, low contrast, and reduced FOV. However, in ART workflow, patient position is maintained and anatomical changes are typically small, which is favorable for DIR process. (d) Machine learning methods are based on patches or DL methods (DLMs), to generate a pCT (i.e. synthetic images) from kV-CBCT. Machine learning methods require a large training cohort and most of these methods require coregistered data for the training step. Some studies proposed to compare several methods for H&N CBCT-based dose calculation. Giacometti et al. compare HU-D curve, DAM and DIR method for H&N VMAT plans [
      • Giacometti V.
      • King R.B.
      • Agnew C.E.
      • Irvine D.M.
      • Jain S.
      • Hounsell A.R.
      • et al.
      An evaluation of techniques for dose calculation on cone beam computed tomography.
      ]. In this study, the DIR method provides the best agreement considering the relative dose difference between kV-CBCT and kV-CT doses delivered to 99% (D99%), 95% (D95%) and 1% (D1%) of the tumor and nodal PTV. Maximal dose differences of 3.9%, 3.2% and 2.7% for HU-D curve, DAM and DIR method respectively, were obtained for D99% of nodal PTV [
      • Giacometti V.
      • King R.B.
      • Agnew C.E.
      • Irvine D.M.
      • Jain S.
      • Hounsell A.R.
      • et al.
      An evaluation of techniques for dose calculation on cone beam computed tomography.
      ]. Barateau et al. compare the three previous methods with a deep learning method (DLM) for H&N RT [
      • Barateau A.
      • De Crevoisier R.
      • Largent A.
      • Mylona E.
      • Perichon N.
      • Castelli J.
      • et al.
      Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning.
      ]. The mean 3D gamma pass rate (local, 2%/2 mm, 30% dose threshold) was 91.0 ± 5.3%, 97.9 ± 1.6%, 98.8 ± 0.7% and 98.1 ± 1.2% for HU-D curve, DAM, DIR and DLM respectively. They conclude that for H&N RT, DIR and DLM appear to be the most attractive methods in terms of dose accuracy as well as calculation time [
      • Barateau A.
      • De Crevoisier R.
      • Largent A.
      • Mylona E.
      • Perichon N.
      • Castelli J.
      • et al.
      Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning.
      ].
      The MV-CT dose calculation can be performed with a specific curve calibration. Compared to kV-CBCT, MV-CT has the advantage of being independent of the patient's corpulence thanks to the collimation. Stability of calibration curve over time depends on linac target [
      • Thomas S.J.
      • Romanchikova M.
      • Harrison K.
      • Parker M.A.
      • Bates A.M.
      • Scaife J.E.
      • et al.
      Recalculation of dose for each fraction of treatment on TomoTherapy.
      ,

      Yadav P, Ramasubramanian V, Paliwal B. Feasibility study on effect and stability of adaptive radiotherapy on kilovoltage cone beam CT. Radiol Oncol 2011;45. https://doi.org/10.2478/v10019-011-0024-5.

      ]. Zhu et al. showed the impact of the acquisition and reconstruction parameters on dose calculation [
      • Zhu J.
      • Bai T.
      • Gu J.
      • Sun Z.
      • Wei Y.
      • Li B.
      • et al.
      Effects of megavoltage computed tomographic scan methodology on setup verification and adaptive dose calculation in helical TomoTherapy.
      ]. Monthly monitoring of the calibration is recommended as well as after any modification of the target or beam [
      • Langen K.M.
      • Meeks S.L.
      • Poole D.O.
      • Wagner T.H.
      • Willoughby T.R.
      • Kupelian P.A.
      • et al.
      The use of megavoltage CT (MVCT) images for dose recomputations.
      ,
      • Duchateau M.
      • Tournel K.
      • Verellen D.
      • de Vondel I.V.
      • Reynders T.
      • Linthout N.
      • et al.
      The effect of tomotherapy imaging beam output instabilities on dose calculation.
      ,
      • Crop F.
      • Bernard A.
      • Reynaert N.
      Improving dose calculations on tomotherapy MVCT images.
      ]. The dose can be recalculated with an accuracy of about ±2.5% for H&N with a HU-ED curve [
      • Pukala J.
      • Meeks S.L.
      • Bova F.J.
      • Langen K.M.
      The effect of temporal HU variations on the uncertainty of dose recalculations performed on MVCT images.
      ]. Other methods such as DIR (between kV-CT and MV-CT) [
      • Branchini M.
      • Fiorino C.
      • Dell’Oca I.
      • Belli M.L.
      • Perna L.
      • Di Muzio N.
      • et al.
      Validation of a method for “dose of the day” calculation in head-neck tomotherapy by using planning ct-to-MVCT deformable image registration.
      ] or DLM have been proposed [
      • Chen X.
      • Yang B.
      • Li J.
      • Zhu J.
      • Ma X.
      • Chen D.
      • et al.
      A deep-learning method for generating synthetic kV-CT and improving tumor segmentation for helical tomotherapy of nasopharyngeal carcinoma.
      ]. MV-CT images have some artefacts, called zipper artefacts, due to the isocenter misalignment, but their dosimetric impact was found insignificant [
      • Geng H.
      • Yu S.-K.
      • Lam W.-W.
      • Wong W.-K.-R.
      • Ho Y.-W.
      • Liu S.-F.
      The Dosimetric Effect of Zipper Artifacts on TomoTherapy Adaptive Dose Calculation—A Phantom Study.
      ]. Moreover, due to high energy, metal artefacts are considerably reduced compared to kV-CT or kV-CBCT. This represents a major advantage in case of dental or orthopaedic implants for patient positioning and dose of the day calculation [
      • Sterzing F.
      • Kalz J.
      • Sroka-Perez G.
      • Schubert K.
      • Bischof M.
      • Röder F.
      • et al.
      Megavoltage CT in Helical Tomotherapy — Clinical Advantages and Limitations of Special Physical Characteristics.
      ]. MV-CT should be preferred in such cases.
      The main limitations of MV-CT imaging are the poor contrast due to high energy and the restricted FOV size. With such imaging modality, parotid glands are not visible [
      • Lee C.
      • Langen K.M.
      • Lu W.
      • Haimerl J.
      • Schnarr E.
      • Ruchala K.J.
      • et al.
      Assessment of Parotid Gland Dose Changes During Head and Neck Cancer Radiotherapy Using Daily Megavoltage Computed Tomography and Deformable Image Registration.
      ]. These images can be used to assess the dosimetric impact of significant weight loss or target volume reduction. A study evaluated the impact of weight loss and anatomical change during H&N RT, measuring differences between planned and delivered dose to spinal cord based on MV-CT images [
      • Noble D.J.
      • Yeap P.-L.
      • Seah S.Y.K.
      • Harrison K.
      • Shelley L.E.A.
      • Romanchikova M.
      • et al.
      Anatomical change during radiotherapy for head and neck cancer, and its effect on delivered dose to the spinal cord.
      ]. They obtain for 133 H&N patients a slight impact on the dose delivered to the spinal cord, with an absolute dose difference of 0.9 Gy (95% CI 0.76 to 1.04 Gy) [
      • Noble D.J.
      • Yeap P.-L.
      • Seah S.Y.K.
      • Harrison K.
      • Shelley L.E.A.
      • Romanchikova M.
      • et al.
      Anatomical change during radiotherapy for head and neck cancer, and its effect on delivered dose to the spinal cord.
      ]. This study shows the feasibility to use daily MV-CT images for dose calculation and indicates that the spinal cord is not the critical organ to consider for H&N ART approach.
      MRI could be used instead of kV-CT for replanning. MRI replanning can be performed with an independent MRI-only workflow or using MR-linac. The main issue of MRI (re)-planning is the lack of electron or mass density information, necessary for dose calculation. To overcome this issue, various methods were developed to generate Synthetic Computed Tomography images from MRI [
      • Johnstone E.
      • Wyatt J.J.
      • Henry A.M.
      • Short S.C.
      • Sebag-Montefiore D.
      • Murray L.
      • et al.
      Systematic Review of Synthetic Computed Tomography Generation Methodologies for Use in Magnetic Resonance Imaging-Only Radiation Therapy.
      ]. For MRI-based dose calculation, recent DLMs provided dose uncertainties lower than 2% compared with the dose calculated on the corresponding kV-CT [
      • Spadea M.F.
      • Maspero M.
      • Zaffino P.
      • Seco J.
      Deep learning based synthetic-CT generation in radiotherapy and PET: A review.
      ,
      • Wang H.
      • Du K.
      • Qu J.
      • Chandarana H.
      • Das I.J.
      Dosimetric evaluation of magnetic resonance-generated synthetic CT for radiation treatment of rectal cancer.
      ,
      • Boulanger M.
      • Nunes J.-C.
      • Chourak H.
      • Largent A.
      • Tahri S.
      • Acosta O.
      • et al.
      Deep learning methods to generate synthetic CT from MRI in radiotherapy: A literature review.
      ].
      Some commercial softwares allow calculation of “dose of the day” with the previously mentioned method [
      • Dunlop A.
      • McQuaid D.
      • Nill S.
      • Murray J.
      • Poludniowski G.
      • Hansen V.N.
      • et al.
      Comparison of CT number calibration techniques for CBCT-based dose calculation.
      ,

      Kainz K. PreciseART® ADAPTIVE RADIATION THERAPY SOFTWARE: n.d.:18.

      ,
      • Tyagi N.
      • Fontenla S.
      • Zhang J.
      • Cloutier M.
      • Kadbi M.
      • Mechalakos J.
      • et al.
      Dosimetric and workflow evaluation of first commercial synthetic CT software for clinical use in pelvis.
      ,
      • Gonzalez-Moya A.
      • Dufreneix S.
      • Ouyessad N.
      • Guillerminet C.
      • Autret D.
      Evaluation of a commercial synthetic computed tomography generation solution for magnetic resonance imaging-only radiotherapy.
      ,
      • Hoegen P.
      • Lang C.
      • Akbaba S.
      • Häring P.
      • Splinter M.
      • Miltner A.
      • et al.
      Cone-Beam-CT Guided Adaptive Radiotherapy for Locally Advanced Non-small Cell Lung Cancer Enables Quality Assurance and Superior Sparing of Healthy Lung.
      ]. All these methods provided an estimation of the delivered dose, they are subject to uncertainties and have to be cautiously used. A validation process, based on dose comparison for phantoms and patients, on in-room and CT images, must be performed considering each in-room imaging system, and each image protocol used for the estimation of the “dose of the day”.

      4.2 Portal dosimetry and other tools

      Among in vivo dosimetry detectors, some EPID softwares offer the possibility to reconstruct 2D or 3D delivered dose distribution [
      • Schopfer M.
      • Bochud F.O.
      • Bourhis J.
      • Moeckli R.
      In air and in vivo measurement of the leaf open time in tomotherapy using the on-board detector pulse-by-pulse data.
      ]. Indeed, portal dosimetry uses MV treatment image of the day acquired beyond patient, to reconstruct associated delivered dose. Generally, dose is computed on kV-CT images, but could be reconstructed on MV-CT or kV-CBCT taking into account anatomy of the day, patient setup and LINAC dose delivery [
      • Rozendaal R.A.
      • Mijnheer B.J.
      • Hamming-Vrieze O.
      • Mans A.
      • van Herk M.
      Impact of daily anatomical changes on EPID-based in vivo dosimetry of VMAT treatments of head-and-neck cancer.
      ]. Tools such as gamma index, profiles, dose difference are available in commercial software to compare initial planning dose and reconstructed delivered dose in 2D or 3D. In vivo portal dosimetry could be a great tool to flag patients who need ART during treatment [
      • Lim S.B.
      • Tsai C.J.
      • Yu Y.
      • Greer P.
      • Fuangrod T.
      • Hwang K.
      • et al.
      Investigation of a Novel Decision Support Metric for Head and Neck Adaptive Radiation Therapy Using a Real-Time In Vivo Portal Dosimetry System.
      ]. Indeed, portal dosimetry allows detection of calculation, delivery, or patient setup errors. Several commercial software are available, such as EPIgray (DOSIsoft) [
      • Ricketts K.
      • Navarro C.
      • Lane K.
      • Blowfield C.
      • Cotten G.
      • Tomala D.
      • et al.
      Clinical Experience and Evaluation of Patient Treatment Verification With a Transit Dosimeter.
      ], DosimetryCheck (MathResolutions) [
      • Nailon W.H.
      • Welsh D.
      • McDonald K.
      • Burns D.
      • Forsyth J.
      • Cooke G.
      • et al.
      EPID-based in vivo dosimetry using Dosimetry CheckTM: Overview and clinical experience in a 5-yr study including breast, lung, prostate, and head and neck cancer patients.
      ], PerFraction (SunNuclear) [
      • Olch A.J.
      • O’Meara K.
      • Wong K.K.
      First Report of the Clinical Use of a Commercial Automated System for Daily Patient QA Using EPID Exit Images.
      ], Adaptivo (Standard Imaging) [
      • Bojechko C.
      • Phillps M.
      • Kalet A.
      • Ford E.C.
      A quantification of the effectiveness of EPID dosimetry and software-based plan verification systems in detecting incidents in radiotherapy.
      ], etc. Feasibility for Tomotherapy [
      • Schopfer M.
      • Bochud F.O.
      • Bourhis J.
      • Moeckli R.
      In air and in vivo measurement of the leaf open time in tomotherapy using the on-board detector pulse-by-pulse data.
      ] and MR-linac of in vivo portal dosimetry has been proven and should be used for a dose verification in online ART workflow [
      • Torres-Xirau I.
      • Olaciregui-Ruiz I.
      • Kaas J.
      • Nowee M.E.
      • van der Heide U.A.
      • Mans A.
      3D dosimetric verification of unity MR-linac treatments by portal dosimetry.
      ]. In vivo portal dosimetry used to detect anatomy variations need definition of thresholds to analyse results. Initially, EPID were not designed for dosimetry but for patient setup and MLC field verification. Several corrections are needed to convert pixel value in dose. This led to several uncertainties about the delivered dose. Consequently, portal dosimetry results need to be correlated with a setup image medical analysis.
      Other commercial tools proposed to retrieve machine log files or fluence between the gantry head and the patient (Mobius (Varian, USA), or Discovery (Scandidos, Sweden), …). However, such tools do not take into account patient anatomy. All these solutions need to be commissioned and quality controls need to be periodically performed to assess accuracy of material (HU stability, EPID stability, calibration, …).
      Practical recommendations:
      • -
        For dose calculation purpose, kV-CT and MV-CT in-room images require a specific HU-density curve while kV-CBCT and MRI images require more sophisticated methods (DIR and DLM) to overcome technical limitations.
      • -
        In-room images require periodic control to ensure their stability.
      • -
        A validation process, based on dose comparison for phantoms and patients, on in-room and CT images, must be performed considering each in-room imaging system, and each image protocol used.
      • -
        Create a dedicated IG-ART protocol for a specific ART evaluation is recommended.
      • -
        Portal dosimetry could help to compute the dose of the day but limitations of such algorithms have uncertainties and have to be evaluated before clinical use.

      5. Dose monitoring (dose accumulation)

      Dose monitoring can be used to trigger a replanning, to replan taking into account the dose previously delivered, or to estimate the delivered dose. Dose monitoring can be performed with dose accumulation of each “dose of the day”. Commercial solutions (integrated in TPS or not) are now available to perform dose accumulation during or after the treatment course.
      Dose distributions need to be in the same space to be added. In a first approximation RIRs between images of the day and planning image can be performed, and the dose distributions corresponding to each image can be added. This method does not take into account the deformation, that is why dose warping is needed before the dose accumulation. However, deformed dose is not measurable and dose received by cells in case of tissue appearance or disappearance is still an unresolved problem.
      The propagation of large deformation errors leads to large dosimetric errors. The result of the deformation and dose accumulation is subjected to several influence parameters: image quality, parameters related to DIR methods, amplitude and type of deformation, dose matrix (voxel size, dose gradient) [
      • Paganelli C.
      • Meschini G.
      • Molinelli S.
      • Riboldi M.
      • Baroni G.
      Patient-specific validation of deformable image registration in radiation therapy: Overview and caveats.
      ]. Veiga et al. evaluated several DIR algorithms from a daily dose calculation perspective on kV-CBCT images: 9% (SD = 4%) of the voxels differed by more than 2% from the prescribed dose [
      • Veiga C.
      • McClelland J.
      • Moinuddin S.
      • Lourenço A.
      • Ricketts K.
      • Annkah J.
      • et al.
      Toward adaptive radiotherapy for head and neck patients: Feasibility study on using CT-to-CBCT deformable registration for “dose of the day” calculations: CT-to-CBCT deformable registration for dose calculations.
      ]. In high gradient regions this value increased to 21% (SD = 6%) and in regions with poor image quality to 28% (SD = 9%). Qin et al. highlighted the need for biomechanical module for large deformations and high gradients [
      • Qin A.
      • Liang J.
      • Han X.
      • O’Connell N.
      • Yan D.
      Technical Note: The impact of deformable image registration methods on dose warping.
      ]. Rigaud et al. evaluated several DIR methods and found that uncertainty on cumulative parotid mean dose was 4 Gy on average (SD = 2.27 Gy) for a prescription dose of 70 Gy (2 Gy per fraction) [
      • Rigaud B.
      • Simon A.
      • Castelli J.
      • Gobeli M.
      • Ospina Arango J.-D.
      • Cazoulat G.
      • et al.
      Evaluation of Deformable Image Registration Methods for Dose Monitoring in Head and Neck Radiotherapy.
      ]. Pukala et al. evaluated five commercial products and pointed out that the effects of registration errors on a dose volume histogram (DVH) are not easily predicted. In fact, the amplitude and direction of structure registration errors, dose gradient and distance from structures influence the quality of the dose deformation on the structures [
      • Pukala J.
      • Johnson P.B.
      • Shah A.P.
      • Langen K.M.
      • Bova F.J.
      • Staton R.J.
      • et al.
      Benchmarking of five commercial deformable image registration algorithms for head and neck patients.
      ]. Glide-Hurst et al. recommended a dosimetric accuracy of ±5% on the entire ART workflow (DIR, segmentation, dose calculation, and dose accumulation) [
      • Yan D.
      Adaptive Radiotherapy: Merging Principle Into Clinical Practice.
      ,
      • Glide-Hurst C.K.
      • Lee P.
      • Yock A.D.
      • Olsen J.R.
      • Cao M.
      • Siddiqui F.
      • et al.
      Adaptive Radiation Therapy (ART) Strategies and Technical Considerations: A State of the ART Review From NRG Oncology.
      ]. They emphasized being cautious with dose warping and dose accumulation when applying ART to decision-making.
      Practical recommendations:
      • -
        Evaluation of RIR and DIR performance (part 1) is recommended in order to know algorithm behaviour in homogeneous and heterogeneous medium, and provide an order of magnitude for dose uncertainties.
      • -
        Be aware of uncertainties due to registrations and dose warping.
      • -
        It is recommended to perform localised registrations for dose accumulation in case of specific area of interest (dose to spinal cord for example).
      • -
        To trigger replanning, approximations can be done by accumulating weekly doses instead of daily doses.

      6. ART workflows

      Several ART strategies were described in publications as offline, online, hybrid or in real-time [
      • Glide-Hurst C.K.
      • Lee P.
      • Yock A.D.
      • Olsen J.R.
      • Cao M.
      • Siddiqui F.
      • et al.
      Adaptive Radiation Therapy (ART) Strategies and Technical Considerations: A State of the ART Review From NRG Oncology.
      ]. In H&N RT treatment, offline and online ART can be employed. Whereas replanning process in online ART implies the use of in-room 3D-image, the process in offline ART is based on new image acquisition (the standard being a new CT planning) during treatment. The delineation of tumor(s) and OAR(s) is needed on this image (Part 2). As the prescribed dose was partially delivered, this dose contribution can be taken into account and is called “background dose”. With this background dose, an estimation of the total delivered dose can be performed. The background dose must be cautiously used for ART since it is based on dose warping which has uncertainties and limitations (part 4). As anatomical changes are a gradual process during H&N RT treatment, at least weekly 3D in-room imaging is recommended to determine if an ART procedure is necessary [
      • Grégoire V.
      • Boisbouvier S.
      • Giraud P.
      • Maingon P.
      • Pointreau Y.
      • Vieillevigne L.
      Management and work-up procedures of patients with head and neck malignancies treated by radiation.
      ,
      • Kearney M.
      • Coffey M.
      • Leong A.
      A review of Image Guided Radiation Therapy in head and neck cancer from 2009–201 – Best Practice Recommendations for RTTs in the Clinic.
      ].

      6.1 Offline ART workflow

      Fig. 1 presents a typical offline H&N ART workflow.
      Figure thumbnail gr1
      Fig. 1Offline H&N adaptive radiotherapy (ART) workflow.
      The first step is to define a criteria that can be used to trigger a replanning. They can be visual based daily image analysis (weight loss, parotid glands position and volume decrease or tumor shrinkage, positioning issue, etc.) or quantitative (PET, estimation of the daily delivered dose, …). There is no consensus on these criteria [
      • Brouwer C.L.
      • Steenbakkers R.J.H.M.
      • Langendijk J.A.
      • Sijtsema N.M.
      Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?.
      ,
      • Pukala J.
      • Johnson P.B.
      • Shah A.P.
      • Langen K.M.
      • Bova F.J.
      • Staton R.J.
      • et al.
      Benchmarking of five commercial deformable image registration algorithms for head and neck patients.
      ]. A recent review gathers studies on this topic [

      Avgousti R, Antypas C, Armpilia C, Simopoulou F, Liakouli Z, Karaiskos P, et al. Adaptive radiation therapy: When, how and what are the benefits that literature provides? Cancer Radiother J Soc Francaise Radiother Oncol 2021:S1278-3218(21)00264-X. https://doi.org/10.1016/j.canrad.2021.08.023.

      ]. Decision criteria is a real issue and could be simple or complex: Richter et al. include patients in a highly automated workflow with the observation of anatomical changes on kV-CBCT during treatment as a decision criterion [
      • Richter A.
      • Weick S.
      • Krieger T.
      • Exner F.
      • Kellner S.
      • Polat B.
      • et al.
      Evaluation of a software module for adaptive treatment planning and re-irradiation.
      ]. Li et al. propose a complex method using functional imaging and kV-CBCT, combined with radiomic and genomic analyses, to identify the directions of escalation or de-intensification of treatment [
      • Li Y.Q.
      • Tan J.S.H.
      • Wee J.T.S.
      • Chua M.L.K.
      Adaptive radiotherapy for head and neck cancers: Fact or fallacy to improve therapeutic ratio?.
      ]. Castelli et al. have established a nomogram to identify, from the first week, patients likely to have a significant dose increase in the parotid glands [
      • Castelli J.
      • Simon A.
      • Rigaud B.
      • Lafond C.
      • Chajon E.
      • Ospina J.D.
      • et al.
      A Nomogram to predict parotid gland overdose in head and neck IMRT.
      ]. Grepl et al. evaluated the dosimetric benefit to adapt dosimetry based on weekly MR images to reduce dysphagia for patients treated by chemo-RT [
      • Grepl J.
      • Sirak I.
      • Vosmik M.
      • Pohankova D.
      • Hodek M.
      • Paluska P.
      • et al.
      MRI-based adaptive radiotherapy has the potential to reduce dysphagia in patients with head and neck cancer.
      ]. The legitimate fear of over-irradiation of the spinal cord tends to be a criterion for the implementation of ART; however, Noble et al. analysed that anatomical changes during treatment do not lead to a risk of spinal cord complications [
      • Noble D.J.
      • Yeap P.-L.
      • Seah S.Y.K.
      • Harrison K.
      • Shelley L.E.A.
      • Romanchikova M.
      • et al.
      Anatomical change during radiotherapy for head and neck cancer, and its effect on delivered dose to the spinal cord.
      ]. In vivo portal dosimetry can help to detect anatomical and/or dosimetric modifications during treatment course [
      • Piron O.
      • Varfalvy N.
      • Archambault L.
      Establishing action threshold for change in patient anatomy using EPID gamma analysis and PTV coverage for head and neck radiotherapy treatment.
      ]. All these elements of analysis have different relevance and effectiveness. Brouwer et al. explored the literature to identify selection criteria and concluded that there was a lack of data quality and the need for further investigation to establish relationships with clinical outcomes [
      • Brouwer C.L.
      • Steenbakkers R.J.H.M.
      • Langendijk J.A.
      • Sijtsema N.M.
      Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?.
      ]. Thus, there is currently no solid data on the criteria for choosing a re-planning.
      Available data show a strong impact of early replanning (1st or 2nd week of treatment) [
      • Zhong H.
      • Adams J.
      • Glide-Hurst C.
      • Zhang H.
      • Li H.
      • Chetty I.J.
      Development of a deformable dosimetric phantom to verify dose accumulation algorithms for adaptive radiotherapy.
      ,
      • Castelli J.
      • Simon A.
      • Louvel G.
      • Henry O.
      • Chajon E.
      • Nassef M.
      • et al.
      Impact of head and neck cancer adaptive radiotherapy to spare the parotid glands and decrease the risk of xerostomia.
      ]. In H&N cancer, anatomic variations appear progressively over the first week of treatment and continue throughout the full treatment. Early replanning allows to correct these variations for a higher number of fractions compared to a later replanning (4 or 5th weeks of treatment). Hence, due to the progressive nature of these anatomic variations, off-line ART seems useful, limiting the risk of variability linked to daily replanning and this despite the lack of current automation of replanning tools at the moment.
      Furthermore, different studies have shown that the use of robust optimization (RO) instead of conventional treatment planning could be a way to avoid or minimise re-planning during the treatment course while better sparing the OARs. The principle of RO has been widely described elsewhere [
      • Unkelbach J.
      • Paganetti H.
      Robust Proton Treatment Planning: Physical and Biological Optimization.
      ]. In RO, the optimization constraints are applied on the CTV, while the treatment uncertainties are directly incorporated in the objective function of the optimization algorithm. In H&N cancer, several studies have shown that RO led to improved target coverage and reduced dose to the OARs compared to conventional VMAT using PTV strategy. Thus Wagenaar et al. showed on a cohort of 10 patients with various H&N tumor localisations treated in VMAT, that RO resulted in a significantly more important D98% to the CTV but significantly lower dose to the main OARs than PTV-based planning [
      • Wagenaar D.
      • Kierkels R.G.J.
      • Free J.
      • Langendijk J.A.
      • Both S.
      • Korevaar E.W.
      Composite minimax robust optimization of VMAT improves target coverage and reduces non-target dose in head and neck cancer patients.
      ]. Miura et al. performed similar work on patients with larynx cancer treated and reached the same conclusions. They also observed that to perturb the nominal dose distributions conducted to less important dose variations to the CTV and OARs using RO [
      • Miura H.
      • Doi Y.
      • Ozawa S.
      • Nakao M.
      • Ohnishi K.
      • Kenjo M.
      • et al.
      Volumetric modulated arc therapy with robust optimization for larynx cancer.
      ]. In an original way, Cubillos-Mesias et al. found that to include the first 2 weekly kV-CBCTs in the RO process of intensity modulated proton therapy planning enabled to better take into account anatomical changes than conventional RO or PTV-based strategy [
      • Cubillos-Mesías M.
      • Troost E.G.C.
      • Lohaus F.
      • Agolli L.
      • Rehm M.
      • Richter C.
      • et al.
      Including anatomical variations in robust optimization for head and neck proton therapy can reduce the need of adaptation.
      ]. They thus showed that PTV-based and RO approaches were not sufficient to take into account anatomical changes in 10 and 5 out of 20 patients, respectively, resulting in the need for plan adaptation. Conversely, using anatomical RO, in all except one patient the CTV coverage was conserved and no adaptation was required. Hence, RO has the potential to provide treatment plans that are more robust to anatomical changes than PTV-based planning. Finally, both planning strategies showed improved plan robustness when considering the anatomy of the two first weeks of treatment.

      6.2 Online ART workflow

      Currently, in most cases, the adaptation during the H&N RT course is carried out offline. However, adaptation software are now commercially available to perform an “online” adaptive replanning [
      • Piron O.
      • Varfalvy N.
      • Archambault L.
      Establishing action threshold for change in patient anatomy using EPID gamma analysis and PTV coverage for head and neck radiotherapy treatment.
      ,
      • Lim-Reinders S.
      • Keller B.M.
      • Al-Ward S.
      • Sahgal A.
      • Kim A.
      Online Adaptive Radiation Therapy.
      ]. This software benefits from specific developments with automatic or semi-automatic solutions. Commercial online solutions (kV-CBCT-based [
      • Archambaud
      • et al.
      Making on-line adaptive radiotherapy possible using artificial intelligence and machine learning for efficient daily re-planning.
      ], MR-based [
      • Hall W.A.
      • Paulson E.
      • Li X.A.
      • Erickson B.
      • Schultz C.
      • Tree A.
      • et al.
      Magnetic resonance linear accelerator technology and adaptive radiation therapy: An overview for clinicians.
      ]) offer automated tools for assessment, and replanning (if necessary or pre-determined) to have a fraction as short as possible for the patient (on the treatment couch during the plan adaptation). These processes can be interesting not necessarily for a systematic daily replanning, but when needed (or weekly for example) during the treatment course when one (or more) replanning decision criteria are met. This workflow is still being evaluated and is the subject of clinical trials (NCT05666193, NCT03972072 (MARTHA-Trial)). Systematic daily ART may not be required in H&N cancer. Indeed, the labour cost of this approach seems to be unfavourable. This opinion is to be qualified for moderate or extreme hypofractionated treatments [
      • Piras A.
      • Boldrini L.
      • Menna S.
      • Venuti V.
      • Pernice G.
      • Franzese C.
      • et al.
      Hypofractionated Radiotherapy in Head and Neck Cancer Elderly Patients: A Feasibility and Safety Systematic Review for the Clinician.
      ], because that potentially reduces the work on the whole treatment. This concept remains to be evaluated.
      An online kV-CBCT-based system mounted with a ring linear accelerator is currently available to implement an automated online ART workflow with the patient on the treatment couch. This platform offers the possibility to treat in a standard way (with daily kV-CBCT) and also to access to dose accumulation on initial kV-CT after every session for follow-up. Another opportunity to treat with this kV-CBCT-based system is to adapt online dosimetry to new anatomy in an integrated way. A timing and automation study is carried out by Yoon et al [
      • Yoon S.W.
      • Lin H.
      • Alonso-Basanta M.
      • Anderson N.
      • Apinorasethkul O.
      • Cooper K.
      • et al.
      Initial Evaluation of a Novel Cone-Beam CT-Based Semi-Automated Online Adaptive Radiotherapy System for Head and Neck Cancer Treatment - A Timing and Automation Quality Study.
      ] with online ART workflow with an “in silico” study, median time session is around 19 min and provides preliminary data on the possibility of carrying out these treatments.
      Recent MRI guided linear accelerator (MR-linac) devices allow MR acquisition before each treatment delivery. These images can be used to perform dose monitoring or replanning in a context of MR-guided H&N ART [
      • Otazo R.
      • Lambin P.
      • Pignol J.-P.
      • Ladd M.E.
      • Schlemmer H.-P.
      • Baumann M.
      • et al.
      MRI-guided Radiation Therapy: An Emerging Paradigm in Adaptive Radiation Oncology.
      ,
      • McDonald B.A.
      • Zachiu C.
      • Christodouleas J.
      • Naser M.A.
      • Ruschin M.
      • Sonke J.-J.
      • et al.
      Dose accumulation for MR-guided adaptive radiotherapy: From practical considerations to state-of-the-art clinical implementation.
      ]. For now, H&N localization is not the main tumor localization for MR-guided RT but some clinical trials are ongoing [
      • Boeke S.
      • Mönnich D.
      • van Timmeren J.E.
      • Balermpas P.
      MR-Guided Radiotherapy for Head and Neck Cancer: Current Developments, Perspectives, and Challenges.
      ]. As presented in Fig. 2, workflows should be adapted for MRI linac online H&N ART.
      Figure thumbnail gr2
      Fig. 2MRI online H&N adaptive radiotherapy (ART) workflow.
      Chen et al. reported their initial clinical experience with a 0.35 T MR-linac machine for 18 H&N patients and proved that MR-guided RT can achieve clinical outcomes comparable to those traditional IMRT for H&N cancer [
      • Chen A.M.
      • Hsu S.
      • Lamb J.
      • Yang Y.
      • Agazaryan N.
      • Steinberg M.L.
      • et al.
      MRI-guided radiotherapy for head and neck cancer: initial clinical experience.
      ]. Lim et al. compared planned and delivered doses after an adaptation to position workflow (“adapt to position” = shift of isocenter and MLC based on daily MR scan) for 8 H&N patients with a 1.5 T Elekta MR-linac device [
      • Lim S.Y.
      • Tran A.
      • Tran A.N.K.
      • Sobremonte A.
      • Fuller C.D.
      • Simmons L.
      • et al.
      Dose accumulation of daily adaptive plans to decide optimal plan adaptation strategy for head-and-neck patients treated with MR-Linac.
      ]. They found that the delivered dose to some OARs was significantly higher than original planned dose, suggesting that an adaptation to shape process (“adapt to shape” = full plan reoptimization based on re-contoured daily MR scan) should be used in some specific H&N cases.
      Mc Donald et al. described their institution workflow for a H&N treatment with 1.5 T MR-linac and demonstrated the treatment feasibility for 10H&N cases [
      • McDonald B.A.
      • Vedam S.
      • Yang J.
      • Wang J.
      • Castillo P.
      • Lee B.
      • et al.
      Initial Feasibility and Clinical Implementation of Daily MR-Guided Adaptive Head and Neck Cancer Radiation Therapy on a 1.5T MR-Linac System: Prospective R-IDEAL 2a/2b Systematic Clinical Evaluation of Technical Innovation.
      ]. A T2-weighted MRI was acquired for daily setup verification and also used for plan adaptation. Registration was done between MRI of the day and reference image. They choose a 5 mm isocenter shift as criteria to choose between “adapt to position” (shift < 5 mm) or “adapt to shape” (shift ≥ 5 mm) process. In this study, for efficiency reasons, “adapt to position” workflow was performed offline (to create a new reference plan). In case of “adapt to position” online workflow, MLC position was adapted to be consistent with reference plan in terms of dosimetry criterions (PTV coverage and OAR constraints).

      6.3 Workflow organization

      A specific ART H&N workflow should be defined and validated in each institution, including method, imaging frequency, decision criteria and professionals concerned (RTTs, physicians, medical physicist, etc.). The number of replanning and selection criteria must therefore be clearly defined before any ART approach is taken. Participant roles should be well defined for all long treatment steps as all treatment phases (delineation, treatment planning, validation, quality control) should be realised in a reasonable time. Some steps could be automated (delineation, adaptation of treatment plan, etc.) permitting a new planification in a shorter period. Expertise in the assessment tools and those used for ART is essential. Regardless of the strategy required, automation is recommended in particular for recontouring and dosimetry, with systematic human validation and corrections (when necessary) for delineation. Tools such as DIR, automatic image segmentation, and expert planning software can help to reduce both operator variability and human time requirement and can significantly reduce ART process.
      In particular, the use of auto-planning solutions could help to achieve these objectives, the ultimate goal being efficient generation of high-quality plans. Among the solutions are the automated rule implementation and reasoning (ARIR), a posteriori and a priori multicriteria optimization (MCO) and knowledge-based planning (KBP), which can be divided in two additional categories: statistical modeling of case/atlas-based, and machine learning methods (DL) [
      • Meyer P.
      • Biston M.-C.
      • Khamphan C.
      • Marghani T.
      • Mazurier J.
      • Bodez V.
      • et al.
      Automation in radiotherapy treatment planning: Examples of use in clinical practice and future trends for a complete automated workflow.
      ]. For H&N cancer planning, atlas-based KPB and ARIR approaches were shown to provide clinically acceptable plans, which were comparable with those obtained manually [
      • Chang A.T.Y.
      • Hung A.W.M.
      • Cheung F.W.K.
      • Lee M.C.H.
      • Chan O.S.H.
      • Philips H.
      • et al.
      Comparison of Planning Quality and Efficiency Between Conventional and Knowledge-based Algorithms in Nasopharyngeal Cancer Patients Using Intensity Modulated Radiation Therapy.
      ,
      • Hazell I.
      • Bzdusek K.
      • Kumar P.
      • Hansen C.R.
      • Bertelsen A.
      • Eriksen J.G.
      • et al.
      Automatic planning of head and neck treatment plans.
      ]. Despite difficulties linked to the large amount of homogeneous data required for the database construction, DL-KBP solution has the potential to drastically reduce the planning time but still needs further investigation to be more efficient in providing plans of similar quality to manual plans [
      • Meyer P.
      • Biston M.-C.
      • Khamphan C.
      • Marghani T.
      • Mazurier J.
      • Bodez V.
      • et al.
      Automation in radiotherapy treatment planning: Examples of use in clinical practice and future trends for a complete automated workflow.
      ]. A posteriori MCO algorithm which proposes to choose one solution among several displayed on a “Pareto surface”, was also efficient in providing clinically acceptable plans, but higher effective working time and optimization time were reported compared to KPB and ARIR [
      • Krayenbuehl J.
      • Zamburlini M.
      • Ghandour S.
      • Pachoud M.
      • Tanadini-Lang S.
      • Tol J.
      • et al.
      Planning comparison of five automated treatment planning solutions for locally advanced head and neck cancer.
      ]. In contrast, a priori MCO directly and automatically generates a single Pareto-optimal plan using a wishlist with predefined dosimetric goals. Overall superiority of this algorithm compared to manual plans was recently demonstrated for H&N cancer but with an optimization time (1 h) which was not compatible with an online ART workflow [
      • Biston M.-C.
      • Liang X.
      • Li Z.
      Robust optimization should be used to replace PTV in radiotherapy treatment planning.
      ]. Recently, Archambault et al. introduced the Intelligent Optimization Engine (IOE), a semi-automated TPS specifically designed for online ART [
      • Archambaud
      • et al.
      Making on-line adaptive radiotherapy possible using artificial intelligence and machine learning for efficient daily re-planning.
      ]. This solution is similar in some points to a priori MCO used to obtain the initial planning and subsequently used for the automated plan generation on couch. Several studies showed the ability of IOE to generate plans with a quality comparable to manual planning within a short time-frame (<10 min) for pelvic [
      • Calmels L.
      • Sibolt P.
      • Åström L.M.
      • Serup-Hansen E.
      • Lindberg H.
      • Fromm A.-L.
      • et al.
      Evaluation of an automated template-based treatment planning system for radiotherapy of anal, rectal and prostate cancer.
      ,
      • Pokharel S.
      • Pacheco A.
      • Tanner S.
      Assessment of efficacy in automated plan generation for Varian Ethos intelligent optimization engine.
      ] and H&N cancers [
      • Yoon S.W.
      • Lin H.
      • Alonso-Basanta M.
      • Anderson N.
      • Apinorasethkul O.
      • Cooper K.
      • et al.
      Initial Evaluation of a Novel Cone-Beam CT-Based Semi-Automated Online Adaptive Radiotherapy System for Head and Neck Cancer Treatment - A Timing and Automation Quality Study.
      ].
      If specific resources are required for offline ART strategies, they will most often use “conventional” care processes but in a shorter time frame than that used for initial preparation.
      With online workflow, the institution organisation needs to be adapted compared to a standard RT workflow particularly in terms of staff, training, and assessment. This also implies thinking about RTT therapists and dosimetrists roles according to the organisation [
      • Shepherd M.
      • Graham S.
      • Ward A.
      • Zwart L.
      • Cai B.
      • Shelley C.
      • et al.
      Pathway for radiation therapists online advanced adapter training and credentialing.
      ]. Online ART requires specific medical and paramedical resources at the treatment machine in a choreography organised and prepared in advance with, in particular, prior training and validation of the skills of each operator through specific accreditation. The presence of the physician for delineation review may be necessary but it can be delegated to the RTTs mainly for OARs [
      • McNair H.A.
      • Joyce E.
      • O’Gara G.
      • Jackson M.
      • Peet B.
      • Huddart R.A.
      • et al.
      Radiographer-led online image guided adaptive radiotherapy: A qualitative investigation of the therapeutic radiographer role.
      ] and in certain situations and after training with certification for target volumes [
      • Shepherd M.
      • Graham S.
      • Ward A.
      • Zwart L.
      • Cai B.
      • Shelley C.
      • et al.
      Pathway for radiation therapists online advanced adapter training and credentialing.
      ,

      Adair Smith G, Dunlop A, Alexander SE, Barnes H, Casey F, Chick J, et al. Evaluation of Therapeutic Radiographer Contouring for Magnetic Resonance Image Guided Online Adaptive Prostate Radiotherapy. Radiother Oncol J Eur Soc Ther Radiol Oncol 2023:109457. https://doi.org/10.1016/j.radonc.2022.109457.

      ]. In all cases, this implies specific training and skills, with a credentialing for RTTs particularly. However, treatment responsibility will always rely on physicians and physicists. To delegate responsability, training courses have to be formalised and competences should be validated by the responsible (physician for contouring and physicist for planning).
      Practical recommendations:
      • -
        Prior training and skills validation are required for each operator through specific accreditation, for offline and online ART treatments.
      • -
        To delegate, training courses have to be formalised and competences should be validated by the responsible (physician for contouring and physicist for planning).
      • -
        As anatomical changes are a gradual process during H&N radiotherapy treatment, at least weekly 3D in-room imaging should be recommended to determine if an ART procedure is necessary.
      • -
        Online strategies can be interesting for H&N ART, not necessary for a systematic daily replanning because progressive variations are observed but needed during the treatment course when one (or more) replanning decision criteria are met.
      • -
        Robust optimization should be used to improve plan robustness to anatomical changes.

      7. Quality assurance

      7.1 Machine and imaging quality assurance

      As in non-ART workflows, a comprehensive machine QA program is needed. QA for conventional and non-conventional linacs has been extensively described in the literature and one should refer to national or international (specific task group reports) guidelines [
      • Klein E.E.
      • Hanley J.
      • Bayouth J.
      • Yin F.-F.
      • Simon W.
      • Dresser S.
      • et al.
      Task Group 142 report: quality assurance of medical accelerators.
      ,
      • Hanley J.
      • Dresser S.
      • Simon W.
      • Flynn R.
      • Klein E.E.
      • Letourneau D.
      • et al.
      AAPM Task Group 198 Report: An implementation guide for TG 142 quality assurance of medical accelerators.
      ,
      • Roberts D.A.
      • Sandin C.
      • Vesanen P.T.
      • Lee H.
      • Hanson I.M.
      • Nill S.
      • et al.
      Machine QA for the Elekta Unity system: A Report from the Elekta MR-linac consortium.
      ].
      As imaging is an important tool for H&N ART, image quality needs to be particularly assessed for any clinical use. A balance between image quality and imaging dose is also required. As CT scans, in-room imaging protocols need to be optimised. In France, a periodic quality control is mandatory for the CT-scanner and recommended for kV-CBCT [
      • de las Heras Gala H.
      • Torresin A.
      • Dasu A.
      • Rampado O.
      • Delis H.
      • Hernández Girón I.
      • et al.
      Quality control in cone-beam computed tomography (CBCT) EFOMP-ESTRO-IAEA protocol (summary report).
      ] and MV-CT in-room imaging devices. Spatial resolution and contrast are key components of these controls. Some quality controls need to be performed according to the image usage. As an example, stability of HU of kV-CBCT, MV-CT, or kV-CT have to be regularly checked if dose calculation is based on such images. In addition, coincidence between imaging and treatment isocenters and accuracy of treatment table displacements must be checked periodically to make sure that treatment could be performed consistently with image registration.
      For MRI, homogeneity and distortion in the magnetic field needs to be periodically checked as well as some geometric parameters [
      • Glide-Hurst C.K.
      • Paulson E.S.
      • McGee K.
      • Tyagi N.
      • Hu Y.
      • Balter J.
      • et al.
      Task group 284 report: magnetic resonance imaging simulation in radiotherapy: considerations for clinical implementation, optimization, and quality assurance.
      ]. For PET imaging, thresholding and reconstruction protocols need to be assessed [
      • Hatt M.
      • Lee J.A.
      • Schmidtlein C.R.
      • Naqa I.E.
      • Caldwell C.
      • De Bernardi E.
      • et al.
      Classification and evaluation strategies of auto-segmentation approaches for PET: Report of AAPM task group No. 211.
      ].
      Except for MRI, in-room imaging involves an additional irradiation. Imaging dose has to be quantified and the protocols have to be optimised (according to clinical purpose and patient morphology) to reduce the imaging dose while ensuring that the ART strategy objectives remain consistent. Indeed, imaging dose can be reduced up to a factor 10 with optimised protocols [
      • Ding G.X.
      • Alaei P.
      • Curran B.
      • Flynn R.
      • Gossman M.
      • Mackie T.R.
      • et al.
      Image guidance doses delivered during radiotherapy: Quantification, management, and reduction: Report of the AAPM Therapy Physics Committee Task Group 180.
      ,
      • Le Deroff C.
      • Berger L.
      • Bellec J.
      • Boissonnat G.
      • Chesneau H.
      • Chiavassa S.
      • et al.
      Monte Carlo-based software for 3D personalized dose calculations in image-guided radiotherapy.
      ].

      7.2 Patient specific quality assurance (PSQA)

      Since its implementation in the mid 1990′s, guidelines for commissioning and QA of IMRT have been widely described and documented [
      • Ezzell G.A.
      • Burmeister J.W.
      • Dogan N.
      • LoSasso T.J.
      • Mechalakos J.G.
      • Mihailidis D.
      • et al.
      IMRT commissioning: multiple institution planning and dosimetry comparisons, a report from AAPM Task Group 119.
      ,
      • Moran J.M.
      • Dempsey M.
      • Eisbruch A.
      • Fraass B.A.
      • Galvin J.M.
      • Ibbott G.S.
      • et al.
      Safety considerations for IMRT: executive summary.
      ,

      [PDF] GUIDELINES FOR THE VERIFICATION OF IMRT - Free Download PDF n.d. https://silo.tips/download/guidelines-for-the-verification-of-imrt (accessed February 3, 2023).

      ], and performing Patient Specific Quality Assurance has been recommended by several professional organisations [
      • Moran J.M.
      • Dempsey M.
      • Eisbruch A.
      • Fraass B.A.
      • Galvin J.M.
      • Ibbott G.S.
      • et al.
      Safety considerations for IMRT: executive summary.
      ]. Miften et al. provided specific recommendations to implement measurement based-PSQA and methodologies to establish tolerance and action limits [
      • Miften M.
      • Olch A.
      • Mihailidis D.
      • Moran J.
      • Pawlicki T.
      • Molineu A.
      • et al.
      Tolerance limits and methodologies for IMRT measurement-based verification QA: Recommendations of AAPM Task Group No. 218.
      ]. They particularly recommended: to perform IMRT QA measurements with a True Composite method (ie. using a stationary QA device placed on couch and measuring the actual plan of the patient), to analyse the dose comparisons in absolute dose mode, to perform a dose calibration of the QA device before each measurement session and to use a global normalisation for the ɣ index analysis.
      While pre-treatment and offline measurement based-PSQA can be done practically in offline ART, it cannot be implemented with a patient on couch in an online ART workflow. In this case, the PSQA will rely on a surrogate system, typically independent computer calculation. This solution will provide a quick result compatible with the timescale of an online ART session. If independent recalculation has been deemed capable of performing a reliable PSQA [
      • Kry S.F.
      • Glenn M.C.
      • Peterson C.B.
      • Branco D.
      • Mehrens H.
      • Steinmann A.
      • et al.
      Independent recalculation outperforms traditional measurement-based IMRT QA methods in detecting unacceptable plans.
      ], it has never been formally proved as a sufficient surrogate for measurements. Indeed, independent recalculation will only catch calculation errors such as beam modelling inaccuracies, and not errors in delivery or machine output. Furthermore, in order to confidently use it, it would be desirable to check the correlation between calculation errors and the surrogate results by studying its sensitivity [

      AAPM Committee Tree - Task Group No. 360 - Performance validation of surrogate assessment systems in the context of medical physics applications (TG360) n.d. https://www.aapm.org/org/structure/?committee_code=TG360 (accessed February 3, 2023).

      ].
      The risk in online ART is that the adapted plan deviates from normal operating conditions leading to an unacceptable plan for the patient. A good approach would be to monitor the complexity of adapted plans to check that they do not fall outside defined boundaries. Tolerance and action limits should be based on local experience. Indeed, several publications showed that treatment plan complexity does not predict PSQA performance at multi-institutional scale as complexity metrics and their correlation with PSQA results are highly dependent on the material used (TPS, linac, measurement device, planning technique) [
      • Glenn M.C.
      • Hernandez V.
      • Saez J.
      • Followill D.S.
      • Howell R.M.
      • Pollard-Larkin J.M.
      • et al.
      Treatment plan complexity does not predict IROC Houston anthropomorphic head and neck phantom performance.
      ,
      • Hernandez V.
      • Saez J.
      • Pasler M.
      • Jurado-Bruggeman D.
      • Jornet N.
      Comparison of complexity metrics for multi-institutional evaluations of treatment plans in radiotherapy.
      ]. Zhao et al. evaluated the need to perform a measurement based-PSQA for adapted plans during online ART. They concluded that measurements may not be necessary for every adapted plan and suggested to perform periodic checks to monitor the trend of PSQA results [
      • Zhao X.
      • Stanley D.N.
      • Cardenas C.E.
      • Harms J.
      • Popple R.A.
      Do we need patient-specific QA for adaptively generated plans? Retrospective evaluation of delivered online adaptive treatment plans on Varian Ethos.
      ].

      7.3 End-to-end testing and risk management

      Before each clinical implementation of a new radiotherapy treatment technique, an end-to-end (E2E) test should be conducted. This is particularly true in the case of ART workflows where each specific component has to be checked individually as well as the complete process. Recommendations about QA of each component are addressed in the previous sections.
      The aim of E2E QA is to check the accuracy of the delivered dose to the patient under real-world conditions, including ultimately verification of accumulated dose [
      • Glide-Hurst C.K.
      • Lee P.
      • Yock A.D.
      • Olsen J.R.
      • Cao M.
      • Siddiqui F.
      • et al.
      Adaptive Radiation Therapy (ART) Strategies and Technical Considerations: A State of the ART Review From NRG Oncology.
      ,
      • Schreiner L.J.
      End to end QA in image guided and adaptive radiation therapy.
      ]. However, the challenge is that, currently, no commercial phantom complies with the requirements of E2E testing of the whole ART workflow. Only a few in-house physical phantoms with embedded organ shape deformation have been designed by independent centres, for H&N [
      • Graves Y.J.
      • Smith A.-A.
      • McIlvena D.
      • Manilay Z.
      • Lai Y.K.
      • Rice R.
      • et al.
      A deformable head and neck phantom with in-vivo dosimetry for adaptive radiotherapy quality assurance.
      ], pelvic [
      • Axford A.
      • Dikaios N.
      • Roberts D.A.
      • Clark C.H.
      • Evans P.M.
      An end-to-end assessment on the accuracy of adaptive radiotherapy in an MR-linac.
      ,
      • Cunningham J.M.
      • Barberi E.A.
      • Miller J.
      • Kim J.P.
      • Glide-Hurst C.K.
      Development and evaluation of a novel MR-compatible pelvic end-to-end phantom.
      ] and lung [
      • Zhong H.
      • Adams J.
      • Glide-Hurst C.
      • Zhang H.
      • Li H.
      • Chetty I.J.
      Development of a deformable dosimetric phantom to verify dose accumulation algorithms for adaptive radiotherapy.
      ] regions, demonstrating the feasibility of E2E ART QA.
      As already mentioned, using in vivo portal dosimetry or fluence detectors is another interesting tool that should be used to control accuracy between planned and delivered dose. Lim et al. found a statistically negative correlation between variation of transit fluence and variation of volumes on CBCT. Such in vivo tools could help to decide if replanning is necessary [
      • Lim S.B.
      • Tsai C.J.
      • Yu Y.
      • Greer P.
      • Fuangrod T.
      • Hwang K.
      • et al.
      Investigation of a Novel Decision Support Metric for Head and Neck Adaptive Radiation Therapy Using a Real-Time In Vivo Portal Dosimetry System.
      ].
      In addition, as implementation of new treatment techniques yields new potential risks, a failure mode and effect analysis (FMEA) is highly recommended as part of a risk management program to target potential pitfalls in the process [
      • Klüter S.
      • Schrenk O.
      • Renkamp C.K.
      • Gliessmann S.
      • Kress M.
      • Debus J.
      • et al.
      A practical implementation of risk management for the clinical introduction of online adaptive Magnetic Resonance-guided radiotherapy.
      ]. Rippke et al. conducted a FMEA of the adapted planning process on a MR-Linac, and found that a large number of error sources, such as missing slices in volumes or erroneous margin extension of target volumes, were not covered by the available QA tools provided by the manufacturer. They hence developed an additional software to fill the gaps [
      • Rippke C.
      • Schrenk O.
      • Renkamp C.K.
      • Buchele C.
      • Hörner-Rieber J.
      • Debus J.
      • et al.
      Quality assurance for on-table adaptive magnetic resonance guided radiation therapy: A software tool to complement secondary dose calculation and failure modes discovered in clinical routine.
      ].
      Practical recommendations:
      For machine and imaging QA:
      • -
        A comprehensive machine QA program according to national or international guidelines with a particular focus on imaging should be designed.
      • -
        The assessment of image quality and image-guided ART protocol optimisation (particularly on acquisition and reconstruction parameters) is recommended.
      For the plan QA:
      • -
        A systematic measurement of pre-treatment PSQA should be done following recommendations made by Miften et al. [
        • Miften M.
        • Olch A.
        • Mihailidis D.
        • Moran J.
        • Pawlicki T.
        • Molineu A.
        • et al.
        Tolerance limits and methodologies for IMRT measurement-based verification QA: Recommendations of AAPM Task Group No. 218.
        ] (before the first treatment session in an online ART workflow and for each new plan generated in an offline workflow).
      • -
        For online ART:
        • -
          A sensitivity analysis to errors of the surrogate QA system should be conducted to assess its reliability.
        • -
          Complexity of adapted plans should be monitored in order to identify plans deviating from normal operating conditions.
        • -
          Periodic measurement-based PSQA of adapted plans should be performed to identify a potential drift in plan QA.
      For the end-to-end testing and risk management:
      • -
        Each component of the ART workflow should be assessed with a specific QA.
      • -
        In the absence of a commercialised E2E phantom dedicated to ART, E2E testing should be conducted with the current existing tools (allowing at a minimum IGRT, DIR and dose verifications).
      • -
        Performing a FMEA is strongly recommended in order to identify potential risks in the ART workflow and provide solutions to mitigate them.

      8. Conclusions

      This paper gives an overview of the key elements of H&N ART and practical recommendations. This manuscript and in particular the recommendations are intended to assist and provide the minimum requirements for using these tools and strategies when implementing them in practice or in clinical trials linked to ART.
      A particular attention should be drawn on the increasing use of artificial intelligence (AI) in radiotherapy. Indeed, AI-based applications, such as automatic segmentation, synthetic CT generation or automatic planning, allow a significant gain in efficiency in offline and online ART workflows but may appear as black boxes [
      • Vandewinckele L.
      • Claessens M.
      • Dinkla A.
      • Brouwer C.
      • Crijns W.
      • Verellen D.
      • et al.
      Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance.
      ,
      • Bosmans H.
      • Zanca F.
      • Gelaude F.
      Procurement, commissioning and QA of AI based solutions: An MPE’s perspective on introducing AI in clinical practice.
      ,
      • Claessens M.
      • Oria C.S.
      • Brouwer C.L.
      • Ziemer B.P.
      • Scholey J.E.
      • Lin H.
      • et al.
      Quality Assurance for AI-Based Applications in Radiation Therapy.
      ]. Claessens et al. provided practical methodologies for the commissioning, implementation and QA of AI models used in clinical practice [
      • Claessens M.
      • Oria C.S.
      • Brouwer C.L.
      • Ziemer B.P.
      • Scholey J.E.
      • Lin H.
      • et al.
      Quality Assurance for AI-Based Applications in Radiation Therapy.
      ].
      For all H&N RT patients, anatomical changes are observed during treatment, that are generally associated with localisation, patient’s anatomy and response to treatment. Imaging or dosimetric tools offers the possibility to detect variations during treatment, but thresholds need to be defined to detect when these variations mandate a treatment plan adaptation. Automatic tools are needed to catch patients who require plan adaptation. In the current state of our knowledge, daily online adaptation for H&N RT normofractionated treatments is not recommended but rather on an individual basis with regular monitoring of observed changes. ART strategies are an opportunity to optimise treatments when clinically it is an issue. ART strategies could adapt dosimetric parameters keeping target coverage and OAR sparing but could also be used to increase local control using dose (des)escalation. This latest objective can be achieved thanks to anatomical imaging allowing tumor visibility or thanks to PET or MRI functional imaging which allow for increased personalisation of the patient's response to treatment.

      Declaration of Competing Interest

      The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

      References

        • Barker J.L.
        • Garden A.S.
        • Ang K.K.
        • O’Daniel J.C.
        • Wang H.
        • Court L.E.
        • et al.
        Quantification of volumetric and geometric changes occurring during fractionated radiotherapy for head-and-neck cancer using an integrated CT/linear accelerator system.
        Int J Radiat Oncol • Biol • Phys. 2004; 59: 960-970https://doi.org/10.1016/j.ijrobp.2003.12.024
        • Nishi T.
        • Nishimura Y.
        • Shibata T.
        • Tamura M.
        • Nishigaito N.
        • Okumura M.
        Volume and dosimetric changes and initial clinical experience of a two-step adaptive intensity modulated radiation therapy (IMRT) scheme for head and neck cancer.
        Radiother Oncol J Eur Soc Ther Radiol Oncol. 2013; https://doi.org/10.1016/j.radonc.2012.11.005
        • Marzi S.
        • Pinnarò P.
        • D’Alessio D.
        • Strigari L.
        • Bruzzaniti V.
        • Giordano C.
        • et al.
        Anatomical and Dose Changes of Gross Tumour Volume and Parotid Glands for Head and Neck Cancer Patients during Intensity-modulated Radiotherapy: Effect on the Probability of Xerostomia Incidence.
        Clin Oncol. 2012; 24: e54-e62https://doi.org/10.1016/j.clon.2011.11.006
        • Beltran M.
        • Ramos M.
        • Rovira J.J.
        • Perez-Hoyos S.
        • Sancho M.
        • Puertas E.
        • et al.
        Dose variations in tumor volumes and organs at risk during IMRT for head-and-neck cancer.
        J Appl Clin Med Phys. 2012; 13: 101-111https://doi.org/10.1120/jacmp.v13i6.3723
        • Brouwer C.L.
        • Steenbakkers R.J.H.M.
        • Langendijk J.A.
        • Sijtsema N.M.
        Identifying patients who may benefit from adaptive radiotherapy: Does the literature on anatomic and dosimetric changes in head and neck organs at risk during radiotherapy provide information to help?.
        Radiother Oncol J Eur Soc Ther Radiol Oncol. 2015; 115: 285-294https://doi.org/10.1016/j.radonc.2015.05.018
        • Schwartz D.L.
        • Garden A.S.
        • Thomas J.
        • Chen Y.
        • Zhang Y.
        • Lewin J.
        • et al.
        Adaptive Radiotherapy for Head-and-Neck Cancer: Initial Clinical Outcomes From a Prospective Trial.
        Int J Radiat Oncol. 2012; 83: 986-993https://doi.org/10.1016/j.ijrobp.2011.08.017
        • Castelli J.
        • Simon A.
        • Lafond C.
        • Perichon N.
        • Rigaud B.
        • Chajon E.
        • et al.
        Adaptive radiotherapy for head and neck cancer.
        Acta Oncol. 2018; 57: 1284-1292https://doi.org/10.1080/0284186X.2018.1505053
        • Pollom E.L.
        • Song J.
        • Durkee B.Y.
        • Aggarwal S.
        • Bui T.
        • von Eyben R.
        • et al.
        Prognostic value of midtreatment FDG-PET in oropharyngeal cancer.
        Head Neck. 2016; 38: 1472-1478https://doi.org/10.1002/hed.24454
        • Bahig H.
        • Yuan Y.
        • Mohamed A.S.R.
        • Brock K.K.
        • Ng S.P.
        • Wang J.
        • et al.
        Magnetic Resonance-based Response Assessment and Dose Adaptation in Human Papilloma Virus Positive Tumors of the Oropharynx treated with Radiotherapy (MR-ADAPTOR): An R-IDEAL stage 2a–2b/Bayesian phase II trial.
        Clin Transl Radiat Oncol. 2018; 13: 19-23https://doi.org/10.1016/j.ctro.2018.08.003
        • McDonald B.A.
        • Vedam S.
        • Yang J.
        • Wang J.
        • Castillo P.
        • Lee B.
        • et al.
        Initial Feasibility and Clinical Implementation of Daily MR-Guided Adaptive Head and Neck Cancer Radiation Therapy on a 1.5T MR-Linac System: Prospective R-IDEAL 2a/2b Systematic Clinical Evaluation of Technical Innovation.
        Int J Radiat Oncol. 2021; 109: 1606-1618https://doi.org/10.1016/j.ijrobp.2020.12.015
        • Lee N.
        • Schoder H.
        • Beattie B.
        • Lanning R.
        • Riaz N.
        • McBride S.
        • et al.
        A Strategy of Using Intra-treatment Hypoxia Imaging to Selectively and Safely Guide Radiation Dose Deescalation Concurrent with Chemotherapy for Loco-regionally Advanced Human Papillomavirus-Related Oropharyngeal Carcinoma.
        Int J Radiat Oncol Biol Phys. 2016; 96: 9-17https://doi.org/10.1016/j.ijrobp.2016.04.027
        • Matuszak M.M.
        • Kashani R.
        • Green M.
        • Owen D.
        • Jolly S.
        • Mierzwa M.
        Functional Adaptation in Radiation Therapy.
        Semin Radiat Oncol. 2019; 29: 236-244https://doi.org/10.1016/j.semradonc.2019.02.006
        • Martens R.M.
        • Noij D.P.
        • Ali M.
        • Koopman T.
        • Marcus J.T.
        • Vergeer M.R.
        • et al.
        Functional imaging early during (chemo)radiotherapy for response prediction in head and neck squamous cell carcinoma; a systematic review.
        Oral Oncol. 2019; 88: 75-83https://doi.org/10.1016/j.oraloncology.2018.11.005
        • Martens R.M.
        • Koopman T.
        • Lavini C.
        • van de Brug T.
        • Zwezerijnen G.J.C.
        • Marcus J.T.
        • et al.
        Early Response Prediction of Multiparametric Functional MRI and 18F-FDG-PET in Patients with Head and Neck Squamous Cell Carcinoma Treated with (Chemo)Radiation.
        Cancers. 2022; 14: 216https://doi.org/10.3390/cancers14010216
      1. Galloway TJ, Zhang Q (Ed), Nguyen-Tan PF, Rosenthal DI, Soulieres D, Fortin A, et al. Prognostic Value of p16 Status on the Development of a Complete Response in Involved Oropharynx Cancer Neck Nodes After Cisplatin-Based Chemoradiation: A Secondary Analysis of NRG Oncology RTOG 0129. Int J Radiat Oncol Biol Phys 2016;96:362–71. https://doi.org/10.1016/j.ijrobp.2016.05.026.

        • Fu S.
        • Li Y.
        • Han Y.
        • Wang H.
        • Chen Y.
        • Yan O.
        • et al.
        Diffusion-Weighted Magnetic Resonance Imaging-Guided Dose Painting in Patients With Locoregionally Advanced Nasopharyngeal Carcinoma Treated With Induction Chemotherapy Plus Concurrent Chemoradiotherapy: A Randomized, Controlled Clinical Trial.
        Int J Radiat Oncol Biol Phys. 2022; 113: 101-113https://doi.org/10.1016/j.ijrobp.2021.12.175
        • Chen A.M.
        • Daly M.E.
        • Cui J.
        • Mathai M.
        • Benedict S.
        • Purdy J.A.
        Clinical outcomes among patients with head and neck cancer treated by intensity-modulated radiotherapy with and without adaptive replanning.
        Head Neck. 2014; 36: 1541-1546https://doi.org/10.1002/hed.23477
        • Loi G.
        • Fusella M.
        • Vecchi C.
        • Menna S.
        • Rosica F.
        • Gino E.
        • et al.
        Computed Tomography to Cone Beam Computed Tomography Deformable Image Registration for Contour Propagation Using Head and Neck, Patient-Based Computational Phantoms: A Multicenter Study.
        Pract Radiat Oncol. 2020; 10: 125-132https://doi.org/10.1016/j.prro.2019.11.011
        • Zhang L.
        • Wang Z.
        • Shi C.
        • Long T.
        • Xu X.G.
        The impact of robustness of deformable image registration on contour propagation and dose accumulation for head and neck adaptive radiotherapy.
        J Appl Clin Med Phys. 2018; 19: 185-194https://doi.org/10.1002/acm2.12361
      2. Brock KK, Mutic S, McNutt TR, Li H, Kessler ML. Use of image registration and fusion algorithms and techniques in radiotherapy: Report of the AAPM Radiation Therapy Committee Task Group No. 132. Med Phys 2017;44:e43–76. https://doi.org/10.1002/mp.12256.

        • Sotiras A.
        • Davatzikos C.
        • Paragios N.
        Deformable Medical Image Registration: A Survey.
        IEEE Trans Med Imaging. 2013; 32: 1153-1190https://doi.org/10.1109/TMI.2013.2265603
        • Viergever M.A.
        • Maintz J.B.A.
        • Klein S.
        • Murphy K.
        • Staring M.
        • Pluim J.P.W.
        A survey of medical image registration - under review.
        Med Image Anal. 2016; 33: 140-144https://doi.org/10.1016/j.media.2016.06.030
        • Kashani R.
        • Hub M.
        • Balter J.M.
        • Kessler M.L.
        • Dong L.
        • Zhang L.
        • et al.
        Objective assessment of deformable image registration in radiotherapy: A multi-institution study.
        Med Phys. 2008; 35: 5944-5953https://doi.org/10.1118/1.3013563
        • Liu F.
        • Hu Y.
        • Zhang Q.
        • Kincaid R.
        • Goodman K.
        • Mageras G.
        Evaluation of deformable image registration and motion model in CT images with limited features.
        Phys Med Biol. 2012; 57: 2539-2554https://doi.org/10.1088/0031-9155/57/9/2539
        • Castillo R.
        • Castillo E.
        • Fuentes D.
        • Ahmad M.
        • Wood A.M.
        • Ludwig M.S.
        • et al.
        A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive.
        Phys Med Biol. 2013; 58: 2861-2877https://doi.org/10.1088/0031-9155/58/9/2861
        • Kerdok A.E.
        • Cotin S.M.
        • Ottensmeyer M.P.
        • Galea A.M.
        • Howe R.D.
        • Dawson S.L.
        Truth cube: Establishing physical standards for soft tissue simulation.
        Med Image Anal. 2003; 7: 283-291https://doi.org/10.1016/S1361-8415(03)00008-2
        • Nie K.
        • Chuang C.
        • Kirby N.
        • Braunstein S.
        • Pouliot J.
        Site-specific deformable imaging registration algorithm selection using patient-based simulated deformations: Site-specific DIR selection using patient-based simulated deformations.
        Med Phys. 2013; 40041911https://doi.org/10.1118/1.4793723
        • Pukala J.
        • Meeks S.L.
        • Staton R.J.
        • Bova F.J.
        • Mañon R.R.
        • Langen K.M.
        A virtual phantom library for the quantification of deformable image registration uncertainties in patients with cancers of the head and neck: Virtual phantoms for the quantification of DIR uncertainty.
        Med Phys. 2013; 40111703https://doi.org/10.1118/1.4823467
        • Castadot P.
        • Lee J.A.
        • Parraga A.
        • Geets X.
        • Macq B.
        • Grégoire V.
        Comparison of 12 deformable registration strategies in adaptive radiation therapy for the treatment of head and neck tumors.
        Radiother Oncol. 2008; 89: 1-12https://doi.org/10.1016/j.radonc.2008.04.010
        • Singhrao K.
        • Kirby N.
        • Pouliot J.
        A three-dimensional head-and-neck phantom for validation of multimodality deformable image registration for adaptive radiotherapy: 3D H&N phantom for DIR validation.
        Med Phys. 2014; 41121709https://doi.org/10.1118/1.4901523
        • Kirby N.
        • Chuang C.
        • Pouliot J.
        A two-dimensional deformable phantom for quantitatively verifying deformation algorithms.
        Med Phys. 2011; 38: 4583-4586https://doi.org/10.1118/1.3597881
        • Lustberg T.
        • van Soest J.
        • Gooding M.
        • Peressutti D.
        • Aljabar P.
        • van der Stoep J.
        • et al.
        Clinical evaluation of atlas and deep learning based automatic contouring for lung cancer.
        Radiother Oncol J Eur Soc Ther Radiol Oncol. 2018; 126: 312-317https://doi.org/10.1016/j.radonc.2017.11.012
        • Santanam L.
        • Hurkmans C.
        • Mutic S.
        • van Vliet-Vroegindeweij C.
        • Brame S.
        • Straube W.
        • et al.
        Standardizing Naming Conventions in Radiation Oncology.
        Int J Radiat Oncol Biol Phys. 2012; 83: 1344-1349https://doi.org/10.1016/j.ijrobp.2011.09.054
        • Mir R.
        • Kelly S.M.
        • Xiao Y.
        • Moore A.
        • Clark C.H.
        • Clementel E.
        • et al.
        Organ at risk delineation for radiation therapy clinical trials: Global Harmonization Group consensus guidelines.
        Radiother Oncol. 2020; 150: 30-39https://doi.org/10.1016/j.radonc.2020.05.038
        • Mayo C.S.
        • Moran J.M.
        • Bosch W.
        • Xiao Y.
        • McNutt T.
        • Popple R.
        • et al.
        American Association of Physicists in Medicine Task Group 263: Standardizing Nomenclatures in Radiation Oncology.
        Int J Radiat Oncol Biol Phys. 2018; 100: 1057-1066https://doi.org/10.1016/j.ijrobp.2017.12.013
        • Brouwer C.L.
        • Steenbakkers R.J.H.M.
        • Bourhis J.
        • Budach W.
        • Grau C.
        • Grégoire V.
        • et al.
        CT-based delineation of organs at risk in the head and neck region: DAHANCA, EORTC, GORTEC, HKNPCSG, NCIC CTG, NCRI, NRG Oncology and TROG consensus guidelines.
        Radiother Oncol J Eur Soc Ther Radiol Oncol. 2015; 117: 83-90https://doi.org/10.1016/j.radonc.2015.07.041
        • van Dijk L.V.
        • Van den Bosch L.
        • Aljabar P.
        • Peressutti D.
        • Both S.
        • Steenbakkers J.H.M.
        • et al.
        Improving automatic delineation for head and neck organs at risk by Deep Learning Contouring.
        Radiother Oncol J Eur Soc Ther Radiol Oncol. 2020; 142: 115-123https://doi.org/10.1016/j.radonc.2019.09.022
        • Močnik D.
        • Ibragimov B.
        • Xing L.
        • Strojan P.
        • Likar B.
        • Pernuš F.
        • et al.
        Segmentation of parotid glands from registered CT and MR images.
        Phys Medica PM Int J Devoted Appl Phys Med Biol Off J Ital Assoc Biomed Phys AIFB. 2018; 52: 33-41https://doi.org/10.1016/j.ejmp.2018.06.012
        • Zhao L.
        • Lu Z.
        • Jiang J.
        • Zhou Y.
        • Wu Y.
        • Feng Q.
        Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images.
        J Digit Imaging. 2019; 32: 462-470https://doi.org/10.1007/s10278-018-00173-0
        • van de Schoot A.J.
        • Schooneveldt G.
        • Wognum S.
        • Hoogeman M.S.
        • Chai X.
        • Stalpers L.J.A.
        • et al.
        Generic method for automatic bladder segmentation on cone beam CT using a patient-specific bladder shape model.
        Med Phys. 2014; 41031707https://doi.org/10.1118/1.4865762
        • Zhang J.
        • Huang L.
        • Wu F.
        • Wang G.
        • Wu L.
        • Huang B.
        • et al.
        Tailoring PTV expansion to improve the dosimetry of post modified radical mastectomy intensity-modulated radiotherapy for left-sided breast cancer patients by using 4D CT combined with cone beam CT.
        J Appl Clin Med Phys. 2021; 22: 139-146https://doi.org/10.1002/acm2.13244
        • Gering D.T.
        • Lu W.
        • Ruchala K.
        • Olivera G.
        Automatic Segmentation of KV-CT and MV-CT Images of Head and Neck Patients.
        Int J Radiat Oncol Biol Phys. 2010; 78: S490-S491https://doi.org/10.1016/j.ijrobp.2010.07.1148
        • Tegtmeier R.C.
        • Ferris W.S.
        • Bayouth J.E.
        • Miller J.R.
        • Culberson W.S.
        Characterization of imaging performance of a novel helical kVCT for use in image-guided and adaptive radiotherapy.
        J Appl Clin Med Phys. 2022; 23: e13648https://doi.org/10.1002/acm2.13648
        • Yang X.
        • Wu N.
        • Cheng G.
        • Zhou Z.
        • Yu D.S.
        • Beitler J.J.
        • et al.
        Automated Segmentation of the Parotid Gland Based on Atlas Registration and Machine Learning: A Longitudinal MRI Study in Head-and-Neck Radiation Therapy.
        Int J Radiat Oncol Biol Phys. 2014; 90: 1225-1233https://doi.org/10.1016/j.ijrobp.2014.08.350
        • Boeke S.
        • Mönnich D.
        • van Timmeren J.E.
        • Balermpas P.
        MR-Guided Radiotherapy for Head and Neck Cancer: Current Developments, Perspectives, and Challenges.
        Front Oncol. 2021; 11616156https://doi.org/10.3389/fonc.2021.616156
        • Kaza E.
        • Guenette J.P.
        • Guthier C.V.
        • Hatch S.
        • Marques A.
        • Singer L.
        • et al.
        Image quality comparisons of coil setups in 3T MRI for brain and head and neck radiotherapy simulations.
        J Appl Clin Med Phys. 2022; 23: e13794https://doi.org/10.1002/acm2.13794
        • Zukauskaite R.
        • Rumley C.N.
        • Hansen C.R.
        • Jameson M.G.
        • Trada Y.
        • Johansen J.
        • et al.
        Delineation uncertainties of tumour volumes on MRI of head and neck cancer patients.
        Clin Transl Radiat Oncol. 2022; 36: 121-126https://doi.org/10.1016/j.ctro.2022.08.005
        • Lorenzen E.L.
        • Kallehauge J.F.
        • Byskov C.S.
        • Dahlrot R.H.
        • Haslund C.A.
        • Guldberg T.L.
        • et al.
        A national study on the inter-observer variability in the delineation of organs at risk in the brain.
        Acta Oncol. 2021; 60: 1548-1554https://doi.org/10.1080/0284186X.2021.1975813
        • Cardenas C.E.
        • Yang J.
        • Anderson B.M.
        • Court L.E.
        • Brock K.B.
        Advances in Auto-Segmentation.
        Semin Radiat Oncol. 2019; 29: 185-197https://doi.org/10.1016/j.semradonc.2019.02.001
        • Vaassen F.
        • Hazelaar C.
        • Vaniqui A.
        • Gooding M.
        • van der Heyden B.
        • Canters R.
        • et al.
        Evaluation of measures for assessing time-saving of automatic organ-at-risk segmentation in radiotherapy.
        Phys Imaging Radiat Oncol. 2020; 13: 1-6https://doi.org/10.1016/j.phro.2019.12.001
        • van der Veen J.
        • Gulyban A.
        • Nuyts S.
        Interobserver variability in delineation of target volumes in head and neck cancer.
        Radiother Oncol. 2019; 137: 9-15https://doi.org/10.1016/j.radonc.2019.04.006
        • Stapleford L.J.
        • Lawson J.D.
        • Perkins C.
        • Edelman S.
        • Davis L.
        • McDonald M.W.
        • et al.
        Evaluation of automatic atlas-based lymph node segmentation for head-and-neck cancer.
        Int J Radiat Oncol Biol Phys. 2010; 77: 959-966https://doi.org/10.1016/j.ijrobp.2009.09.023
        • Lim J.Y.
        • Leech M.
        Use of auto-segmentation in the delineation of target volumes and organs at risk in head and neck.
        Acta Oncol Stockh Swed. 2016; 55: 799-806https://doi.org/10.3109/0284186X.2016.1173723
        • Daisne J.-F.
        • Blumhofer A.
        Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation.
        Radiat Oncol. 2013; 8: 154https://doi.org/10.1186/1748-717X-8-154
        • Savjani R.R.
        • Lauria M.
        • Bose S.
        • Deng J.
        • Yuan Y.
        • Andrearczyk V.
        Automated Tumor Segmentation in Radiotherapy.
        Semin Radiat Oncol. 2022; 32: 319-329https://doi.org/10.1016/j.semradonc.2022.06.002
        • Schouten J.P.E.
        • Noteboom S.
        • Martens R.M.
        • Mes S.W.
        • Leemans C.R.
        • de Graaf P.
        • et al.
        Automatic segmentation of head and neck primary tumors on MRI using a multi-view CNN.
        Cancer Imaging. 2022; 22: 8https://doi.org/10.1186/s40644-022-00445-7
      3. Lalaoui L, Mohamadi T. A comparative study of Image Region-Based Segmentation Algorithms 2013. https://doi.org/10.14569/IJACSA.2013.040627.

        • Boldrini L.
        • Bibault J.-E.
        • Masciocchi C.
        • Shen Y.
        • Bittner M.-I.
        Deep Learning: A Review for the Radiation Oncologist.
        Front Oncol. 2019; 9: 977https://doi.org/10.3389/fonc.2019.00977
        • Qazi A.A.
        • Pekar V.
        • Kim J.
        • Xie J.
        • Breen S.L.
        • Jaffray D.A.
        Auto-segmentation of normal and target structures in head and neck CT images: A feature-driven model-based approach.
        Med Phys. 2011; 38: 6160-6170https://doi.org/10.1118/1.3654160
        • Vandewinckele L.
        • Claessens M.
        • Dinkla A.
        • Brouwer C.
        • Crijns W.
        • Verellen D.
        • et al.
        Overview of artificial intelligence-based applications in radiotherapy: Recommendations for implementation and quality assurance.
        Radiother Oncol. 2020; 153: 55-66https://doi.org/10.1016/j.radonc.2020.09.008
        • Sharp G.
        • Fritscher K.D.
        • Pekar V.
        • Peroni M.
        • Shusharina N.
        • Veeraraghavan H.
        • et al.
        Vision 20/20: Perspectives on automated image segmentation for radiotherapy.
        Med Phys. 2014; 41050902https://doi.org/10.1118/1.4871620