Interobserver variations in the delineation of planning target volume and with orgagans at risk different contouring methods in intensity-modulated radiation therapy for nasopharyngeal carcinoma
Peng Yinglin1, Sun Wenzhao1, Cheng Wanqin2, Xia Haiqun3, Yao Jijin4, Xiao Weiwei1, Shen Guanzhu5, Yang Lin1, Zhou Shu1, Li Jiaxin6, Guan Ying7, Liu Shuai8, Deng Xiaowu1
1Department of Radiation Oncology,Sun Yat-sen University Cancer Center,State Key Laboratory of Oncology in South China,Collaborative Innovation Center for Cancer Medicine,Guangzhou 510060,China; 2Department of Oncology,The Shunde Hospital of Southern Medical University,Shunde 528300,China; 3Department of Radiation Oncology,Tungwah Hospital of Sun Yat-sen University,Dongguan 523110,China; 4Department of Radiation Oncology,The Fifth Affiliated Hospital of Sun Yat-sen University,Zhuhai 519000,China; 5Department of Radiation Oncology,Affiliated Cancer Hospital of Guangzhou Medical University,Guangzhou 510095,China; 6Department of Radiation Oncology,The First Affiliated Hospital of Sun Yat-sen University,Guangzhou 510080,China; 7Department of Radiation Oncology,Affiliated Cancer Hospital of Guangxi Medical University,Nanning 530021,China; 8Department of Radiation Oncology,The Sixth Affiliated Hospital of Sun Yat-sen University,Guangzhou 510655,China
Objective To assess the interobserver variations in delineating the planning target volume (PTV) and organs at risk (OAR) using different contouring methods during intensity-modulated radiation therapy (IMRT) for nasopharyngeal carcinoma (NPC), aiming to provide references for the quality control of multi-center clinical trials. Methods The PTV and OAR of CT image of 1 NPC patient manually delineated by 10 physicians from 8 different radiation centers were defined as the "manual contour group", and the OAR auto-contoured using the ABAS software and modified by the physicians were defined as the "auto+manual contour group". The maximum/minimum ratio (MMR) of the PTV and OAR volumes, and the coefficient of variation (CV) for different delineated contours were comparatively evaluated. Results Large variation was observed in the PTV and OAR volumes in the manual contour group. The MMR and CV of the PTV were 1.72-3.41 and 0.16-0.39, with the most significant variation in the PTVnd (MMR=3.41 and CV=0.39 for the PTVnd-L). The MMRand CV of the manually contoured OAR were 1.30-7.89 and 0.07-0.67. The MMR of the temporal lobe, spinal cord, temporomandibular joint, optic nerve and pituitary gland exceeded 2.0. Compared with the manual contour group, the average contouring time in the auto+ manual group was shortened by 68% and the interobserver variation of the OAR volume was reduced with an MMR of 1.04-2.44 and CV of 0.01-0.37. Conclusions Large variation may occur in the PTV and OAR contours during IMRT plans for NPC delineated by different clinicians from multiple medical centers. Auto-contouring+ manually modification can reduce the interobserver variation of OAR delineation, whereas the variation in the delineation of small organs remains above 1.5 times. The consistency of the PTV and OAR delineation and the possible impact upon clinical outcomes should be reviewed and evaluated in multi-center clinical trials.
Peng Yinglin,Sun Wenzhao,Cheng Wanqin et al. Interobserver variations in the delineation of planning target volume and with orgagans at risk different contouring methods in intensity-modulated radiation therapy for nasopharyngeal carcinoma[J]. Chinese Journal of Radiation Oncology, 2019, 28(10): 762-766.
[1] Shen G,Xiao W,Han F,et al. Advantage of PET/CT in target delineation of MRI-negative cervical lymph nodes in intensity-modulated radiation therapy planning for nasopharyngeal carcinoma[J]. J Cancer,2017,8(19):4117-4123. DOI:10.7150/jca.21582.
[2] Onal C,Cengiz M,Guler OC,et al. The role of delineation education programs for improving interobserver variability in target volume delineation in gastric cancer[J]. Br J Radiol,2017,90(1073):20160826. DOI:10.1259/bjr.20160826.
[3] Raudaschl PF,Zaffino P,Sharp GC,et al. Evaluation of segmentation methods on head and neck CT:auto-segmentation challenge 2015[J]. Med Phys,2017,44(5):2020-2036. DOI:10.1002/mp.12197.
[4] Stapleford LJ,Lawson JD,Perkins C,et al. Evaluation of automatic atlas-based lymph node segmentation for head-and-neck cancer[J]. Int J Radiat Oncol Biol Phys,2010,77(3):959-966. DOI:10.1016/j.ijrobp.2009.09.023.
[5] Huger S,Graff P,Harter V,et al. Evaluation of the Block Matching deformable registration algorithm in the field of head-and-neck adaptive radiotherapy[J]. Phys Med,2014,30(3):301-308. DOI:10.1016/j.ejmp.2013.09.001.
[6] Warfield SK,Zou KH,Wells WM. Simultaneous truth and performance level estimation (STAPLE):an algorithm for the validation of image segmentation[J]. IEEE Trans Med Imag,2004,23(7):903-921. DOI:10.1109/TMI.2004.828354.
[7] Akhondi-Asl A,Hoyte L,Lockhart ME,et al. A logarithmic opinion pool based STAPLE algorithm for the fusion of segmentations with associated reliability weights[J]. IEEE Trans Med Imag,2014,33(10):1997-2009. DOI:10.1109/TMI.2014.2329603.
[8] Xavier G,Jean D,Stephano A,et al. Inter-observer variability in the delineation of pharyngo-laryngeal tumor,parotid glands and cervical spinalcord:comparison between CT-scan and MRI[J]. Radiother Oncol,2005,77(1):25-31. DOI:10.1016/j.radonc.2005.04.010.
[9] Gwynne S,Spezi E,Sebag-Montefiore D,et al. Improving radiotherapy quality assurance in clinical trials:assessment of target volume delineation of the pre-accrual benchmark case[J]. Br J Radiol,2013,86(1024):1-11. DOI:10.1259/bjr.20120398.
[10] ICRU report No.83. Prescribing,recording,and reporting photon-beam intensity-modulated radiation therapy[R]. Geneva:ICRU,2010.
[11] Jager EA,Kasperts N,Caldas-Magalhaes J,et al. GTV delineation in supraglottic laryngeal carcinoma:interobserver agreement of CT versus CT-MR delineation[J]. Radiat Oncol,2015,10(26):1-9. DOI:10.1186/s13014-014-0321-4.
[12] LiJ Wang,Yesong Guo,Lanfang Zhang,et al. Upper bound of Ⅱ b region in clinical target volume for intensity-modulated radiotherapy for nasopharyngeal carcinoma[J]. Chin J Radiat Oncol,2016,25(11):1151-1155. DOI:10.3760/cma.j.issn.1004-4221.2016.11.002.
[13] Grégoire V,Ang K,Budach W,et al. Delineation of neck node levels for head and neck tumors:a 2013 update. DAHANCA,EPRTC,HKNPCSG,NCIC CTG,NCRI,RTOG,TROG consensus guidelines[J]. Radiother Oncol,2014,110:172-181. DOI:10.1016/j.radonc.2013.10.010
[14] Feng M,Demiroz C,Vineberg KA,et al. Normal tissue anatomy for oropharyngeal cancer:contouring variability and its impact on optimization[J]. Int J Radiat Oncol Biol Phys,2012,84(2):245-249. DOI:10.1016/j.ijrobp.2012.03.031.
[15] Tao CJ,Yi JL,Chen NY,et al. Multi-subject atlas-based auto-segmentation reduces interobserver variation and improves dosimetric parameter consistency for organs at risk in nasopharyngeal carcinoma:a multi-institution clinical study[J]. Radiother Oncol,2015,115(3):407-411. DOI:10.1016/j.radonc.2015.05.012.
[16] Leibfarth S,Eckert F,Welz S,et al. Automatic delineation of tumor volumes by co-segmentation of combined PET/MR data[J]. Phys Med Biol,2015,60(14):5399-5412. DOI:10.1016/S0167-8140(15)30520-X.
[17] Thomson D,Boylan C,Liptrot T,et al. Evaluation of an automatic segmentation algorithm for definition of head and neck organs at risk[J]. Radiat Oncol,2014,9(173):1-12. DOI:10.1186/1748-717X-9-173.
[18] XA Li,A Tai,DW Arthur,et al. Variability of target and normal structure delineation for breast cancer radiotherapy:an RTOG multi-institutional and multiobserver study[J]. Int J Radiat Oncol Biol Phys,2009,73(3):944-951. DOI:10.1016/j.ijrobp.2008.10.034.