Abstract
Objective
The aim of this study is to assess the performance of a computer-aided semi-automated algorithm we have adapted for the purpose of segmenting malignant pleural mesothelioma (MPM) on CT.
Methods
Forty-five CT scans were collected from 15 patients (M:F \(=\) 10:5, mean age 62.8 years) in a multi-centre clinical drug trial. A computer-aided random walk-based algorithm was applied to segment the tumour; the results were then compared to radiologist-drawn contours and correlated with measurements made using the MPM-adapted Response Evaluation Criteria in Solid Tumour (modified RECIST).
Results
A mean accuracy (Sørensen–Dice index) of 0.825 (95% CI [0.758, 0.892]) was achieved. Compared to a median measurement time of 68.1 min (range [40.2, 102.4]) for manual delineation, the median running time of our algorithm was 23.1 min (range [10.9, 37.0]). A linear correlation (Pearson’s correlation coefficient: 0.6392, \(p < 0.05\)) was established between the changes in modified RECIST and computed tumour volume.
Conclusion
Volumetric tumour segmentation offers a potential solution to the challenges in quantifying MPM. Computer-assisted methods such as the one presented in this study facilitate this in an accurate and time-efficient manner and provide additional morphological information about the tumour’s evolution over time.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
Malignant pleural mesothelioma (MPM) is an aggressive thoracic malignancy that is closely linked to past exposure to asbestos. It is currently responsible for over 47,000 annual deaths worldwide, a number which continues to increase despite legal restrictions limiting the use of asbestos in many countries [1]. MPM is currently the greatest single cause of work-related deaths in the UK [2]. Although the production of asbestos was gradually phased out in the 1980s, the disease’s long latency period, typically ranging from 30 to 40 years, has caused a continuing rising trend of MPM in the country, which is projected to peak in 2020 [3]. Moreover, asbestos is still being harvested and used in the developing world, most notably in China and India, where MPM is rapidly becoming a prominent occupational health concern [4, 5].
MPM usually originates in the parietal pleura of the lung and grows as a ‘rind’ around the pleural surface. It has a tendency to encase the affected lung, severely impairing its ventilatory function. The detection of early-stage MPM on CT is difficult because of the complexity of thoracic anatomy and the challenge in distinguishing the tumour from neighbouring tissues, in terms of both pixel intensity and regional texture. A sample CT axial slice, with the relevant thoracic tissues highlighted, is shown in Fig. 1. Intensity distributions of these tissues (in Hounsfield units) are shown in Fig. 2. Their overlapping nature, hence the tumour’s low contrast on CT, is evident.
To quantify the progression of a tumour and its response to treatment in clinical trials and patient follow-ups, current clinical practice recommends the use of MPM-adapted Response Evaluation Criteria in Solid Tumour (modified RECIST) [6]. This quantifies the tumour based on a one-dimensional measurement of its thickness at two locations on three axial levels of the scan. A major drawback of modified RECIST is that it measures the tumour at just six singular points, irrespective of the tumour’s overall shape and growth pattern. As a result, it is known to be prone to intra-observer and inter-observer variations. In one study [7], major and minor disagreements were found in 40% and 10.5% of the cases, respectively. Such discrepancies can largely be attributed to the inconsistent selection of measurable lesions and radiological artefacts such as the partial volume effect, which gives rise to ambiguous tissue boundaries. Additionally, being one dimensional in nature, the system fails to adequately address tumour growth in the axial direction. Overall, considering the low CT contrast between the MPM tumour and surrounding tissues and the tumour’s characteristic ‘rind-pattern’ growth, modified RECIST is limited both in its ease of application, consistency and overall clinical utility.
Noting the limitations of modified RECIST, previous works on MPM [8,9,10,11,12,13,14,15,16] have supported the use of segmented tumour volumes for evaluating the tumour’s response to treatments.
Ak et al. [8] estimated the tumour volume by counting the number of evenly spaced dots that fall within the tumour boundary, as determined by the clinical observer. Though the results showed good correlation with patient survival and prognostic data, it remains a manual method, which would require tedious and time-consuming radiological supervision.
Armato et al. [9] developed an automated method to compute for modified RECIST. This method works by first segmenting the lungs by thresholding to mark the inner margin of the tumour, followed by taking a thickness measurement perpendicular to the nearby chest wall or mediastinum. The results were presented in terms of ‘clinical acceptance rate’, as determined by trained radiologists, which was found to be as high as 75%. Although this approach offers some guidance for making RECIST measurements, it still makes use of the modified RECIST framework and does not tackle its intrinsic limitations.
In view of the challenging nature of automated MPM segmentation, Frauenfelder et al. [10] applied interpolation to hand-drawn tumour contours found on every 4–5 axial cuts. Inter-observer agreement of the segmented tumour was reported to be significantly higher than that of modified RECIST (\(\kappa =0.9\) vs \(\kappa =0.33\)). However, although interpolation helped reduce the workload, the method did not circumvent the need for manual drawing.
Liu et al. [11] presented some preliminary works on a volume-based MPM tumour evaluation, where the authors studied the baseline and follow-up data collected from 30 patients and found patient survival to be linked to baseline tumour volume with a good degree of certainty.
Chaosaowong et al. [14] introduced a method that computes a contour containing the tumour and pleura. Assuming a convex shape for the pleura, concave irregularities are treated as potential sites of pleural thickening, which would undergo thresholding before the final classification. In addition to being prone to thresholding-related issues, this approach made numerous assumptions about the tumour’s pattern of growth, which would limit its applicability in a wider clinical context.
Sensakovic et al. [15] applied a more advanced MPM segmentation method based on a nonlinear diffusion model and a k-class classifier. For each of the 31 MPM scans examined in the study, 5 axial scans were segmented on a 2-D basis and validated by manual delineations made by five independent clinical observers. Mean Jaccard similarity coefficient (J-index) was found to be 0.517 (\(p < 0.05\)) between observers and 0.484 (\(p< 0.05\)) between manual and computed segmentations, which is less than ideal for a wider clinical application. It should also be noted that this method was implemented in 2-D, tested only with diagnostic imaging data, and did not allow the clinician to influence the segmentation itself through user interaction. Labby et al. [16] added an interpolation component to the 2-D method of Sensakovic et al. and extended its scope to MPM follow-up studies. An inverse relationship was reported between the tumour and aerated lung volumes, which is in line with clinical expectation.
It should be noted despite the above efforts, a method that is capable of segmenting all tumour cases accurately is yet to be established.
The segmentation of MPM presents numerous application-specific challenges, one of which is due to the similarity in CT attenuation of an MPM lesion with its neighbouring tissues. This is made worse by the presence of atelectatic lungs and pleural effusion; commonly found in patients with clinically evident MPM. This largely precludes the direct application of simple segmentation methods such as thresholding, region growing, texture filtering, and active contours. The tumour may also grow in finger-like projections along the lung fissures or hilar vessels and can invade the neighbouring structures. This would severely affect the performance of shape and morphology-based methods [13]. Moreover, the long thin shape of the tumour, anatomical complexity of the thoracic region, in particular due to secondary chest conditions such as pleural effusion, intrinsic image noise, and partial volume effect, pose considerable challenges which collectively prevent the application of many established segmentation methods.
In this paper, we present a computer-aided segmentation algorithm that is capable of accurately segmenting the MPM tumour and has the ability to incorporate input from end-users with good robustness.
Methods and materials
Study design
The data used in this study were collected from a Phase II clinical trial of Vinflunine, which was tested as a therapeutic agent for MPM across nine centres in the UK, France, and Germany. Specifics on the trial design and outcome are given in [17]. Informed consent was obtained from all individual participants included in the study.
For our study, data from the UK centres were available, collected from 15 patients, with a total of 48 baseline and follow-up CT scans. Patient characteristics are given in Table 1. All patients had histologically and cytologically confirmed cases of mesothelioma and at least one lesion that satisfied the measurability criteria in modified RECIST (defined as pleural tumour thickness of at least 5 mm at three locations on the CT scan, with a sum >20 mm). Each participant received one baseline scan and between one to three follow-up scans. All scans are valid for assessing tumour responses under modified RECIST (i.e. at least four weeks have lapsed between subsequent scans). Patients were treated until either disease progression or unacceptable chemotherapeutic toxicity.
Data collection
The CT examinations were performed on a LightSpeed Ultra CT scanner (General Electric Medical Systems). Each CT scan consisted of multiple axial slices of \(512 \times 512\) pixels. An assortment of thick (5 mm), thin (2.5 mm), and quasi-isotropic (0.625 mm) scans was available, with a voxel spacing of 0.68 mm. No contrast enhancing agent was used.
Random walk-based image segmentation
We implemented the semi-automatic random walk-based segmentation method by Grady [18], where details of the mathematical formulation are presented. The method handles weak tissue boundaries well and is able to segment any arbitrary shapes with appropriately placed seeds.
The key steps in our segmentation algorithm are outlined in Fig. 3.
We have extended Grady’s original method to 3-D based on a nine-connected graph model, aiming to improve the algorithm performance by adopting additional image information from adjacent axial slices for classifying the image voxel in question. Performance-wise, it is superior to simple interpolation applied in the vertical axis because uneven tumour growth and anatomical irregularities are dealt with equally in the planar and inter-planar domains and are therefore better accounted for.
Compared to its planar counterpart, a volumetric segmentation would not require exhaustive initialisation on all axial slices; specifying initialisation seeds on just a few axial slices is sufficient to produce accurate full volume segmentations.
User interaction
User-defined seeds are initialisation points the radiologically trained user places, based on their clinical experience, in regions they known to be of tumour. Using a semi-automated method with user-defined seeds is advantageous because it gives the radiologists more control of the segmentation process by enabling them to influence both the initialisation and post-segmentation revision steps with their clinical knowledge about the patient’s disease.
However, defining ’seed regions’, contour areas of known tumour instead of points within the tumour, as required by Grady’s random walk-based method, on a large number of image slices is laborious, substantially reducing the clinical practicality of the algorithm. For our study, initialising seeds are placed by a clinical radiology specialist with five years of MPM diagnostic experience, based on expert knowledge about MPM, and added them to between six and ten axial slices for each image scan, that is, one initialised slice for every ten raw image slices. On average, 20–30 seeds were placed per initialisation slice, taking 20–30 s. The initialisation slices were not evenly distributed across the volume scan; they tend to concentrate around regions of difficulty, marked by the presence of weak tumour boundary, fluid and/or collapsed lung. Additionally, to facilitate an effective response evaluation, the same axial locations were selected for initialisation in follow-up scans of the same patient. This is comparable to modified RECIST, where the measurements are taken from the same transverse cuts for different scans of the same patient. Further seeds can be added at a review stage if deemed necessary by the observer, to enhance the segmentation accuracy. This was only required in one out of every three scans. The additional running time for this additional seeding process is minimal, normally a fraction of the overall time spent on the initial segmentation, as will be presented in the Results section of this paper.
All computation times are based on using a workstation with Pentium-D CPU 3.39 GHz with 2GB of RAM.
Gold standard
To validate our findings, a clinical radiologist with five years of experience in MPM evaluation manually delineated the tumour contours on the whole imaging dataset. Though such delineations vary between observers and over time, for simplicity, we refer to them here as the ’reference truth’. We recognise the fact that the reference truth used might not be ideal, but for the purpose of our study and from an explorative research perspective, we use them here as a surrogate gold standard. To reduce observer bias, a blinded experimental design was implemented, where the delineations were made without knowledge of the clinical outcomes of individual patients and the modified RECIST measurements.
Data analysis and statistical methods
The accuracy of the segmentation results is evaluated by calculating the Sørensen–Dice index (DICE) according to the following equation, where X and Y represents the reference truth and the segmentation result, respectively:
To assess the clinical utility of the computer-assisted method, we computed the correlation of changes in computed tumour volume with those in modified RECIST measurement.
Results
Tumour quantification
Applying our computer-aided algorithm, segmented MPM tumour contours are computed in the axial planes. Sample results from two arbitrarily selected scans are shown in Fig. 4. Note the close resemblance of the segmented tumour with the reference truth. The calculated planar DICE measures in these cases were 0.89 and 0.91, respectively.
Results validation
An assessment of the effect of user input on the method’s performance and its overall robustness is shown in Fig. 5. Note the accuracy of segmentation is largely independent of the number of ’seeds’ used, once beyond a certain level. Note also the good reproducibility and consistency of the results, where changing the ’seeding’ map did not significantly impact on the overall segmentation accuracy.
An analysis of the accuracy measure for individual slices in these cases is shown in Fig. 6. As expected, performance of the algorithm generally deteriorates with distance from the initialisation slices. Full segmentation results and computation times of each individual scan are presented in Tables 2 and 3, respectively.
Good accuracy of the computerised method is clearly demonstrated, with results yielding a mean accuracy of 0.825 (95% CI [0.758, 0.892]).
Time efficiency of our method
The median time spent on manually delineating the tumour in a typical CT scan was 68.1 min (range [40.2, 102.4]). In comparison, the median running time of the computer-aided procedure was 23.1 min (range [10.9, 37.0]). The median total time spent on manual user interaction was 2.8 min (range [1.8, 4.2]) per image scan. The computer running time could potentially be reduced further by increasing the workstation processing power or by incorporating the use of graphics processor units (GPUs).
Although modified RECIST would take less time to measure from start to finish, it remains a manual process, which requires focused work from a clinician; whereas a computer-aided algorithm such as the one presented in this paper requires little supervision and would enable this clinical time to be invested elsewhere.
Statistical correlation with modified RECIST
Correlation with the modified RECIST is shown as a scatter plot with linear fit, as shown in Fig. 7.
This shows that tumour response found using the segmented volumes is well correlated with that predicted by the change in modified RECIST and supports the use of volumetric segmentation from a clinical perspective.
Discussion
Assessing the therapeutic response of MPM is difficult because of the tumour’s poor image contrast and its large variation in shape and growth pattern, which prevent an effective choice of measurement points when employing modified RECIST. These characteristics also happen to make the computer-assisted segmentation of MPM difficult.
It should be noted that apart from Sensakovic et al. [15], most of the existing works on computer-assisted MPM segmentation did not assess the accuracy of their proposed method in a systematic way. Sensakovic et al. [15], whilst presenting a more advanced approach to the problem, produced a less than desirable J-index of 0.484, was implemented only in the planar space, was applied to only diagnostic imaging data, and did not allow the clinician to influence the segmentation itself through user interaction.
Our proposed method, on the other hand, incorporates a three-dimensional framework, flexibly accepts end-user inputs, and produces results that are consistently accurate and with competitive running times.
The results from our method are generally satisfactory, yielding a mean accuracy (DICE) of 0.825 (95% CI [0.758, 0.892]), taking a median running time of 1385 s (95% CI [653, 2218]), greatly reducing the time requirement of an otherwise tedious process. The method also exhibits good robustness because changing the user seed number and configuration did not significant alter the end result. A strong correlation was found between the changes in tumour volume and those in modified RECIST. These results support the use of our algorithm in segmenting MPM for both diagnostic and treatment monitoring purposes. A comparison with results from various published works on computer-assisted MPM segmentation is given in Table 4.
To further assess the applicability of our method in a wider clinical context, it is crucial to develop and validate criteria for categorising tumour changes. Oxnard et al. [19] used geometric models to suggest equivalents of the RECIST classification criteria in the volume space. We note that given the small size and distribution of our data, we are unable to validate these thresholds based on our study because only 1 out of our 15 patients would be classified as ‘progressive disease’ and the rest ‘stable disease’. In addition, although these geometric model-derived thresholds provide good insight into potential volume response criteria, because they are based on standard geometric shapes, they may not lend well to the uneven shapes and irregular growth patterns of MPM. Currently, the issue of volume response criteria remains a contentious area requiring more work.
To further our work, larger patient datasets are needed. It would also be helpful to collect more detailed follow-up clinical data from the patients, such as measures of their quality of life and prognostic data, preferably stratified according to age, gender, and disease stage at diagnosis. These additional clinical data would enable us to better validate our method.
Due to the challenges in assessing the MPM tumour based on CT scans alone, there is a growing interest in employing metabolic imaging in MPM follow-ups [20, 21]. To this end, it might be helpful to examine the possibility of bridging the information obtained from segmented tumour volume to metabolic PET data, such as establishing a correlation between changes in the tumour’s metabolic output and a particular trend of morphological change in its shape.
Currently, modified RECIST remains the standard approach to quantifying MPM in clinical practice, mostly due to its favourable prediction of patient survival and its existing wide acceptance in the radiological community. However, computer-aided volume-based methods, such as the one presented in this paper, are emerging as a new tactic to the clinical problem, for their automated action and better performance consistency.
References
World Health Organization (2007) WHO calls for prevention of cancer through healthy workplaces. Secondary WHO calls for prevention of cancer through healthy workplaces. http://www.who.int/mediacentre/news/notes/2007/np19/en/index.html
Rushton L, Hutchings S, Brown T (2008) The burden of cancer at work: estimation as the first step to prevention. Occup Environ Med 65(12):789–800. doi:10.1136/oem.2007.037002
Vogel L (2005) Special report: asbestos in the world. HESA Newslett 27:7–21
Courtice MN, Lin S, Wang X (2012) An updated review on asbestos and related diseases in China. Int J Occup Environ Health 18(3):247–253. doi:10.1179/1077352512Z.00000000021
Joshi TK, Bhuva UB, Katoch P (2006) Asbestos ban in India: challenges ahead. Ann NY Acad Sci 1076:292–308. doi:10.1196/annals.1371.072
Byrne MJ, Nowak AK (2004) Modified RECIST criteria for assessment of response in malignant pleural mesothelioma. Ann Oncol 15(2):257–260
Thiesse P, Ollivier L, Di Stefano-Louineau D, Négrier S, Savary J, Pignard K, Lasset C, Escudier B (1997) Response rate accuracy in oncology trials: reasons for interobserver variability. Groupe Français d’Immunothérapie of the Fédération Nationale des Centres de Lutte Contre le Cancer. J Clin Oncol 15(12):3507–3514. doi:10.1200/jco.1997.15.12.3507
Ak G, Metintas M, Metintas S, Yildirim H, Ozkan R, Ozden H (2010) Three-dimensional evaluation of chemotherapy response in malignant pleural mesothelioma. Eur J Radiol 74(1):130–135. doi:10.1016/j.ejrad.2009.02.002
Armato SG 3rd, Oxnard GR, Kocherginsky M, Vogelzang NJ, Kindler HL, MacMahon H (2005) Evaluation of semiautomated measurements of mesothelioma tumor thickness on CT scans. Acad Radiol 12(10):1301–1309. doi:10.1016/j.acra.2005.05.021
Frauenfelder T, Tutic M, Weder W, Götti RP, Stahel RA, Seifert B, Opitz I (2011) Volumetry: an alternative to assess therapy response for malignant pleural mesothelioma? Eur Respir J 38(1):162–168. doi:10.1183/09031936.00146110
Liu F, Zhao B, Krug LM, Ishill NM, Lim RC, Guo P, Gorski M, Flores R, Moskowitz CS, Rusch VW, Schwartz LH (2010) Assessment of therapy responses and prediction of survival in malignant pleural mesothelioma through computer-aided volumetric measurement on computed tomography scans. J Thorac Oncol 5(6):879–884. doi:10.1097/JTO.0b013e3181dd0ef1
Plathow C, Schoebinger M, Fink C, Hof H, Debus J, Meinzer HP, Kauczor HU (2006) Quantification of lung tumor volume and rotation at 3D dynamic parallel MR imaging with view sharing: preliminary results. Radiology 240(2):537–45. doi:10.1148/radiol.2401050727
Labby ZE, Armato SG, Dignam JJ, Straus C, Kindler HL, Nowak AK (2013) Lung volume measurements as a surrogate marker for patient response in malignant pleural mesothelioma. J Thorac Oncol 8(4):478–486. doi:10.1097/JTO.0b013e31828354c8
Chaisaowong K, Aach T, Jager P, Vogel S, Knepper A, Kraus T (2007) Computer-assisted diagnosis for early stage pleural mesothelioma: towards automated detection and quantitative assessment of pleural thickening from thoracic CT images. Methods Inf Med 46(3):324–331. doi:10.1160/ME9050
Sensakovic WF, Armato SG 3rd, Straus C, Roberts RY, Caligiuri P, Starkey A, Kindler HL (2011) Computerized segmentation and measurement of malignant pleural mesothelioma. Med Phys 38(1):238–244. doi:10.1118/1.3525836
Labby ZE, Nowak AK, Dignam JJ, Straus C, Kindler HL, Armato SG (2013) Disease volumes as a marker for patient response in malignant pleural mesothelioma. Ann Oncol 24(4):999–1005. doi:10.1093/annonc/mds535
Talbot DC, Margery J, Dabouis G, Dark G, Taylor H, Boussemart H, Cadic V, Pinel MC, Rivière A, Ollivier L, Ruffié P (2007) Phase II study of vinflunine in malignant pleural mesothelioma. J Clin Oncol 25(30):4751–4756. doi:10.1200/JCO.2007.12.5641
Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28(11):1768–1783. doi:10.1109/TPAMI.2006.233
Oxnard GR, Armato SG 3rd, Kindler HL (2006) Modeling of mesothelioma growth demonstrates weaknesses of current response criteria. Lung Cancer 52(2):141–148. doi:10.1016/j.lungcan.2005.12.013
Basu S, Saboury B, Torigian DA, Alavi A (2011) Current evidence base of FDG-PET/CT imaging in the clinical management of malignant pleural mesothelioma: emerging significance of image segmentation and global disease assessment. Mol Imaging Biol (MIB) 13(5):801–811. doi:10.1007/s11307-010-0426-6
Armato SG 3rd, Entwisle J, Truong MT, Nowak AK, Ceresoli GL, Zhao B, Misri R, Kindler HL (2008) Current state and future directions of pleural mesothelioma imaging. Lung Cancer 59(3):411–420. doi:10.1016/j.lungcan.2007.09.027
Funding
This study was funded by the National Institute of Health Research—Biomedical Research Centres Research Grant.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Chen, M., Helm, E., Joshi, N. et al. Computer-aided volumetric assessment of malignant pleural mesothelioma on CT using a random walk-based method. Int J CARS 12, 529–538 (2017). https://doi.org/10.1007/s11548-016-1511-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-016-1511-3