Melanoma is considered the most deadly form of skin cancer and is caused by the development of a malignant tumour of the melanocytes.  The objective of the skin cancer detection project is to develop a framework to analyze and assess the risk of melanoma using dermatological photographs taken with a standard consumer-grade camera.
 
The skin cancer detection framework consists of novel algorithms to perform the following:

  • illumination correction preprocessing
  • segmentation of the lesion
  • feature extraction 

Our data set is provided at the end of the page. This includes images extracted from the public databases DermIS and DermQuest, along with manual segmentations of the lesions.

Illumination Correction Preprocessing

The first step in the proposed framework is a preprocessing step, where the image is corrected for illumination variation (i.e. the presence of shadows and brightly illuminated areas). Our approach to the problem of correcting is a multi-stage illumination modeling algorithm. We assume an illumination-reflectance multiplicative model where each pixel from the Value colour channel (in the HSV colour space) can be decomposed into an illumination component and a reflectance component. The goal of the algorithm is to first estimate the illumination component and calculate the reflectance component using that illumination estimate.

In the VIP lab, the proposed multi-stage illumination modeling algorithm uses the following stages to estimate and correct for illumination variation (shown in Fig. 1):

  • Initial Monte Carlo illumination estimate
  • Final parametric illumination estimate
  • Calculate the reflectance component

Flow chart showing the steps to correct the input image for illumination variation.

 Fig. 1. Flow chart showing the steps to correct the input image for illumination variation. 

Skin Lesion Segmentation

The objective of the skin lesion segmentation step is to find the border of the skin lesion. It is important that this step is performed accurately because many features used to assess the risk of melanoma are derived based on the lesion border. Our approach to finding the lesion border is a texture distinctiveness-based lesion segmentation. 

Flow chart showing the steps to calculate the texture distinctiveness of metric

 Fig 2. Flow chart showing the steps to calculate the texture distinctiveness of metric

The first stage of the skin lesion segmentation algorithm is to learn representative texture distributions and calculate the texture distinctiveness metric for each distribution (shown in Fig. 2). A texture vector is extracted for each pixel in the image. Then, a Gaussian mixture model is implemented that learns the texture distributions based on the set of texture vectors. Finally, the dissimilarity between a texture distribution and all other texture distirbutions is measured, which is quantified as the texture distinctiveness metric.

Flow chart showing the merging of the texture distinctiveness map and initial regions. 

Fig. 3. Flow chart showing the merging of the texture distinctiveness map and initial regions. Each solid colour in the image of initial regions corresponds to a single region.

In the second stage, the pixels in the image are classified as being part of the normal skin or lesion class (shown in Fig. 3). To do this, the image is divided into a number of regions. These regions are combined with the texture distinctiveness map to find the skin lesion.

Feature Extraction

In order to use classification techniques, the image must be transformed such that it represented a point in some n-dimensional feature space. The axes in this feature space represent calculations that are relevant to describing the observed phenomenon (e.g., malignancy).

We propose a set of what we call high-level intuitive features (HLIFS). A HLIF is defined as follows (Amelard 2013):

High-Level Intuitive Feature (HLIF): A mathematical model that has been carefully designed to describe some human-observable characteristic, and whose score can be intuited in a natural way.

In standard clinical practice, many dermatologists follow the ABCD rule for identifying melanoma. That is, for a given skin lesion, they attempt to identify Asymmetry (colour/structure), Border irregularity, Colour patterns, and Diameter. Our work involves modeling the ABC components of this analysis. Using the HLIF framework (Amelard 2013), these features are modeled such that intuitive diagnostic rationale can be given back to the doctor.

Fig. 4 shows an example interface. Since the features were designing according to the HLIF framework, the system is able to convey to the user why it detected colour asymmetry.

Example interface (GUI1)

Example Interface GUI2

 

Fig. 4. Example interface showing how intuitive diagnostic rationale can be given to the user. This increases the user-system trust over a simple classification output.

Melanoma images are from the DermIS (http://www.dermis.net) and DermQuest (http://www.dermquest.com) database.

Downloads

Skin Image Data Set 1.zip

Skin Image Data Set 2.zip

Related people

Directors

Alexander Wong, David A. Clausi, Paul Fieguth

Students

Andre Carrington, Daniel S. Cho, Elnaz Barshan, Farnoud Kazemzadeh, Robert Amelard, Shahid Haider, Edward Li

Alumni

Jeffrey Glaister

Related research areas

Biomedical Imaging

Image Segmentation/Classification

Related  publications

Journal articles

Glaister, J.A. Wong, and D. A. Clausi, "Automatic segmentation of skin lesions from dermatological photographs using a joint probabilistic texture distinctiveness approach", IEEE Transactions on Biomedical Engineering, Accepted.Details

Amelard, R.J. GlaisterA. Wong, and D. A. Clausi, "High-level intuitive features (HLIFs) for intuitive skin lesion descriptionpdf", IEEE Transactions on Biomedical Engineering, vol. 62, issue 3, pp. 820-831, October, 2015.Details

Glaister, J.R. AmelardA. Wong, and D. A. Clausi, "MSIM: Multi-Stage Illumination Modeling of Dermatological Photographs for Illumination-Corrected Skin Lesion Analysis", IEEE Transactions on Biomedical Engineering, vol. 60, issue 7, pp. 1873 - 1883, November, 2013. Details

 Conference papers

Chung, A.C. Scharfenberger, F. Khalvati, A. Wong, and M. A. Haider, "Statistical Textural Distinctiveness in Multi-Parametric Prostate MRI for Suspicious Region Detectionpdf", International Conference on Image Analysis and Recognition (ICIAR) , July, 2015. Details

Kazemzadeh, F.S. HaiderA. WongC. Scharfenberger, and D. A. Clausi, "Concurrent Multiview Discrete Spectral Imaging Device from the VIS to the NIR", SPIE: Optics + Photonics, Novel Optical Systems Design and Optimization XVII , vol. 9193, San Diego, USA, SPIE Proceedings, 2014. Details


Amelard, R.A. Wong, and D. A. Clausi, "Extracting Morphological High-Level Intuitive Features (HLIF) for Enhancing Skin Lesion Classificationpdf", 34th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, pp. 4458 - 4461, August, 2012. Details
 
Amelard, R.A. Wong, and D. A. Clausi, "Extracting High-Level Intuitive Features (HLIF) For Classifying Skin Lesions Using Standard Camera Imagespdf", 9th Conference on Computer and Robot Vision, Toronto, pp. 396-403, May, 2012. Details
 

Glaister, J.A. Wong, and D. A. Clausi, "Illumination Correction in Dermatological Photographs using Multi-stage Illumination Modeling for Skin Lesion Analysis", 34th Annual International Conference of the IEEE Engineering in Medicine and Biology, pp. 102-105, 2012. Details

Book chapters

Amelard, R.J. GlaisterA. Wong, and D. A. Clausi, "Melanoma decision support using lighting-corrected intuitive feature modelspdf", Computer Vision Techniques for the Diagnosis of Skin Cancer, pp. 193 - 219, October, 2013. Details

Theses

Amelard, R., "High-Level Intuitive Features (HLIFs) for Melanoma Detectionpdf", Department of Systems Design Engineering, pp. 85, 2013. Details

Glaister, J, "Automatic segmentation of skin lesions from dermatological photographspdf", Department of Systems Engineering, Waterloo, ON, Canada, University of Waterloo, 2013. Details