Goal
Participants are asked to submit automated predictions of lesion segmentation boundaries from dermoscopic images.
Data
Lesion segmentation data includes the original image, paired with the expert manual tracing of the lesion boundaries in the form of a binary mask.
Training Data
Dermoscopy Image Data
2000 images are provided as training data. The training data
file is a ZIP file, containing dermoscopic lesion images in
JPEG format. All images are named using the scheme
ISIC_<image_id>.jpg, where
<image_id> is a 7-digit unique identifier.
EXIF tags in the images have been removed; any remaining EXIF
tags should not be relied upon to provide accurate
metadata.
Ground Truth Segmentations
The training ground truth file is a ZIP file, containing
2000 binary mask images in PNG format. All masks are named
using the scheme
ISIC_<image_id>_Segmentation.png, where
<image_id> matches the corresponding
Training Data image for the mask. All mask images will have the
exact same dimensions as their corresponding lesion image. Mask
images are encoded as single-channel (grayscale) 8-bit PNGs (to
provide lossless compression), where each pixel is either:
0: representing the background of the image, or areas outside the lesion255: representing the foreground of the image, or areas inside the lesion
Masks were created by an expert clinician, using either a semi-automated process (using a user-provided seed point, a user-tuned flood-fill algorithm, and morphological filtering) or a manual process (from a series of user-provided polyline points).
Participants are not strictly required to utilize the training data in the development of their lesion segmentation algorithm and are free to train their algorithm using external data sources. Any such external sources of data must be properly cited in the supplied abstract.
Submission Instructions
The Test Data files are in a ZIP container, and are the exact same format as the Training Data. The Test Data files should be downloaded via the "Download test dataset" button below. Note: you must be signed-in and registered to participate in this phase of the challenge in order for this link to be visible.
The submitted Test Results file should be in the exact same format as the Training Ground Truth file. Specifically, the results file should be a ZIP file of 600 binary mask images in PNG format. Each mask should contain the participant's best attempt at a fully automated lesion segmentation of the corresponding image in the Test Data. Each mask should be named and encoded according to the conventions of the Training Ground Truth.
Participants may make unlimited and independent submissions to each phase, but only the most recent submission to the Test Phase will be used for official judging.
Evaluation
Participants will be ranked and awards granted based only on the Jaccard index. Additionally, submitted segmentations will be compared the following variety of metrics, for scientific completeness:
Some useful resources for metrics computation include: