Task
The goal for ISIC 2019 is classify dermoscopic images among nine different diagnostic categories:
- Melanoma
- Melanocytic nevus
- Basal cell carcinoma
- Actinic keratosis
- Benign keratosis (solar lentigo / seborrheic keratosis / lichen planus-like keratosis)
- Dermatofibroma
- Vascular lesion
- Squamous cell carcinoma
- None of the others
25,331 images are available for training across 8 different categories. Additionally, the
test
dataset (planned release August 2nd) will contain an additional outlier class not
represented in
the training data, which developed systems must be able to identify.
Two tasks will be available for participation: 1) classify dermoscopic images without
meta-data,
and 2) classify images with additional available meta-data. Task 1’s deadline will be August
16th.
Task 2 will be August 23th, after release of test meta-data on August 16th. Participants of
Task 2
must submit to Task 1 as well, though participants can submit to Task 1 alone.
In addition to submitting predictions, each competitor is required to submit a link to a
manuscript
describing the methods used to generate predictions.
Submission
Submissions are made to the
ISIC Challenge submission system, which
provides automated
format validation, pre-scoring, metadata editing capabilties.
Evaluation
Evaluation of algorithms is entirely automated, and rankings are determined by balanced
multi-class
accuracy. At the conclusion of the ISIC Challenge, all scores are posted to a public
leaderboard,
providing official rankings and more detailed metrics for every submission.
Awards
Cash prizes of $4,000, $2,000, and $1,000 will be awarded to the first, second, and third
place
participants of image-only and meta-data tasks. USD will be awarded to winners of each of
the
tasks. The monetary prizes for the winners of the challenge will be awarded after the MICCAI
Workshop in Shenzhen, China, in October 2019. The prizes are being provided by Canfield
Scientific,
Inc., a US company, and are subject to any restrictions incumbent on the sponsor. Winners
will be
asked to identify a recipient individual or entity who will be required to provide tax
documentation
(U.S. citizens- IRS form W-9, non-U.S. citizens Form W-8 BEN).
Sponsors
- Canfield Scientific
- IBM
- MetaOptima
Clinical Chairs
- Josep Malvehy, M.D. ;
University Hospital Clinic of Barcelona, Barcelona, Spain - Allan Halpern, M.D. ;
Memorial Sloan Kettering Cancer Center, New York City, NY, USA
Computer Vision Chairs
- Noel C. F. Codella, Ph.D. ;
IBM Research, Yorktown Heights, NY, USA
Challenge Co-Chairs
- M. Emre Celebi, Ph.D. ;
University of Central Arkansas, Conway, AR, USA - Marc Combalia, M.S. ;
Fundació Clínic per a la Recerca Biomèdica, Barcelona, Spain - David Gutman, M.D., Ph.D. ;
Emory University, Atlanta, GA, USA - Brian Helba ;
Kitware, Inc., Clifton Park, NY, USA - Harald Kittler, M.D. ;
Medical University of Vienna, Vienna, Austria - Veronica Rotemberg, M.D., Ph.D. ;
Memorial Sloan Kettering Cancer Center, New York City, NY, USA - Philipp Tschandl, M.D., Ph.D. ;
Medical University of Vienna, Vienna, Austria