ISIC 2017 Challenge [Closed]

Summary

The goal of the challenge is to help participants develop image analysis tools to enable the automated diagnosis of melanoma from dermoscopic images. Image analysis of skin lesions is composed of 3 parts:

  • Part 1: Lesion Segmentation
  • Part 2: Detection and Localization of Visual Dermoscopic Features/Patterns
  • Part 3: Disease Classification

Please note: Competitors may choose to participate in any of the three parts. Participation in all three is not mandatory

This challenge provides training data (~2000 images) for participants to engage in all 3 components of lesion image analysis. A separate public validation dataset (~150 images) and blind held-out test dataset (~600 images) will be provided for participants to generate and submit automated results.

This year, participants are required to write-up a 4 page abstract describing the methods used to generate their submissions, post these abstracts to arXiv, and submit a link to the document with their results. Participants are also asked, but not required, to make source code freely available online (i.e. via GitHub).

All participants are also invited to expand upon their 4 page abstract and submit a full-length manuscript to a special issue of the IEEE Journal of Biomedical and Health Informatics (JBHI) dedicated to the challenge and skin lesion analysis. More details will be coming shortly.

Important Dates (subject to change)

  • December 9th, 2016: Release training data (images + ground truth)
  • January 7th, 2017: Release validation and test datasets (images only)
  • March 1st, 2017: Submission Deadline
  • March 2nd, 2017: Winners announced, and speaker invitations sent.
  • April 18-21st, 2017: Conference

Publication Mechanisms

This year, there will be three primary mechanisms participants will have to publish their work:

  1. All participants will be required to write a 4 page abstract describing the methods used in their submission. Participants must post these abstracts to arXiv, and provide links to these documents with their submissions. These documents will be curated and linked to from the challenge website. Any submissions without this link will not be accepted. Only one abstract is needed to cover submissions to all parts that a participant wishes to submit to. Participants are encouraged, though not required, to provide source code links in their abstracts (i.e. GitHub).

  2. Participants will be invited to expand their abstract into a full-length journal manuscript for submission to an IEEE Journal of Biomedical and Health Informatics (JBHI) Special Issue on Skin Lesion Analysis. Details to follow.

  3. Participants are permitted to publish their work to alternative journals of their choosing. However, these must be submitted after the IEEE Special Issue has been published.

The organizing committee has published a preprint manuscript summarizing the challenge methods and the overall findings:

Codella N, Gutman D, Celebi ME, Helba B, Marchetti MA, Dusza S, Kalloo A, Liopyris K, Mishra N, Kittler H, Halpern A. "Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)". arXiv: 1710.05006 [cs.CV] Available: https://arxiv.org/abs/1710.05006

When using this dataset for research publications, please use the above citation.

Organizers

  • Members of the International Skin Imaging Collaboration
  • Allan Halpern (Clinical Leader) (Memorial Sloan Kettering Cancer Center, New York, USA)
  • Brian Helba (Technical Leader) (Kitware, New York, USA)
  • David Gutman (Technical Leader) (Emory University, Atlanta, USA)
  • Noel Codella (Computer Vision Expert) (IBM, New York, USA)
  • M. Emre Celebi (Computer Vision Expert) (University of Central Arkansas, Conway, Arkansas)