Datasets & Publications

EndoVis 2026

Sub-ChallengePublicationDataset
RARE2026: Recognition of Anomalies in low-pREvalance cancer
SurgVu2026: Surgical Visual Understanding
STIR2026: Surgical Tissue Tracking Using the STIR (Surgical Tattoos in Infrared) Dataset
TIGER-SQ-AI2026: AI-based surgical quality assessment for thoracic lymphadenectomy in minimally invasive  esophagectomy 
CLiMB2026: Colonoscopy Localization and Mapping Benchmark
iMED2026: Multi-Endoscope Dataset Novel View Synthesis Challenge

EndoVis 2025

Sub-ChallengePublicationDataset
SurgVu: Surgical Visual Understandinghttps://arxiv.org/abs/2501.09209
RARE: Recognition of Anomalies in low-pREvalance cancer
STIR: Surgical Tissue Tracking Using the STIR (Surgical Tattoos in Infrared) Dataset
OSS: Open Suturing Skillshttps://zenodo.org/records/7940583

EndoVis 2024

Sub-ChallengePublicationDataset
PhaKIR: Surgical Procedure Phase Recognition, Keypoint Estimation, and Instrument Instance Segmentationhttps://doi.org/10.1016/j.media.2026.103945https://doi.org/10.5281/zenodo.15740620
SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarially Generated Corruptionshttps://arxiv.org/abs/2407.11906
SegCol: Semantic Segmentation for Tools and Fold Edges in Colonoscopy datahttps://arxiv.org/abs/2412.16078https://www.synapse.org/Synapse:syn59491650.1/datasets/
SurgVU: Surgical visual understandinghttps://arxiv.org/abs/2501.09209
HiSWA-RLLS: Hierarchical surgical workflow analysis for robotic left lateral sectionectomyhttps://www.synapse.org/Synapse:syn55239402.2/datasets/
STIR: Surgical Tissue Tracking Using the STIR (Surgical Tattoos in Infrared) Datasethttps://arxiv.org/abs/2503.24306https://zenodo.org/records/14803158
OSS: Open Suturing Skills Challengehttps://zenodo.org/records/7940583
FedSurg: Federated Learning for Surgical Visionhttps://arxiv.org/abs/2510.04772

EndoVis 2023

Sub-ChallengePublicationDataset
SIMS: Surgical Instrument Multi-Domain Segmentation Challengehttps://www.synapse.org/Synapse:syn47193563/files/
PitVis: Surgical workflow and instrument recognition in endonasal surgeryhttps://arxiv.org/abs/2409.01184https://doi.org/10.5522/04/26531686
SurgToolLoc: Surgical Tool Localization in endoscopic videoshttps://arxiv.org/abs/2305.07152https://arxiv.org/abs/2501.09209
Syn-ISSSynthetic data for Instrument Segmentation in Surgery
SurgRIPE: Surgical Robot Instrument Pose Estimationhttps://doi.org/10.1016/j.media.2025.103674https://www.synapse.org/Synapse:syn51471789/files/

EndoVis 2022

Sub-ChallengePublicationDataset
SurgToolLoc: Endoscopic surgical tool localization by leveraging tool presence labelshttps://arxiv.org/abs/2305.07152https://arxiv.org/abs/2501.09209
CholecTriplet2022: Surgical Action Triplet Detection and Localizationhttps://arxiv.org/abs/2302.06294https://github.com/CAMMA-public/cholect45
SAR-RARP50: Instrumentation segmentation and Action Recognition on robotic RadicalProstatectomyhttps://arxiv.org/abs/2401.00496https://rdr.ucl.ac.uk/projects/SAR-RARP50_Segmentation_of_surgical_instrumentation_and_Action_Recognition_on_Robot-Assisted_Radical_Prostatectomy_Challenge/191091
SimCol-to 3D: Simulated Colonoscopy data for 3D (scene) reconstructionhttps://arxiv.org/abs/2307.11261https://www.synapse.org/#!Synapse:syn28548633/wiki/617130
SurgT: a challenge for tissue tracking in surgeryhttps://arxiv.org/abs/2302.03022
P2ILF: Preoperative to Intraoperative Laparoscopy Fusionhttps://doi.org/10.1016/j.media.2024.103371

EndoVis 2021

Sub-ChallengePublicationDataset
HeiSurf: HeiChole Surgical Workflow Analysis and Full Scene Segmentationhttps://www.synapse.org/Synapse:syn25101790/files/
GIANA: Gastrointestinal ImAge ANAlysis
CholecTriplet2021: Surgical Action Triplet Recognitionhttps://arxiv.org/abs/2204.04746https://github.com/CAMMA-public/cholect45
FetReg: Placental Vessel Segmentation and Registration in Fetoscopyhttps://arxiv.org/abs/2106.05923https://weiss-develop.cs.ucl.ac.uk/fetreg/
PETRAW: PEg TRAnsfer Workflow recognition by different modalitieshttps://arxiv.org/abs/2202.05821https://www.synapse.org/#!Synapse:syn25147789/wiki/608848
SimSurgSkill: Objective Surgical Skill Assessment in VR Simulationhttps://arxiv.org/abs/2212.04448https://console.cloud.google.com/storage/browser/isi-simsurgskill-2021?pli=1

EndoVis 2020

Sub-ChallengePublicationDataset
CATARACTS Segmentationhttps://arxiv.org/abs/2110.10965https://ieee-dataport.org/open-access/cataracts
CATARACTS Workflowhttps://ieee-dataport.org/open-access/cataracts
MIcro-Surgical Anastomose Workflow recognition on training sessions (MISAW)https://www.sciencedirect.com/science/article/abs/pii/S0169260721005265https://www.synapse.org/#!Synapse:syn21776936/wiki/601700
Surgical visual domain adaptation: from virtual reality to real, clinical environments (SurgVisDm)https://arxiv.org/abs/2102.13644https://www.synapse.org/#!Synapse:syn22083820/wiki/603200

EndoVis 2019

Sub-ChallengePublicationDataset
Robust Medical Instrument Segmentation (ROBUST-MIS)https://doi.org/10.1038/s41597-021-00882-2

https://doi.org/10.1016/j.media.2020.101920
https://www.synapse.org/#!Synapse:syn18779624/wiki/592660
Stereo Correspondence and Reconstruction of Endoscopic Datahttps://arxiv.org/abs/2101.01133
Surgical Workflow and Skill Analysishttps://paperswithcode.com/paper/comparative-validation-of-machine-learning

https://paperswithcode.com/paper/comparative-validation-of-machine-learning
https://www.synapse.org/#!Synapse:syn18824884/wiki/592586

EndoVis 2018

Sub-ChallengePublicationDataset
Gastrointestinal Image ANAlysis (GIANA)https://doi.org/10.1007/978-3-030-64340-9_22

Surgical Workflow Analysis in the SensorOR
https://www.synapse.org/#!Synapse:syn21898456/wiki/601956
Robotic Scene Segmentationhttps://arxiv.org/abs/2001.11190https://endovissub2018-roboticscenesegmentation.grand-challenge.org/Data/
CATARACTShttps://www.sciencedirect.com/science/article/abs/pii/S136184151830865Xhttps://cataracts2018.grand-challenge.org/data/

EndoVis 2017

Sub-ChallengePublicationDataset
Gastrointestinal Image ANAlysis (GIANA)https://doi.org/10.1007/978-3-030-64340-9_22
Surgical Workflow Analysis in the SensorORhttps://www.synapse.org/#!Synapse:syn21898456/wiki/601956
Robotic Instrument Segmentationhttps://arxiv.org/abs/1902.06426https://endovissub2017-roboticinstrumentsegmentation.grand-challenge.org/Data/
Kidney Boundary Detectionhttps://link.springer.com/article/10.1007/s11548-019-02102-0https://endovissub2017-kidneyboundarydetection.grand-challenge.org/Data/

EndoVis 2015

Sub-ChallengePublicationDataset
Instrument segmentation and trackinghttps://arxiv.org/pdf/1805.02475.pdf
Automatic polyp detection in colonoscopy videoshttps://ieeexplore.ieee.org/abstract/document/7840040https://polyp.grand-challenge.org/Databases/
Early Barrett’s cancer detectionhttps://endovissub-barrett.grand-challenge.org/Data_description/
Detection of abnormalities in gastroscopic imageshttps://endovissub-abnormal.grand-challenge.org/Data/