VideoMCC

a New Benchmark for Video Comprehension

What is VideoMCC?

Video Multiple Choice Caption (VideoMCC) is a new task for video understanding and a new benchmark for this task. We believe that VideoMCC is a good option for developing and evaluating algorithms for video understanding at a high-semantic level.

VideoMCC problem statement

Given a video clip and a set of 5 English sentences, the task is to determine which sentence best describes the visual content of the input clip.


Download the paper from arXiv.
Use BibTeX for citation.

Examples of VideoMCC tasks


  1. WE'RE KEEPING A VERY CLOSE EYE ON ALL OF THIS.
  2. BEHIND THE SCENES EGYPT'S POWERFUL MILITARY PLAYS A HAND IN MUBARAK'S DEPARTURE
  3. I WAS RIGHT BY THE SHOOTER WHEN HE PULLED THE GUN
  4. WE BEGIN WITH BREAKING NEWS OUT OF MANHATTAN FOR THE FORMER LEADER OF THE IMF HAS JUST LEFT THE COURTHOUSE
  5. WE WARNED ABOUT THIS FOR YEARS NOW AS HUMANITARIANS

  1. IT'S IN THE NORTHWEST CORNER OF NOWHERE.
  2. MOST OF THE SOUTHEAST IS DRYING OUT THIS MORNING AFTER GETTING POUNDED BY A POWERFUL STORM.
  3. CALIFORNIA SOLAR ENERGY MARKET IS COMING AT A COST TO HOMES AND BUSINESSES.
  4. GROUP GATHERED NEAR THE WHITE HOUSE TO LIGHT THE NATIONAL MENORAH.
  5. ADRIAN AMONG IS COVERING THE LATEST FROM SEOUL SOUTH KOREA.

  1. I DIDN'T THINK WE WERE GOING TO MAKE IT
  2. AS WE SAW IN THIS CRASH, MANY SEAT BACKS HAVE TV SCREENS, APPROVED BY THE FAA BUT A WORRY TO SOME.
  3. ALL OF THESE DEVELOPMENTS ARE BEING MONITORED AT B.P.'S CRISIS CENTER IN HOUSTON, WHERE CLAYTON SANDELL PAID A VISIT
  4. PRESIDENT OBAMA PULLED INTO THE COURTYARD IN VATICAN CITY AN AMERICAN FLAG HERALDING HIS LONG ANTICIPATED AUDIENCE WITH POPE FRANCIS.
  5. AND GAS PRICES CLIMBING STEADILY FOR THE PAST TWO DAYS, JUST HOW HIGH WILL THEY GO? PLUS, WHAT IS BEHIND THE FIRST LADY'S BANGS? THOSE CERTAINLY ARE HER BANGS

  1. NEXT TIME WE'RE PROBABLY GOING TO RED LOBSTER.
  2. VIOLENT WINDS AND DRIVING RAINS BATTERING THE ISLAND CUBA TAKING THE MOST DIRECT HIT.
  3. YOU HAVE BEEN LISTENING TO A NEWS CONFERENCE THERE IN AURORA COLORADO WHERE THE POLICE CHIEF HAS NOW CONFIRMED 14 DEAD AT LEAST 50 INJURED
  4. GOD IS GOOD GOD IS GREAT AND WE THANK YOU FOR OUR FOOD
  5. THIS IS A NEW STORM SYSTEM.

For further information contact: videomcc@cs.dartmouth.edu