Similar Segments in Social Speech

Motivation: With users' growing willingness to share personal activity information, the eventual acceptance of social multimedia, including video and audio recordings of casual interactions, is inevitable. To unlock the potential value, we need to develop methods for searching such records. This task will support such research.

Use Scenario: A new member has joined an organization or social group that has a small archive of conversations among its members. He starts to listen, looking for any information that can help him better understand, participate in, enjoy, find friends in, and succeed in this group. As he listens to the archive (perhaps at random, perhaps based on some social tags, perhaps based on an initial keyword search) he finds something of interest, and wants to find more like it, across the entire archive.

He marks what he found as a region of interest and requests more like it. The system comes back with a set of ``jump-in'' points, places in the archive to which he could jump and start listening/watching with the expectation of finding something similar.

Task Specification: Given a short second audio/video region of interest, return an ordered list of regions similar to it, where similarity is based on the perceptions of human searchers.

Sponsor: This challenge was organized under the auspices of MediaEval 2013, three teams completed, with interesting results, described in five papers.


More Information:
The Similar Segments in Social Speech Task (pdf), Proceedings of MediaEval 2013

Frequently Asked Questions

Documentation and Downloads

Nigel Ward,
University of Texas at El Paso
David G. Novick
University of Texas at El Paso
Tatsuya Kawahara,
Kyoto University
Elizabeth Shriberg,
Louis-Philippe Morency,
University of Southern California
Catharine Oertel, KTH

Research Assistant:
Steven D. Werner