Similar Video Retrieval via Order-Aware Exemplars and Alignment

• 作者: Masato Uchida Teruki Horie Yasuo Matsuyama
• 来源期刊: 信号与信息处理(英文)
• 学科: 工学
• 关键词: Similar Video RETRIEVAL EXEMPLAR Learning M-Distance Sequence ALIGNMENT Data STRUCTURING
• 年，卷（期）: 2018,（2）
• 页码范围: 73-91
• 页数: 19页
• 分类号: TP39

摘要

In this paper, we present machine learning algorithms and systems for similar video retrieval. Here, the query is itself a video. For the similarity measurement, exemplars, or representative frames in each video, are extracted by unsupervised learning. For this learning, we chose the order-aware competitive learning. After obtaining a set of exemplars for each video, the similarity is computed. Because the numbers and positions of the exemplars are different in each video, we use a similarity computing method called M-distance, which generalizes existing global and local alignment methods using followers to the exemplars. To represent each frame in the video, this paper emphasizes the Frame Signature of the ISO/IEC standard so that the total system, along with its graphical user interface, becomes practical. Experiments on the detection of inserted plagiaristic scenes showed excellent precision-recall curves, with precision values very close to 1. Thus, the proposed system can work as a plagiarism detector for videos. In addition, this method can be regarded as the structuring of unstructured data via numerical labeling by exemplars. Finally, further sophistication of this labeling is discussed.