论文标题

MMSYS'22大挑战在基于AI的足球视频制作中

MMSys'22 Grand Challenge on AI-based Video Production for Soccer

论文作者

Midoglu, Cise, Hicks, Steven A., Thambawita, Vajira, Kupka, Tomas, Halvorsen, Pål

论文摘要

足球在全球体育产业中占有很大的市场份额,并且对观看足球比赛的视频的兴趣不断增长。在这方面,重要的是要提供游戏摘要和主要游戏事件的亮点。但是,注释和生产活动和摘要通常需要昂贵的设备以及很多繁琐的,繁琐的手动劳动。因此,自动化视频制作管道以低得多的成本提供快速的游戏亮点被视为“圣杯”。在这种情况下,人工智能(AI)技术的最新发展显示出巨大的潜力。尽管如此,最先进的方法还远远不足以适合具有必要实时要求的实际情况以及严格的绩效标准(至少在其中发现诸如目标和卡等官方事件的检测必须100%准确)。此外,应通过注释和分类,正确的剪辑,生成简短的描述,选择适当的缩略图来彻底增强事件检测,最后将活动重点介绍为整体游戏摘要,类似于体育新闻中通常播放的内容。即使事件标记操作到目前为止已获得最大的关注,但端到端的视频制作管道也包括其他各种操作,这些操作达到了自动足球分析的总体目的。这项挑战旨在使用AI来协助这种生产管道的自动化。特别是,我们专注于检测到事件后发生的增强操作,即事件剪辑(任务1),缩略图选择(任务2)和游戏摘要(任务3)。挑战网站:https://mmsys2022.ie/authors/grand-challenge。

Soccer has a considerable market share of the global sports industry, and the interest in viewing videos from soccer games continues to grow. In this respect, it is important to provide game summaries and highlights of the main game events. However, annotating and producing events and summaries often require expensive equipment and a lot of tedious, cumbersome, manual labor. Therefore, automating the video production pipeline providing fast game highlights at a much lower cost is seen as the "holy grail". In this context, recent developments in Artificial Intelligence (AI) technology have shown great potential. Still, state-of-the-art approaches are far from being adequate for practical scenarios that have demanding real-time requirements, as well as strict performance criteria (where at least the detection of official events such as goals and cards must be 100% accurate). In addition, event detection should be thoroughly enhanced by annotation and classification, proper clipping, generating short descriptions, selecting appropriate thumbnails for highlight clips, and finally, combining the event highlights into an overall game summary, similar to what is commonly aired during sports news. Even though the event tagging operation has by far received the most attention, an end-to-end video production pipeline also includes various other operations which serve the overall purpose of automated soccer analysis. This challenge aims to assist the automation of such a production pipeline using AI. In particular, we focus on the enhancement operations that take place after an event has been detected, namely event clipping (Task 1), thumbnail selection (Task 2), and game summarization (Task 3). Challenge website: https://mmsys2022.ie/authors/grand-challenge.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源