Multimodal Learning toward Micro-Video Understanding


Title: Multimodal Learning toward Micro-Video Understanding
pages 页数: 188 pages
Edition 版本: 1
Language 语言: English
Released: 2019-09-17
ISBN-10 书号: 1681736284
ISBN-13 书号: 9781681736280


Book Description
Micro-videos,a new form of user-generated content,have been spreading widely across various social platforms,such as Vine,Kuaishou,and TikTok.
Different from traditional long videos,micro-videos are usually recorded by smart mobile devices at any place within a few seconds. Due to their brevity and low bandwidth cost,micro-videos are gaining increasing user enthusiasm. The blossoming of micro-videos opens the door to the possibility of many promising applications,ranging from network content caching to online advertising. Thus,it is highly desirable to develop an effective scheme for high-order micro-video understanding.
Micro-video understanding is,however,non-trivial due to the following challenges: (1) how to represent micro-videos that only convey one or few high-level themes or concepts; (2) how to utilize the hierarchical structure of venue categories to guide micro-video analysis; (3) how to alleviate the influence of low quality caused by complex surrounding environments and camera shake; (4) how to model multimodal sequential data,i.e. textual,acoustic,visual,and social modalities to enhance micro-video understanding; and (5) how to construct large-scale benchmark datasets for analysis. These challenges have been largely unexplored to date.
In this book,we focus on addressing the challenges presented above by proposing some state-of-the-art multimodal learning theories. To demonstrate the effectiveness of these models,we apply them to three practical tasks of micro-video understanding: popularity prediction,venue category estimation,and micro-video routing. Particularly,we first build three large-scale real-world micro-video datasets for these practical tasks. We then present a multimodal transductive learning framework for micro-video popularity prediction. Furthermore,we introduce several multimodal cooperative learning approaches and a multimodal transfer learning scheme for micro-video venue category estimation. Meanwhile,we develop a multimodal sequential learning approach for micro-video recommendation. Finally,we conclude the book and figure out the future research directions in multimodal learning toward micro-video understanding

下载地址:

Multimodal Learning toward Micro Video Understanding 9781681736280.pdf

打赏
未经允许不得转载:finelybook » Multimodal Learning toward Micro-Video Understanding

相关推荐

  • 暂无文章

评论 抢沙发

  • 昵称 (必填)
  • 邮箱 (必填)
  • 网址

觉得文章有用就打赏一下

您的打赏,我们将继续给力更多优质内容

支付宝扫一扫打赏

微信扫一扫打赏