建立视频内搜索

Boris Chen, Ben Klein, Jason Ge, Avneesh Saluja, Guru Tahasildar, Abhishek Soni, Juan Vimberg, Elliot Chow, Amir Ziai, Varun Sekhri, Santiago Castro, Keila Fong, Kelli Griggs, Mallia Sherzai, Robert Mayer, Andy Yao, Vi Iyengar, Jonathan Solorzano-Hamilton, Hossein Taghavi, Ritwik Kumar

Boris Chen，Ben Klein，Jason Ge，Avneesh Saluja，Guru Tahasildar，Abhishek Soni，Juan Vimberg，Elliot Chow，Amir Ziai，Varun Sekhri，Santiago Castro，Keila Fong，Kelli Griggs，Mallia Sherzai，Robert Mayer，Andy Yao，Vi Iyengar，Jonathan Solorzano-Hamilton，Hossein Taghavi，Ritwik Kumar

Introduction

介绍

Today we’re going to take a look at the behind the scenes technology behind how Netflix creates great trailers, Instagram reels, video shorts and other promotional videos.

今天我们将看一下 Netflix 创造出伟大的预告片、Instagram 短片、视频短片和其他宣传视频的幕后技术。

Suppose you’re trying to create the trailer for the action thriller The Gray Man, and you know you want to use a shot of a car exploding. You don’t know if that shot exists or where it is in the film, and you have to look for it it by scrubbing through the whole film.

假设您正在尝试创建动作惊悚片《灰人》的预告片，您知道您想使用一张汽车爆炸的镜头。您不知道该镜头是否存在或在电影中的位置，并且必须通过浏览整部电影来查找它。

Exploding cars — The Gray Man (2022)

爆炸的汽车 - 灰人（2022）

Or suppose it’s Christmas, and you want to create a great instagram piece out all the best scenes across Netflix films of people shouting “Merry Christmas”! Or suppose it’s Anya Taylor Joy’s birthday, and you want to create a highlight reel of all her most iconic and dramatic shots.

或者假设现在是圣诞节，你想从Netflix电影中的所有最佳场景中创建一个伟大的Instagram作品，展示人们喊出“圣诞快乐”的场景！或者假设现在是Anya Taylor Joy的生日，你想创建一个她所有最具标志性和戏剧性的镜头的精华片段。

Creating these involves sifting through hundreds of thousands of movies and TV shows to find the right line of dialogue or the appropriate visual elements (objects, scenes, emotions, actions, etc.). We have built an internal system that allows someone to perform in-video search across the entire Netflix video catalog, and we’d like to share our experience in building this system.

创建这些内容需要筛选数十万部电影和电视节目，以找到合适的对话或适当的视觉元素（对象、场景、情感、动作等）。我们已经建立了一...