ShotDirector：具备电影化转场的导演级可控多镜头视频生成
ShotDirector: Directorially Controllable Multi-Shot Video Generation with Cinematographic Transitions
把 6-DoF 相机位姿与内参作为参数级条件注入视频生成模型，并用镜头感知掩码实现分层提示控制，为可控多镜头视频生成提供了可复用的条件注入与转场设计范式。
原文依据 we adopt a camera control module that incorporates 6-DoF poses and intrinsic settings to enable precise camera information injection
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论镜头转场在多镜头视频生成中起着关键作用，因为它们决定了整体叙事表达与视觉叙事的导演设计。然而，近期进展主要集中于镜头间的低层视觉一致性，忽视了转场如何被设计以及电影语言如何促成连贯的叙事表达。这往往导致仅仅是顺序性的镜头切换，而缺乏有意图的剪辑模式。为解决这一局限，我们提出 ShotDirector，一个高效框架，融合了参数级相机控制与分层剪辑模式感知提示。具体而言，我们采用一个相机控制模块，引入 6-DoF 位姿与内参设置，以实现精确的相机信息注入。此外，采用镜头感知掩码机制引入感知专业剪辑模式的分层提示，从而对镜头内容实现细粒度控制。通过这一设计，我们的框架有效结合参数级条件与高层语义引导，实现电影般的可控镜头转场。为便于训练与评估，我们构建了 ShotWeaver40K，一个捕捉电影化剪辑模式先验的数据集，并开发了一套面向可控多镜头视频生成的评估指标。大量实验证明了我们框架的有效性。
英文原文摘要 1426 字符
Shot transitions play a pivotal role in multi-shot video generation, as they determine the overall narrative expression and the directorial design of visual storytelling.However, recent progress has primarily focused on low-level visual consistency across shots, neglecting how transitions are designed and how cinematographic language contributes to coherent narrative expression. This often leads to mere sequential shot changes without intentional film-editing patterns. To address this limitation, we propose ShotDirector, an efficient framework that integrates parameter-level camera control and hierarchical editing-pattern-aware prompting.Specifically, we adopt a camera control module that incorporates 6-DoF poses and intrinsic settings to enable precise camera information injection. In addition, a shot-aware mask mechanism is employed to introduce hierarchical prompts aware of professional editing patterns, allowing fine-grained control over shot content. Through this design, our framework effectively combines parameter-level conditions with high-level semantic guidance, achieving film-like controllable shot transitions.To facilitate training and evaluation, we construct ShotWeaver40K, a dataset that captures the priors of film-like editing patterns, and develop a set of evaluation metrics for controllable multi-shot video generation. Extensive experiments demonstrate the effectiveness of our framework.