视觉语言模型 · CVPR2026 ·2026.06.03

如何拍出令人难忘的照片?以可执行反馈赋能用户

How to Take a Memorable Picture? Empowering Users with Actionable Feedback

Francesco Laiti、Davide Talon、Jacopo Staiano、Elisa Ricci

与你有关的部分

把 MLLM 的内部激活沿「由低到高记忆性」的教师轨迹做免训练引导,使其输出可执行的拍摄建议;这套 teacher-student steering 思路可直接迁移到其他需要让 VLM 给出可操作建议的视觉任务(如构图、光照、美学反馈)。

原文依据 based on Multimodal Large Language Models (MLLMs), is training-free and employs a teacher-student steering strategy
可迁移到 图像记忆性预测多模态大语言模型指令生成图像美学与拍摄建议

摘要译文

由模型翻译 · 术语统一 · 请对照原文核对关键结论

图像记忆性,即一张图像被记住的可能性,在计算机视觉中传统上要么被当作被动预测任务来研究,由模型回归一个标量分数;要么用生成式方法改动视觉输入以提升图像被记住的似然。然而,这些范式都不支持用户在拍摄时获得帮助,而在拍摄时最关键的问题是:如何提升一张照片的记忆性。我们引入了记忆性反馈(MemFeed)任务,其中自动化模型应向用户提供可执行、人类可解释的指导,目标是增强图像未来的可回忆性。我们还提出了 MemCoach,这是首个以自然语言给出具体记忆性提升建议(例如「强调面部表情」「让主体前移」)的方法。我们的方法基于多模态大语言模型(MLLM),无需训练,并采用教师-学生引导策略,将模型的内部激活对齐到从教师模型沿由最不难忘到最难忘的样本序列学习到的更具记忆性的模式上。为对这一新任务进行系统评测,我们进一步提出了 MemBench,这是一个新的基准,包含序列对齐的拍摄组以及标注的记忆性分数。我们的实验在多个 MLLM 上进行,证明了 MemCoach 的有效性,其性能一致优于若干零样本模型。结果表明,记忆性不仅可以被预测,还可以被教授和指导,从而将关注点从单纯的预测转向面向人类创作者的可执行反馈。数据集与代码将在论文发表后公开。

英文原文摘要 1699 字符

Image memorability, i.e., how likely an image is to be remembered, has traditionally been studied in computer vision either as a passive prediction task, with models regressing a scalar score, or with generative methods altering the visual input to boost the image likelihood of being remembered. Yet, none of these paradigms supports users at capture time, when the crucial question is how to improve a photo memorability. We introduce the task of **Mem**orability **Feed**back (**MemFeed**), where an automated model should provide actionable, human-interpretable guidance to users with the goal to enhance an image future recall. We also present **MemCoach**, the first approach designed to provide concrete suggestions in natural language for memorability improvement (e.g., "emphasize facial expression," "bring the subject forward"). Our method, based on Multimodal Large Language Models (MLLMs), is training-free and employs a teacher-student steering strategy, aligning the model internal activations toward more memorable patterns learned from a teacher model progressing along least-to-most memorable samples. To enable systematic evaluation on this novel task, we further introduce **MemBench**, a new benchmark featuring sequence-aligned photoshoots with annotated memorability scores. Our experiments, considering multiple MLLMs, demonstrate the effectiveness of MemCoach, showing consistently improved performance over several zero-shot models. The results indicate that memorability can not only be predicted but also taught and instructed, shifting the focus from mere prediction to actionable feedback for human creators. Dataset and code will be publicly released upon publication.

标签

会议 CVPR2026
页码 29738-29749
Bibkey
来源 CVF Open Access