视觉文档理解与推理:一种带智能体级自适应测试时扩展的多智能体协作框架
Visual Document Understanding and Reasoning: A Multi-Agent Collaboration Framework with Agent-Wise Adaptive Test-Time Scaling
把视觉文档理解拆成规划、执行、判断、回答四个智能体并做智能体级自适应测试时扩展,为 VLM 在复杂多步推理场景下提供了一种可复用的「程序化扩展」替代单体模型堆参数的思路。
原文依据 we introduce MACT, a Multi-Agent Collaboration framework with agent-wise adaptive Test-time scaling
摘要译文
由模型翻译 · 术语统一 · 请对照原文核对关键结论以单体模型规模扩张为主导的视觉语言模型(VLM)范式,在文档理解与推理任务上正逐渐失效:由于该领域本质上需要基于文档的程序化推理、认知复杂度与事实准确性,单纯扩大模型规模带来的收益不断递减。为此,我们提出 MACT——一种带智能体级自适应测试时扩展的多智能体协作框架,开创性地转向程序化扩展范式,动态适配视觉文档理解与推理中的各功能实体。MACT 将视觉文档处理流程分解为四个专门化智能体,即规划、执行、判断与回答,以缓解认知过载,并引入关键的自我校正回路以保证事实依据。该协作架构进一步由智能体级自适应测试时扩展策略增强,该策略依据各功能的复杂度与冗余度智能分配计算资源。在多个视觉文档理解基准上的评测表明,MACT 以更小的参数规模取得更优性能,能够有效适配各类文档场景,同时不损害其通用推理与数学推理能力。三个变体始终位列平均性能前三,相较基座模型平均提升 9.9%–11.5%。
英文原文摘要 1415 字符
The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based procedural reasoning, cognitive complexity, and factual accuracy. To this end, we introduce MACT, a Multi-Agent Collaboration framework with agent-wise adaptive Test-time scaling that pioneers a paradigm shift to procedural scaling, adapting dynamically to the functional entities of visual documents understanding and reasoning. MACT decomposes the visual document processing flow into four specialized agents, i.e., planning, execution, judgment, and answer, to resolve cognitive overload and introduce a critical self-correction loop for factual grounding. This collaborative architecture is amplified by an agent-wise adaptive test-time scaling strategy that intelligently allocates computational resources based on the complexity and redundancy of each functionality. Evaluated on multiple visual document understanding benchmarks, MACT achieves superior performance with a smaller parameter scale, adapting effectively to various document scenarios without compromising its general or mathematical reasoning capabilities. The three variants consistently attain top-three average performance rankings, with average performance enhancements of 9.9-11.5% over the base models.