Research

Paper

AI LLM March 10, 2026

Chow-Liu Ordering for Long-Context Reasoning in Chain-of-Agents

Authors

Naman Gupta, Vaibhav Singh, Arun Iyer, Kirankumar Shiragur, Pratham Grover, Ramakrishna B. Bairi, Ritabrata Maiti, Sankarshan Damle, Shachee Mishra Gupta, Rishikesh Maurya, Vageesh D. C

Abstract

Sequential multi-agent reasoning frameworks such as Chain-of-Agents (CoA) handle long-context queries by decomposing inputs into chunks and processing them sequentially using LLM-based worker agents that read from and update a bounded shared memory. From a probabilistic perspective, CoA aims to approximate the conditional distribution corresponding to a model capable of jointly reasoning over the entire long context. CoA achieves this through a latent-state factorization in which only bounded summaries of previously processed evidence are passed between agents. The resulting bounded-memory approximation introduces a lossy information bottleneck, making the final evidence state inherently dependent on the order in which chunks are processed. In this work, we study the problem of chunk ordering for long-context reasoning. We use the well-known Chow-Liu trees to learn a dependency structure that prioritizes strongly related chunks. Empirically, we show that a breadth-first traversal of the resulting tree yields chunk orderings that reduce information loss across agents and consistently outperform both default document-chunk ordering and semantic score-based ordering in answer relevance and exact-match accuracy across three long-context benchmarks.

Metadata

arXiv ID: 2603.09835
Provider: ARXIV
Primary Category: cs.CL
Published: 2026-03-10
Fetched: 2026-03-11 06:02

Related papers

Raw Data (Debug)
{
  "raw_xml": "<entry>\n    <id>http://arxiv.org/abs/2603.09835v1</id>\n    <title>Chow-Liu Ordering for Long-Context Reasoning in Chain-of-Agents</title>\n    <updated>2026-03-10T15:57:35Z</updated>\n    <link href='https://arxiv.org/abs/2603.09835v1' rel='alternate' type='text/html'/>\n    <link href='https://arxiv.org/pdf/2603.09835v1' rel='related' title='pdf' type='application/pdf'/>\n    <summary>Sequential multi-agent reasoning frameworks such as Chain-of-Agents (CoA) handle long-context queries by decomposing inputs into chunks and processing them sequentially using LLM-based worker agents that read from and update a bounded shared memory. From a probabilistic perspective, CoA aims to approximate the conditional distribution corresponding to a model capable of jointly reasoning over the entire long context. CoA achieves this through a latent-state factorization in which only bounded summaries of previously processed evidence are passed between agents. The resulting bounded-memory approximation introduces a lossy information bottleneck, making the final evidence state inherently dependent on the order in which chunks are processed.\n  In this work, we study the problem of chunk ordering for long-context reasoning. We use the well-known Chow-Liu trees to learn a dependency structure that prioritizes strongly related chunks. Empirically, we show that a breadth-first traversal of the resulting tree yields chunk orderings that reduce information loss across agents and consistently outperform both default document-chunk ordering and semantic score-based ordering in answer relevance and exact-match accuracy across three long-context benchmarks.</summary>\n    <category scheme='http://arxiv.org/schemas/atom' term='cs.CL'/>\n    <published>2026-03-10T15:57:35Z</published>\n    <arxiv:comment>Published as a workshop paper at ICLR 2026 Workshop MemAgents</arxiv:comment>\n    <arxiv:primary_category term='cs.CL'/>\n    <author>\n      <name>Naman Gupta</name>\n    </author>\n    <author>\n      <name>Vaibhav Singh</name>\n    </author>\n    <author>\n      <name>Arun Iyer</name>\n    </author>\n    <author>\n      <name>Kirankumar Shiragur</name>\n    </author>\n    <author>\n      <name>Pratham Grover</name>\n    </author>\n    <author>\n      <name>Ramakrishna B. Bairi</name>\n    </author>\n    <author>\n      <name>Ritabrata Maiti</name>\n    </author>\n    <author>\n      <name>Sankarshan Damle</name>\n    </author>\n    <author>\n      <name>Shachee Mishra Gupta</name>\n    </author>\n    <author>\n      <name>Rishikesh Maurya</name>\n    </author>\n    <author>\n      <name>Vageesh D. C</name>\n    </author>\n  </entry>"
}