Self-Anchor Large Language Model Reasoning via Step-by-step Attention Alignment скачать в хорошем качестве

Self-Anchor Large Language Model Reasoning via Step-by-step Attention Alignment

Paper: https://arxiv.org/abs/2510.03223 Title: Self-Anchor: Large Language Model Reasoning via Step-by-step Attention Alignment Authors: Hongxiang Zhang, Yuan Tian, Tianyi Zhang Abstract: To solve complex reasoning tasks for Large Language Models (LLMs), prompting-based methods offer a lightweight alternative to fine-tuning and reinforcement learning. However, as reasoning chains extend, critical intermediate steps and the original prompt will be buried in the context, receiving insufficient attention and leading to errors. In this paper, we propose Self-Anchor, a novel pipeline that leverages the inherent structure of reasoning to steer LLM attention. Self-Anchor decomposes reasoning trajectories into structured plans and automatically aligns the model's attention to the most relevant inference steps, allowing the model to maintain focus throughout generation. Our experiment shows that Self-Anchor outperforms SOTA prompting methods across six benchmarks. Notably, Self-Anchor significantly reduces the performance gap between ``non-reasoning'' models and specialized reasoning models, with the potential to enable most LLMs to tackle complex reasoning tasks without retraining. Tags: Machine Learning, Natural Language Processing, Research, reinforcement learning, transfer learning, transformer, attention mechanism, multi-task, few-shot, zero-shot, gru, attention, self-attention, search, translation, question answering, self, anchor, large, language, model, research paper, academic, study, analysis, tutorial, explained, breakdown, paper review, research summary, AI research, scientific paper, methodology, results, findings, innovation, technology, computing, algorithm, dataset Welcome to the Mayuresh Shilotri's Youtube . Maintained by Mayuresh Shilotri You can follow me at Blog - https://shilotri.com/ LinkedIn -   / mayureshshilotri   Twitter -   / mshilotri   Note: I only claim to have read the research paper and created a Video using AI tool. I am not the author. All intellectual heavy lifting was performed by the respective authors. 🙏