Papers
arxiv:2608.26730

Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training

Published on Aug 27
ยท Submitted by
lty
on Sep 4
Authors:
,
,
,

Abstract

Boundary-Calibrated Intervention Transfer selectively reuses past training evidence by checking contextual applicability and running bounded trials, reducing harmful updates and improving final model quality in autonomous post-training.

Large language models offer broad capabilities, but adapting them to evolving domains, tools, and requirements often entails repeated post-training. Autonomous systems automate parts of this process by proposing updates, training candidates, and using evaluation feedback to select subsequent proposals. As evidence accumulates, a central problem emerges: which past update evidence remains actionable after subsequent training has changed the parent model? An update's effect depends on its parent, data, and training stage. Treating past success as context-free permission can waste compute. If the resulting child is promoted, it can also degrade the subsequent training trajectory. We formulate this problem as conditional experience transfer and introduce Boundary-Calibrated Intervention Transfer (BCIT), a method that authorizes experience reuse before weight-changing training. BCIT binds an observed effect to its source context, checks applicability conditions, vetoes candidates with named hard conflicts, and obtains current-state evidence through a bounded training trial when needed. Fully trained candidates still face a shared adoption rule, and only observed events extend memory. On one 4B model adapted across finance reasoning, text-to-SQL, and function calling, candidate updates exhibit heterogeneous target and retention effects across the evaluated contexts. Under matched candidates, evidence, and compute, BCIT authorizes fewer harmful updates and attains higher equal-budget final-model quality than the evaluated alternatives. These results support treating experience authorization as a distinct problem in autonomous post-training.

Community

Paper author Paper submitter

We are excited to share Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training.

Past post-training successes do not necessarily remain valid after the parent model, data, or training stage changes. We formulate this challenge as conditional experience transfer and introduce Boundary-Calibrated Intervention Transfer (BCIT), a transparent Reject / Validate / Train policy that binds update evidence to its source context, vetoes hard conflicts, and runs bounded current-parent trials when applicability is uncertain.

Across finance reasoning, text-to-SQL, and function calling adaptation with Qwen3-4B, BCIT achieves the highest equal-budget final-model quality among the evaluated shared-model alternatives. It improves the mean task score by 2.63 points over Flat-Additive (95% CI [2.10, 3.16]) while satisfying the prespecified retention margins.

๐Ÿ“„ Paper: https://arxiv.org/abs/2608.26730

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.26730
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.26730 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.26730 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.26730 in a Space README.md to link it from this page.

Collections including this paper 2