OLAResearchX/xmemtransfer-llama2-source-20m

XMemTransfer LLaMA-2 source memory (20M)

This repository contains a frozen source-memory artifact used in the XMemTransfer experiments.

Project links

• Website: XMemTransfer project page
• Paper: Cross-Model Memory Transfer via Target-Side Reader Adaptation
• Code: OLAResearch/XMemTransfer
• Model repo: https://huggingface.co/OLAResearchX/xmemtransfer-llama2-source-20m
• Collection: https://huggingface.co/collections/OLAResearchX/xmemtransfer

Files

• memory.pt: source memory checkpoint
• memory_best.pt: best checkpoint selected during source training
• memory_config.json: hash and memory configuration
• source_adaptor_best.pt: source-side adaptor checkpoint used with the source memory

Intended use

This artifact is meant to be paired with target-side adaptors from the XMemTransfer project for cross-model memory-transfer experiments.

Provenance

• source model family: LLaMA-2 7B
• source corpus: WikiText-2021
• source token budget: 20M

Usage and limitations

These files are research artifacts for the XMemTransfer implementation, not standalone Transformers pipeline checkpoints. Follow the project code to construct the memory reader and load the checkpoint. Results depend on the paired backbone, source memory, data preprocessing, and configuration released with the model.

Citation

Please cite the XMemTransfer paper when using these artifacts.