SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
Paper • 2312.07987 • Published • 41
LLM
-
-
SubGen: Token Generation in Sublinear Time and Memory
Paper • 2402.06082 • Published • 11 -
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 51 -
SaulLM-7B: A pioneering Large Language Model for Law
Paper • 2403.03883 • Published • 92 -
Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning
Paper • 2405.17258 • Published • 16