Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers
Paper • 2406.16450 • Published
Skander Moalla
skandermoalla
AI & ML interests
DeepRL, RL finetuning
Recent Activity
upvoted a paper about 11 hours ago
Apertus: Democratizing Open and Compliant LLMs for Global Language
Environments upvoted a paper about 11 hours ago
Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions liked a dataset about 11 hours ago
LukeBailey181Pub/D_3kOrganizations
