EMO: Pretraining mixture of experts for emergent modularity
•
18
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
View all activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
allenai/MolmoAct2-Think-LIBERO
Robotics • 5B • Updated • 19 • 3
allenai/MolmoAct2-LIBERO
Robotics • 5B • Updated • 32 • 2
allenai/MolmoAct2-SO100_101
Robotics • 5B • Updated • 132 • 7
allenai/MolmoAct2-BimanualYAM
Robotics • 5B • Updated • 509 • 3
allenai/MolmoAct2-DROID
Robotics • 5B • Updated • 44 • 4
allenai/EMO
Text Generation • 14B • Updated • 10 • 3
allenai/StdMoE_1b14b_1T
Text Generation • 14B • Updated • 42 • 1
allenai/StdMoE_1b14b_130B
Text Generation • 14B • Updated • 34 • 1
allenai/StdMoE_1b4b_130B
Text Generation • 4B • Updated • 40 • 2
allenai/Emo_1b14b_130B
Text Generation • 14B • Updated • 82 • 2
allenai/Emo_1b14b_1T
Text Generation • 14B • Updated • 68 • 10
allenai/Dense_1b_130B
Text Generation • 1B • Updated • 111 • 1
allenai/StdMoE_1b14b_1T_EmoAnnealed
Text Generation • 14B • Updated • 12 • 1
allenai/StdMoE_1b14b_1T_Preanneal
Text Generation • 14B • Updated • 14 • 1
allenai/Molmo2-ER
Image-Text-to-Text • 5B • Updated • 73.9k • 7
allenai/MolmoAct2-FAST-Tokenizer
Robotics • Updated • 2
allenai/MolmoAct2-Pretrain
Robotics • 5B • Updated • 45 • 3
allenai/MolmoAct2-Think
Robotics • 5B • Updated • 29 • 2
allenai/MolmoAct2
Robotics • 5B • Updated • 38 • 4
allenai/GraspMolmo
Robotics • 8B • Updated • 406 • 10
allenai/H_pre_LQK_32kv_8k_11k_SWA
Updated • 22 • 2
allenai/G_pre_8kv_8k_14k_SWA
Updated • 125
allenai/H_post_LQK_8kv_4k_11k_SWA
Updated • 92
allenai/G_post_LQK_8kv_4k_14k_SWA
Updated • 203
allenai/B_post_LQK_32kv_4k_11k
Updated • 93
allenai/K_post_HQK_8kv_12k
Updated • 202
allenai/H_post_LQK_32kv_8k_11k_SWA
Updated • 94
allenai/A_post_HQK_8kv_8k_13k_SWA_fp8
Updated • 89
allenai/H_post_LQK_32kv_8k_11k_SWA_fp8
Updated • 92
allenai/F_pre_8kv_8k_14k_SWA
Updated • 15