-
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 6 -
Weighted Grouped Query Attention in Transformers
Paper • 2407.10855 • Published -
Fast Transformer Decoding: One Write-Head is All You Need
Paper • 1911.02150 • Published • 9 -
MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding
Paper • 2406.09297 • Published • 6
Ahmed Ali
ahmed-ali
AI & ML interests
None yet
Recent Activity
liked
a dataset
2 days ago
tiiuae/alyah-emirati-benchmark
upvoted
an
article
about 1 month ago
Open Responses: What you need to know
upvoted
a
collection
about 2 months ago
Arabic Speech Datasets
Organizations
None yet
-
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Paper • 2305.13245 • Published • 6 -
Weighted Grouped Query Attention in Transformers
Paper • 2407.10855 • Published -
Fast Transformer Decoding: One Write-Head is All You Need
Paper • 1911.02150 • Published • 9 -
MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding
Paper • 2406.09297 • Published • 6
models
7
ahmed-ali/PixelCopter
Reinforcement Learning
•
Updated
ahmed-ali/Reinforce-Cartpole-v1
Reinforcement Learning
•
Updated
ahmed-ali/dqn-SpaceInvadersNoFrameskip-v4
Reinforcement Learning
•
Updated
•
2
ahmed-ali/q-Taxi-v3
Reinforcement Learning
•
Updated
ahmed-ali/q-FrozenLake-v1-4x4-noSlippery
Reinforcement Learning
•
Updated
ahmed-ali/ppo-Huggy
Reinforcement Learning
•
Updated
•
14
ahmed-ali/ppo-LunarLander-v2
Reinforcement Learning
•
Updated
•
3
datasets
0
None public yet