daw

hufftea

·

AI & ML interests

None yet

Recent Activity

reacted to Hoglet-33's post with 🔥 1 day ago

We are announcing the first generation of the Pebble model family! These are the models we are releasing: - Pebble 10M - Pebble 25M - Pebble 50M Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT. Depending on development time and resources, we may also release: - Pebble 5M - Pebble 75M - Pebble 1M (possibly) We hope you're excited and enjoy the models! Follow for more: @Hoglet-33 https://huggingface.co/basically-ai

View all activity

Organizations

models 0

None public yet

datasets 0

None public yet