Characterizing Warp Divergence from Pascal to Blackwell
Paper • 2607.23402 • Published • 9
AI & ML interests
None defined yet.
Recent Activity
View all activity
alpindale
authored a
paper 3 days ago
Post
3407
Hi!
I will get off the internet for a moment.
I launched the Hanami Project because I didn't supported SillyTavern UI anymore atm.
Too much options for my dead brain, still very good, but I wanted more simple, professional, phone accessible and sober front end for when I will be gone from home.
I did my maximum to finish it before I go, I want you to have it, I want my work to be used (even if it's AI slop for some of you) for who care.
Here's the github repo: https://github.com/Undi95/Hanami
If you have any suggestion, bugs report, pull request or anything, post it, if you want to modify it, fork it, but keep the credit, and add myself haha.
If you search an option, a function, you will find it. But at first, the front end will be what you expect: minimalist, but customizable, empty at first. Navigate to see all it can do. Everything is well organized.
Context is full ? No worries anymore, with memory file, files access, auto compaction and smooth transition, you can continue your chat like nothing happened. (Inspired from Claude)
The front end have a final option for everyone : The tools calling for action and emotion could be a bit too much for smaller model, you can, in this case, use the "Simple" option in Settings > Model > Model mode.
"Simple: no tools are exposed to the model — Hanami handles memory server-side (facts are extracted during compaction) and guesses the emotion from the text. Pick this for small models, which often fail at tool calling."
My last gift for myself, and for you.
Cya!
I will get off the internet for a moment.
I launched the Hanami Project because I didn't supported SillyTavern UI anymore atm.
Too much options for my dead brain, still very good, but I wanted more simple, professional, phone accessible and sober front end for when I will be gone from home.
I did my maximum to finish it before I go, I want you to have it, I want my work to be used (even if it's AI slop for some of you) for who care.
Here's the github repo: https://github.com/Undi95/Hanami
If you have any suggestion, bugs report, pull request or anything, post it, if you want to modify it, fork it, but keep the credit, and add myself haha.
If you search an option, a function, you will find it. But at first, the front end will be what you expect: minimalist, but customizable, empty at first. Navigate to see all it can do. Everything is well organized.
Context is full ? No worries anymore, with memory file, files access, auto compaction and smooth transition, you can continue your chat like nothing happened. (Inspired from Claude)
The front end have a final option for everyone : The tools calling for action and emotion could be a bit too much for smaller model, you can, in this case, use the "Simple" option in Settings > Model > Model mode.
"Simple: no tools are exposed to the model — Hanami handles memory server-side (facts are extracted during compaction) and guesses the emotion from the text. Pick this for small models, which often fail at tool calling."
My last gift for myself, and for you.
Cya!
alpindale
submitted a
paper to Daily Papers 9 days ago
chargoddard
authored a
paper 6 months ago
bjoernp
authored a
paper 7 months ago
chargoddard
authored 4
papers about 1 year ago
Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation
Paper • 2406.14971 • Published
Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation
Paper • 2410.08371 • Published • 3
INTELLECT-1 Technical Report
Paper • 2412.01152 • Published • 3
Training-Free Tokenizer Transplantation via Orthogonal Matching Pursuit
Paper • 2506.06607 • Published • 3
Post
16211
Hi there!
If you want to create your own thinking model or do a better MistralThinker, I just uploaded my entire dataset made on Deepseek R1 and the axolotl config. (well I made them public)
Axolotl config : Undi95/MistralThinker-v1.1
The dataset : Undi95/R1-RP-ShareGPT3
You can also read all I did on those two discord screenshot from two days ago, I'm a little lazy to rewrite all kek.
Hope you will use them!
If you want to create your own thinking model or do a better MistralThinker, I just uploaded my entire dataset made on Deepseek R1 and the axolotl config. (well I made them public)
Axolotl config : Undi95/MistralThinker-v1.1
The dataset : Undi95/R1-RP-ShareGPT3
You can also read all I did on those two discord screenshot from two days ago, I'm a little lazy to rewrite all kek.
Hope you will use them!
- 6 replies
Alignment-Lab-AI
posted an update almost 2 years ago
Post
2087
remember boys and girls, always keep all your data, its never a waste of time!
Post
28416
Exciting news!
After a long wait, Ikari and me finally made a new release of our last model on NeverSleep repo: Lumimaid-v0.2
This model can be used in different size, from the small Llama-3.1-8B to the gigantic Mistral-Large-123B, finetuned by us.
Try them now!
- NeverSleep/Lumimaid-v0.2-8B
- NeverSleep/Lumimaid-v0.2-12B
- NeverSleep/Lumimaid-v0.2-70B
- NeverSleep/Lumimaid-v0.2-123B
All the datasets we used will be added and credit will be given!
For the quant, we wait for fix to be applied (https://github.com/ggerganov/llama.cpp/pull/8676)
Hope you will enjoy them!
After a long wait, Ikari and me finally made a new release of our last model on NeverSleep repo: Lumimaid-v0.2
This model can be used in different size, from the small Llama-3.1-8B to the gigantic Mistral-Large-123B, finetuned by us.
Try them now!
- NeverSleep/Lumimaid-v0.2-8B
- NeverSleep/Lumimaid-v0.2-12B
- NeverSleep/Lumimaid-v0.2-70B
- NeverSleep/Lumimaid-v0.2-123B
All the datasets we used will be added and credit will be given!
For the quant, we wait for fix to be applied (https://github.com/ggerganov/llama.cpp/pull/8676)
Hope you will enjoy them!
- 4 replies
Post
15533
Hello there,
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
- 4 replies
Post
16647
Hey everyone,
Just wanted to shout out a massive thank you to all 2000 of you who've followed me on Hugging Face! 🎉 It's incredible to have such an awesome crew backing me up as I dive into all these LLM experiments.
Even though not all my models turn out perfect, I've found some real gems and methods along the way 💎. It's like digging for treasure – sometimes you found nothing, but sometimes you find a pearl, and sometimes you find a new method to try.
Your support and encouragement mean the world to me, and I'm really stoked to keep experimenting and learning. If you told me some years ago I would have so much people following me for what I do, I wouldn't have believed it. Here's to more discoveries and adventures ahead! 🚀
Also, big thanks once again, and a huge shoutout to @IkariDev for being there through this journey and supporting me. I'm excited for our future work together and hope we will continue to make people happy! 👏
I want to thank @Gryphe too, since my early work was heavily inspired from MythoMax and the RP/ERP vibe of it. If I'm here today it's probably because of you 😂
I was so close to forget @chargoddard and his amazing tool too! What will we do without mergekit in our life? Thank you! 🙏
See y'all at 3k!
Just wanted to shout out a massive thank you to all 2000 of you who've followed me on Hugging Face! 🎉 It's incredible to have such an awesome crew backing me up as I dive into all these LLM experiments.
Even though not all my models turn out perfect, I've found some real gems and methods along the way 💎. It's like digging for treasure – sometimes you found nothing, but sometimes you find a pearl, and sometimes you find a new method to try.
Your support and encouragement mean the world to me, and I'm really stoked to keep experimenting and learning. If you told me some years ago I would have so much people following me for what I do, I wouldn't have believed it. Here's to more discoveries and adventures ahead! 🚀
Also, big thanks once again, and a huge shoutout to @IkariDev for being there through this journey and supporting me. I'm excited for our future work together and hope we will continue to make people happy! 👏
I want to thank @Gryphe too, since my early work was heavily inspired from MythoMax and the RP/ERP vibe of it. If I'm here today it's probably because of you 😂
I was so close to forget @chargoddard and his amazing tool too! What will we do without mergekit in our life? Thank you! 🙏
See y'all at 3k!
- 5 replies
Post
20740
Hello!
The 8B/70B OG Llama-3 models made with the Orthogonal Activation Steering script as been pushed in private.
After multiple test with an empty prompt system, I can confirm it's not uncensored enough, but I wanted to try all the GGUF before (and it take time to do lmao)
If you want to try that yourself, here is the script : https://gist.github.com/wassname/42aba7168bb83e278fcfea87e70fa3af
And here is the same script that we modified to be able to use it on multiple GPU for 70B : https://files.catbox.moe/ya4rto.ipynb
Llama3-Unholy-8B-OAS don't have the problem as it was already trained to be less censored, but the OG one was really too much censored.
I will try to redo that soon, as it seems to HAVE WORKED for some prompt (as seen on the log, for exemple) but it's not enough.
32 entry of the dataset is clearly not enough, but it's okay, I really wanted to try that as it was something new.
I could take the Unholy way and retrain the 70B before using OAS but it should work without, that's not the goal.
The 8B/70B OG Llama-3 models made with the Orthogonal Activation Steering script as been pushed in private.
After multiple test with an empty prompt system, I can confirm it's not uncensored enough, but I wanted to try all the GGUF before (and it take time to do lmao)
If you want to try that yourself, here is the script : https://gist.github.com/wassname/42aba7168bb83e278fcfea87e70fa3af
And here is the same script that we modified to be able to use it on multiple GPU for 70B : https://files.catbox.moe/ya4rto.ipynb
Llama3-Unholy-8B-OAS don't have the problem as it was already trained to be less censored, but the OG one was really too much censored.
I will try to redo that soon, as it seems to HAVE WORKED for some prompt (as seen on the log, for exemple) but it's not enough.
32 entry of the dataset is clearly not enough, but it's okay, I really wanted to try that as it was something new.
I could take the Unholy way and retrain the 70B before using OAS but it should work without, that's not the goal.
- 61 replies
Post
9689
Soon new releases on NeverSleep 👀
8B/70B Llama3 RP fine-tune in the work!
8B/70B Llama3 RP fine-tune in the work!
- 2 replies
chargoddard
authored a
paper over 2 years ago
Post
Hey, it took some time but I finally moved out and got internet back, so here I am again!
A lot of things to get updated on, I will try to reply to each of you ASAP.
See you soon!
A lot of things to get updated on, I will try to reply to each of you ASAP.
See you soon!
- 1 reply
Post
From @IkariDev and @Undi95
New release from NeverSleep!
MiquMaid-v2-70B
NeverSleep/MiquMaid-v2-70B
NeverSleep/MiquMaid-v2-70B-GGUF
DPO version
NeverSleep/MiquMaid-v2-70B-DPO
NeverSleep/MiquMaid-v2-70B-DPO-GGUF
MiquMaid-v2-2x70B
NeverSleep/MiquMaid-v2-2x70B
NeverSleep/MiquMaid-v2-2x70B-GGUF
DPO version
NeverSleep/MiquMaid-v2-2x70B-DPO
NeverSleep/MiquMaid-v2-2x70B-DPO-GGUF
Feedback appreciated!
New release from NeverSleep!
MiquMaid-v2-70B
NeverSleep/MiquMaid-v2-70B
NeverSleep/MiquMaid-v2-70B-GGUF
DPO version
NeverSleep/MiquMaid-v2-70B-DPO
NeverSleep/MiquMaid-v2-70B-DPO-GGUF
MiquMaid-v2-2x70B
NeverSleep/MiquMaid-v2-2x70B
NeverSleep/MiquMaid-v2-2x70B-GGUF
DPO version
NeverSleep/MiquMaid-v2-2x70B-DPO
NeverSleep/MiquMaid-v2-2x70B-DPO-GGUF
Feedback appreciated!
- 4 replies
alpindale
authored a
paper almost 3 years ago