meta-math/MetaMathQA
Viewer • Updated • 395k • 63.3k • 457
How to use Q-bert/MOLAR-10.7B with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("kyujinpy/Sakura-SOLAR-Instruct")
model = PeftModel.from_pretrained(base_model, "Q-bert/MOLAR-10.7B")Q-LoRA fine-tuned on kyujinpy/Sakura-SOLAR-Instruct with meta-math/MetaMathQA
Adapter model and normal model is available, you can download with both styles.
You must use this prompt style.
### Query: <query>
### Response: <response>
Detailed results will be found Here
| Metric | Value |
|---|---|
| Avg. | |
| ARC (25-shot) | |
| HellaSwag (10-shot) | |
| MMLU (5-shot) | |
| TruthfulQA (0-shot) | |
| Winogrande (5-shot) | |
| GSM8K (5-shot) |
Base model
kyujinpy/Sakura-SOLAR-Instruct