Instructions to use answerdotai/ModernBERT-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use answerdotai/ModernBERT-large with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="answerdotai/ModernBERT-large")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("answerdotai/ModernBERT-large") model = AutoModelForMaskedLM.from_pretrained("answerdotai/ModernBERT-large") - Notebooks
- Google Colab
- Kaggle
update-onnx-model
#13
by kozistr - opened
Issue with loading the onnx model with TEI
So, I've re-exported the onnx file following code.
onnx_model = SentenceTransformer('answerdotai/ModernBERT-large', backend='onnx', model_kwargs={'export': True})
onnx_model.save_pretrained(output_dir)