Instructions to use google/pix2struct-widget-captioning-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/pix2struct-widget-captioning-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("visual-question-answering", model="google/pix2struct-widget-captioning-base")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("google/pix2struct-widget-captioning-base") model = AutoModelForImageTextToText.from_pretrained("google/pix2struct-widget-captioning-base") - Notebooks
- Google Colab
- Kaggle
Missing example for running the model
2
#2 opened about 3 years ago
by
molntamas
The model_type 'pix2struct' is not recognized. It could be a bleeding edge model, or incorrect
1
#1 opened about 3 years ago
by
fatemerhmi