Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

google
/
pix2struct-widget-captioning-base

Visual Question Answering
Transformers
PyTorch
Safetensors
pix2struct
image-text-to-text
Model card Files Files and versions
xet
Community
3

Instructions to use google/pix2struct-widget-captioning-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Transformers

    How to use google/pix2struct-widget-captioning-base with Transformers:

    # Use a pipeline as a high-level helper
    from transformers import pipeline
    
    pipe = pipeline("visual-question-answering", model="google/pix2struct-widget-captioning-base")
    # Load model directly
    from transformers import AutoProcessor, AutoModelForImageTextToText
    
    processor = AutoProcessor.from_pretrained("google/pix2struct-widget-captioning-base")
    model = AutoModelForImageTextToText.from_pretrained("google/pix2struct-widget-captioning-base")
  • Notebooks
  • Google Colab
  • Kaggle
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Missing example for running the model

2
#2 opened about 3 years ago by
molntamas

The model_type 'pix2struct' is not recognized. It could be a bleeding edge model, or incorrect

1
#1 opened about 3 years ago by
fatemerhmi
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs