Densifying Sparse Representations for Passage Retrieval by Representational Slicing
Paper • 2112.04666 • Published
Configuration Parsing Warning:Config file config.json cannot be fetched (too big)
Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
This model, (DeLADE+[CLS])+, is trained by fusing neural lexical and semantic components in single transformer using DistilBERT as a backbone using hard negative mining and knowledge distillation with ColBERT teacher, which is detailed in the below paper.
A Dense Representation Framework for Lexical and Semantic Matching Sheng-Chieh Lin and Jimmy Lin.
You can find the usage of the model in our DHR repo: (1) Inference on MSMARCO Passage Ranking; (2) Inference on BEIR datasets.
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support