| --- |
| license: apache-2.0 |
| pipeline_tag: text-ranking |
| library_name: lightning-ir |
| base_model: |
| - google/electra-base-discriminator |
| tags: |
| - cross-encoder |
| --- |
| |
| # Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders |
|
|
| This model is presented in the paper [Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders](https://huggingface.co/papers/2404.06912). It's a cross-encoder architecture designed for efficient and permutation-invariant passage re-ranking. |
|
|
| Code: https://github.com/webis-de/set-encoder |
|
|
| We provide the following pre-trained models for general-purpose re-ranking. |
|
|
| To reproduce the results, run the following command using the [Lightning IR](https://github.com/webis-de/lightning-ir) library and the configuration files from the repository repository linked above: |
|
|
| ```bash |
| lightning-ir re_rank --config ./configs/re-rank.yaml --model.model_name_or_path <MODEL_NAME> |
| ``` |
|
|
| (nDCG@10 on TREC DL 19 and TREC DL 20) |
|
|
| | Model Name | TREC DL 19 (BM25) | TREC DL 20 (BM25) | TREC DL 19 (ColBERTv2) | TREC DL 20 (ColBERTv2) | |
| | ---------------------------------------------------------------------------------------- | ----------------- | ----------------- | ---------------------- | ---------------------- | |
| | [webis/set-encoder-base](https://huggingface.co/webis/set-encoder-base) | 0.746 | 0.704 | 0.781 | 0.768 | |
| | [webis/set-encoder-large](https://huggingface.co/webis/set-encoder-large) | 0.750 | 0.722 | 0.789 | 0.791 | |
|
|
|
|
| ## Citation |
|
|
| If you use this code or the models in your research, please cite our paper: |
|
|
| ```bibtex |
| @InProceedings{schlatt:2025, |
| address = {Berlin Heidelberg New York}, |
| author = {Ferdinand Schlatt and Maik Fr{\"o}be and Harrisen Scells and Shengyao Zhuang and Bevan Koopman and Guido Zuccon and Benno Stein and Martin Potthast and Matthias Hagen}, |
| booktitle = {Advances in Information Retrieval. 47th European Conference on IR Research (ECIR 2025)}, |
| doi = {10.1007/978-3-031-88711-6_1}, |
| month = apr, |
| publisher = {Springer}, |
| series = {Lecture Notes in Computer Science}, |
| site = {Lucca, Italy}, |
| title = {{Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders}}, |
| year = 2025 |
| } |
