Information Retrieval Benchmarks

It would be really interesting to see these featured - especially since it’s one area deep learning approaches have not entirely overwhelmed yet. eg:

One issue is, TREC collections may not be available to use in this way? I’m not sure about that though, might be good to ask someone - i seem to remember some of the TREC datasets had additional restrictions.

1 Like

Hey Igor,
great suggestion of a benchmark to have. Do you know of repositories with pretrained models for information retrieval working on TREC?