Feb 21, 2024 · We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user …

May 31, 2024 · BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user objectives. The benchmark's complexity and compact size make it suitable for evaluating large …

Sep 5, 2025 · Abstract: We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi …

Dec 16, 2023 · Abstract: We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO) to evaluate the ability of IR models to follow multi-faceted task objectives. We …

Bibliographic details on BIRCO: A Benchmark of Information Retrieval Tasks with Complex Objectives.

We propose the BIRCO benchmark for evaluating the performance of IR systems on tasks with complex objectives.

We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user objectives.

We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user objectives.

We present the B enchmark of I nformation R etrieval (IR) tasks with C omplex O bjectives (BIRCO), which consists of five diverse and challenging tasks. BIRCO evaluates the ability of IR systems to …

The paper introduces BIRCO, a new benchmark for evaluating information retrieval (IR) systems that leverage large language models (LLMs). Unlike traditional IR benchmarks focused on keyword …