TREC 2023 Tip-of-the-Tongue dataset
The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories.
Resources
5 resources available
-
2023 Tip-of-the-Tongue development data
FILE -
2023 Tip of the Tongue QRels
FILE -
2023 Tip-of-the-Tongue test data
FILE -
2023 Tip-of-the-Tongue training data
FILE -
2023 Tip-of-the-Tongue corpus
JSON LINES, COMPRESSED WITH ZIP
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[ "006:55" ] |
| contactPoint |
{ "fn": "Ian Soboroff", "hasEmail": "mailto:ian.soboroff@nist.gov" } |
| description | The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories. |
| distribution |
[ { "title": "2023 Tip-of-the-Tongue development data", "accessURL": "https://trec.nist.gov/data/tot/2023-dev.zip" }, { "title": "2023 Tip of the Tongue QRels", "accessURL": "https://trec.nist.gov/data/tot/2023-qrels.txt" }, { "title": "2023 Tip-of-the-Tongue test data", "accessURL": "https://trec.nist.gov/data/tot/2023-test.zip" }, { "title": "2023 Tip-of-the-Tongue training data", "accessURL": "https://trec.nist.gov/data/tot/2023-train.zip" }, { "title": "2023 Tip-of-the-Tongue corpus", "format": "JSON lines, compressed with zip", "mediaType": "application/zip", "description": "This corpus is distributed by the track coordinators via Zenodo", "downloadURL": "https://zenodo.org/records/11185090/files/corpus.jsonl.zip?download=1" } ] |
| identifier | ark:/88434/mds2-3275 |
| issued | 2024-11-27 |
| keyword |
[ "TREC text retrieval conference" ] |
| language |
[ "en" ] |
| license | https://www.nist.gov/open/license |
| modified | 2024-05-09 00:00:00 |
| programCode |
[ "006:045" ] |
| publisher |
{ "name": "National Institute of Standards and Technology", "@type": "org:Organization" } |
| references |
[ "https://trec.nist.gov/pubs/trec32/papers/Overview_tot.pdf" ] |
| theme |
[ "Information Technology:Data and informatics" ] |
| title | TREC 2023 Tip-of-the-Tongue dataset |
