TREC 2023 Tip-of-the-Tongue dataset
The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories.
Resources
5 resources available
-
2023 Tip-of-the-Tongue development data
FILE -
2023 Tip of the Tongue QRels
FILE -
2023 Tip-of-the-Tongue test data
FILE -
2023 Tip-of-the-Tongue training data
FILE -
2023 Tip-of-the-Tongue corpus
JSON LINES, COMPRESSED WITH ZIP
Find Related Datasets
Search by Tags
Click any tag below to search for similar datasets
Complete Metadata
| @type | dcat:Dataset |
|---|---|
| accessLevel | public |
| bureauCode |
[
"006:55"
]
|
| contactPoint |
{
"fn": "Ian Soboroff",
"hasEmail": "mailto:ian.soboroff@nist.gov"
}
|
| description | The Tip-of-the-Tongue (ToT) Track focuses on the known-item identification task where the searcher has previously experienced or consumed the item (e.g., a movie) but cannot recall a reliable identifier (i.e., It's on the tip of my tongue...). Unlike traditional ad-hoc keyword-based search, these information requests tend to be natural-language, verbose, and complex containing a wide variety of search strategies such as multi-hop reasoning, and frequently express uncertainty and suffer from false memories. |
| distribution |
[
{
"title": "2023 Tip-of-the-Tongue development data",
"accessURL": "https://trec.nist.gov/data/tot/2023-dev.zip"
},
{
"title": "2023 Tip of the Tongue QRels",
"accessURL": "https://trec.nist.gov/data/tot/2023-qrels.txt"
},
{
"title": "2023 Tip-of-the-Tongue test data",
"accessURL": "https://trec.nist.gov/data/tot/2023-test.zip"
},
{
"title": "2023 Tip-of-the-Tongue training data",
"accessURL": "https://trec.nist.gov/data/tot/2023-train.zip"
},
{
"title": "2023 Tip-of-the-Tongue corpus",
"format": "JSON lines, compressed with zip",
"mediaType": "application/zip",
"description": "This corpus is distributed by the track coordinators via Zenodo",
"downloadURL": "https://zenodo.org/records/11185090/files/corpus.jsonl.zip?download=1"
}
]
|
| identifier | ark:/88434/mds2-3275 |
| issued | 2024-11-27 |
| keyword |
[
"TREC text retrieval conference"
]
|
| language |
[
"en"
]
|
| license | https://www.nist.gov/open/license |
| modified | 2024-05-09 00:00:00 |
| programCode |
[
"006:045"
]
|
| publisher |
{
"name": "National Institute of Standards and Technology",
"@type": "org:Organization"
}
|
| references |
[
"https://trec.nist.gov/pubs/trec32/papers/Overview_tot.pdf"
]
|
| theme |
[
"Information Technology:Data and informatics"
]
|
| title | TREC 2023 Tip-of-the-Tongue dataset |
