Data · dataset · 2024
MARB
Listed in Researchdata.se
Reporting bias (the human tendency to not mention obvious or redundant information) and social bias (societal attitudes toward specific demographic groups) have both been shown to propagate from human text data to language models trained on such data.
Description
However, the two phenomena have not previously been studied in combination. The MARB dataset was developed to begin to fill this gap by studying the interaction between social biases and reporting bias in language models.
Unlike many existing benchmark datasets, MARB does not rely on artificially constructed templates or crowdworkers to create contrasting examples. Instead, the templates used in MARB are based on naturally occurring written language from the 2021 version of the enTenTen corpus (Jakubíček et al., 2013).
Links
Where it is published
- DOI doi.org/10.23695/v3wp-6c64 ↗
DOI / persistent id · from researchdata se
Catalogue records · 1
- OAI-PMH record api.researchdata.se/oai-pmh?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai%3A… ↗
metadata API · from researchdata se
Topics
- From keywords
- Computer Science & AI · Earth & Environmental Science · Humanities
- Inferred from text
- Text 75%
Provenance · 1 source records, 7 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Researchdata.se | oai:researchdata.se:doi-10-23695-v3wp-6c64/0 | 13 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].local:field:computer-science-ai | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[field].local:field:earth-environmental | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[field].local:field:humanities | mapping · researchdata se | connector:researchdata_se@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · researchdata se | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · researchdata se | connector:researchdata_se@1.0.0 | /metadata/dc/description |
| publication_date | source · researchdata se | connector:researchdata_se@1.0.0 | |
| title | source · researchdata se | connector:researchdata_se@1.0.0 | /metadata/dc/title |