Archive · dataset · 2024
The CAP Babel Machine (Phase 2)
Listed in CKAN @ IoT Lab
We present an open-source and freely available natural language processing system designed for comparative policy studies.
Description
Manually labeling large corpora can be tedious and often demands extensive domain expertise. Recent advancements in machine learning and natural language processing hold the potential for language models to surpass human-level accuracy in text classification tasks.
In our experiments, we fine-tuned Large Language Models (LLMs) across various language and domain corpora using 21 categories from the Comparative Agendas Project codebook. This project is an update for the project "The CAP Babel Machine." In Phase 2, we fine-tuned XLM-RoBERTa models for new language-domain combinations to extend the capabilities of our previous pipeline. We also leveraged open neural machine translation models to augment our existing training data.
Read the rest (1 more)
Additionally, we fine-tuned models for three new tasks: sentiment classification, emotion classification, and classification using the Manifesto Project codebook.
Links
Get the data
- Models huggingface.co/poltextlab ↗
download · from ckan iotlab com
- Performance metrics (Manifesto) ckan.iotlab.com/dataset/4376654d-b449-429c-8b34-8f3dd211de68/resource/b8b7e30d… ↗
download · from ckan iotlab com
- Performance metrics (sentiment) ckan.iotlab.com/dataset/4376654d-b449-429c-8b34-8f3dd211de68/resource/ab2c2264… ↗
download · from ckan iotlab com
- Performance metrics (emotion) ckan.iotlab.com/dataset/4376654d-b449-429c-8b34-8f3dd211de68/resource/7f3a464b… ↗
download · from ckan iotlab com
- Performance metrics (CAP) ckan.iotlab.com/dataset/4376654d-b449-429c-8b34-8f3dd211de68/resource/bf7a0348… ↗
download · from ckan iotlab com
Where it is published
- CKAN @ IoT Lab dataset page ckan.iotlab.com/dataset/cap-babel-phase-2 ↗
landing page · from ckan iotlab com
Catalogue records · 1
- CKAN API ckan.iotlab.com/api/3/action/package_show?id=4376654d-b449-429c-8b34-8f3dd211d… ↗
metadata API · from ckan iotlab com
Topics
- From keywords
- Computer Science & AI · Engineering
- Inferred from text
- Natural language processing 79% · Text 75%
Provenance · 1 source records, 9 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| CKAN @ IoT Lab | 4376654d-b449-429c-8b34-8f3dd211de68 | 5 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| concepts[field].anzsrc:field:460208 | enrichment · ckan iotlab com | taxonomy-embedding@1.0.0 | title+keywords+description (79%) |
| concepts[field].local:field:computer-science-ai | mapping · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | |
| concepts[field].local:field:engineering | mapping · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · ckan iotlab com | keyword-concept-rules@1.0.0 | title+description (75%) |
| created_date | source · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | |
| description | source · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | /notes |
| publication_date | source · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | |
| title | source · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 | /title |
| updated_date | source · ckan iotlab com | connector:ckan_iotlab_com@1.0.0 |