Data · dataset · 2024
Test datasets for indexing of Chinese medical articles by 4 large models.
Listed in ScienceDB
Description
Four large models were used to extract and summarize the key information of 100 randomly selected Chinese medical research articles, and the accuracy of extraction and summary was scored.The dataset included:Basic information of 100 articles;Prompts constructed based on the abstracts and research methods of 100 literatures;JSON data containing indexing information generated from 4 large models;Key information extracted from JSON data and AI summary text;Scoring of the indexing results of each model.Four LLM are ChatGML4.0, ChatGPT4o, iFLYTEK Spark, Kimi.
Links
Where it is published
- DOI doi.org/10.57760/sciencedb.o00130.03231 ↗
DOI / persistent id · from scidb cn
Catalogue records · 1
- OAI-PMH record scidb.cn/oai?verb=GetRecord&metadataPrefix=oai_dc&identifier=10.57760%2… ↗
metadata API · from scidb cn
Topics
- From keywords
- Earth & Environmental Science · Engineering · Humanities · Life Sciences · Medicine & Health · Social Science
- Inferred from text
- Epidemiology 69% · Text 75%
Provenance · 1 source records, 13 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| ScienceDB | 10.57760/sciencedb.o00130.03231 | 10 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].anzsrc:group:4202 | enrichment · scidb cn | taxonomy-embedding@1.0.0 | title+keywords+description (69%) |
| concepts[field].local:field:earth-environmental | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:engineering | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:humanities | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:life-sciences | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:medicine-health | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[field].local:field:social-science | mapping · scidb cn | connector:scidb_cn@1.0.0 | |
| concepts[modality].local:modality:text | enrichment · scidb cn | keyword-concept-rules@1.0.0 | title+description (75%) |
| description | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/description |
| license | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/rights |
| publication_date | source · scidb cn | connector:scidb_cn@1.0.0 | |
| title | source · scidb cn | connector:scidb_cn@1.0.0 | /metadata/dc/title |