Constarium
← Search

Table · dataset · 2026

Table 1_Performance evaluation of mainstream large language models in cataract science popularization Q&A: a comparative study of readability, quality, and educational suitability.docx

Listed in figshare and Loughborough Research Repository — shown once because both records carry DOI 10.3389/fopht.2026.1943376.s001

Background<p>Cataract is one of the main causes of visual impairment and reversible blindness worldwide, and it mainly affects the elderly population.

Description

Clinically accurate and sufficiently readable patient education materials play a crucial role in this regard. With the rapid development of large language models (LLMs), patients are increasingly obtaining health information generated by artificial intelligence (AI); however, the reliability of online medical information is often questionable.

This study systematically evaluated the readability, quality, and educational suitability of mainstream LLMs when answering questions related to cataract.</p>Methods<p>Five mainstream LLMs - Doubao, DeepSeek, Wenxin Yiyan, Tongyi Qianwen, and GPT-5 - were evaluated based on their responses to 20 frequently asked questions (FAQs) for cataract patient, which covered five subject categories. Text readability was assessed through multiple indicators, including the Coleman-Liau Index (CL), Linsear Write (LW), Automated Readability Index (ARI), Simple Measure of Gobbledygook (SMOG), Gunning Fog Index (GFOG), Flesch Reading Ease Score (FRES), and Flesch–Kincaid Grade Level (FKGL).

Read the rest (4 more)

Information quality and educational suitability were evaluated using the Global Quality Score (GQS) and the Chinese version of the Patient Education Material Readability Assessment Tool (c-PEMAT-P). Differences between groups were compared using one-way ANOVA and Kruskal-Wallis tests, with correlation analyses exploring relationships among indicators.</p>Results<p>There were significant differences among LLMs in terms of readability, information quality, and educational suitability (all p < 0.05).

GPT-5 had the highest c-PEMAT-P and GQS scores, however, several readability difficulty indices of GPT-5 and Tongyi Qianwen were also higher. There were significant differences in readability among different content categories. The postoperative management and risk/prevention topics tended to have better educational suitability, whereas surgical diagnosis, treatment, and preoperative management were more difficult to read.

Correlation analysis demonstrated that the correlation between the quality indicators and the readability-related indicators is generally weak.</p>Conclusion<p>In terms of generating educational materials for cataract patient, LLMs have potential, but the output quality varies depending on the model and the topic. GPT-5 performs best in terms of overall quality and educational suitability, but its readability is not always at an ideal level.

Model selection has a crucial impact on the quality and educational suitability of the information, while the content topic mainly affects the language complexity. Therefore, for the responsible use of LLMs in cataract patient education, the cataract education materials generated by LLMs need to undergo expert review, readability optimization, and patient-centered validation before clinical application.</p>

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Tabular 65% · Text 75%
Provenance · 2 source records, 34 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/339795673 d agoJSON v1
Loughborough Research Repositoryoai:figshare.com:article/339795673 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:field:321201mapping · figshare comvocabulary-mapper@1.0.0keywords['Ophthalmology']
concepts[field].anzsrc:field:321201mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['Ophthalmology']
concepts[field].anzsrc:field:420302mapping · figshare comvocabulary-mapper@1.0.0keywords['digital health']
concepts[field].anzsrc:field:420302mapping · repository lboro ac ukvocabulary-mapper@1.0.0keywords['digital health']
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:materials-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:psychology-behavioralmapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · repository lboro ac ukconnector:repository_lboro_ac_uk@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
concepts[modality].local:modality:tabularenrichment · figshare comkeyword-concept-rules@1.0.0title+description (65%)
concepts[modality].local:modality:textenrichment · figshare comkeyword-concept-rules@1.0.0title+description (75%)
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title