← Search

Data · dataset · 2017

SM01: Web Crawling with JLC parallel execution pattern - experiment reports

Listed in Teesside University Research Data Repository

Research project SM01 (Parallel Semantic Crawler for manufacturing multilingual web...) The JLC pattern is running parallel thread for each domain in the Crawl Job domain cue.

Description

Objective of the experiment was to find what number of parallel DLC threads (TCmax) results in the highest execution efficiency. The crawlers were run: 2, 4, 6, 8, 10, 12, 14 and 16 parallel DLC threads, against the Sc subset.

Other configuration parameters: Load Take per iteration (LT) set to 1 and Page Loads limit (PLmax) set to 30. Sampling period of the resource utilization: 5 seconds.

Links

Where it is published

Catalogue records · 1

Topics

From keywords
Earth & Environmental Science · Engineering · Humanities
Provenance · 1 source records, 8 field assertions
SourceKeyLast seenRaw
Teesside University Research Data Repositoryoai:data.mendeley.com/5prx8vycr5.114 h agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:earth-environmentalmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:engineeringmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
concepts[field].local:field:humanitiesmapping · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
descriptionsource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/description
licensesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/rights
publication_datesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0
titlesource · researchdata tees ac ukconnector:researchdata_tees_ac_uk@1.0.0/metadata/dc/title