Skip to content
FlowHubFluxonLab
W
Document AI & Extractionfree

Orchestrate Web Crawls with Scrapyd and Automated Data Enrichment

by 21CELUpdated Aug 2026
Share Post Share
MaWhen clicking ‘Execute workflow’When clicking ‘…HRjob_listCofilter_jobIfcheck_job_statusWaWait3HRcheck_itemsHRrun_jobHRscreenshotsHRjob_logHRDL-htmlHRHTMLSIloop-htmlHRDL-screenshotsSIloop-screenshotsAgcombine-screenshotscombine-screens…Agcombine-htmlSOSplit HTMLSOSplit-screenshotRTRespond to WebhookRespond to Webh…IfIf-job-checkCoFilter-result1234567891011121314151617181920212223
1/5
STEPS · 23
Run manually by an operator

Manually triggered, launches Scrapyd web crawls over HTTP, polls for completion, aggregates results, and enriches the scraped data.

Tags

manualcomplexDocument Extractiondiscoveredpending-review
CategoryDocument AI & Extraction
Triggermanual
Complexitycomplex
Nodes21
AddedJun 27, 2026