E-commerce Lead-Generation & Data-Harvesting Pipeline
A social storytelling / lead-gen platform
Overview
A focused Node.js lead-generation pipeline that harvests e-commerce store data (Shopify and PrestaShop merchants) from a store-intelligence source, then normalizes and summarizes the results into clean CSV lead lists.
Why It Exists
The platform needed targeted lists of online merchants for outreach and lead generation. This tool automates collecting and deduplicating store/domain data so the sales side can work from structured datasets instead of manual research.
What We Built
ESM Node scripts that page through a store-intelligence JSON API (87+ pages per source), persisting raw responses per page for Shopify and PrestaShop separately. Companion sumarise/summarise-shopify scripts merge the paged JSON, extract unique domains and identifier types, and emit consolidated domains.csv / domains-shopify.csv lead exports.
Technologies & Approach
Modern Node.js with ES modules and the native fs/promises API; a fetch-driven, header-faithful request layer for paginated harvesting; lightweight set-based deduplication and CSV serialization. Deliberately minimal and dependency-free for a one-shot data job.
Outcome / Impact
Turned a manual research chore into a repeatable harvesting-and-summarization pipeline, producing structured merchant lead lists ready for outreach.
Capabilities Demonstrated
- Automated, paginated data harvesting from third-party APIs
- Dataset deduplication, normalization, and CSV export
- Lightweight, dependency-free Node automation