Scraping Project Manager / Scraping Lead (Freelance)

À propos de L'offre sur Kernel emploi Afrique
B2B SaaS company in the fashion-tech space that turns large volumes of market data into actionable insights to help brands make better decisions and reduce waste.
Le poste
Data is at the core of the product and of this role. You will run our client's scraping operations (~400 web scrapers in production daily). This is a hands-on, senior role where you specify, challenge deliverables, review the code of more junior engineers, and get into the code yourself when needed. "Project Manager" here means seniority and ownership of technical decisions, it is not ticket coordination, and it is not people management.
This is a freelance position, 100% remote, working in an international environment where English and French are both used (Bilingual profile required).
Your Role

• Own scraping projects in production end-to-end, from specification to deliverable validation.
• Own the technical calls: pick the approach for a given site, and be able to say what it costs and what it gives up.
• Challenge deliverables and guarantee their quality, being able to get into the code to verify what is produced.
• Review code written by more junior engineers and raise the level of what ships.
• Manage and maintain a proxy mix (datacenter, residential, mobile, unlocker) adapted to each site's constraints.
• Size the throughput of the web scrapers according to targets and technical constraints.
• Track and optimize the cost per scraped site.
• Handle complex scraping challenges: catalogs behind a CDN intercepting datacenter IPs, large retailers with aggressive anti-bot protection, closed catalog APIs, mobile or residential IP management, and large catalogs.

Profil recherché
Your Qualifications

• Around 2 years of experience running scraping in production. What matters is what you have actually operated, not the number of years on a CV.
• Proven experience managing a proxy mix: datacenter, residential, mobile, unlocker.
• Experience in throughput sizing and cost-per-site tracking.
• At least 1 of those years spent on complex challenges: bypassing CDNs that intercept datacenter IPs, scraping large retailers with aggressive anti-bot protection, closed catalog APIs, working with mobile or residential IPs, and handling large catalogs.
• Ability to specify, challenge a deliverable, and step directly into the code in Python.
• Comfortable reviewing someone else's code and giving direct, useful feedback.
• Bilingual profile: Professional working proficiency in both French and English.

Tech Stack
Python and Scrapy, running on Zyte. Playwright and Camoufox on the harder targets. You are expected to be at home in this stack (deep expertise in every single tool listed is not required).