Infatica Logo

Infatica

Scraping Tech Lead (Web scraping & Anti-bot)

Reposted 16 Days Ago
Be an Early Applicant
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
Lead the web scraping development team, drive architectural decisions, manage development processes, and research anti-bot systems for the platform.
The summary above was generated by AI

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Leadership

  • Team building: participate in hiring backend, browser, DevOps, and QA engineers
  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

Requirements

  • Extensive Scraping experience (mandatory)
  • 5+ years of engineering experience in high-load backend/data platforms
  • Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
  • Experience with async Python and Go (ideally both), Redis, queues, message brokers
  • Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
  • Experience analyzing and bypassing bot protection systems — strong plus
  • Fluent English (all documentation and part of the team are English-speaking)
  • Decision-making skills, mentoring abilities, and accountability for results

Benefits

What We Offer

  • Participate in developing the company's key product from scratch
  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us 

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!

Top Skills

Go
Helm
HTTP
Http/2
Kubernetes
Prometheus
Python
Redis
Tls

Similar Jobs

16 Days Ago
Remote
Spain
Senior level
Senior level
Information Technology
Lead the web scraping development team, overseeing architecture design, development processes, anti-bot research, and DevOps setup to enhance platform capabilities.
Top Skills: GoHelmKubernetesPrometheusPythonRedis
9 Hours Ago
Remote or Hybrid
Barcelona, Cataluña, ESP
Senior level
Senior level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Responsible for expanding UL's Renewables Advisory business in Spain, managing customer relationships, promoting advisory capabilities, and developing growth strategies.
Top Skills: Crm SoftwareMS Office
9 Hours Ago
Remote or Hybrid
3 Locations
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The AIDR Specialist will drive CrowdStrike's initiatives for securing GenAI and applications, collaborating with sales teams, and advising customers on AIDR products while managing the sales pipeline.
Top Skills: Ai SecurityApplication SecurityCloud SecurityDevsecopsMeddpiccProduct Security

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account