Infatica Logo

Infatica

Senior Scraping Engineer (Web scraping & Anti-bot)

Reposted 3 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Spain
Senior level
Remote
Hiring Remotely in Spain
Senior level
Lead architectural decisions for a high-load web scraping platform, focusing on anti-bot systems and crawling while maintaining code quality and infrastructure stability.
The summary above was generated by AI

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Engineer for our web scraping development team who will lead and drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Ownership

  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

- 4-6+ years in backend, data engineering, automation, or high-load systems.

- Strong production web scraping experience with protected / dynamic / JS-heavy websites.

- Python async stack; Go experience is a plus.

- Experience with Playwright, Puppeteer, Selenium, Scrapy, browser automation, CDP.

- Strong understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, proxies.

- Redis, queues/message brokers, Docker, CI/CD, observability.

- Kubernetes experience is preferred; deep K8s/SRE is a plus, not a hard blocker within this budget.

- Ability to write clear technical documentation in English.

- Ownership mindset: reliability, monitoring, incident debugging, cost control


Benefits
  • Participate in developing the company's key product from scratch
  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us 

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!

Similar Jobs

11 Hours Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Machine Learning • Software
Design, build, and operate production-grade AI agents for product workflows. Own architecture, tool/schema design, prompt/instruction artifacts, human-in-the-loop boundaries, integrations with Microsoft 365/Power Platform/AWS, and evaluation/governance. Monitor quality, reduce hallucinations, optimize cost and performance, and iterate based on real usage to improve product operations.
Top Skills: Ai AgentsAPIsAws BedrockAws EventbridgeAws LambdaAws Step FunctionsCopilot StudioLlmsMicrosoft 365Microsoft GraphPower PlatformPrompt EngineeringRestWebhooks
12 Hours Ago
In-Office or Remote
United Kingdom
Mid level
Mid level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The role involves researching and developing large language models (LLMs) with a focus on transformer architecture, data curation, distributed training, and optimization. Responsibilities include conducting experiments, collaborating with teams, and staying updated on deep learning advancements.
Top Skills: Distributed ComputingLarge Language ModelsPythonPyTorchTransformer Architectures
12 Hours Ago
In-Office or Remote
London, Greater London, England, GBR
Senior level
Senior level
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
The Account Executive will drive new customer acquisition and revenue, self-prospecting to build sales pipelines, and collaborating with marketing and sales teams. Responsibilities include understanding customer needs in voice AI, articulating Deepgram's value, and managing existing accounts for upsell opportunities.
Top Skills: AIAPIsMlSpeech-To-SpeechSpeech-To-TextText-To-Speech

What you need to know about the London Tech Scene

London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account