Build a production-ready web crawling and AI lead-qualification application: crawl and extract website content, analyze with LLMs to score/qualify industry-specific leads, produce structured outputs, and deliver a maintainable handover-ready product.
This is a remote position.
MENA Alliances is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads.
In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom).
The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand.
- Develop a web crawling and scraping system to collect relevant data from a list of websites.
- Extract and process meaningful content from crawled pages.
- Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
- Design a scoring or ranking mechanism that qualifies and prioritizes leads.
- Produce a structured output containing qualified leads with clear reasoning or scoring.
- Deliver a standalone, well-structured application ready for handover to the client.
RequirementsTechnical Requirements
- Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
- Strong knowledge of content extraction and text analysis.
- Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
- Ability to design and build clean, maintainable software products, not just quick prototypes.
- Familiarity with modern development stacks and best practices.
- Experience in lead generation, marketing technology, or sales intelligence tools.
- Knowledge of prompt engineering, particularly for multilingual or non-English content.
- Experience building end-to-end AI-powered tools or automation solutions.
- German language skills are a plus but not required (language support will be provided by the client).
Benefits
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead EMEA insider risk investigations and assessments, identify threats to people and assets, conduct interviews and evidence analysis, brief stakeholders, develop mitigation strategies and training, and collaborate with InfoSec, HR, Legal, and IT to strengthen insider risk controls and awareness.
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Advise UK government customers on cybersecurity strategy, build executive relationships, deliver thought leadership and briefings, support strategic partnerships (NCSC), enable sales and product teams, translate government requirements into product priorities, and represent CrowdStrike at events and parliamentary/industry forums. Role includes travel, security-clearance eligibility, and mentoring internal teams.
Top Skills:
AICloud SecurityEdrEndpoint SecurityIdentity And Access ManagementIncident ResponseLog ManagementSIEMThreat IntelligenceXdrZero Trust
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Build and maintain scalable data infrastructure and tools for OverWatch analysts. Develop web services and data-processing pipelines, deploy and operate cloud-native distributed systems, integrate research into production, participate in devops/on-call, and improve platform effectiveness using Go/Python, AWS, databases, Kafka, Elasticsearch, and Kubernetes.
Top Skills:
AWSC++CassandraElasticsearchGoKafkaKubernetesLinuxPostgresPythonRedisRust
What you need to know about the London Tech Scene
London isn't just a hub for established businesses; it's also a nursery for innovation. Boasting one of the most recognized fintech ecosystems in Europe, attracting billions in investments each year, London's success has made it a go-to destination for startups looking to make their mark. Top U.K. companies like Hoptin, Moneybox and Marshmallow have already made the city their base — yet fintech is just the beginning. From healthtech to renewable energy to cybersecurity and beyond, the city's startups are breaking new ground across a range of industries.
