Freelance AI & Web Scraping Developer
Required skills
- AI
- Web Crawling
- BeautifulSoup
- Scrapy
- Playwright
- Puppeteer
- Content Extraction
- Text Analysis
- AI/LLM APIs
- OpenAI
Nice to have
- Marketing Technology
- Sales Intelligence
- Prompt Engineering
- Multilingual Content
- Automation Solutions
Role summary
MENA Alliances is seeking a remote Freelance AI & Web Scraping Developer to build a smart tool for lead qualification. The role involves developing a web crawling and AI-powered application to extract content from company websites, use AI to determine marketing target suitability for specific industries, and produce a structured output of qualified leads. The final product should be a clean, maintainable, and handover-ready application.
This is a remote position.
MENA Alliances is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads.
In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom).
The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand.
Key Responsibilities
- Develop a web crawling and scraping system to collect relevant data from a list of websites.
- Extract and process meaningful content from crawled pages.
- Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical.
- Design a scoring or ranking mechanism that qualifies and prioritizes leads.
- Produce a structured output containing qualified leads with clear reasoning or scoring.
- Deliver a standalone, well-structured application ready for handover to the client.
Requirements
Technical Requirements
- Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks.
- Strong knowledge of content extraction and text analysis.
- Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models).
- Ability to design and build clean, maintainable software products, not just quick prototypes.
- Familiarity with modern development stacks and best practices.
Nice to Have
- Experience in lead generation, marketing technology, or sales intelligence tools.
- Knowledge of prompt engineering, particularly for multilingual or non-English content.
- Experience building end-to-end AI-powered tools or automation solutions.
-
German language skills are a plus but not required (language support will be provided by the client).
Benefits
Originally posted on Himalayas
