Web Scraping & AI Engineer (Full-Stack)

About the role

Vyrian is seeking a senior, hands‑on engineer whose core expertise lies in web scraping and applied AI. You will design, build, and maintain full‑stack applications that transform scraped data into internal tools used daily by the team.

Key responsibilities

• Design and maintain resilient scrapers and crawlers for complex, JavaScript‑heavy, anti‑bot‑protected sites.
• Integrate LLMs and AI agents to parse messy pages, adapt to layout changes, and keep extraction pipelines reliable.
• Architect and develop internal web applications that expose cleaned data to end‑users.
• Ship full‑stack solutions covering front‑end, APIs, and back‑end services.
• Build scalable data pipelines for cleaning, normalising, storing, and monitoring scraped data.
• Collaborate with product and data teams to translate business needs into functional systems.

Required profile

• 5+ years of full‑stack software development experience, with at least 2 years focused on production web scraping and AI/LLM integration.
• Proven track record delivering production‑grade scrapers for challenging targets, handling proxies, session management, fingerprinting, and rate limiting.
• Hands‑on experience embedding LLMs into extraction workflows, designing prompts and schemas for reliable structured output.
• Comfortable using AI development tools daily to design architecture and ship features.

Required skills

• Scrapy
• Playwright
• Puppeteer
• Selenium
• BeautifulSoup
• Proxies, session management, browser fingerprinting, rate limiting
• Large Language Models (LLMs) and AI agents
• Full‑stack development (front‑end, APIs, back‑end services)