Web Scraping & AI Engineer (Full-Stack)

About the role

Vyrian is looking for a hands‑on Full‑Stack Engineer who can design resilient web scrapers and deliver end‑to‑end web applications. The role combines the puzzle‑solving aspect of data extraction with the craftsmanship of building reliable, user‑facing products.

Key responsibilities

• Design, build, and maintain scalable web scrapers and crawlers for a variety of sources, including JavaScript‑heavy and anti‑bot‑protected sites.
• Develop full‑stack web applications covering front‑end interfaces, APIs, and back‑end services.
• Create robust data pipelines to clean, normalize, store, and monitor scraped data.
• Adapt and maintain scrapers as target websites evolve, ensuring high reliability.
• Collaborate with product and data teams to translate requirements into technical solutions.
• Help scale infrastructure to handle large data volumes efficiently.

Required profile

• Proven experience building web scrapers and full‑stack applications.
• Comfortable working independently with end‑to‑end project ownership.
• Strong focus on data quality, clean code, and system resilience.

Required skills

• Scrapy
• Playwright
• Puppeteer
• Selenium
• BeautifulSoup
• Understanding of HTTP, HTML/DOM
• Experience with headless browsers, proxies, and rate‑limiting techniques

What we offer

• Hybrid work model with 2–3 days onsite in Colombo 01.
• Opportunity to work on cutting‑edge data extraction and AI projects.
• Collaborative environment within a global semiconductor and data‑solutions provider.