Full-Stack Web Scraping & AI Engineer
Vyrian, Inc. · Colombo
Job description
About the role
Vyrian is looking for a Full‑Stack Engineer who can design resilient web scrapers and deliver end‑to‑end web applications. The role combines the puzzle‑solving of data extraction with the craft of building reliable, user‑facing products.
Key responsibilities
- Design, build and maintain scalable scrapers and crawlers for JavaScript‑heavy and anti‑bot‑protected sites.
- Develop full‑stack web applications, including front‑end interfaces, APIs and back‑end services.
- Create data pipelines that clean, normalize, store and monitor scraped data.
- Adapt scrapers as target websites change to ensure reliability at scale.
- Collaborate with product and data teams to translate requirements into technical solutions.
Required profile
- 3+ years of professional full‑stack software development experience.
- 1+ year of hands‑on experience with scraping frameworks such as Scrapy, Playwright, Puppeteer, Selenium or BeautifulSoup.
- Strong understanding of HTTP, HTML/DOM, headless browsers, proxies and rate‑limiting techniques.
- Ability to work independently, own projects end‑to‑end and maintain high data quality.
Required skills
- Scrapy, Playwright, Puppeteer, Selenium, BeautifulSoup
- Python, Node.js, Go
- React, Vue, Angular
- REST or GraphQL API design and consumption
- SQL and NoSQL databases
- AWS, GCP or Azure cloud platforms
- Docker containerization
- Airflow, Kafka, Spark (preferred)
- CI/CD pipeline implementation
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Sri Lanka.
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 18 hours ago
Expires 1 month from now
3 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Vyrian, Inc.
Colombo