W
Software Development Engineer in Test - AI
Web com Canada · India - Remote · posted 2 Nov 2026
Full-timeIT & SoftwareRemote
About the job
Who we are.
Newfold Digital is a leading web technology company serving millions of customers globally. Our customers know us through our robust portfolio of brands. We have some of the industry's most prominent and storied go-to-market brands, including Bluehost, HostGator, Domain.com, Network Solutions, Register.com and Web.com. We help customers of all sizes build a digital presence that delivers results. With our extensive product offerings and personalized support, we take pride in collaborating with our customers to serve their online presence needs. The strength of our company lives in the intersection of our people, our customers, and our brands.
Role Summary:
This role goes beyond traditional QA; the ideal candidate should be capable of validating, evaluating, and improving AI-powered systems, agents, copilots, and LLM-driven workflows while building scalable automation frameworks and intelligent quality solutions. You will work closely with Engineering, AI/ML, Platform, Product, and DevOps teams to ensure reliability, safety, observability, scalability, and quality of modern AI-native applications and Agentic systems.
What you'll do & how you'll make your mark.
1. AI/LLM Quality Engineering
• Design, validate, and optimize testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents.
• Develop AI evaluation (Evals) frameworks for: Hallucination detection Groundedness Toxicity & bias validation Response quality Context relevance Prompt regression testing Determinism & consistency Safety and guardrail validation
• Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics.
• Create synthetic datasets and benchmark datasets for AI testing scenarios.
• Test multi-agent orchestration workflows and agent memory/context retention.
• Validate MCP (Model Context Protocol) integrations and tool interoperability.
• Work on Context…
Similar jobs
R
Cloud DBA III - IN (PostgreSQL)
Rackspace US · India, Hyderabad · 15 Nov 2026
R
Security Engineer III (EDR) - IN
Rackspace US · IND-Gurgaon · 15 Nov 2026
R
Java fullstack Engineer - IV (Mumbai)
Rackspace US · India, Mumbai · 15 Nov 2026
R
Security Engineer III - IN
Rackspace US · IND-Gurgaon · 15 Nov 2026
R
Manager - Cloud Infrastructure Support
Rackspace US · IND-Work from Home-Gurgaon · 15 Nov 2026
R
Cloud Engineer II
Rackspace US · IND-Work from Home-Gurgaon · 15 Nov 2026
Collected from Web com Canada's official careers site by LitCareer. Always apply on the employer's own site; LitCareer never charges you to apply.