Vantive2h ago
Principal Eng, Quality Assurance
On-SiteBengaluru, Karnataka, India8–10 yrsManual & Functional QA
Job Specification
Project Role : Quality Engineering Lead
Project Role Description : Leads a team of quality engineers through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecycle. Applies business and functional knowledge to develop end-to-end testing strategies through the use of quality processes and methodologies. Applies testing methodologies, principles and processes to define and implement key metrics to manage and assess the testing process including test execution and defect resolution.
Must have skills : Microsoft Functional Testing
Good to have skills : NA
Minimum 5 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Owns functional test planning and execution for Copilot Studio agents. Validates conversational behavior, grounded answers, flows, and tool integrations, and ensures quality and responsible AI gates are met before release.
Design and execute test plans and test cases for Copilot Studio agents, covering topics, trigger phrases, entities, variables, and conversation/agent flows.
Validate generative orchestration and generative answers for accuracy, grounding in knowledge sources, and consistency of responses.
Test Power Automate flows and MCP Server tool/plugin integrations for functional correctness, error handling, and failure scenarios.
Perform bias, safety, and hallucination checks as part of responsible AI validation.
Test agent publishing and behavior across channels (Teams, web, custom apps) and across environments (dev-test-prod).
Identify conversational breakdowns and connector/plugin issues log, triage, and track defects through to closure, and verify fixes.
Run functional and regression testing, including prompt and instruction changes, and maintain test evidence.
Ensure solutions meet the agreed Definition of Done before UAT.
Collaborate with developers, the Architect, and the Business Analyst to clarify requirements and edge cases.
Support UAT coordination and release readiness checks.
Required Skills & Experience
Experience in functional/QA testing, preferably on conversational AI, chatbot, or low-code platforms.
Hands-on exposure to testing Copilot Studio agents (topics, generative answers, knowledge sources, publishing).
Working knowledge of Power Automate flows and API/tool integration testing concepts (including MCP Server tool connections).
Understanding of responsible AI principles and bias/safety validation practices.
Experience with defect management and test tracking tools (Azure DevOps/Jira).
Strong attention to detail, with a structured approach to test design and conversational-flow troubleshooting.
Exposure to Agile delivery environments preferred.
Additional Information
15-year full-time education is required.
Ready to apply for Quality Engineering Lead?
Opens Accenture in India’s official LinkedIn application page in a new tab. No TargetQA account required.
Practice real browser automation challenges and review scenario-based interview questions tailored to this role.
Test design techniques, defect lifecycle, boundary analysis, and agile QA.
Solve real browser automation problems in Java, Python, TypeScript, and C#.
Prepare for senior SDET architecture and live debugging interview rounds.
Continue Exploring