Senior QA Engineer – GovCloud (Automation & AI)

As a Senior QA Engineer, you will be the primary quality owner for bringing new features to Digital Experience Analytics (DXA) in GovCloud. This product analyzes user interactions across our customers' websites and applications, helping them pinpoint friction points and identify necessary improvements. This is no small endeavor, as we collect and process more than 5 petabytes of data each month.

The work spans validation in GovCloud staging, establishing release criteria, and partnering with engineering from development through rollout. You will join a full-stack DXA engineering team (comprising quality, frontend, and backend engineers), collaborate with cross-functional DXA teams in adjacent domains, and partner closely with GovCloud customer management and SRE. Following the initial rollout, the role is expected to expand within six months to cover additional DXA quality initiatives and new innovation projects.

This is a hands-on technical role combining release ownership with automation engineering: framework design, CI/CD integration, execution reliability, and the responsible adoption of AI-assisted tools.

Responsibilities

• Own GovCloud release quality end to end: test planning, staging validation, regression, sign-off, documentation
• Design, build, and maintain scalable Playwright automation frameworks using TypeScript/JavaScript
• Develop and maintain UI, API, and end-to-end automated test suites, keeping flakiness low through stable locator and wait strategies
• Identify and prioritize manual test cases suitable for automation, and convert them into automated scripts
• Implement robust patterns such as Page Object Model, fixtures, reusable utilities, and data-driven testing
• Integrate automated suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions) with parallel execution, reporting, and failure triage
• Use AI-assisted tools (Cursor, Claude, Claude Code, GitHub Copilot, or similar) to accelerate test design, script creation, refactoring, debugging, failure analysis, and documentation
• Review and validate all AI-generated output before use; apply the security and privacy discipline GovCloud requires, and never share sensitive data, credentials, or customer information with AI tools
• Design and run test approaches for AI features where pass/fail is not binary, including output evaluation, guardrails, prompt regression, and edge cases
• Build datasets and repeatable workflows to track GenAI quality over time

Candidates based in the Tysons vicinity will be prioritized as this role is Hybrid, 3 days per week onsite.

Qualifications

Minimum Qualifications

• 5+ years of professional experience in backend, integration, and data QA or SDET roles.
• Hands-on experience writing queries to inspect missing or incorrect session data and converting manual verification checks into repeatable automated tests.
• Experience developing tools in Python to parse JSON, analyze system logs, compare data outputs, and report system failures.
• API Testing: Experience testing RESTful web services, including verifying multi-step systems with delayed or asynchronous data delivery.
• Experience writing automated integration tests using Java and JUnit, and managing scheduled test executions within CI/CD systems like Jenkins.
• Experience using AWS services (e.g., S3 for test artifacts) and reading cloud system logs to debug test failures.
• Release Engineering: Experience defining release criteria and establishing pass/fail deployment gates.

Preferred Qualifications

• Experience in FedRAMP, AWS GovCloud, or other regulated cloud environments, including work with federal agencies or public-sector customers
• Experience with Playwright and JavaScript/TypeScript, or a comparable modern UI/API automation stack
• Experience testing AI, ML, or LLM-powered features, including evaluating outputs where pass/fail is not binary
• Experience using AI-assisted development tools to improve QE productivity
• Experience with AI-driven testing capabilities such as self-healing locators, AI-based test generation, or MCP-based Playwright integrations
• Experience with Appium and/or WebdriverIO
• Exposure to performance, accessibility, visual regression, or security testing tools
• Experience with Docker, cloud test execution platforms, or reporting tools (Allure, etc.)
• Familiarity with contract testing, test data management, and BDD approaches

Medallia is committed to equal pay and transparency. The annual base salary range for this position is $101,500 - $150,000.USD. Please note that the salary range information provided is a general guideline and combines all of the distinct labor markets within the US. It is uncommon for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on a variety of factors. Medallia considers factors such as (but not limited to) scope and responsibilities of the position, candidate’s work experience, candidate’s work location, education/training, key skills, internal peer equity, external market data, as well as, market and business considerations when making compensation decisions.

Medallia also offers competitive health and wellness benefits, including but not limited to medical, dental, vision, 401(k), short-term and long-term disability, life and AD&D insurance, statutory leaves, paid parental leave, and paid holidays. Benefits and eligibility may vary by location and role.

At Medallia, we celebrate diversity and recognize the value it brings to our customers and employees. Medallia is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age (40 and over), disability, genetic information, veteran status or military service, or any other status protected by state or local law. Individuals with a disability who need an accommodation to apply please contact us at ApplicantAccessibility@medallia.com. For information regarding how Medallia collects and uses personal information, please review our Privacy Policies. Applications will be accepted for 30 days from the date this role was posted or until the role has been filled.