The Senior Quality Engineer - AI & Automation extends traditional quality assurance responsibilities by leading modern quality engineering practices across automated testing, AI-assisted testing, and intelligent quality validation. The role partners with engineering, product, architecture, and data teams to improve software quality, release confidence, testing efficiency, and customer outcomes through automation, continuous testing, and emerging AI-enabled quality engineering capabilities.
Role Specific Essential Functions
Design, implement, and maintain scalable test automation frameworks and continuous testing capabilities that support CI/CD pipelines and enterprise quality objectives.
Lead the adoption of AI-assisted quality engineering practices to improve test creation, defect detection, test coverage analysis, and quality insights.
Define and execute testing strategies for AI-enabled applications, intelligent automation solutions, analytics platforms, and data-driven products to validate functionality, reliability, performance, security, and expected business outcomes.
Establish quality metrics, automation standards, and release-readiness criteria that drive measurable improvements in product quality, testing efficiency, and delivery effectiveness.
Partner with engineering, architecture, product, and platform teams to identify quality risks early and embed quality practices throughout the software development lifecycle.
Evaluate emerging automation, AI-driven testing, and quality engineering technologies and recommend solutions that improve testing effectiveness, operational efficiency, and customer experience.
Role Specific Expectations And Qualifications
5+ years of experience in Quality Assurance, Quality Engineering, Software Testing, or Test Automation supporting complex enterprise technology solutions.
Experience designing and implementing automated testing frameworks and integrating automated testing into CI/CD pipelines using technologies such as Selenium, Playwright, Cypress, Appium, or equivalent automation platforms.
Experience testing Generative AI and Large Language Model (LLM) based applications using platforms such as OpenAI, Anthropic Claude, Amazon Bedrock, Azure AI, Google Vertex AI, or equivalent AI technologies.
Experience with AI evaluation and observability frameworks such as LangSmith, DeepEval, Ragas, Promptfoo, TruLens, MLflow Evaluation, or similar model testing and monitoring platforms.
Understanding of Retrieval-Augmented Generation (RAG), AI agents, vector databases, prompt engineering, and AI quality characteristics including accuracy, relevance, hallucination detection, bias testing, safety validation, and model performance monitoring.
Location: Hillsboro, OR | Marlborough/Chelmsford, MA
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Who We Are
What makes First Tech different? Click here to learn more!
Every great journey begins with a bold idea—and ours is no different. First Tech and DCU were founded on the belief that financial solutions should put people first. That belief has fueled decades of innovation and service, rooted in the tech sector and expanding to support members from all walks of life.
Employees Are Eligible For
Traditional medical, dental, and vision coverage
Generous 401(k) match
Paid Time Off: You'll accrue up to 15 days in your first year. In addition, you'll receive 40 hours of sick time and 3 personal days, which refresh annually
Paid federal holidays
Special employee pricing on lending products such as mortgage, auto, and personal loans (eligibility subject to standard account requirements and underwriting criteria)
Employment Statements
First Tech is an equal opportunity employer, and we value diversity, inclusion, and equity at our company. We evaluate qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.
If you're applying for a job and need a reasonable accommodation for any part of the employment process, please send an email to recruiters@firsttechfed.com and let us know the nature of your request and contact information. Please note that only those inquiries concerning a request for reasonable accommodation will be responded to from this email address.
First Tech is not currently offering Visa transfer/sponsorship for this position.
Ready to apply for Senior QA Engineer - Data And AI?
Opens First Tech Federal Credit Union’s official LinkedIn application page in a new tab. No TargetQA account required.
