Skip to main content

Software Engineer in Test

Philadelphia, NY
Permanent

Role Overview

We are seeking a high-caliber Senior Automation & Quality Engineer to lead the evolution of

testing ecosystem. In this role, you will move beyond traditional automation by pioneering

AI-assisted test generation and agentic workflows. You will be responsible for designing

robust, scalable test cases to be judged by LLM-based evaluation to drastically reduce manual

authoring time while maintaining elite-level system reliability.

Core Responsibilities

AI-Driven Testing Innovation: Design and implement LLM-assisted test scaffolding

(using tools like Claude Code, GitHub Copilot, or Vertex AI) to automate the creation of

complex test suites.

Hybrid Testing Strategy: Demonstrate a high degree of flexibility by performing

manual exploratory testing when necessary and transitioning those insights into high performance functional automation using Python, pytest, and TypeScript.

Cross-Project Contribution: Act as a versatile quality consultant across multiple

workstreams. You must thrive in a high-paced delivery environment, balancing

competing priorities across different project teams.

Agentic Frameworks: Maintain a strong understanding of Agentic AI frameworks and

Agent Evaluations to ensure the reliability of AI-driven products.

Performance Engineering: Conduct deep-dive performance analysis, latency profiling,

and bottleneck identification using Locust or Apache JMeter.

Backend Validation: Perform deep integration and contract testing for distributed

systems built on Fast API, Spring Boot, Kafka, and REST APIs.

Required Technical Expertise

Languages: Expert-level proficiency in Python, Java, or Go.

Testing Frameworks: Deep experience with pytest (fixtures, parametrize, mocking) or

TypeScript frameworks like Playwright or WebDriver IO.

Messaging & Data: Experience testing event-driven architectures involving Apache

Kafka or Pulsar, and validating data across MongoDB, PostgreSQL, or Redis.

Observability: Ability to leverage Grafana or the ELK Stack for advanced test

monitoring and alerting.

Qualifications & Work Environment

Experience: 5 to 15 years of experience in software quality engineering or automation

development.

Adaptability: Proven track record of contributing to various projects simultaneously

under tight deadlines.

Location & Presence: This is a hybrid role. The selected candidate must be able to

work from the office 3 to 4 days a week. * Primary Office Locations: Mount Laurel,

NJ or West Chester, PA.

Methodology: Strong background in Agile/Scrum environments with a focus on

TDD/BDD and Shift-Left testing practices

Job Type: Permanent

Job ID: 253798021