Science,Engineering|Quality Engineering|Quality Control Engineer,Engineering|Quality Engineering,IT & Telecoms,Science|Quality Control Scientist,Science|Quality Assurance Scientist,IT & Telecoms|Software Development Engineer In Test,Engineering Jobs

• Karate & API Testing experience must have.
• Selenium with Cucumber/BDD and UI Automation.
• Microservices Testing and Postman.
• Performance Testing: JMeter/LoadRunner.
• Mobile Automation: Appium.
• Cloud: AWS/Azure/GCP.
• Containerization: Docker.
• Strong automation, regression, integration, and functional testing experience.

We are seeking a QA Automation Engineer to help build and validate a next-generation agentic AI application within a growing AI-driven HCM software ecosystem.

This is not a traditional QA automation role. The application uses large language models (LLMs) and AI agents to dynamically determine application behavior and workflows, creating testing challenges that cannot be solved through conventional scripted automation alone.

The team is building a new Python-based testing and evaluation framework from the ground up specifically for agentic AI systems. This includes LLM-as-judge evaluations, agent state checks, behavioral validation, and testing approaches designed for non-deterministic AI outputs.

Python and hands-on AI/LLM testing experience are the primary requirements for this role. Playwright is used for front-end automation but is a secondary/supporting skill rather than the core focus.

• Design, build, and maintain automated testing and evaluation solutions for agentic and LLM-driven applications.
• Help build a new Python-based AI testing and evaluation framework from the ground up, including defining patterns, standards, and approaches as the platform evolves.
• Develop LLM-as-judge evaluators and other automated methods for assessing AI-generated outcomes.
• Validate agent states, conversational flows, tool interactions, outputs, and expected behaviors across multi-step agentic workflows.
• Develop testing strategies for non-deterministic LLM behavior where conventional scripted pass/fail assertions are insufficient.
• Evaluate AI responses for factors such as accuracy, relevance, consistency, groundedness, and appropriate behavior.
• Test agent behavior across expected paths, edge cases, failure scenarios, and variable outputs.
• Use Playwright for front-end/UI automation where appropriate while maintaining a separate Python-based evaluation layer for AI behavior.
• Partner closely with software engineers and AI developers to identify risks, troubleshoot failures, and improve product quality.
• Help establish testing standards, evaluation methodologies, and automation practices for an evolving agentic AI platform.
• Take shared ownership of quality within a collaborative engineering model rather than operating within a traditional siloed QA organization.

• Strong hands-on Python programming and automation experience.
• Experience testing AI/LLM-based, conversational AI, or agentic systems.
• Experience with or strong knowledge of LLM evaluation techniques, including LLM-as-judge, state/behavior validation, or similar approaches.
• Experience validating non-deterministic AI behavior where expected outcomes cannot always be represented through conventional scripted assertions.
• Ability to design and build testing or evaluation frameworks, rather than solely executing within an established automation framework.
• Strong understanding of software testing, automation principles, debugging, and root-cause analysis.
• Ability to design test scenarios for complex, multi-step application and agent workflows.
• Strong problem-solving skills and ability to operate effectively in an early-stage, greenfield environment where standards and processes are still being defined.
• Comfortable working in a distributed quality model, with QA responsibility shared closely across engineering rather than owned solely by a formal QA function.

• Experience with Playwright for front-end automation.
• Experience with PyTest, Behave, or similar Python testing frameworks.
• Experience testing AI agents, tool/function calling, multi-turn conversations, or complex agentic workflows.
• Experience evaluating LLM outputs for groundedness, hallucination, relevance, correctness, consistency, or completeness.
• Experience testing guardrails, failure scenarios, and AI validation controls.
• Experience validating agent tool usage and downstream system interactions.
• API and database testing experience.
• Experience integrating automated testing and evaluation into CI/CD pipelines.
• Experience within HCM, HR technology, payroll, or related enterprise software.

This is an early-stage, greenfield AI initiative where engineering conventions, testing standards, and evaluation frameworks are actively being developed.

The team operates using an AI-SDLC model, with small engineering pods working closely with AI agents rather than relying on traditional, highly structured development and QA workflows. Quality ownership is collaborative and distributed across the team.

The broader product is more than a chatbot. It is an expanding agentic HCM software ecosystem, with a conversational interface serving as one entry point into a growing set of AI-driven HR and workforce capabilities.

The strongest candidate will be a Python-focused QA Automation Engineer with genuine hands-on AI/LLM testing experience who is excited about helping define how agentic applications should be tested.

You should understand that testing an AI agent requires more than confirming whether a predefined workflow completes successfully. You will help determine whether an agent behaved appropriately, reached the correct state, used the right tools, produced an acceptable result, and performed reliably across inherently variable interactions.

This role is particularly well suited for someone who enjoys building frameworks rather than simply using them, solving testing problems that do not yet have established answers, and working closely with engineers to shape how agentic AI applications are evaluated and validated at scale.

• Seeking a highly skilled Quality Engineer with expertise in both front-end and back-end technologies to join our dynamic team.
• The ideal candidate will have a strong background in various programming languages, testing frameworks, and tools
• Develop and maintain automated test scripts for front-end applications using technologies such as Angular, NodeJS, JavaScript, and TypeScript.
• Implement back-end API testing using industry-standard tools and frameworks like Jmeter, Selenium (WebDriver), Jasmine, and Cucumber.
• Collaborate with development and QA teams to integrate automated testing into the continuous integration/continuous deployment (CI/CD) pipeline.
• Demonstrate proficiency in Python, C or Java for back-end automation and scripting tasks.
• Utilize your expertise in JavaScript and TypeScript to develop and enhance front-end test scripts, particularly for Angular applications.
• Apply Test-Driven Development (TDD) and Behavior-Driven Development (BDD) methodologies to ensure comprehensive test coverage and efficient collaboration with cross-functional teams.
• Work with testing frameworks such as Jmeter for performance testing, Selenium for web application testing, Jasmine for front-end unit testing, Cucumber for behavior-driven testing, and API-based frameworks for testing back-end services.
• Leverage tools like Veracode and SonarQube to conduct security assessments and ensure code quality standards are met.
• Utilize Serenity and Playwright for end-to-end testing of Angular 16 applications, focusing on maintaining high-quality and reliable test suites.
• Familiarity with Oracle databases for ensuring the integrity and correctness of data in testing scenarios.
• Work with AWS Code Services for efficient code deployment and collaborate with AWS infrastructure teams to streamline the CI/CD process.
• Stay updated on emerging technologies and industry best practices, bringing new ideas and innovative approaches to the testing process.
• Effectively communicate with cross-functional teams, including developers, product managers, and other stakeholders, to ensure a shared understanding of testing requirements.

• Bachelor's degree in computer science, engineering, or a related field.
• Minimum 5-7 years of experience in QA Automation
• Proven experience as a Quality Engineer with a focus on both front-end and back-end automation.
• Strong programming skills in Python, C or Java, JavaScript, and TypeScript.
• Experience with testing frameworks such as Jmeter, Selenium, Jasmine, and Cucumber.
• Knowledge of Mortgage-based security (MBS) preferred.
• Familiarity with Veracode and SonarQube for code security and quality assessments.
• Knowledge of Serenity and Playwright for end-to-end testing of Angular applications.
• Experience with AWS Code Services and Spring Boot is a plus.

Location: New York City, NY (Onsite/Hybrid)
Employment Type: Contract
Visa: US Citizens Only (Diversity Hiring)

We are seeking an experienced QA Automation Engineer with strong expertise in Java, Selenium, and Healthcare domain. The ideal candidate should have hands-on experience in automation framework development, API testing, and validating healthcare applications while working in an Agile environment.

• 7+ years of QA Automation experience.
• Strong hands-on experience with Java and Selenium WebDriver.
• Experience in developing and maintaining automation frameworks.
• Strong experience with TestNG/JUnit.
• Hands-on experience with API Testing using Postman or REST Assured.
• Experience with SQL and database validation.
• Experience with Git, Maven, Jenkins, and CI/CD pipelines.
• Strong understanding of SDLC, STLC, and Agile methodologies.
• Excellent debugging and defect analysis skills.
• Strong communication and collaboration skills.

• Design, develop, and maintain scalable test automation frameworks and scripts.
• Perform UI, API, functional, regression, integration, and end-to-end testing.
• Develop automation using Selenium WebDriver, Playwright, and Karate.
• Perform REST API testing and validate requests, responses, and business rules.
• Write complex SQL queries for database validation and data reconciliation.
• Perform data migration and source-to-target validation.
• Integrate automated tests with CI/CD pipelines and support DevOps practices.
• Collaborate with developers, BAs, and product teams in an Agile/Scrum environment.
• Manage automation code using Git/Bitbucket.
• Support testing of applications running in AWS environments.
• Identify defects, troubleshoot failures, and perform root-cause analysis.
• Leverage AI/GenAI tools and techniques to improve test automation and QA efficiency.

• 6–10 years of software testing/SDET experience.
• Strong Automation Testing experience.
• Strong hands-on Java and TypeScript.
• Selenium WebDriver, Playwright, and Karate.
• Strong SQL & Database Testing skills.
• Complex SQL queries, data validation, and data migration testing.
• REST API Testing experience.
• Understanding of DevOps/CI-CD.
• Experience with Git/Bitbucket.
• Strong Agile/Scrum experience.
• 1–2 years of hands-on AWS experience is required.
• AI/GenAI experience is strongly preferred.

• Strong experience with Playwright Automation Framework.
• Hands-on expertise in Python programming.
• Experience in API Testing and Automation.
• Good knowledge of MS SQL and Snowflake.
• CI/CD experience with Jenkins.
• Hands-on experience using Splunk for troubleshooting and log analysis.
• Familiarity with Cursor, Microsoft Copilot, and OpenAI/GenAI tools.
• Strong analytical, debugging, and problem-solving skills.

• Design, develop, and maintain automated test frameworks using Playwright and Python.
• Perform API testing, validation, and automation using REST/JSON services.
• Develop and execute test cases for applications integrating with MS SQL and Snowflake databases.
• Build and manage automated test pipelines using Jenkins.
• Analyze application logs, troubleshoot issues, and support root-cause analysis using Splunk.
• Collaborate with development, SRE, and product teams to ensure high-quality software releases.
• Leverage Cursor, Microsoft Copilot, and OpenAI tools to improve test automation productivity
• and test coverage.
• Create and maintain QA documentation, test plans, and automation reports.

• Experience with Cisco products, networking, or cloud platforms.
• Exposure to Agile/Scrum environments.
• Knowledge of test automation best practices and performance testing.

Job Title: QA Engineer (Karate Automation)
Location: Jersey City, NJ (Hybrid/Onsite)
Duration: Long-Term Contract

We are seeking an experienced QA Engineer with strong expertise in Karate Automation Testing to join our team. The ideal candidate will be responsible for designing, developing, and executing automated test solutions for API and web applications while ensuring high-quality software delivery.

• 5+ years of experience in Software Quality Assurance.
• Strong hands-on experience with Karate Framework for API automation testing.
• Experience in API testing using REST and SOAP services.
• Strong knowledge of Java, Maven, and Test Automation frameworks.
• Experience with BDD (Behavior-Driven Development) concepts.
• Expertise in creating and maintaining automated test scripts.
• Experience with Postman, Swagger, and API validation.
• Knowledge of SQL and database testing.
• Experience with Jenkins, Git, and CI/CD pipelines.
• Strong understanding of SDLC, STLC, Agile, and Scrum methodologies.
• Excellent debugging, analytical, and problem-solving skills.

• Design, build, and maintain scalable automation frameworks using Robot Framework
• Develop reusable, modular keyword-driven test libraries for OSS applications
• Automate functional, regression, integration, and end-to-end test scenarios across the full stack.
• Author custom Python libraries and keywords to extend Robot Framework for complex OSS use cases.
• Should be able to automate UI testing with Selenium, validate service integrations using API testing libraries (REST and SOAP), and verify data integrity through database libraries
• Integration with CI/CD pipeline
• Integration of automated tests with CI/CD pipeline