Principal Software Engineer In Test

Principal Software Engineer – In Test Company: Invisible Technologies Location: Hybrid worldwide with remote flexibility for most roles Employment Type: Full-time About the Role Invisible Technologies develops an end-to-end AI platform that structures messy data, automates digital workflows, deploys agentic solutions, measures outcomes, and integrates human expertise. The platform is used by top AI companies such as Microsoft, AWS, and Cohere. We are looking for an experienced Principal Engineer – Testing to lead the testing architecture for autonomous workflows, intelligent agents, and high-reliability infrastructure across our AI platform. The role involves designing testing frameworks for backend, APIs, data pipelines, and AI models. Responsibilities Design, implement, and own the testing architecture across the AI platform, spanning backend, APIs, data pipelines, and AI models. Build and scale automation frameworks to support unit, integration, regression, performance, and AI‑specific testing. Develop test strategies that balance reliability, speed, and coverage for complex, dynamic, and data‑heavy systems. Create simulation and sandbox environments to test AI workflows and orchestration logic. Integrate automated testing into CI/CD pipelines, enabling confident, rapid deployments with safety guarantees. Lead root‑cause analysis and implement practices that prevent regressions across systems and features. Champion a quality‑balanced culture and mentor engineers in best practices for building robust, testable systems. Qualifications 10+ years of experience in software quality engineering, test automation, or systems testing roles. Expertise in test automation frameworks (e.g., Pytest, Playwright) and infrastructure‑as‑code pipelines. Experience designing and validating tests in distributed, event‑driven, and microservices architectures. Familiarity with testing in AI/ML systems, including model output validation and behavior‑driven testing. Experience with containerized environments (Docker) and cloud platforms (AWS/GCP/Azure). Strong understanding of CI/CD systems (particularly Git) and modern observability tooling (e.g., Grafana, Prometheus). Excellent problem‑solving, debugging, and documentation skills. A track record of technical leadership and mentoring in cross‑functional environments. Nice to Have Experience testing large‑scale AI frameworks, LLM integrations, or decision systems. Exposure to tools like dbt, Spark, or DataDog. Contributions to open‑source testing tools or quality initiatives. Deep curiosity about LLM behavior, autonomous systems, and human‑in‑the‑loop testing strategies. A desire to develop the most consequential AI software system of the future. Compensation Invisible offers a fair and competitive pay structure that reflects regional cost of living and internal equity. Compensation includes base salary, bonuses, and equity for roles above entry level. The final offer is determined by location, experience, skills, and market conditions. Additional details on total compensation and benefits will be discussed during the hiring process. Working at Invisible We operate at the intersection of advanced AI and human ingenuity. The pace is fast, the challenges are big, and growth is unmatched. The culture values bold ideas, relentless drive, and turning ambiguity into opportunity. Hiring Guidelines Invisible is a hybrid organization with offices worldwide. While some roles allow remote flexibility, most positions require in‑office collaboration dependent on specific locations. Details will be communicated during recruitment. AI Interviewing Guidelines We use AI tools to support an efficient, engaging, and inclusive interview process. Candidates can learn more about our AI practice and guidelines by visiting our dedicated page. Accessibility Statement We are committed to providing reasonable accommodations for individuals with disabilities. Contact our Talent Acquisition team for assistance. Equal Opportunity Statement We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, veteran status, or other protected characteristics. Due to a high volume of candidates, we may use automated decision‑maker technologies to filter candidates based on application questions. If you object to automated decision‑making, please contact us. #J-18808-Ljbffr