AI SDET (Agent Hacker)
Pune / India
Engineering – Engineering /
Full Time /
Remote
Join the Future of Supply Chain Intelligence — Powered by Agentic AI
At Resilinc, we’re not just solving supply chain problems — we’re pioneering the intelligent, autonomous systems that will define its future. Our cutting-edge Agentic AI enables global enterprises to predict disruptions, assess impact instantly, and take real-time action — before operations are even touched. Recognized as a Leader in the 2025 Gartner® Magic Quadrant™ for Supply Chain Risk Management, we are trusted by marquee clients across life sciences, aerospace, high tech, and automotive to protect what matters most — from factory floors to patient care.
Our advantage isn’t just technology — it’s the largest supplier-validated data lake in the industry, built over 15 years and constantly enriched by our global intelligence network. It’s how we deliver multi-tier visibility, real-time risk assessment, and adaptive compliance at scale.
But the real power behind Resilinc? Our people. We’re a fully remote, mission-driven global team, united by one goal: ensuring vital products reach the people who need them — when and where they need them.
Whether it’s helping ensure cancer treatments arrive on time or flagging geopolitical risks before they disrupt critical supply lines, you’ll see your impact every day. If you're passionate about building technology that matters, driven by purpose, and being an agent of change who is ready to shape the next era of self-healing supply chains, we’d love to meet you.
Resilinc | Innovation with Purpose. Intelligence with Impact.
About The Role
At Resilinc, we build intelligent systems that safeguard the global supply chain. As a pioneer in supply chain risk management, we’re pushing the boundaries of resilience with AI-powered platforms. We are building a team of forward-thinking Agent Hackers (AI SDETs) to join our mission.
What’s an Agent Hacker? It’s not just a title — it’s a mindset. You’re the kind of engineer who goes beyond traditional QA, probing the limits of autonomous agents, reverse-engineering their behavior, and designing smart, self-evolving test frameworks.
In this role, you’ll be at the forefront of testing cutting-edge technologies, including Large Language Models (LLMs), AI agents, and Generative AI systems. You’ll play a critical role in validating the performance, reliability, fairness, and transparency of AI-powered applications—ensuring they meet high standards for both quality and responsible use.
If you think like a tester, code like a developer, and break systems like a hacker — Resilinc is your proving ground.
What You Will Do
- Develop and implement QA strategies for AI-powered applications, focusing on accuracy, bias, fairness, robustness, and performance.
- Design and execute automated and manual test cases to validate AI Agents/LLM models, APIs, and data pipelines and good understanding of data integrity, data models, etc
- Assess AI models using quality metrics such as precision/recall, and hallucination detection.
- Test AI models for bias, fairness, explainability (XAI), drift, and adversarial robustness.
- Validate prompt engineering, fine-tuning techniques, and model-generated responses for accuracy and ethical AI considerations.
- Service/tool development.
- Conduct scalability, latency, and performance testing for AI-driven applications.
- Collaborate with data engineers to validate data pipelines, feature engineering processes, and model outputs.
- Design, develop, and maintain automation scripts using Selenium and Playwright for API and web testing
- Work closely with cross-functional teams to integrate automation best practices into the development lifecycle.
- Identify, document, and track bugs while conducting detailed regression testing to ensure product quality.
What You Will Bring
- Proven expertise in testing AI models, LLMs, and Generative AI applications, with hands-on experience in AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest.
- Strong proficiency in Python for writing test scripts and automating model validation, along with a deep understanding of AI bias detection, adversarial testing, model explainability (XAI), and AI robustness.
- Demonstrate strong SQL expertise for validating data integrity and backend processes, particularly in PostgreSQL and MySQL.
- Strong analytical and problem-solving skills with keen attention to detail, along with excellent communication and documentation abilities to convey complex testing processes and results.
If you are a person with a disability needing assistance with the application process please contact HR@resilinc.com.
Benefits
We offer comprehensive benefits that are specific to each country. Your talent acquisition contact can provide you with a FAQ list for your country. Everyone at Resilinc is eligible for healthcare coverage, retirement benefits, paid time off and learning and development opportunities.
To learn more about Resilinc, visit our website:
