Software Engineer II (AI Tooling)
Boston, MA
Data Science & Research /
On-site
At WHOOP, we're on a mission to unlock human performance. WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives.
As a Software Engineer II focused on AI Tooling, you will help build innovative, user-centric AI systems that power the next generation of internal tools at WHOOP. Your work will directly impact teams across the company by delivering intelligent applications like large language model (LLM)-powered assistants for translating natural language to SQL, translation services, and more. You’ll also contribute to tools that accelerate the machine learning and artificial intelligence development process across WHOOP. You'll work across the stack to prototype, deploy, and scale ML and AI tools that enhance productivity, decision-making, and automation.
This role is ideal for an engineer who is excited about applied AI, thrives in cross-functional environments, and wants to build cutting-edge tools using modern LLM technologies.
RESPONSIBILITIES:
- Design, develop, and deploy internal AI tools powered by large language models, including natural language to SQL query generation, AI-driven translation and summarization services, and other productivity-enhancing tools
- Develop tools that enable efficient machine learning model training, support the integration of models into the WHOOP production environments, and improve access to data at WHOOP.
- Build robust APIs, services, and user interfaces to expose AI tools to internal users.
- Integrate AI models into operational workflows, ensuring low latency and high reliability.
- Collaborate with Product Managers, Software Engineers, Data Scientists, and end users to define product requirements and iterate on solutions.
- Own the full development lifecycle and contribute to the platform infrastructure supporting LLM and ML applications.
- Monitor and improve the performance, quality, and cost-efficiency of AI-powered tools.
- Stay current with advances in generative AI, LLMs, and agentic systems; evaluate new technologies for adoption.
QUALIFICATIONS:
- Proficient in software engineering with experience in Python (preferred), Java, or Scala.
- Experience with front-end frameworks like VueJS, ReactJS, or NextJS is preferred but not required.
- Experience, professional or personal, working with or integrating large language models (e.g., OpenAI, Anthropic, Hugging Face Transformers).
- Familiarity with prompt engineering, fine-tuning, or retrieval-augmented generation (RAG) techniques.
- Familiar with data storage and processing technologies such as Snowflake, S3, Spark, and relational databases
- Demonstrated ability to turn ambiguous internal problems into scoped engineering solutions.
- Effective communicator with a collaborative mindset and experience working across cross-functional teams.
Learn more about how to be successful in your engineering career at WHOOP via our Career Framework.
This role is based in the WHOOP office located in Boston, MA. The successful candidate must be prepared to relocate if necessary to work out of the Boston, MA office.
Interested in the role, but don’t meet every qualification? We encourage you to still apply! At WHOOP, we believe there is much more to a candidate than what is written on paper, and we value character as much as experience. As we continue to build a diverse and inclusive environment, we encourage anyone who is interested in this role to apply.
WHOOP is an Equal Opportunity Employer and participates in E-verify to determine employment eligibility. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
