Applied AI Operations Lead
San Francisco, CA / Remote
Engineering – Engineering - AI /
Full Time /
Remote
Company Overview
Canvas Medical is accelerating everyday medicine with an EMR platform built for healthcare automation. We create modern, elegant front- and back-end tooling to enable new ways for developers and clinicians to integrate data, automate workflows, and collaborate to solve healthcare's toughest challenges. In doing so we advance our mission to give care teams superpowers with software.
Canvas is institutionally backed by some of the greatest technology investors in the world (funded notable health tech companies such as GoodRx, Oscar Health, and Hims & Hers Health).
The Role
We're hiring an Applied AI Operations Lead to join our GTM Operations team and drive successful deployment, adoption, and governance of AI agents across our customer base. This role serves as the critical bridge between our Applied AI engineering team and the healthcare organizations implementing Canvas's state-of-the-art AI capabilities to transform their clinical and operational workflows.
You'll be the hands-on expert who partners directly with customers to deploy and manage AI agents built with foundation model APIs and our server-side SDK, ensuring they deliver measurable value in real-world healthcare settings. This means working closely with clinical, operational, and financial stakeholders to understand their unique workflows, configure agents for optimal performance, and operate robust governance frameworks that build trust in AI-powered automation.
This role is ideal for someone who combines technical depth in LLM-based systems with exceptional customer-facing skills and a passion for healthcare transformation. You'll translate complex AI capabilities into compelling value stories, guide customers through change management, and create repeatable playbooks that accelerate AI adoption across the Canvas customer base. Your work will directly impact how thousands of care teams leverage AI to deliver better patient outcomes while reducing administrative burden.
You'll collaborate with our Applied AI engineering team to inform product development based on field insights, work with customer success to ensure smooth implementations, and partner with technical marketing to showcase the transformative impact of AI agents in Canvas. As AI becomes central to healthcare delivery, you'll be at the forefront of this revolution, helping our customers realize the full potential of healthcare automation.
What You'll Do
Customer Deployment & Implementation
- Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation
- Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI
- Configure and optimize agent performance using prompt engineering, context management, and tool selection based on specific customer requirements
- Create and maintain customer-specific evaluation frameworks that demonstrate agent effectiveness and build stakeholder confidence
Governance & Trust Building
- Maintain AI governance frameworks that ensure safe, reliable agent operations in production healthcare environments
- Design and implement monitoring systems for agent performance, including accuracy tracking, drift detection, and quality assurance protocols
- Partner with clinical and compliance teams to ensure deployed agents meet regulatory requirements and operational standards
- Develop and deliver training programs that enable care teams to effectively collaborate with AI agents
Technical Excellence & Innovation
- Work hands-on with foundation model APIs (OpenAI, Claude, Gemini) and the Canvas SDK to troubleshoot and optimize agent behavior
- Collaborate with Applied AI engineering to translate field insights into product improvements and new capabilitiesBuild and maintain a library of best practices, implementation templates, and governance playbooks that accelerate customer success
- Stay current with advances in LLM technology and healthcare AI applications to guide strategic customer conversations
Strategic Customer Partnership
- Serve as the trusted AI advisor for Canvas customers, helping them navigate the transformation to AI-powered healthcare operations
- Drive executive conversations about AI strategy, demonstrating how Canvas's platform capabilities enable competitive advantage
- Create compelling narratives around AI impact using customer success stories, performance metrics, and ROI analyses
- Partner with sales teams on strategic opportunities, providing technical expertise and vision for AI transformation
Qualifications
Required Experience & Background
- 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering)
- Demonstrated experience deploying and managing LLM-based applications in production environments
- Track record of driving successful enterprise technology implementations with measurable business outcomes
- Strong project management skills with ability to juggle multiple customer engagements simultaneously
AI & Technical Expertise
- Hands-on experience with products offered from foundation model providers (OpenAI, Anthropic, Google) and AI tools for low-code automation, with understanding of their capabilities and limitations
- Understanding of AI safety, alignment, and governance principles
- Experience with evaluation frameworks, A/B testing, and performance monitoring for AI systems
- Learned experience with the edges and limitations of AI products, and understanding of the iterative process required to get high quality results
Healthcare & Domain Knowledge
- Healthcare technology experience required, with ability to give workflow advice and construct automations that meet the needs of healthcare users
- Understanding of clinical workflows, EMR systems, and healthcare operations a plus
- Familiarity with HIPAA, clinical documentation standards, and healthcare compliance considerations
- Ability to quickly develop domain expertise and speak credibly with clinical stakeholders
Skills & Capabilities
- Comfort with ambiguity and ability to define structure in undefined spaces
- Exceptional written and verbal communication skills with ability to create compelling technical content
- Strong analytical and problem-solving abilities with data-driven approach to decision making
- Experience creating and delivering technical training to diverse audiences
Who You Are
- You're energized by ambiguity and thrive in fast-paced environments where you can experiment, iterate, and scale what works
- You have 5+ years of experience implementing workflow tools and automation solutions in enterprise settings, with 2+ years of hands-on experience with LLM-based systems
- You're deeply familiar with foundation model capabilities and have practical experience with context engineering and adversarial testing
- You excel at translating technical complexity into business value, comfortable presenting to both technical teams and C-suite executives
- You bring a consultative approach to customer engagement, able to diagnose problems, design solutions, and drive change management
- You have experience in healthcare technology or a strong willingness to rapidly develop domain expertise in clinical and operational workflows
- You combine technical depth with exceptional communication skills, able to create documentation, deliver training, and influence stakeholders
What Success Looks Like at 90 Days
- You've successfully deployed AI agents with at least 3 Canvas customers, demonstrating measurable improvements in efficiency and user satisfaction
- You've made significant contributions, based on your field insights, to the best practices playbook for AI agent deployment and monitoring
- You've created compelling case studies and ROI analyses that accelerate sales cycles and customer adoption
$175,000 - $250,000 a year
Employee Benefits
- Competitive Salary & Equity Package
- Health Insurance (includes option with 100% family coverage)
- 401k
- Paid Maternity/Paternity Leave (12 weeks)
- Flexible/unlimited PTO
- Home Office Stipend
Location
San Francisco preferred.
We are a mostly remote, distributed team. We encourage people to do their work when and where they perform at their best. Because of this structure, strong written communication skills, time management skills, and personal accountability are very important to us.
Canvas Medical provides equal employment opportunities to all employees and applicants for employment without regard to race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
