Software Engineer, ML Infrastructure

Palo Alto /
Product & Infrastructure /
Who are we?
We’re a small, diverse team working at the cutting edge of machine learning. At Cohere, our mission is to build machines that understand the world and to make them safely accessible to all. Language is at the crux of this, but it can be difficult and expensive to parse the syntax, semantics, and context that all work together to give words meaning. The Cohere platform provides access to Large Language Models through its APIs that read billions of web pages and learn to understand the meaning, sentiment, and intent of the words we use in a richness never seen before. 

We recently raised our Series A and are focused on bringing our technology to market. We will partner with customers so they can build natural language understanding and generation into their products with just a few lines of code.

We’re ambitious — we believe our technology will fundamentally transform how industries interact with natural language. And we have the technical chops to back it up - Cohere’s CEO, Aidan Gomez, is a co-author of the groundbreaking paper “Attention is all you need”, (over 23k citations) and was previously part of Google Brain. Our entire technical team is world-class. 

We are focused on creating a diverse and inclusive work environment so that all of our team members can thrive. We welcome kind and brilliant people to our team, from wherever they come.

Why this role?
Ship clean and fast code.

Go, Tensorflow and Kubernetes.

Become a pioneer in the field of large neural network serving.

This role is ideal for you if you are excited about building the next generation of infrastructure to enable large-scale machine learning. Here you will build infrastructure to support both the training and serving of extremely large scale models, as well as downstream applications that are able to leverage the capabilities of those models. In this role, you will work on the cutting edge of research and engineering, design and develop state-of-the-art machine learning models and deploy them to production.

Please Note: Our office is located in Toronto, Canada but this role is remote-flexible and is open to those located in either Canada or the US.

As a ML Infra Engineer, you will:

    • Design and create scalable infrastructure to train and serve models
    • Design and implement robust data pipelines (crawlers, storage, filters)
    • Design and implement scalable services for machine learning applications
    • Build internal tooling (CI/CD, dev utilities) to move faster together
    • Keep up with the cutting edge and adopt new technologies to improve performance and reliability

You may be a good fit if:

    • You are familiar with Go, Docker, and Kubernetes
    • You are excited to add new technologies to your toolbox and use them where it makes sense
    • Bonus: You have shipped Go/Tensorflow services to production
    • Bonus: You have a strong opinion about the UNIX philosophy 

Our Perks:
🤝 An open and inclusive culture and work environment 
🧑‍💻 Work closely with a team on the cutting edge of AI research 
🍽 Free daily lunch 
🦷 Full health and dental benefits for employees based in Canada and the US, including a separate budget to take care of your mental health 
🐣 100% Parental Leave top-up for 6 months for employees based in Canada and 12 weeks in the US
🎨 Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
🏙 Remote-flexible, office in Toronto and coworking stipend
✈️ 6 weeks of vacation and shared Canada/US holidays 

If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.

We welcome applicants of all kinds and are committed to providing both an equal opportunity process and work environment. We value and celebrate diversity and strive to create an inclusive work environment for all.