Senior Software Engineer - Infrastructure

Silicon Valley/Toronto/Remote in North America /
Software /
Untether AI is building the world’s highest performance pure-digital AI inference chip.  We’re a rapidly growing Toronto-based startup, with employees across Canada and the US, building next generation hardware AI accelerators for neural net inference.  We are investing in software in a big way in order to make it as seamless as possible for researchers and developers to successfully deploy neural networks on our hardware.  

We’re looking for best in class engineers to join our existing top-notch team.  When you join Untether AI, you will be part of a team that designs, develops and verifies the software that interacts with our chip, collaborating with our hardware engineers and with fellow software engineers in the process.  By creating software that fully realizes the capabilities of the hardware, you will help get AI inference to the general populace.

As part of this exceptional team, you are able to - and get excited by - identifying functional/performance bottlenecks and how to alleviate them in order to achieve scalable and reliable software.  You excel in an environment with complex software and hardware designs.

***Please note: While our engineering HQ is in Toronto, this is a remote opportunity and we welcome applicants from anywhere in North America.***

We are looking for software engineers at all experience levels to help build out the tools and systems needed to drive high developer productivity at Untether AI.


    • As a Senior Software Engineer (Infrastructure) at Untether AI, you will enable a productive developer experience for yourself and for other members on the team. As a member of the team, you will develop efficient compilation, testing and packaging flows. You will help to (or lead) scale out testing capabilities in both AWS and on Untether AI’s own hardware. You will also improve and/or maintain continuous integration (CI) infrastructure. You’ll also provide integrations and dashboards to control and report on build and CI status. If that isn’t exciting enough, you will also collaborate with the team to build scalable simulation and dataflow pipelines.


    • 5+ years of experience in a software development or site reliability engineering role 
    • Experience developing software in C++ and using common C++ build tools (Makefile, CMake, or similar)
    • Proficient in one or more scripting languages (bash, python, or similar) 
    • Good understanding of git and github.
    • Familiar with linux system configuration and management
    • Familiar with containerized workflows (Docker, kubernetes)
    • Familiar with AWS services and administration
    • Familiar with continuous integration (CI) systems

Preferred Skills & Experience

    • Experience in a DevOps or site reliability engineering role
    • Experience developing and maintaining CI systems (Jenkins, Teamcity, gitlab)
    • Experience building and deploying containerized systems (Docker, kubernetes)
    • Experience with AWS services and administration
    • Experience with software package management systems (debian apt, pypi, conan)
    • Experience developing github hooks, actions, and integrations
    • Knowledge of software release best practices
    • Knowledge of git internals and tools for repository transformations

What are some of the perks that you will receive being part of Untether AI?

    • Aligned to Untether’s philosophy, our employees enjoy the same perks, regardless of role or level. In part, these include:

    • 20 vacation days
    • Strong health and extended health benefits from day 1
    • Unlimited sick days
    • Stock options
    • Being part of building chips and software that will change the world

Thinking about applying?

    • We’re a pretty welcoming bunch of people. If we’ve piqued your interest, you’re passionate about the same things we are but you aren’t sure if you check all the boxes, please apply anyway. We’re a great place to work, an even better place to learn and we focus on both capability and potential!

    • Besides being a pretty friendly group, we’re also pretty diverse - ethnically, experientially and in our physical and mental abilities. If you are someone who needs accommodation during the interview process and/or in the workplace, please send a note along with your resume to and we’ll be in touch.
A little bit more about Untether AI:

Untether AI has developed a groundbreaking new architecture that brings neural net inference to new levels of performance and efficiency. We’ve already sold our product to smart clients who want to get in at ground zero. We’ve done this while continuing to improve our technology creating ultra-efficient, high performance AI chips that eliminates the data movement bottleneck that costs energy and performance in traditional architectures. We’re a team made up of scientists, engineers and entrepreneurs and have the support of tier one investors. We recently received $125 million in our series B funding round which enables us to expand our customer engagements, enhance our software offering, and build the next generation of industry leading AI inference products. Join us to be part of something big - a chance to create the future of AI.