Senior Deep Learning Engineer

Toronto / North America/Remote
Software /
Full-time /
We’re looking for best in class engineers to join our existing top-notch team.  When you join Untether AI, you will be part of a team that designs, develops and verifies the software that interacts with our chip, collaborating with our hardware engineers and with fellow software engineers in the process.  By creating software that fully realizes the capabilities of the hardware, you will help get AI inference to the general populace.
As part of this exceptional team, you are able to - and get excited by - identifying functional/performance bottlenecks and how to alleviate them in order to achieve scalable and reliable software.  You excel in an environment with complex software and hardware designs.

We are looking for an experienced Senior Deep Learning Engineer to join our Neural Networks team. The main objective of our team is to make it as seamless as possible for researchers and developers to successfully deploy neural networks to run on our hardware. This involves optimizing a variety of common neural networks to run efficiently on our architectures. The Senior Deep Learning Engineer will also be designing and building a model optimization software pipeline so that our customers’ models can be automatically prepared for on-chip inference. If you want to be working at the bleeding edge of AI, this role is for you!


    • Computer Science, Engineering or related degree
    • 5+ years experience, with a healthy amount of both deep learning and software engineering (2+ years each)
    • Experience with one or more deep learning frameworks (preferably Tensorflow and/or PyTorch)
    • Experience working with one or more of the following: CNNs, LSTMs/RNNs, Transformers
    • Experience reproducing academic work from the field of AI
    • Strong math background
    • Strong Python skills
    • Experience with C/C++

Preferred Skills & Experience

    • Masters or PhD in Computer Science, Engineering, or related field
    • Embedded or low-level programming experience
    • CUDA/OpenGL experience
    • Experience deploying neural networks to production
    • Experience with model compression techniques such as quantization, quantization-aware training, knowledge distillation, pruning, etc.

General Skills

    • Enthusiastic about all things AI
    • Passionate about solving hard problems and pushing the envelope of what is possible
    • Comfortable with both big picture thinking and in-the-weeds deep dives
    • Driven, organized and self-directed
    • Ability to build projects from the ground up
    • Comfortable working within a rapidly evolving project
    • Strong focus on testing and software quality
    • Team focus and desire to help build the team

Thinking about applying?

    • We’re a pretty welcoming bunch of people.  If we’ve piqued your interest, you’re passionate about the same things we are but you aren’t sure if you check all the boxes, please apply anyway.  We’re a great place to work, an even better place to learn and we focus on both capability and potential!
    • Besides being a pretty friendly group, we’re also pretty diverse - ethnically, experientially and in our physical and mental abilities.  If you are someone who needs accommodation during the interview process and/or in the workplace, please send a note along with your resume to and we’ll be in touch.

What are some of the perks that you will receive being part of Untether AI?

    • Aligned to Untether’s philosophy, our employees enjoy the same perks, regardless of role or level.  In part, these include:

    • 20 vacation days
    • Strong health and extended health benefits
    • Unlimited sick days
    • Stock options
    • Building chips and software that will change the world
A little bit more about Untether AI

Untether AI has developed a groundbreaking new architecture that brings neural net inference to new levels of performance and efficiency.  We’ve already sold our product to smart clients who want to get in at ground zero.  We’ve done this while continuing to improve our technology creating ultra-efficient, high performance AI chips that eliminates the data movement bottleneck that costs energy and performance in traditional architectures.  We’re a team made up of scientists, engineers and entrepreneurs and have the support of tier one investors. We recently received $125 million in our series B funding round which enables us to expand our customer engagements, enhance our software offering, and build the next generation of industry leading AI inference products. Join us to be part of something big - a chance to create the future of AI.