Machine Learning Engineer - Sensor Fusion Detection
Foster City, CA
Software – Perception /
Full-time /
Hybrid
At Zoox, you will collaborate with a team of world-class engineers with diverse backgrounds in areas such as AI, robotics, mechatronics, planning, control, localization, computer vision, rendering, simulation, distributed computing, design, and automated testing. You’ll master new technologies while working on code, algorithms, and research in your area of expertise to create and refine key systems and move Zoox forward.
The Sensor Fusion Detection team is looking for someone to help them achieve next-generation perception model which is critical for Zoox to deploy a robotaxi fleet in major target cities.
In this role, you will:
- Train and upgrade current image backbone to be multi-frame, even higher resolution and using large foundational, language-aligned feature encoder;
- Deploy temporal image backbone into on-vehicle inference architecture and optimize runtime compute resource;
- Incorporate temporal information into the the existing Zoox’s multi-sensor (Vision, Lidar and Radar) early fusion system to predict object velocity and scene flow;
- Develop effective metrics and evaluating algorithm performance with these metrics to demonstrate improvement.
Qualifications
- Master's degree or PhD in computer science or related field
- Experience with Vision Language Model or multi-modal 3D foundation model.
- Experience writing highly efficient C++ software and python
- Experience with model deployment with TensorRT
- Proficient in PyTorch model design, implementation, training and evaluation.
Bonus Qualifications
- GPU/CUDA programming experience
- Experience with customized TRT plugin development
- Experience working with LiDAR, Camera and Radar data
Compensation
There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. The salary will range from $180,000 to $289,000. A sign-on bonus may be part of a compensation package. Compensation will vary based on geographic location, job-related knowledge, skills, and experience.
Zoox also offers a comprehensive package of benefits including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.
About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.
Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.
A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
