Software Engineer (Ray Core)
San Francisco, CA /
About the role:
Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend.
About the Ray Core team:
The Ray core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray.
A snapshot of projects you can work on:
- Optimizing performance of large-scale workloads on Ray
- Stability and stress testing infrastructure
- Improving fault tolerance (HA)
As part of this role, you will:
- Develop high quality open source software to simplify distributed programming (Ray)
- Identify, implement, and evaluate architectural improvements to Ray core
- Improve the testing process for Ray to make releases as smooth as possible
- Communicate your work to a broader audience through talks, tutorials, and blog posts
We'd love to hear from you if have:
- At least 2 year of relevant work experience
- Solid background in algorithms, data structures, system design
- Experience in building scalable and fault-tolerant distributed systems
Anyscale provides an application development platform for developers to build distributed applications. We’re commercializing a popular open source project called Ray, which is a framework for distributed computing as well as an ecosystem of libraries for scalable machine learning. Our goal is to build a standardized platform for distributed computing. Ray was developed at UC Berkeley by Robert Nishihara and Philipp Moritz, under the guidance of Ion Stoica and Michael Jordan, and the four of them have co-founded Anyscale. The company raised a $20.6M Series A and a $40M Series B funding from Andreessen Horowitz (a16z), NEA, Foundation Capital, Intel Capital, Ant Financial, Amplify Partners, 11.2 Capital, and The House Fund.
With Ray, we're making it easy to program at any scale (from your laptop to the datacenter) by providing easy-to-use, general-purpose, and high-performance tools. In addition, we are building a rich ecosystem of libraries (for reinforcement learning, hyperparameter search, experiment management, machine learning training, prediction serving, and more) on top of the core distributed system so that users can rapidly build sophisticated applications. Help us build the future of software development.
We are looking for passionate, motivated people who are excited to build tools to power the next generation of cloud applications.
Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.