Principal Software Engineer

New York, NY /
Engineering /
Full time
Think of a SQL data warehouse, but with millisecond-level latency for real-time data. That is Materialize, the first streaming SQL data warehouse.

We are not "disrupting" or changing the behaviors of the world's population, but instead building something that works in a space where most products simply do not. Our work builds on top of Timely Dataflow and Differential Dataflow, both created by our co-founder Frank McSherry.

We are looking for seasoned Engineering generalists with extensive experience leading technical architecture and who are proficient in Rust, C++, Java, or functional programming languages. It's vital to also have experience working with large data sets, distributed systems, and backend development, as well as an interest in developing software in Rust.

Materialize is deployed on top of streaming message queues, like Kafka, and allows users to specify arbitrary SQL views on top of their queues and query those views instantly. Stream processing software like Kafka has greatly improved the end-to-end latency of moving messages around in real time, but today there's no good solution for making use of that data easily. Materialize brings the user-facing simplicity of SQL views - for arbitrary SQL queries, not just some SQL-inspired minimal language - to the streaming data ecosystem.

All of this is only possible because Materialize is built on top of Timely Dataflow and Differential Dataflow, both of which are award winning projects with strong theoretical foundations. Materialize's Chief Scientist and co-founder Frank McSherry built Timely Dataflow over years of research. Timely was inspired by an earlier Microsoft Research project (also led by Frank) called Naiad, which won several academic accolades including best paper at SOSP 2013.
Working at Materialize

* 100% health insurance for you and your dependents
* 401k
* SkunkWorks Fridays
* Flexible working hours
* 4 weeks of vacation
* Competitive equity package

We understand it takes a diverse team of highly intelligent, passionate, curious, and creative people to develop the exceptional product we are building. Our dynamic team has incredible perspectives to share, just as we know you do, and we take great pride in being an equal opportunity employer.