Data Lake Platform Lead (Oakland, CA)

Oakland, CA
Engineering
Full-time

From our founding until now, our mission has remained the same: to remove the engineering burden from data teams by standardizing and fully automating data connectors. With Fivetran, your data just arrives in your warehouse, canonical and ready to query, no engineering or maintenance required. As we watch more and more companies leverage our technology to become truly data-driven, we’re proud not only of our growth but also of the fact that we’ve grown without compromising our core values:

Preserve your integrity, even when it's hard.
Always do the right thing, even when it's harder in the short run.

Take the initiative.
Fivetran belongs to all of us. If you see an opportunity to improve something, seize it!

Trust each other.
We trust our teammates to do their part. Our customers trust our product to do what we say it does.

Nurture diversity, equality and inclusiveness.
We seek out teammates who share our values and drive, not people who are exactly like us. We're building a company that works for everyone. At Fivetran, you can always be your authentic self.

Lead, don't follow.
Many of the assumptions in our industry are wrong. We hire smart people and make decisions by reasoning from first principles.

One team, one dream.
We share the pains and successes of our customers, partners and colleagues. And we go above and beyond for each other.

If these values resonate with you, we’d love to hear from you!

Fivetran is looking for an experienced software architect to build out our next-generation data lake. Fivetran is a fully-managed data pipeline that pipes data from sources like Salesforce and Postgres into destinations like Snowflake and BigQuery. We follow a zero-configuration, automation-first approach. Our 500+ customers leave the pipes to us and focus on getting insights out of their data. We're looking for a senior technical architect to help us bring this automation-first approach to data lakes. Our customers should be able to pipe data from any Fivetran source into a Parquet-in-S3 data lake, so they have a vendor-neutral long term repository of their data. We're looking for domain expert to lead a small team defining and building out this vision.

As a Data Lake Platform Lead at Fivetran you will:

    • Create a new source connector within the first 1 month
    • Start building a prototype Parquet-in-{S3,GCS} data lake in month 2
    • Develop general awareness of all areas of Fivetran's code base and infrastructure by month 6
    • Start participating in our on-call rotation by month 3
    • Start contributing to hiring by participating in the interview process by month 2
    • Launch a Parquet-in-{S3,GCS} data lake alpha with < 5 customers by month 6
    • Launch the data lake to general availability by month 12

Your Superpowers:

    • Writes well-structured and performant code
    • Expertise in Parquet format, distributed computing, Hadoop ecosystem
    • Works well in a small team
    • Mentors junior developers
    • Passionate about performance optimization
    • Experience with VisualVM or other profilers
    • Strong ability to communicate about software architecture and related decision making

Perks of working with us:

    • 100% paid Medical, Dental, Vision and Basic Life Insurance
    • Unlimited/flexible PTO
    • 401k match program
    • Pet Insurance -- and yes, you can bring your well-behaved fur babies to work
    • Commuter Benefits to help with transit and parking costs
    • Professional development and training opportunities
    • Unlimited coffee, office snacks and frequent catered lunches
    • Company happy hours and fun team building activities