Data Engineer
San Francisco
Engineering /
Full-Time /
On-site
The Opportunity
As a Data Engineer, you are passionate and drive excellence across data ingestion, preparation, modeling and quality. The successful candidate will drive the organization's design of high performance data models, helping us effectively get the most from our data.
How You'll Make A Difference Day To Day
- Collaborate with stakeholders to solve problems by modeling complex datasets to fit their needs
- Identify, design, and implement internal process improvements; automate manual processes where appropriate. Optimize how data gets delivered, and scale our data systems where needed
- Design processes for data observability, usage metrics, and monitoring of the platform
- Create data tools for the organization to make data-driven decisions
- Be an active contributor to architectural decisions as we enhance our data platform and infrastructure
Required to work on-site 3 days a week (Tuesday, Wednesday, Thursday). Managers may require additional on-site days.
Minimum Qualifications:
- 3+ years of strong data engineering design/development experience in building large-scale distributed data platforms/products
- Knowledge of Python, SQL
- Experience with dbt and data modeling, especially incremental models
- Experience designing and implementing data ingestion platforms, interacting with multiple third-party data sources, and assembling them into actionable structures
- Experience in developing data architectures within greenfield efforts
- Experience with both structured and unstructured datasets
- Ability to establish and maintain relationships with key stakeholders
Preferred Qualifications:
- Experience with a Security related SaaS product
- Familiarity with Apache Kafka, or Kinesis
- Familiarity with applying Data Science algorithms and/or ML ops
- Experience with a variety of data serialization formats (Avro, Parquet, JSON, Protobuf, etc)
- Familiar with workflow management systems (Airflow, Argo Workflows, etc)
$120,000 - $150,000 a year
