Senior Data Engineer
Santa Monica, CA
Engineering – Engineering /
Full-time /
We're looking for a self-driven software engineer with experience working with the latest ETL frameworks who is eager to tackle new problems in a data driven environment.
The Data-Platform team uses Spark, SQL, Airflow, Hive, HDFS, and other technologies to support an ETL pipeline, data warehouse, and reporting platform. The ideal candidate for this position is skilled at architecting robust solutions to complex problems with efficient and automated methods.
Responsibilities for this role include:
- Building out new ingest pipelines
- Building pipelines to query, merge, and enrich for a presentation ready datastore
- Building new, and scaling out existing ETL applications
- Analyze, scrub, and integrate third party data
- Productionalizing Data Science Models
- Coordinating data models with other engineering teams
- Tuning and optimizing Spark apps to get the most out of the quickly evolving platform
Qualifications - Must Haves
- Experience working with Spark, Hadoop, or other big data processing platform in high-volume environments
- A solid and demonstrable understanding of ETL workflows
- SQL fluency and an understanding of relational data models
- Comfortable in the Linux environment
- A desire to understand business use-cases and seek new value propositions
- An ability to embrace new challenges regularly
- Authorized to work in the US
- Able to work on-site in the Santa Monica area
Qualifications - Nice to Haves
- Python
- Airflow
- Scala
- CI/CD fundamentals
- Docker/Kubernetes environments
- Scrum/Agile experience
VideoAmp Perks
- Small, friendly, and highly collaborative team, with no brilliant jerks - but lots of highly intelligent and motivated coworkers
- Unlimited PTO
- Unlimited use of personal trainer
- Catered meals and fully stocked kitchen (premium + cold brew coffee, fresh produce, breakfast, variety of beverage options)
- Corporate support for hackathons, lunch and learns, and attending conferences
- In-office gym
- Commuter benefits
- Optional company outings
