Principal Data Engineer
Technology – Technology
Do you have passion for data and building impactful data products? Do you want to see how data drives the transformation of financial services, solve big problems and make a meaningful difference in people’s lives?
Upgrade, Inc. is a new consumer credit platform that combines personal loans with tools that help consumers understand, monitor and improve their credit. We’ve raised $60 million in our first capital raise in March 2017, which remains the largest Series A round ever raised by a FinTech company. While the founding team is very accomplished and the business model has been proven, we are still in the early days of this new platform and there is an enormous opportunity to have a significant impact.
Upgrade is building out a brand new Data Engineering team, working together closely with the Analytics team to ensure we are a data driven organization. Data drives decision making across Product, Marketing, Finance, Risk and all other teams and Data Engineering will help build and maintain the next generation data infrastructure that powers all of it.
What you have/are:
*Highly collaborative with analysts, product teams and data scientists with great social skills and high levels of empathy.
*5+ years experience in designing, building and maintaining efficient, scalable and reliable batch and real-time data pipelines to load data in a well structured cloud data warehouse such as Redshift, BigQuery or Snowflake.
*Strong SQL skills with the ability of writing complex queries on large data sets.
*3+ years of working with a data engineering/sciences friendly programming languages such as Python or Scala.
*A deep understanding of dimensional modeling with facts, dimensions and aggregates.
*Experience building realtime pipelines in Apache Spark, Flink, Storm and the likewise using a scalable distributed messaging systems such as Kafka or kinesis.Experience with workflow management systems like Airflow, Luigi, AWS Data Pipeline, Oozie and the likewise.
*Worked in a fast paced environment and been scrappy when needed. Hate doing the same task more than once and always think automation.
*Strong knowledge of version control with Git.Do not feel out of place when an enthusiastic colleague starts a conversation on distributed computing and storage in the cafeteria.
*Read or will read the blog post https://medium.freecodecamp.org/the-rise-of-the-data-engineer-91be18f1e603 and totally appreciate it.
Bonus points for:
Experience with financial data.Experience with PII data and its secure storage and retrieval.Experience with cloud environments - AWS, GCP, Azure and the likewise. Experience with stateless computing with AWS Lambda, iron.io and the likewise. Experience with implementing machine learning pipelines. Experience with docker and kubernetes.
What you will Do:
Quickly gain a deep understanding of the business and how data flows through the organization.Collaborate with Analytics, Engineering & Tech Ops teams to understand our source data and help build a world class data warehouse on the cloud which will act as the one source of truth for all information in the organization. Build and own awesome scalable data pipelines to enrich the data warehouse. Work with engineering, product and the business as they plan for new product initiatives or data needs and proactively develop solutions.
What you will get:
An opportunity to join us at an early stage where what you build will be of great meaningful impact and will pave the way for our future success and yours too.A highly open, collaborative and supportive team environment that will encourage your crazy but brilliant ideas and respect your decisions. Help and support in creating goals that drive you, take on projects that excite you and learn new things everyday.Great OPEN office location.Conveniently located in San Francisco Financial District.Close to BART and Public Transportation.Comprehensive benefits package: Medical, dental, & vision.Unlimited vacation policy.Kitchen stocked with beverages, snacks & treats.Weekly & monthly social gatherings / happy hours.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status