Data Engineer
Irvine, CA
Dev /
Full Time /
Remote
We are looking for a Data Engineer to help build our data infrastructure.
We are seeking a junior to mid-level Data Engineer to join our dynamic data engineering team. This role involves building and optimizing ETL workflows, rewriting data science notebooks for production environments, and repricing parcel carrier data according to various discount terms. The successful candidate will be immediately involved in feature development for our core product, handling EDI and CSV formatted data across different parcel shipping schemas.
This person should be familiar with PySpark, Python, and Databricks in the AWS ecosystem. Experience working with SQL (e.g. PostgreSQL) is also preferred.
This role is fairly autonomous. A successful applicant should be comfortable using their skill, intuition, and creativity to accomplish a task without detailed direction on how it should be accomplished. While the ideal candidate should be capable and independent, they will be part of a supportive and friendly team dedicated to mutual success. This person should be comfortable working in 2-week sprint cycles.
Minimum Requirements:
Bachelor’s degree in Computer Science or a related field, or equivalent experience.
US citizenship or permanent residence
Key Responsibilities
- Develop and maintain efficient ETL workflows using Databricks within AWS.
- Optimize data science notebooks for a robust production environment.
- Implement repricing logic for parcel carrier data based on various discount agreements.
- Parse and process data in various formats, including EDI and CSV, across multiple shipping schemas.
- Collaborate actively in a team setting within 2-week sprint cycles, contributing to the team's success while working autonomously on assigned tasks.
Preferred if applicant is skilled in the following technologies
- Databricks
- PySpark
- SQL (Databricks SQL or Spark SQL preferred)
- Git
- Python
Bonus if familiar with
- EDI, CSV, and JSON data feeds
- Parcel shipping data
- Parcel audit
$115,000 - $150,000 a year
Salary range reflects compensation for US-based applicants. The range for applicants outside of the US market will be competitive to local market rates.
In recent years, we’ve pioneered first-in-industry shipping data analytics software, so that our clients can understand the factors affecting their shipping spend. No other company is helping businesses reduce shipping costs with technology like Reveel. Candidly, the logic behind shipping costs is insane and very hard to understand! We make that easy for our customers by creating amazing software.
Since 2006, Reveel® has been dedicated to providing Shipping Intelligence® for the smartest business decisions possible. Founded by former DHL sales executives, Reveel was created to level the playing field. Over the past decade-plus, our zero-risk services have saved our clients millions of dollars.
