Data Engineer - (must be local to MA, ME, NH, RI, or VT)
Boston, MA
Technology Innovation – Engineering /
Remote
As the Data Engineer in the Technology’s Innovation Department LAMP team, you will be building and maintaining data pipelines to support analysis of transit and other types of data.
Principal duties and responsibilities:
- As a Data Engineer on our LAMP team, you will play a pivotal role in shaping the architecture and flow of transit data across systems. In this role, you will architect data solutions using modern engineering principles, ensuring scalability and reliability. Your competency in data modeling will be crucial for designing structures that support our business logic and analytical needs. Your analytical skills will be put to use tuning logic to optimizing data processing and retrieval performance.
- This role demands a blend of technical acumen in data engineering tools and practices, strategic thinking for technology selection, and the interpersonal skills to collaborate effectively within the team and broader organization. Your contributions will directly impact the efficiency and effectiveness of our data-driven strategies, making this a critical and rewarding position in our department.
Minimum experience and required skills:
- Proficient with Python
- Proficient with SQL and query optimization
- Experience with data management on local environments
- Experience with automated testing, including continuous integration (CI)
- Experience with Git workflows (such as pull requests) and code reviewing
- Experience with data pipeline architecture and deployment
- Experience with data modeling
- Experience with data quality analysis
- Ability to translate business requirements into technology
- Strong communication skills
- Strong analytical thinking and debugging abilities
- Attention to detail
Preferred experience and skills:
- Knowledge of transit data standards (such as GTFS, GTFS-RT, TODS, TIDES)
- Experience with Terraform / Infrastructure as Code tools
- Experience with AWS data tools and resource management
- Experience with cross-language data platforms like Arrow
Location:
This role can be 100% remote or hybrid.
As a contracted role for the MBTA, we are only able to employ people living in the following states - ME, MA, NH, RI, and VT.
At this time, we are only able to hire US residents who will reside in the US for the duration of their employment
Compensation:
Pay rate range is $75 - $98 per hour (W-2), up to 1880 hours per year.
