Senior Software Engineer - Data
Remote
Back End /
Remote
Role Summary
We are rapidly integrating new data sources and are seeking a motivated Data Engineer to help own and scale our data platform. You will be working on enhancing the existing data pipeline to run more efficiently, defining data models, working with various spatial data (raster and vector), , deploying pipeline and application updates to the Cloud, defining infrastructure as code, and building and maintaining observability and monitoring into our data pipeline.
***Please Note: This role is REMOTE, with a preference for candidates to be local to Atlanta, Washington, DC, Miami, NYC, and the San Francisco Bay Area. We are unable to provide sponsorship.****
What you’ll do
● Design, build, and maintain efficient, reusable, and reliable ETL pipelines
● Define data models and mappings for newly integrated data
● Ensure data quality through the use of quality checks and validation
● Deploy pipeline and service updates using helm, flux and CDK to EKSMonitor, triage, and resolve any issues with data flow, data quality, or cluster scaling
● Collaborate with software engineers, product, and design to ensure alignment on data needs and deliverables
● Design, build, and maintain new interfaces and capabilities that are unlocked by new data integrations
What we are looking for
● 5+ years of experience developing software, with at least 3 years of experience working with data pipelines
● Experience building and scaling data pipelines (Airflow, or similar) with comprehensive testing and data quality checks
● Experience deploying IaC to the Cloud (AWS, GCP)
● Experience with OpenSearch or ElasticSearch
● Versed in Kubernetes management with k9s, kubectl, helm, and flux
● Proficiency in python and pydantic models
● Experience working with large quantities of data and/or geospatial data formats
● Ability to work in a distributed team with solid communication skills
● Strong customer focus
What will make you stand out
● Experienced deploying code with CDKExperience with GIS or working with customers who use GIS
● Experience building observability and monitoring into data pipelines
● Demonstrated ability to triage and resolve performance and scaling issues
What you get
● Competitive compensation, including company equity to ensure you can share in the success of your work
● Full health benefits
● A 401k Vehicle
● Opportunity to change how Individuals, Businesses, and Governments interact with Earth data
● Fun, collaborative work environment that is hybrid (remote / onsite) once a QTR, team building meeting for a week+
● Fast-paced startup environment
● Lots of personal responsibility, opportunities for growth and learning
