Senior Software Engineer - Data Infrastructure
New York, NY
Proxima – Engineering /
Full-Time /
Hybrid
Proxima
Proxima is more than just a business to us; it's a vision of transforming the consumer technology landscape and giving B2C businesses the data they need to make informed decisions that drive highly performant actions. We are empowering our customers to achieve their greatest potential with innovative, data-driven solutions.
We are a first-of-its-kind data intelligence solution that leverages artificial intelligence and a proprietary database of over 60 million (and growing) unique shopper personas to enable businesses to achieve greater scale, efficiency, and financial success across their acquisition, retention, and operational strategies. We’re on a mission to help maximize their performance with AI-powered solutions that have traditionally been out of reach for most companies. We believe profitable growth starts with better data.
About The Role
The Data Engineering team is looking to hire a Software Engineer who is excited to work with production facing data tools, and support a growing business model for Proxima. As a Senior Software Engineer (Data Infrastructure) at Proxima, you will be at the forefront of shaping and optimizing our data infrastructure. This role is pivotal, and will inform architecture, best practices, timelines and business and operational decision making. Working closely with cross-functional teams, you’ll implement technical solutions that drive efficiency of our data processes, and troubleshoot and resolve issues.
This role isn’t just about maintaining the status quo; it’s an opportunity to innovate and actively contribute to discussions about technology, architecture, and solutions for both new and existing projects. If you’re passionate about driving technological excellence and thrive in a dynamic, and collaborative environment, this role is tailor-made for you.
What You'll Do
- Manage AWS + Airflow infrastructure underlying our data platform
- Build opinionated guardrails to drive improvements in data quality, cost efficiency, and data governance APIs and controllers that support our IAM, compute, and storage patterns
- Software automation that connects our data services and surfaces metadata to downstream customers for discovery and data contract enforcement
- Monitor our core systems and the mechanisms built on top
- Collaborate effectively with a team of proficient software engineers to develop and maintain the fundamental platform that powers the cutting-edge Proxima’s data warehouse infrastructure
- Engage in the complete data lifecycle, participating in the development of new revenue generating products
- Design, Build and Deliver end-to-end data solutions to improve the reliability, scalability, latency and efficiency of the data platform
- Implement automation for key elements of the development process, including data quality, managing alerts and handling critical infrastructure operations
- Collaborate and Share on-call responsibilities, including incident management, with the larger engineering team
- Guide and support fellow engineers within the team by serving as a mentor, while actively contributing to the sharing of knowledge through training sessions and comprehensive documentation
What You Need
- 5-8 years of experience in software engineering experience in a production setting writing clean, maintainable, and well-tested code
- Strong proficiency in object-oriented programming languages like Python, NodeJS or Go, with expertise in SQL languages like Redshift, SparkSQL or Postgres
- Strong familiarity with PySpark and similar programming APIs
- Familiarity with modern data file formats (Parquet, Avro) and table formats (Delta Lake, Iceberg, Hudi)
- Demonstrated expertise in designing and implementing large-scale systems, diligently monitoring project progress, and showcasing proactive leadership as a self-starter on diverse projects
- Experience working with cloud services, Terraform, Airflow, Kubernetes, CI/CD, and working with modern cloud-based infrastructure: AWS RDS, DynamoDb, Redshift, Lambda, API Gateway.
- Competitive understanding of data structures and types, data transformation, validation, and query performance tuning.
- Experience debugging and performance tuning APIs and ETL jobs
- Excellent communication skills tailored for effective collaboration within both a service-oriented team and the broader organizational context
- Strong collaborator, ability to work cross functionally
- Bachelor’s Degree or higher in Computer Science or similar field
- Data Warehousing fundamentals, working with Redshift or Databricks
- Experience using ORMs, in particular SQLAlchemy
- Experience debugging stack traces in Python and Java
- Experience supporting ML/AI projects
Preferences:
$160,000 - $230,000 a year
The base pay for this position represents the low and high range for this role. The actual base salary offered for this position will depend on numerous factors including individual performance, skills and experience. The base salary is just one component of Proxima’s compensation package which includes a wide range of medical, dental, vision and other benefits, as well as equity.
Why You'll Love Working Here
We can promise:
- Competitive salary in a fast-growing, close-knit, & motivated team
- Unlimited PTO so you can take the time you need
- Health, dental, and vision insurance for you and your dependents
- Annual membership to OneMedical and Teledoc
- Summer Fridays from July 4th Weekend to Labor Day each year
- 401k program
- 12 weeks Paid Parental Leave benefits
- Commuter pre-tax benefits
- Learning & Development Stipend
- HSA and FSA pre-tax benefits
- Pet-Friendly Office Space in the Heart of Soho
We value diversity and inclusivity. We are an equal opportunity employer and do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
