Senior Lead Data Engineer - R01554949
San Ramon, California, United States
AI & Data Engineering – AI & Data Engineering : Data Engineering /
Employee /
On-site
About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.
Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Senior Lead Data Engineer
Primary Skills
- CI/CD Pipeline, React (React Context / Redux), Django / Flask / FastAPI, Docker, CSS/SCSS/LESS, PyTest, PostgreSQL / MongoDB / Redis, Kubernetes, REST API / GraphQL
Specialization
- Python Fullstack with Microservices: Software Development Lead
Job requirements
- Location: Santa Ana, California
- Onsite: 5 days
- We are seeking a skilled Python Developer to support the migration of existing applications and scripts from an external vendor’s environment into our internal platform. The ideal candidate will have strong Python development experience, a solid understanding of software architecture, and the ability to refactor, enhance, and optimize code for long-term maintainability.
- Analyze existing vendor-provided Python codebases and related assets.
- Migrate, refactor, and integrate code into the internal platform while ensuring compatibility and performance.
- Enhance and extend existing code functionality based on evolving business user requirements.
- Re-architect components as needed to align with internal coding standards, best practices, and infrastructure.
- Develop automated tests to validate migrated and enhanced code functionality.
- Collaborate with platform engineers, business analysts, and stakeholders to capture requirements and deliver solutions.
- Document migration processes, enhancements, system changes, and updated workflows.
- Troubleshoot, debug, and resolve issues during migration, enhancement, and post-deployment.
- Identify opportunities for automation, performance improvements, and process efficiency.
- Strong proficiency in Python (3.x) and related frameworks/libraries.
- Strong proficiency in pandas, nympy, sqlalchemy, tenacity, polars, dask, pyspark, etc.
- Strong knowledge of data engineering, ETL processes, or microservices.
- Strong knowledge of APIs, databases (SQL/NoSQL), and data pipelines.
- Experience with code migration, integration, or re-platforming projects.
- Proven ability to enhance and extend existing code to meet business requirements.
- Familiarity with software design patterns, modularization, and refactoring best practices.
- Experience with version control (Git), CI/CD pipelines, and testing frameworks (pytest/unittest).
- Strong debugging, problem-solving, and analytical skills.
- Excellent communication and documentation abilities.
- Preferred Skills
- Experience with cloud platforms (AWS, Azure, or GCP).
- Familiarity with containerization (Docker, Kubernetes).
- Prior experience collaborating with external vendors or in a migration/enhancement-focused role.
Overview
Responsibilities
Qualifications
Know what it’s like to work and grow at Brillio: Click here
