Lead Data Engineer
Mumbai, MH
Engineering – Data Engineering and Data Science /
Full time (Remote) /
Remote
Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
As a Lead Data Engineer, you have 8+ years of hands-on experience in Data Engineering. You work with business leads, analysts, and data scientists to understand the business domain and engage with fellow engineers to build data products that empower better decision-making. You are passionate about the data quality of our business metrics and the flexibility of your solution that scales to respond to broader business questions.
If you love to solve problems using your skills, then come join the Team Mactores. We have a casual and fun office environment that actively steers clear of rigid "corporate" culture, focuses on productivity and creativity, and allows you to be part of a world-class team while still being yourself.
What you will do?
- Lead the project implementation from the technical perspective
- Write efficient code in the chosen technology for the project - For example - Spark, Apache Beam.
- Explore new technologies in Data lake modernization, Data warehouse migration, and ETL Migrations and learn new technologies to optimize the migration and operations process efficiently.
- Collaborate with many engineering and business teams to build better data products and services.
- Deliver the projects along with the team collaboratively and manage updates to customers on time.
- Participate in the hiring process for Associate and Senior level data engineers and lead them on projects, mentor and define their technical career path by collaborating with them
What are we looking for?
- 4 + years of experience in Apache Spark.
- 4+ years of experience in any ETL tool
- 2+ years of experience in architecting ETL jobs using pySpark, and SparkSQL
- 6+ years of experience in SQL queries and stored procedures
- Have a deep understanding of all the Dataframe API with all the transformation functions supported by Spark 2.7+
You are preferred if you have
- Prior experience in working on AWS EMR, Apache Airflow
- Certifications - AWS Certified Big Data – Specialty Cloudera or Hortonworks Certified Big Data Engineer
- Understanding of DataOps Engineering
Life at Mactores
We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.
1. Be one step ahead
2. Deliver the best
3. Be bold
4. Pay attention to the detail
5. Enjoy the challenge
6. Be curious and take action
7. Take leadership
8. Own it
9. Deliver value
10. Be collaborative
We would like you to read more details about the work culture on https://mactores.com/careers
The Path to Joining the Mactores Team
At Mactores, our recruitment process is structured around three distinct stages:
Pre-Employment Assessment:
You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.
Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.
HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.
At Mactores, we are committed to providing equal opportunities in all of our employment practices, and we do not discriminate based on race, religion, gender, national origin, age, disability, marital status, military status, genetic information, or any other category protected by federal, state, and local laws. This policy extends to all aspects of the employment relationship, including recruitment, compensation, promotions, transfers, disciplinary action, layoff, training, and social and recreational programs. All employment decisions will be made in compliance with these principles.
Note: Please answer as many questions as possible with this application to accelerate the hiring process.
