Data Engineer - Python/SQL/AWS
Mumbai, India
Technology – Engineering /
Full Time /
Hybrid
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.
Nielsen is seeking an organized, detail oriented, team player, to join the OpIntel team in the role of Data Engineer. Nielsen’s Audience Measurement Engineering platforms support the measurement of television viewing in more than 30 countries around the world. Ideal candidates will have exceptional skills in programming, testing, debugging and problem solving as well as effective communication and writing skills.
Qualifications:
- Bachelor’s degree in computer science, information systems, software engineering or a related field (foreign equivalent degree acceptable) plus
- three (3) years of experience in: software development technology using Python and SQL to write data pipelines/ETL/ELT, designing OLAP and S3 object store data architecture
- Two(2) years of experience with/in: AWS DevOps, Python,Spark
- Some experience with/in: Test Automation, CICD Pipeline Development
Roles and Responsibilities
- Design, develop, test and support highly complex data engineering software solutions for analytical data storage (AWS Data Lake, Data Warehouse) by providing necessary design and technical expertise.
- Understand the big picture in an End-to-End data environment and understand upstream system data and downstream consumption requirements.
- Adopt standard platform tools for source code management, CICD, Orchestration, monitoring and alerting (gitlab, airflow, jenkins etc).
- Work on AWS cloud infrastructure in a DevOps capacity, including automating the deployment and scaling of EMR, EC2, S3.
- Participate in technical planning & requirements gathering phases including discovery, design, code, test and documentation.
- Demonstrate development best practices to guarantee the quality and sustainability of software deliverables.
- Support Testing and UAT phases and participate in Deployment.
- As a Software Engineer on Nielsen Engineering’s OpIntel Team, you will be part of a collaborative group of skilled Software Engineers who deal with a wide variety of Nielsen data from our TV, Digital/Internet, and Radio monitoring business. You will be working closely with offshore team members in the software development lifecycle process.
- You will be designing and building complex data-driven applications and processes that help
- to ensure that Nielsen TV, Digital/Internet, and Radio measuring systems are generating accurate data.