Senior Data Engineer - W6052
Hyderabad
Nisum India – Data Science & Analytics /
Full Time / Contract /
Hybrid
What You'll Do
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility, and foster data-driven decision-making across the organization.
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Write unit/integration tests, contributes to engineering wiki, and documents work.
- Perform data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.
- Work closely with a team of frontend and backend engineers, product managers, and analysts.
- Define company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.
- Design data integrations and data quality framework.
- Design and evaluates open source and vendor tools for data lineage.
- Work closely with all business units and engineering teams to develop a strategy for long term data engineering platform architecture
What You Know
- A minimum of 8 years of ETL and Data Engineering experience is required.
- Experience with relational SQL and NoSQL databases.
- Experience with Azure cloud Data services
- 5-8+ years of experience in a Data Engineer & ETL Tools (any one tool) role (Azure)
- Data Engineer with Azure functions and Azure ADF, Databricks and PySpark
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.
Education
- A bachelor's degree in information technology, software development management, software engineering, computer science, or a related field.
Benefits
- In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
- Continuous Learning - Year-round training sessions are offered as part of skill enhancement certifications sponsored by the company on a need basis. We support our team to excel in their field.
- Parental Medical Insurance - Nisum believes our team is the heart of our business and we want to make sure to take care of the heart of theirs. We offer opt-in parental medical insurance in addition to our medical benefits.
- Activities -From the Nisum Premier League's cricket tournaments to hosted Hack-a-thon, Nisum employees can participate in a variety of team-building activities such as skits, and dances performance in addition to festival celebrations.
- Free Meals - Free snacks and dinner is provided on a daily basis, in addition to subsidized lunch.