Senior Software Engineer (R-16103)
Hyderabad - India
Technology /
Employee: Full Time /
Hybrid
Why We Work at Dun & Bradstreet
Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,500+ global team members are passionate about what we do. We are dedicated to helping clients turn uncertainty into confidence, risk into opportunity and potential into prosperity. Bold and diverse thinkers are always welcome. Come join us! Learn more at dnb.com/careers.
About Us:
Our global community of colleagues bring a diverse range of experiences and perspectives to our work. You'll find us working from a corporate office or plugging in from a home desk, listening to our customers and collaborating on solutions. Our products and solutions are vital to businesses of every size, scope and industry. And at the heart of our work you’ll find our core values: to be data inspired, relentlessly curious and inherently generous. Our values are the constant touchstone of our community; they guide our behavior and anchor our decisions.
Designation: Senior Software Engineer – Big Data
Location: Hyderabad / Remote
- KEY RESPONSIBILITIES
- Design ETL/ELT data pipelines using Databricks, Dataproc or any other ETL processing engine. Familiarity with Data Pipelines, Data Lakes and modern Data Warehousing practices (virtual data warehouse, push down analytics etc.)
- Worked on Various Data Ingestion mechanism for Analytics Feature store.
- Expert level programming skills on Python
- Expert level programming skills on Spark
- Cloud Based Infrastructure: AWS (and the very many services it offers) i.e. EC2, RDS, AWS Redshift, EMR, Snowflake, Athena, PrestoDB Experience with one of the ETL Informatica, StreamSets in creation of complex parallel loads, Cluster Batch Execution and dependency creation using Jobs/Topologies/Workflows etc.,
- Experience in SQL and conversion of SQL stored procedures into Strong exposure working with web service origins/targets/processors/executors, XML/JSON Sources and Restful API’s.
- Strong exposure working with GCP and relation databases like AlloyDB including complex SQL constructs and DDL generation.
- Exposure to Apache Airflow for scheduling jobs Strong knowledge of Big data Architecture (HDFS), Cluster installation, configuration, monitoring, cluster security, cluster resources management, maintenance, and performance tuning Create detailed designs and POCs to enable new workloads and technical capabilities on the Platform.
- Work with the platform and infrastructure engineers to implement these capabilities in production.
- Manage workloads and enable workload optimization including managing resource allocation and scheduling across multiple tenants to fulfill SLAs.
- Participate in planning activities, Data Science and perform activities to increase platform skills
- KEY Requirements
- Minimum 8 years of experience in ETL/ELT Technologies, preferably Spark, Hadoop, Databricks
- Minimum of 6 years hands-on experience with Big Data technologies e.g. Hadoop, Spark, Hive.
- Minimum 3+ years of experience on Spark Minimum of 3+ years of experience in Cloud Technologies (Preferably in Google Cloud Platform)
- Hands on experience with Databricks.
- Minimum 6 years of experience in Cloud environments, preferably AWS
- Minimum of 4 years working in a Big Data service delivery (or equivalent) roles focusing on the following disciplines: Big Data (Hadoop ecosystems/distributions e.g. Cloudera 5.14 or 5.15, Databricks)
- Any experience with NoSQL and Graph databases
- Exposure to role and attribute based access controls Exposure to BI tools like Tableau, PowerBI, Looker, etc.,
- Hands on experience with managing solutions deployed in the Cloud, preferably on AWS Experience working in a Global company, working in a DevOps model is a plus
All Dun & Bradstreet job postings can be found at https://www.dnb.com/about-us/careers-and-people/joblistings.html and https://jobs.lever.co/dnb. Official communication from Dun & Bradstreet will come from an email address ending in @dnb.com.
Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever. Your use of this page is subject to Lever's Privacy Notice and Cookie Policy, which governs the processing of visitor data on this platform.
