Data Engineer_Azure

India
Commercial Services – Banking, Financial Services, and Insurance Sector /
Full-time /
Remote
We are 3PILLAR GLOBAL
We build breakthrough software products that power digital businesses. We are an innovative product development partner whose solutions drive rapid revenue, market share, and customer growth for industry leaders in Software and SaaS, Media and Publishing, Information Services, and Retail. Our key differentiator is our Product Mindset. Our development teams focus on building for outcomes and all of our team members around the globe are trained on the Product Mindset’s core values – Minimize Time to Value, Solve For Need, and Excel at Change. Our teams apply this mindset to build digital products that are customer-facing and revenue-generating. Our business-minded approach to agile development ensures that we align to client goals from the earliest conceptual stages through market launch and beyond.

In 2024, 3Pillar Global India was named as a “Great Place to Work” for the seventh year in a row based on how our employees feel about our company, collaborative culture, and work/life balance - come join our growing team

Job Description:
Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering!

Minimum Qualification

    • Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
    • Must have experience with the Azure data engineering services
    • ADLS Gen2, ADF, Azure Databricks, Azure SQL DB, Azure Synapse Analytics, Azure Functions etc.
    • Advanced SQL skills and experience with relational databases and database design.
    • Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries
    • Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc.
    • Experience with data visualization tools like PowerBI, Tableau etc. 
    • Proficiencient in data pipeline and workflow management tools e.g. Airflow
    • Experience working with Cloud Data Warehouse solutions like Snowflake, Azure Synapse, Redshift.
    • Good exposure of working on Data Lakes & Data Warehouses solutions
    • Excellent problem-solving, communication, and organizational skills.
    • Proven ability to work independently and with a team.

Additional Experience Desired

    • Experience in developing custom notification system using Azure Communication Services or SendGrid
    • Experience working with data ingestion tools such as Fivetran, stitch, or Matillion.
    • Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
    • Familiarity with machine learning technologies.
    • Experience in Java or Scala