Data Engineer
Remote (UK)
Group – IT /
Fixed-term /
Remote
About Avalere Health
Established in 2001, Avalere Health is a purposefully built commercialization partner for the biopharmaceutical, medical technology, and wellness industries.
Our 1,500+ experts combine their knowledge and expertise across our core disciplines — Consulting; Medical; Policy; Value, Evidence, and Access; Marketing; and Digital Experience Technology — to create the connections that make better health happen.
Avalere Health partners with its clients to navigate the complex and rapidly changing healthcare ecosystem. Together, our experts help clients connect patients with life-changing therapies, realizing the potential of strategies and solutions to accelerate innovation that improves lives.
We live and breathe our five values in everything we do: We are authentic. We act with integrity. We value difference. We play for the team. We enjoy the journey. At Avalere Health, we imagine a healthier world and create the connections to make it happen.
About the role
As an Azure Data Engineer, your role involves designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. Your responsibilities will include, but not limited to:
Data Integration
Data Integration and ETL (Extract, Transform, Load):
You’ll develop and implement data integration processes to extract data from diverse sources and load it into data warehouses or data lakes.
Azure Data Factory is a key tool for building efficient ETL pipelines. Your goal is to ensure that data is effectively cleaned, transformed, and loaded.
Your sources will include Rest API from various systems. Being able to onboard data from API's is essential. Use of Postman for testing outside of ADF is a preferred skill.
Data Migration
As an Azure Data Engineer, you’ll handle and analyse large volumes of data using big data technologies such as Azure Databricks and Apache Spark.
Your responsibilities include creating data processing workflows and pipelines to support data analytics, machine learning, and other data-driven applications.
1. In summary, your role revolves around building data processing pipelines, creating analytics solutions, and enabling data-driven decision-making within organizations using Azure cloud tools
2. Keep honing your skills, as the demand for Microsoft Certified Data Engineers continues to grow!
Data Management and Storage:
You’ll work with various data storage options provided by Microsoft Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.
Your task is to design data storage systems that scale, perform efficiently, and meet the organisation’s requirements.
Essential skills
- Proficiency in SQL, SQL Server
- Understand parallel processing and data architecture patterns
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Data Lake Storage
- Ability to design and implement pipelines in ADF.
- Build complex efficient processes for transformation using SQL & ADF Pipelines
- Ensure secure, organised, and reliable data pipelines
- Troubleshoot all data quality issues
- Your core foundation will be data analytics which lead you to becoming a data engineer
Data Migration
- This is your first assignment
- You will use Data Factory, Dedicated and serverless SQL DB's and Syanpse.
- You will pull data from API's & other sources, you will stage and transform this data before loading into the target using API endpoints
- You will analyse all sources to understand the data (with business support)
- You will build processes to validate and highlight exceptions that sit outside any migration rules
- You will successfully load data into target on multiple passes and process any feedback into changes necessary for a successful go live
What we can offer
Avalere Health aims to empower every employee to develop and thrive. We empower our team with the tools, skills, and support needed to think differently and to solve healthcare’s most complex challenges.
At the center of our people-led culture is our Career Experience team, whose mission is to provide every employee with a purpose-driven career. We also pride ourselves on our personalized learning approach to ensure you receive the training you need to help you grow within the company and take advantage of our global scale and scope.
We are committed to embedding diversity and inclusion in every aspect of our organization. We encourage diversity of thought, inclusive behavior, and break down barriers to ensure every individual feels valued and encouraged to contribute their unique abilities and potential. As part of our commitment to building a healthier world, every employee is also encouraged to participate in our community engagement efforts, which support a wide range of healthcare programs and wellbeing causes worldwide.
We have city hubs across North America, Europe, and Asia, geared toward collaborating, training, socializing, and coming together as a global organization while maintaining and fully supporting flexible working practices. Our compensation and benefits package is benchmarked across the industry. We offer a generous company pension/retirement plan, private medical insurance, comprehensive employee wellbeing initiatives, compelling time-off policy, plus many other excellent employee benefits.
We encourage all applicants to read our candidate privacy notice before applying to Avalere Health.
