Senior Data Engineer
US Remote
Engineering – Data Engineering /
Full time /
Remote
At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle. Visit h1.co to learn more about us.
Data Engineering has teams which are responsible for collecting, curating, normalizing and matching data from hundreds of disparate sources from around the globe. Data sources include scientific publications, clinical trials, conference presentations and claims among others. In addition to developing the necessary data pipelines to keep every piece of information updated in real-time and provide the users with relevant insights, the teams are also building automated, scalable and low-latency systems for the recognition and linking of various types of entities, such as linking researchers and physicians to their scholarly research and clinical trials. As we rapidly expand the markets we serve and the breadth and depth of data we want to collect for our customers, the team must grow and scale to meet that demand.
WHAT YOU'LL DO AT H1
As a Senior Big Data Engineer at H1, you will play a crucial role analyzing vast amounts of data, writing production grade pipelines and infrastructure optimization using PySpark and Hudi. You'll manage projects across all stages including application deployment on a Kubernetes (k8s) based data platform to ensure efficient and scalable management of data-intensive workloads and storage.
You will:
- Be responsible for product features related to data transformations, enrichment, and analytics.
- Work closely with internal stakeholders, gathering requirements, delivering solutions, while effectively communicating progress and tracking tasks to meet project timelines.
- Act as a subject matter expert with our data, navigating challenges with a business analytics mindset, seizing every opportunity to refactor code in the interests of maintainability and reusability.
- You’ll provide L2 support for escalated issues as needed.
- Work with various tools including generative AI and open-source libraries, to standardize data and implement scalable distributed pipelines.
- You’ll develop efficient distributed algorithms for processing and joining large datasets, as well as writing clean, modular code that is easy to maintain.
- Additionally, you will lead the creation of proof of concepts (POCs) and drive projects to production-ready solutions, contributing to internal process improvements and infrastructure scalability.
ABOUT YOU
You possess robust hands-on technical expertise encompassing both conventional and non-conventional ETL methodologies, alongside proficiency in T-SQL and Spark-SQL. Your skill set includes mastery of multiple programming languages such as Python (PySpark), Java, or Scala, as well as adeptness in streaming and other advanced data processing techniques. As a self-starter, you excel in managing projects across all stages, from requirement gathering and design to coding, testing, implementation, and ongoing support. Your proactive approach and diverse skill set make you an invaluable asset in driving innovation and delivering impactful solutions within our dynamic data engineering team.
REQUIREMENTS
-5+ years of experience in working with strong engineering teams and deploying products,
- Strong coding skills in Python (PySpark), Java, Scala or any proficient language of choice and stacks supporting large scale data processing and/or machine learning.
- Experience with Docker/Kubernetes.
- Strong grasp of computer science fundamentals: data structures, algorithmic trade-offs, etc.
- Strong knowledge and understanding of concepts in machine learning is desirable.
- Experience in utilizing LLM models is a plus.
- Should be willing to manage projects through all the stages (requirements, design, coding, testing, implementation, and support).
- Ability to write clean, modular data processing code that is easy to maintain.
- working and maintaining cloud infrastructure with terraform is a plus
Not meeting all the requirements but still feel like you’d be a great fit? Tell us how you can contribute to our team in a cover letter!
COMPENSATION
This role pays $140,000 to $170,000 per year, based on experience, in addition to stock options.
Anticipated role close date: 04/29/2024
H1 OFFERS
- Full suite of health insurance options, in addition to generous paid time off
- Pre-planned company-wide wellness holidays
- Retirement options
- Health & charitable donation stipends
- Impactful Business Resource Groups
- Flexible work hours & the opportunity to work from anywhere
- The opportunity to work with leading biotech and life sciences companies in an innovative industry with a mission to improve healthcare around the globe
H1 is proud to be an equal opportunity employer that celebrates diversity and is committed to creating an inclusive workplace with equal opportunity for all applicants and teammates. Our goal is to recruit the most talented people from a diverse candidate pool regardless of race, color, ancestry, national origin, religion, disability, sex (including pregnancy), age, gender, gender identity, sexual orientation, marital status, veteran status, or any other characteristic protected by law.
H1 is committed to working with and providing access and reasonable accommodation to applicants with mental and/or physical disabilities. If you require an accommodation, please reach out to your recruiter once you've begun the interview process. All requests for accommodations are treated discreetly and confidentially, as practical and permitted by law.
#H1-HF
