Data Engineer (Medical)
Remote, US
Technology – Data Engineering /
Full-time /
Remote
As the leading health-system-affiliated, advanced real-world health data company, CuriMeta is committed to being a trusted partner who invests in, and creates, advanced health data and research solutions intended to close pressing gaps in evidence and insights across a diverse set of diseases.
At CuriMeta, we place people at the center of everything we do. We’re looking for people who are passionate about advancing health data and research solutions to solve urgent scientific and clinical challenges – and improve healthcare for all.
Following our launch in 2022, CuriMeta has continued to grow rapidly and we’re seeking new members to add to our expanding team! Help us build the future of advanced real-world healthcare data today.
The CuriMeta Technology Team is looking for an experienced Data Engineer.
The Data Engineer will grow our technology capabilities by developing data management solutions to support ingest, transformation, export, data transformation and scalable data management for CuriMeta data products. The primary responsibility is to design, construct, deliver, and maintain data pipelines and schemas to address business and technical requirements, leveraging industry and standards-based engineering principles and patterns.
Essential Duties and Responsibilities
- To perform this job successfully, an individual must be able to perform the following satisfactorily; other duties may be assigned. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
- Proven experience in the medical data space, including some combination of medical data models, structured data, terminologies and vocabularies, images, notes and genomics.
- Following defined Technology team agile processes, convert product requirements into technical designs with supporting diagrams, documents and estimates for delivery.
- Author data pipelines to implement ingest, transformation and export of complex clinical data sets.
- Ongoing maintenance of data pipelines to ensure timely processing of data.
- Performance tuning for supported pipeline and data infrastructures.
- Experience with SQL to support database creation and data extraction, including features to ensure referential integrity and performance (statistics, indexes, keys, triggers) as well as a thorough understanding of database information schemas.
- Stay on top of the latest data engineering approaches and technologies to support ongoing Technology team advancements and integrations.
- Support the application of stringent security protocols to support ongoing SOC2 and HITRUST certifications.
Technology Skills
- Languages - Python and related data libraries (Pandas, Numpy, PySpark, Polars).
- Databricks - Medallion Architecture, Notebooks, Workflows, data loading and extraction.
- Orchestration - Apache Airflow with related Operators, Hooks and Triggers.
- Astronomer with Astro CLI and SDK.
- Experience with one or more ETL/ELT platforms.
- RDMBS experience for DDL and DML
- DBMate schema migration tool, or similar.
- Testing data generation tools.
Competencies
- Continuous Learning - Assesses own strengths and weaknesses. Pursues training and development opportunities. Seeks feedback to improve performance. Shares expertise with others. Strives to continuously build knowledge and skills.
- Customer Service - Displays courtesy and sensitivity. Manages difficult or emotional customer situations. Meets commitments. Responds promptly to customer needs. Solicits customer feedback to improve service.
- Planning & Organization - Integrates changes smoothly. Plans for additional resources. Prioritizes and plans work activities. Sets goals and objectives. Uses time efficiently. Works in an organized manner.
- Problem Solving - Develops alternative solutions. Gathers and analyzes information skillfully. Identifies problems in a timely manner. Resolves problems in early stages. Works well in group problem solving situations.
- Teamwork - Balances team and individual responsibilities. Contributes to building a positive team spirit. Exhibits objectivity and openness to others' views. Gives and welcomes feedback. Puts success of team above own interests.
- Use of Technology - Adapts to new technologies. Demonstrates required skills. Keeps technical skills up to date. Troubleshoots technological problems. Uses technology to increase productivity.
Qualifications
- Education/Experience - Bachelor's degree from four-year college or university; two, or more, years related experience and/or training; or equivalent combination of education and experience.
- Language Ability - Read, analyze and interpret business, professional, technical or governmental documents. Write reports, business correspondence and procedure manuals. Effectively present information and respond to questions from managers, customers and the public.
- Mathematical Ability - Add, subtract, multiply and divide in all units of measure, using whole numbers, common fractions and decimals. Compute rate, ratio and percent, and draw and interpret bar graphs.
- Reasoning Ability - Solve practical problems and deal with a variety of concrete variables in situations where only limited standardization exists. Interpret a variety of instructions furnished in written, oral, diagram, or schedule form.
- Computer Skills - Proficient use of computer and software to support the clear documentation of complex technical subjects, including diagramming and presentations. Practical experience with software engineering, Agile software methodologies, and data engineering on cloud infrastructure.
- Certificates and Licenses - Certifications are encouraged • Data Science and Data Engineering , • Azure Cloud certifications
Benefits - Includes but not limited to:
Medical, Dental, and Vision Insurance
Life, Accident, and Disability Insurance
401k
Flexible Spending Account (FSA)
Health Savings Account (HSA)
Paid holidays
Discretionary/Flexible Vacation
Paid sick leave
Employee Assistance Program
CuriMeta is an Equal Opportunity Employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
All applicants must be able to complete pre-employment onboarding requirements (if selected) which may include any/all of the following: criminal background check, drug screen, education, and employment verification.
All applicants must have permanent U.S. work authorization.