Data Engineer (Healthcare Data)

About Pangaea Data

Pangaea Data (Pangaea) is a South San Francisco and London based business founded by Dr Vibhor Gupta and Prof Yike Guo (Director Data Science Institute at Imperial College London; Provost, Hong Kong University of Science and Technology). They have worked in medicine and computing for over 20 years and have raised over $300 million through their academic research, including a $110 million grant focused on development work on large language models in medicine. Pangaea’s AI platform, PALLUX, is configured on clinical guidelines to find more untreated (undiagnosed, miscoded, at-risk) and under-treated patients with hard-to-diagnose conditions for screening and treatment at the point of care. Pangaea’s advisors include industry veterans from healthcare and the life sciences, including Lord David Prior (former chairman, NHS England) and Mr. Andy Palmer (former CIO, Novartis).

The Role

As Data Engineer (Healthcare Data), you will join Pangaea’s team to lead and support the development of reliable, scalable, and secure data solutions. The ideal candidate will be experienced with healthcare data standards (e.g. FHIR, OMOP), possess a strong understanding of data privacy regulations (e.g., HIPAA, GDPR), and have technical expertise to design and implement data pipelines, storage systems, and integrations.  

This role will continue to evolve as the business grows, but in the short term it will also involve development of the software product and collaboration with the clinical and scientific team. A strong software engineering background and knowledge in AI, especially Machine Learning and Natural Language Processing, is essential. For the right candidate, this is a senior technical position with scope to grow into a leadership role.

Key technical responsibilities will include:

• Design, implement, and maintain ETL pipelines to collect, clean, and transform healthcare data from various sources such as EHR systems, APIs, and databases
• Ensure data quality and integrity through robust testing and validation processes
• Optimize storage solutions for structured and unstructured healthcare data using databases (e.g., MongoDB) and cloud-based data warehouses (e.g., Azure Cosmos, Azure Fabric)
• Maintain strict compliance with data privacy regulations such as HIPAA, GDPR, and other local healthcare policies
• Work closely with the clinical team to understand data requirements and translate them into technical solutions
• Collaborate with the AI team to provide clean, well-structured datasets for research, and AI/ML models
• Stay up-to-date with the latest data engineering technologies and best practices

Mandatory Requirements

Technical skills:

• A university qualification (Bachelors, Masters, Doctorate) with at least two years of university study in Computer Science, Informatics, Data Science, Engineering, or related
• Experience in data engineering, with a focus on healthcare data preferred
• Familiarity with NoSQL databases (e.g., MongoDB) and relational databases (e.g., PostgreSQL, MySQL)
• 5+ years in Python and SQL work
• Knowledge of ETL tools (e.g., Apache Airflow) and cloud platforms (e.g., AWS, Azure, GCP).
• Understand data modelling concepts and best practices. Experience with healthcare data standards (e.g., HL7, FHIR, ICD, SNOMED, DICOM) preferred
• Excellent problem-solving and communication skills

Personal traits:

• Ability to communicate complex ideas effectively, both verbally and written
• Ability to engage all levels of the company and the customers’ organizations
• Ability to work collaboratively in a team environment

Nice to Have

• 3-5 years experience of managing teams
• Experience working on large-scale, commercial software development projects is a plus
• Experience with research communities and/or efforts, including having published papers (being listed as author) at AI/ML/NLP/CV conferences (e.g. Bio-IT, NeuraIPS, ICML, ICLR, ACL, CVPR and KDD) and journals
• Experience and knowledge of deploying AI and Data solutions for healthcare and pharmaceuticals at scale is desirable

Perks and Benefits

• Flexible working hours
• Salary dependent on experience
• Package of attractive benefits including private medical insurance and monthly travel card
• You will join a dedicated highly renowned team offering you the opportunity to grow and develop your professional skills and profile
• You will have the opportunity to learn about building a startup business from experienced professionals and serial entrepreneurs

Application Contact Information

Your application should include a CV and cover letter highlighting your relevant experiences and motivations. Please send this to careers@pangaeadata.ai

General Information

Pangaea Data is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristics protected by local laws, regulations, or ordinances.