Healthcare and Life SciencesGlobal healthcare and life sciences organisation (North America)
Data platform and ETL modernisation
Challenge
Needed analytics that unify research, supply chain, manufacturing and commercial data. Legacy Informatica pipelines were expensive and could not scale.
What we did
Designed a Databricks lakehouse with PySpark and Delta Lake.
Migrated enterprise ETL pipelines from Informatica to Spark.
Built a cloud data platform with Azure Data Factory, ADLS Gen2 and Azure Synapse.
Technologies
DatabricksPySparkDelta LakeAzure Data FactoryADLS Gen2Azure SynapseInformatica (source)
Outcomes
Faster analytics, and duplicate data removed.
Lower ETL licence cost and better scalability.
A standard ingestion framework.
Three successive engagements with the same client.
