Design, create, modify extract, transform, load (ETL) pipelines in Azure Data Factory ensuring efficient data flow from source to destination.
Ensure data accuracy and data integrity throughout the ETL processes via data validation, cleansing, deduplication, and error handling to ensure reliable and usable data being ingested.
Monitor the ETL processes and optimize ETL pipelines for speed and efficiency, addressing bottlenecks, and ensuring the ETL system can handle the volume, velocity, and variety of data.
Participate in data modeling, designing of the data structures and schema in the data warehouse to optimize query performance and align with business needs.
Work closely with Business controlling, data engineers and IT teams to understand data requirements and deliver the data infrastructure that supports business goals.
Provide technical support for ETL systems, troubleshooting issues and ensuring the continuous availability and reliability of data flows.
Ensure proper documentation of data sources, ETL processes and data architecture.
Requirements:
3-5 years of database experience in an enterprise production environment
Working experience on Azure cloud and with Azure Data Factory is a must, and Oracle cloud would be a plus
Demonstrable proficiency in PL/SQL to write SQL scripts
Experience in data injection, cleansing and data modelling
Hands on Database administration skills on Oracle and PostgreSQL would be a plus
Good analytical and troubleshooting skills
Curious, proactive, self-motivated and able to work in a dynamic environment
