EY AI & Data is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. We implement information-driven strategies, data platforms and advanced data analytics solution systems that help grow, optimize and protect client organizations. We go beyond strategy and provide end to end design, build and implementation of real life data environments and have some of the best architects, project managers, business analysts, data scientists, big data engineers, developers and consultants in the region.
We are seeking a highly skilled and experienced ETL Integration Lead to join our dynamic team. The ideal candidate will have a strong background in data governance, ETL engineering, PySpark, and Alation. As an ETL Integration Lead, you will be responsible for leading the design, development, and implementation of ETL processes and data integration solutions to support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Lead the design, development, and implementation of ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.
- Ensure data quality, integrity, and consistency through robust data governance practices.
- Collaborate with data architects, data scientists, and business stakeholders to understand data requirements and deliver effective data integration solutions.
- Develop and maintain ETL pipelines using PySpark and other relevant technologies.
- Utilize Alation for data cataloging, metadata management, and data lineage tracking.
- Monitor and optimize ETL processes for performance, scalability, and reliability.
- Troubleshoot and resolve data integration issues in a timely manner.
- Mentor and guide junior ETL engineers and provide technical leadership to the team.
- Stay up-to-date with the latest trends and best practices in ETL engineering, data governance, and data integration technologies.
Key Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred.
- Proven experience as an ETL Integration Lead or similar role.
- Strong expertise in ETL engineering and data integration techniques.
- Proficiency in PySpark and experience with other ETL tools and frameworks.
- In-depth knowledge of data governance principles and best practices.
- Experience with Alation or similar data cataloging and metadata management tools.
- Strong SQL skills and experience with relational databases and data warehousing solutions.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
Preferred Qualifications:
- Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud.
- Certification in data governance, ETL engineering, or related areas.
