COMPANY DESCRIPTION
About the Company
JERA Global Markets (JERAGM) is a leading utility-backed seaborne energy trader specialising in LNG, coal and freight. A joint venture between majority shareholder JERA Co., Inc. and EDF Trading, JERAGM's shareholders are among the world's major utilities.
JERAGM operates one of the largest energy portfolios in the world which gives it an in-depth understanding of the way local, regional and international energy markets behave. Its in-depth knowledge and market insights enable us to capture trading opportunities, optimise portfolios, create value and enhance security of supply for our customers.
Headquartered in Singapore, JERAGM has a global talent pool of close to 300 people across offices located in four strategic locations: Singapore, Japan (Tokyo), the UK (London) and the US (Baltimore).
JERAGM is strongly capitalised with over US$500 million in paid up capital and a total equity of US$4 billion. JERAGM has retained its A+ Stable rating from R&I, attributable to a robust business model and solid financial base.
DESIGNATION : Senior Data Engineer, SG
RESPONSIBILITIES
Position Description:
The Senior Data Engineer (L2 Squad Lead) is a software development role within the Data Team in the JERAGM IT Department.
The L2 squad is responsible for platform administration, operational support, small change and release management. Larger, more complex changes are delivered by an L3 squad and project teams.
JERAGM is investing in Data and Analytics to enable a data driven approach to commercial decision making, risk management and operations. As part of this, the Data Team is delivering a modern data platform using Azure services and Databricks. The team is delivering capabilities across the business, including:
A central warehouse of trade, valuation, and risk data
A central hub for sharing market fundamentals for commodity markets
Pipelines for scraping, ingesting and analysing internal, public and licensed data
Processes and tools for data governance and discovery
A reporting tool for EOD P&L Attribution
Analytics and visualisation tailored to JERAGM business user needs
The role will be part of a highly qualified team, primarily based in Singapore. The team operates an agile delivery framework in a fast-paced trading environment following DevOps principles and practices. The team believe in the mantra of acting fast, failing fast and learning fast. Every team member is hands-on and team members are encouraged to work closely with each other and end users. Everyone in the team is highly engaged and we continually share our thoughts and ideas in daily stand ups and weekly system design meetings. At the same time as collaborating as a team, we encourage our engineers to plan and execute their own work so they can work autonomously and take ownership.
The role will cover the following areas:
Lead Engineer in L2 Squad (40%):
Lead a team of 2-4 Data Engineers.
Collaborate with the Data Engineering Manager, Lead BA, and Data Project Manager on backlog grooming and sprint planning.
Clearly define the goals and purposes in each JIRA for the L2 squad.
Conduct code reviews for the L2 and L3 squads in every sprint.
Coordinate with the data team and cross-functional teams for planning and to meet delivery timelines.
Provide regular updates to the Data Engineering Manager and escalate issues as needed.
Conduct weekly 1:1 catch-ups with Data Engineers.
Assist the Data Engineering Manager in hiring new Data Engineers and provide feedback on performance.
Identify process gaps, suggest improvements, and work with the team to implement them.
Build team culture where calculated risks are safe to take and learning from mistakes is encouraged.
Release Management and Support activity (30%):
Assist the team with Production code deployment and data platform support.
Act as a gatekeeper Production following JERAGM's change management process.
Support production data pipelines and reports.
Provide detailed analysis of data issues in Production with a quick turnaround time.
On occasion, provide support for applications in Public Holidays and in weekend releases.
Compile and present monthly Ops reports.
Help the Data Engineering Manager by sharing evidence based on data-driven analysis.
Set up security for end users when required.
Assist in setting up test environments and running pipelines in test for the Data team or other IT teams.
Data Engineering (30%):
Design and deliver data solutions using an agile, iterative approach based on Scrum.
Develop high quality data pipelines using Spark, Python, SQL and Azure services.
Collaborate with the Data Engineering Manager on technical architecture and design.
Analyse and estimate IT changes, providing input on technical opportunities, constraints, and trade-offs.
Create documentation and present to both technical and non-technical audiences.
Handover 1st line support to the JERAGM IT Ops teams and 2nd/3rd line support to the L2 squad.
Conduct detailed testing for development activities and demonstrate results according to the delivery methodology and coding standards.
Create complex charts and reports using Python libraries, Databricks, and Power BI.
QUALIFICATIONS
Experience Required:
More than 5 years experience in a similar role covering:
Technologies:
Extensive cloud experience in Azure and expertise in modern cloud-based data architectures.
Advanced coding experience in Python and SQL.
Good to have experience in Databricks or equivalent experience in Spark.
Advanced knowledge of Databricks e.g. Unity Catalog, Delta Live Tables, Platform administration, know internal of Databricks e.g. Optimize, Vacuum, Z-order etc.
In-depth knowledge of Azure services, including VNET, Key Vaults, Azure Data Factory, ADLS Gen2, Virtual Machines, App Services, Storage Accounts, and Azure Active Directory.
Experience orchestrating data pipelines using Azure Data Factory or Airflow.
Knowledge of Python packages such as Pandas, Numpy, and Seaborn.
Strong understanding of Big Data, MapReduce, Spark, and file formats like Parquet, Avro, and ORC.
Familiarity with reporting tools such as Power BI or Tableau.
Support:
Experience in a support role with experience using JIRA or similar tools to track issues and manage them through a small team.
Experience managing releases under a change control process.
Experience of communicating with users and other stakeholders.
Software engineering and delivery
Source code management e.g. Azure DevOps, Git
Agile delivery methodologies such as SCRUM or Kanban
OTHER INFORMATION
Person Specification:
Highly organized and methodical, with strong attention to detail
Adaptable, able to multi-task and work independently or in various team settings.
Confident and effective communicator, comfortable contributing in meetings and talking to users.
Strong academic background with a degree, equivalent professional qualification, or relevant experience.
Analytical, flexible, and curious, open to diverse opinions and new ideas.
Collaborative, Agile, trustworthy, and takes ownership with a getting things done attitude.
