INTL - Senior Data Engineer

Job Description

A large Utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python, C , .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work independently with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning features to serve trading and analytics needs. The Senior Data Engineer will also collaborate with quantitative analysts, traders, and commercial stakeholders to design new application features, dashboards, and analytics for portfolio management, pricing, and risk analysis. Additionally, they will support broader IT initiatives by ensuring compliance with corporate standards, best practices, and robust architectural design. This position will be officially managed by the IT department but will work very closely with the trading team. It requires strong problem-solving skills, a willingness to learn new technologies and markets, and the ability to thrive in a highly collaborative, agile environment. Excellent communication and collaboration skills are essential, along with proven experience in the relevant technologies and processes. This position is 3 days a week onsite in Mayfair, London.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: .

Skills and Requirements

Bachelors degree and 5 - 8 years of relevant experience OR 9-12 years of relevant combination of education and work experience

Strong Python, C , .NET development skills proven ability to write efficient, production-quality code (e.g., data structures, error handling, code optimization).

Proficiency in SQL comfortable designing databases, writing complex queries, and handling performance tuning.

Experience with Databricks (or a comparable Spark environment) ability to build data pipelines, schedule jobs, and create dashboards/notebooks.

Experience with Azure services (Data Factory, Synapse, or similar) and knowledge of cloud-based data solutions.

Familiarity with version control (Git), CI/CD pipelines, and Agile/Scrum methodologies.

Ability to communicate technical topics to non-technical stakeholders.

Demonstrated problem-solving capabilities and willingness to learn new technologies, markets, and business concepts. Exposure to Dash Plotly (or similar Python frameworks like Streamlit) for dashboard creation.

Experience with Machine Learning model development and data science workflows (including frameworks such as scikit-learn, PyTorch, or TensorFlow).

Experience in Quantitative Finance or strong interest in mathematical/financial modeling, derivatives pricing, or algorithmic trading.

Familiarity with ETRM platforms (e.g., OpenLink Endur).

Masters degree in computer science, Engineering, or a related technical field.

Experience building highly scalable data applications in a cloud environment. null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to .