Data Engineer
We have an exciting Hybrid working opportunity for a Data Engineer to join our clients growing Data team, playing a key role in surfacing data within their fast-growing Finance business on the South Coast
The role
- Responsibility for designing, building, and implementing a robust and scalable data warehouse that meets and functions with the Microsoft Azure Platform. This requires defining data models and ensuring data integrity and accuracy and enabling integrations with other platforms.
- Automating data pipelines to extract, transform, and load data from various sources into the data warehouse, identifying and implementing appropriate tools such as data bricks, designing, and testing data transformations, and ensuring data quality and consistency.
- Having a good understanding of the available data warehousing and data integration tools and be able to make informed decisions on the most suitable tools for each situation, researching, testing, and evaluating new technologies as required.
- Creation and maintenance of technical documentation for the data warehouse, including data models, data pipelines, and system configurations. Provide ongoing support and maintenance for the data warehouse, including troubleshooting, and resolving any technical issues.
- Ensuring a high-quality level of data in the data warehouse and ensuring that it is free from errors and inconsistencies. Implement data quality checks, monitoring data quality metrics, and resolving any data quality issues that arise.
- Building data visualizations using Microsoft PowerBI that effectively communicate insights and trends to employees according to their data needs for analysis and reporting, creating dashboards and reports that are both informative and visually appealing.
- Maintaining and optimising the performance of the data warehouse to ensure that it is operating efficiently and effectively. This includes analysing data usage patterns, identifying bottlenecks, and implementing performance improvements.
- Participating in the Disaster Recovery planning and testing process, ensuring that the data warehouse and associated systems are protected in the event of a disaster. Ensuring continuity of service by developing and maintaining backup and recovery procedures and testing these procedures regularly.
- Writing SQL views and stored procedures
- Database modelling, development and optimisation
Skills:
Strong SQL skills to be able to write complex queries and procedures for data extraction and analysis.Can work closely with business stakeholders, other IT teams and external providers. You must be technically competent and understand operational workflows and impacts.
- Has a can-do attitude and is able to use their initiative to bring about positive change and take initiative in spotting opportunities and finding ways to solve challenges with data.
- Has hands-on experience with data warehousing and ETL tools and packages which integrate with Azure Data Factory.
- Has a comprehensive understanding of ETL technical design, data quality testing, cleansing, and monitoring. You should have experience with data sourcing, exploration, and analysis, as well as data warehousing and data modelling capabilities.
- Has experience with PowerBI for producing data visualisations and dashboards for effective data reporting.
- Thrives on problem solving and is able to suggest solutions.
- Can distil a complex problem into a workable solution and implement it.
- Has gumption and strives to continuously learn and implement new skills and technologies on the fly. Can take an assignment and “run with it”.
Desirables: Previous experience working in the financial industry.
Experience with Azure, especially Azure Data Factory and Azure DevOps or AWS
Previous coding experience
API experience
Working knowledge of Python
Location:
We’re incredibly flexible about where, when and how you work: we don’t want anyone to be prevented from coming to work for Saltus as a result of the working pattern that they’re looking for. Ideally, you’d be able to be based out of our office between Southampton and Portsmouth for a couple of days each week, working the remainder of the week from home. We are passionate about championing flexible working for our people, so if there’s a slightly different working pattern that you’re looking for, then please come and have a chat to us about it!