
Data Engineer
Permanent @Garniche Jobs UK posted 2 weeks ago in IT ShortlistJob Detail
-
Job ID 338200
Job Description
Data Engineer
£40k – £50k
Haywards Heath / Hybrid
Benefits:
3% pension contribution
25 days annual leave and 8 bank holidays
Apprenticeship Schemes
Pension contributions
Annual basic eye examination and £100 off the cost of lenses and frames
Cycle2Work scheme
Salary sacrifice program
Full catalogue of iHasco training courses covering professional, mental health, and wellbeing as well as first aid and fire safety training.
Benefithub (vouchers for entertainment, shpping and travel and money saving schemes)
Dolly Parton's Imagination Library (Free Childrens Books – for the kids not the applicant!)
Help@hand. Unum is our Life Assurance partner. They provide a range of services such as remote GP's, mental health support, physiotherapy, second medical opinions as well as life, money and well being support. (Travel maybe required)
The Data Engineer will be responsible for leading on our core Data Warehousing project, defining, developing, and maintaining a data warehouse from the ground up. They will be key in supporting the strategic direction of the business, providing eyes on data, and developing scalable data architecture.
They will work closely with all departments across the business in identifying gaps and providing data solutions.
This role will report into the IT DevOps Manager.
PRINCIPAL RESPONSIBILITIES
Responsible for designing, building, and implementing a robust and scalable data warehouse that meets and functions with the Microsoft Azure Platform. This requires defining data models and ensuring data integrity and accuracy and enabling integrations with other platforms.
Automating data pipelines to extract, transform, and load data from various sources into the data warehouse, identifying and implementing appropriate tools such as Microsoft Power Automate, designing, and testing data transformations, and ensuring data quality and consistency.
Having a good understanding of the available data warehousing and data integration tools and be able to make informed decisions on the most suitable tools for each situation, researching, testing, and evaluating new technologies as required.
Ensure the security and safety within the data warehouse and ensuring compliance with all relevant data protection regulations, including GDPR. This will involve implementing appropriate security measures, monitoring data access and usage, and responding to any data security incidents as well as supporting the data protection team as needed.
Creation and maintenance of technical documentation for the data warehouse, including data models, data pipelines, and system configurations. Provide ongoing support and maintenance for the data warehouse, including troubleshooting, and resolving any technical issues.
Ensuring a high-quality level of data in the data warehouse and ensuring that it is free from errors and inconsistencies. Implement data quality checks, monitoring data quality metrics, and resolving any data quality issues that arise.
Building data visualizations using Microsoft PowerBi that effectively communicate insights and trends to employees according to their data needs for analysis and reporting, creating dashboards and reports that are both informative and visually appealing. Supporting the training of employees in empowering them to create and manage their own dashboards and reports.
Maintaining and optimizing the performance of the data warehouse to ensure that it is operating efficiently and effectively. This includes analyzing data usage patterns, identifying bottlenecks, and implementing performance improvements.
Participate in the Disaster Recovery planning and testing process, ensuring that the data warehouse and associated systems are protected in the event of a disaster. Ensure continuity of service by developing and maintaining backup and recovery procedures and testing these procedures regularly.
Working collaboratively with other members of the Group IT team, attending team meetings, and contributing to the development of best practices and standards.
Review and stay up to date with the latest developments in data warehousing and data management, bringing new options and solutions to the table to improve systems.
PERSON SPECIFICATION & KEY SKILLS
The Data Engineer must be able to work closely with business stakeholders, other IT teams and external providers. The person must be technically competent, understand operational workflows and impacts as well as having strong organisational and project management skills.
Strong IT skills, with a high level of accuracy and attention to detail, to ensure data accuracy and reliability.
Hands-on experience with data warehousing and ETL tools and packages, particularly Azure Synapse, to extract, transform and load data into data warehouses.
Comprehensive understanding of ETL technical design, data quality testing, cleansing, and monitoring. They should have experience with data sourcing, exploration, and analysis, as well as data warehousing and data modelling capabilities.
Solid understanding of modern code development practices, including version control, unit testing, and continuous integration.
Hands-on experience with programming languages, particularly Python, and their utilisations with API's and Microservices.
Strong SQL skills to be able to write complex queries and procedures for data extraction and analysis.
Experience with PowerBI desired for producing data visualisations and dashboards for effective data reporting.
Highly passionate about data and insight, with a natural curiosity to explore and analyse data to derive valuable insights.
A logical approach to problem-solving to be able to identify and resolve data-related issues and challenges is essential.
Excellent communication skills, able to author reports when required as well as convey information both written and verbally to colleagues both within and outside the IT Department.
Experience of working within a large, multi-function business environment with complex business processes and requirements.
Experience of working with senior managers, business IT users, internal and external IT specialists, and other stakeholders.
Able to proactively prioritize and manage your tasks, able to adjust on the fly as needed to meet business requirements.
Comfortable and confident at liaising with clients, third parties and staff at all levels. Able to build strong relationships with colleagues in the team and across the business.
INDIT
Planet Recruitment acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. Planet Recruitment is an Equal Opportunities Employer.
By applying for this role your details will be submitted to Planet Recruitment. Our Candidate Privacy Information Statement explains how we will use your information.
Only candidates with the relevant skills and experience will be contacted after application, if you do not hear back from us within 7 days you have unfortunately been unsuccessful in your application.
Please note that no terminology in this advert is intended to discriminate on the grounds of a person's gender, marital status, race, religion, colour, age, disability or sexual orientation. Every candidate will be assessed only in accordance with their merits, qualifications and abilities to perform the duties of the position