The Data Engineer will play a pivotal role in operationalising the most-urgent data and analytics initiatives and be responsible for the bulk of the building, managing and optimising data pipelines and moving these data pipelines effectively into production for key data and analytics consumers.

The Data Engineer will be responsible for compliance with data governance and data security requirements while creating, improving and operationalising these integrated and reusable data pipelines to enable faster data access, integrated data reuse and vastly improved time-to-solution for the companiess data and analytics initiatives.

This role will require both creative and collaborative working with IT, IT Security and the wider business. It will involve evangelising effective data management practices and promoting better understanding of data and analytics. The data engineer will also be tasked with working with key business stakeholders, IT experts and subject-matter experts to plan and deliver optimal analytics and data science solutions.

Build data pipelines: Manage data pipelines and assist with the implementation of a new semantic layer. These data pipelines need to be created, maintained and optimised as workloads move from development to production for specific use cases. Architecting, creating and maintaining data pipelines will be the primary responsibility of the data engineer.
Drive Automation through effective metadata management: The data engineer will be responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimise manual and error-prone processes and improve productivity. The data engineer will also need to assist with renovating the data management infrastructure to drive automation in data integration and management.
This will include (but not be limited to):

Learning and using modern data preparation, integration and AI-enabled metadata management tools and techniques.
Tracking data consumption patterns and resulting value.
Performing intelligent sampling and caching.
Monitoring schema changes.
Increasing trust in the data.
Recommending or sometimes even automating existing and future integration flows.
Collaborate across departments: The newly hired data engineer will need strong collaboration skills in order to work with varied stakeholders within the organisation. In particular, the data engineer will work with data analysts in refining their data requirements for various data and analytics initiatives and their data consumption requirements.
Educate and train: The data engineer should be curious and knowledgeable about new data initiatives and how to address them. This includes applying their data and/or domain understanding in addressing new data requirements. They will also be responsible for proposing appropriate (and innovative) data ingestion, preparation, integration and operationalisation techniques in optimally addressing these data requirements. The data engineer will be required to train counterparts such as

data analysts, IT and business data consumers in this data pipelining and preparation to make it easier for them to integrate and consume the data they need for their own use cases. The data engineer will also be an advocate of data value and security, assisting with cyber awareness

Participate in ensuring compliance and governance during data use: It will be the responsibility of the data engineer to ensure that the data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives. The data engineer will work with our security officer to assist with identification of data movement or manipulation in the event of a cyber incident. The data engineer will participate in vetting and promoting content created in the business and by data analysts to a curated data catalog for governed reuse.
Become a data and analytics evangelist: The data engineer will be considered a blend of data and analytics “evangelist,” “data guru” and “fixer.” This role will promote the available data and analytics capabilities and expertise to business unit leaders and educate them in leveraging these capabilities in achieving their business goals.

Skills

Advanced analytical skills and attention to detail
Proven ability to quickly learn new applications, processes, and procedures

Strong experience supporting and working with cross-functional teams in a dynamic business environment.
Has good judgment, a sense of urgency and has demonstrated commitment to high standards of ethics, regulatory compliance, customer service and business integrity.
Excellent verbal and written communication skills
Professional image with the ability to form good partner relationships across functions
Strategic, intellectually curious thinker with focus on outcomes
Advanced knowledge of MS Office, SQL, Tableau, Tableau Prep, SSRS, SSIS and MS Visual Studio
Strong experience with various Data Management architectures
Exposure to hybrid deployments: Cloud and On-premise

Experience

Extensive experience in data management disciplines including data integration, modelling, optimisation and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks.

Strong experience working in cross-functional teams and collaborating with business stakeholders in support of a departmental and/or multi-departmental data management and analytics initiatives