Job Title : Senior Big Data Engineer (Business Intelligence)

Industry Sector : Other

Salary :

Location : UK

Job Type : Permanent

Job Description :

Role & Responsibilities

Develop highly scalable, robust, performant and extensible Big Data platforms which enable collection, storage, modelling, and analysis of massive datasets from multiple real time and near real time sources

To ensure the delivery of new projects and any upgrades/enhancements to the key components that make up the Retail BI technology stack do not compromise the security, performance, scalability and robustness of these components, which include:

Oracle, Teradata, SQL Server and Big Query databases, Airflow orchestration frameworks, the analytical/reporting layer that consists of a Hadoop HDFS Cluster with Presto and Hive

Make key technology decisions and help define the strategic direction and platform(s) for BI reporting across the company.

Work closely with the business to work out where the biggest value-creating opportunities lie and then single-mindedly deliver both POC’s and productionised reporting capabilities that fulfil the requirements.

Assist in making technology choices to ensure that we build key skills around central key capabilities within the BI & Reporting team.

Grow and maintain strong business relationships with senior stakeholders and executives.

Respond quickly to key business questions ensuring they have access to information and insight to make commercial decisions (answers now)

Work with the Major Project and wider business teams to deliver large scale projects

Specialist Skills And Experience Requirements

A history of repeatedly driving business value through automated and high quality BI initiatives

Recent exposure and hands on experience with BIG Data and Cloud projects, preferably a migration from on premise Oracle or SQL solution to a Google Platform.

Able to distil complex technical delivery into easy to understand simple deliverables for the business.

Lead and inspiring a team capable of delivering against our data & information vision.

Focus on identifying the business and commercial value in the work we are delivering and driving that value into the business.

Work collaboratively with senior members of the Finance and Product teams to develop appropriate solutions and evolve self-service culture.

Skills

ESSENTIAL:

Linux/Unix Operating Systems, SQL, PL/SQL, Hadoop HDFS, Apache Airflow, Python, Shell Scripting, Oracle, Data Modelling, ETL tools like ODI

DESIRABLE:

SQL Server, SSAS, MDS, Teradata, Cloud Platforms like Google Cloud Platform (GCP) - Data Proc, Big Query, Azure or Amazon S3, Proc C*, Hive and Presto

Experience

Cloud platform technologies such as Google Cloud, Microsoft Azure and Amazon Web Services.

Relational Databases like Oracle, Teradata or similar.

Big Data Analytic frameworks and query tools such as Spark, Hive and Presto.

Good knowledge and awareness of Security, Dev-Ops best practices, networks, back-ups, replication, experiencing of transporting thousands of Terabytes of data between On-Premise to Cloud systems

Deep understanding of cloud computing infrastructure and platforms

Leadership and managing a small team of developers and analysts

Engaging with Senior Management and Executives

Hands on working on Big Data Sets and BI Cloud projects.

High attention to detail and appreciates the importance of data integrity.

Working to tight project timescales

Experience of being a highly motivated self-starter