Data Engineer

Job Req ID:  4062
Posting Date:  25-Jan-2023
Function:  Data & AI

Snowhill, Birmingham, United Kingdom

Salary:  competitive plus benefits

About BT

BT has a key role in British society, fostering change and leading technology innovation. From delivering the Olympics, to supporting the emergency services, to investing more into research than any other UK technology company, we take pride in everything we do - and in the people who work here.
We're now a global company operating at the forefront of the information age, employing 90,000 people in 180 countries. And we're on a mission. Guided by our core values of Personal, Simple and Brilliant our goal is to help customers, communities and businesses overcome barriers and release their potential.
So, if you're interested in the power of potential, why not join us today and release yours? You can read more here about what it's like to work at BT.


About this role

Our ability to deliver brilliant personalised experiences for all of our  28 Petabytes of BT wealth of data and 30m customers is fundamental to our future success. As a business we are investing extensively in the automation of our operations and networks, and in building our base management and data capabilities. This will allow us to take better decisions with data and to act on them in an automated way across all our customer interactions. 
Data driven automation and decision making has never been more important to BT. We’re creating the best personal experiences for our customers to help them stay connected, and that mission is all underpinned by high quality, low latency data. This role will play a critical part in the creation and be part  of BT Digital build data pipelines, data systems and the data products built on top. 
As part of a team of highly skilled data engineers, you will create and maintain our logical data models, integrating data from multiple data sources into a central cloud repository. You will apply data cleansing and data standardisation rules, providing clear documentation of the business rules embedded in the system, with the potential of solving data quality issues through your team. You will work closely with the wider team to understand what the data journey needs to look like and work closely with the Data Architect team, Data scientists and AI team  to develop our products and services. You will write and maintain data engineering user documentation to provide transparency and maintain the knowledge base within the team. 


You'll have the following responsibilities
•    Act as team lead role with some line management
•    Set the standard for data engineering excellence and best-practice
•    Review requirements to define data solutions.
•    Work with enterprise architects to define tooling and platforms based on business requirements.
•    Work with Data Architects and sign off data modelling patterns and standards
•    Work with data governance and architecture teams to ensure architecture conformance for all technical deliveries
•    Ensure architectural security compliance.
•    Collaborate with technical and non-technical stakeholders to understand data requirements as an input to the architecture.
•    Undertake data profiling and source system analysis.
•    Unblock team with technical issues.
•    Build Data Engineering pipelines and solutions.
•    Translate operational data into insights and present back to business stakeholders and colleagues.
•    Define and develop dataops process
You'll have the following skills & experience

•    Deep technical knowledge of complex (and simple) data architectures, covering all aspects (compliance, risk, security) of our requirements
•    Detailed knowledge of the concepts and principles of data engineering
•    Sound awareness of Data Management best practice, including data lifecycle management
•    Extensive skills in SQL, both at production grade and at analytical level, gained through intensive application in a commercial business environment
•    Can deliver complex big data solutions with structured and unstructured data
•    Excellent oral and written communication skills for all levels of an organisation
•    Collaborate to identify how work activities across the teams are related and highlight inefficiencies. You help to remove barriers and find the resources or support needed to improve processes
•    Expert in Cloud Computing patterns, workflows and services; and how they relate to a big data platform.
•    Some experience with data streaming architectures (eg Kafka, Spark)
•    Some experience in implementing observably patterns 
•    Experience/working knowledge of DevOps pipelines for data solutions
•    Knowledge of automated testing tool stack & technologies
•    Experience in data governance & data quality frameworks
•    Knowledge of REST/Graph APIs and how they can be used in a data environment.


Desirable skills & experience

•    Experienced in deploying data solutions and cloud infrastructure via CI/CD pipelines
•    Experienced in deploying Infrastructure as Code (Terraform / Cloudformation etc)
•    Knowledge of Docker/Kubernetes, and how these can be used to simplify deployments.
•    Experience of building large scale data pipelines on at least one Cloud Platform (GCP and AWS preferred)
•    Solid Python data and development experience with major SDK’s / packages.



•    Along with the great development and networking building opportunities you will also enjoy:
•    A target bonus of up to 10%
•    Pension contributions
•    Share save scheme
•    Access to exclusive staff products and savings



Who is the BT Group
We're the leading communications provider with customers in 180 countries. Across the world we enable customer's digital transformations so they can thrive. our focus is simple: be the global provider-of-choice for managed network and IT infrastructure services..