Data Engineering Specialist

Why this job matters

The Data Engineering Specialist executes a range of workstreams in building and implementing processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning business needs into the data that supports the BT Group's data strategies.

What you’ll be doing

Data Engineering: building robust data solutions across a hybrid architecture; managing and scaling data pipelines from internal and external data sources to support new product launches and drive data quality across data products.   
Data Quality: Ensuring data quality and integrity through automated testing and validation.   
Observability: Designing and implementing observability solutions to monitor data pipelines, platforms, identify issues and optimise performance.   
AI Integration: Collaborating with data scientists to integrate ML models into our data pipelines & platforms. 
Data Governance: Working closely with our Architecture, Engineering and Governance leads to ensure our development practices and platforms support security and data management best practice. 
Visualisation: Driving the adoption of data visualisation & its ability to support data story telling.   
Innovation:Staying up to date with emerging technologies and market trends to support the development of our technical roadmap. 
Coaching and Mentoring: Support the development of our junior engineers, through line management where appropriate. 
Mentors other data engineers, helping to improve the team's abilities by acting as a technical resource.
Champions, continuously develops and shares with team knowledge on emerging trends and changes in data engineering.

The Skills You'll Need

Data Engineering: Strong proficiency in data engineering concepts, tools and technologies. (Tech stack: AWS, GCP & Hadoop), Spark, Python/Scala/Java, SQL, Kafka, cloud native services). Ability to work with very large streaming data sets and perform complex data transformations.   
Data Management: Knowledge of data governance, data quality, and data privacy standards. Familiarity with data warehousing, data lakes, and cloud-based data storage solutions.  
Data Modelling: Ability to design and implement effective data models to support business processes. 
Observability & DevOps: experience in developing and integrating observability tooling 
AI & ML: experience building pipelines support ML models and integrating AI solutions.  
Domain expertise: relating to BT Networks products, not limited to Wi-Fi standards, device management, industry measures & regulatory obligations.
Inclusive leadership: Leverages diverse and inclusive thinking to maximise the effectiveness and success of teams, policies, practices, and products.
 
Experience you’d be expected to have: 
 
Proven ability and experience to develop and support data solutions at scale [MANDATORY] 
Strong understanding of cloud platforms (AWS or GCP) [MANDATORY] 
Drive to push forward engineering standards and want to be hands on. [MANDATORY] 
Proven experience of DevOps practices and tools [MANDATORY] 
Understanding of observability tools and concepts [MANDATORY]
Knowledge of data governance and best practices for data security and privacy [MANDATORY] 
Stakeholder engagement [MANDATORY] 
Experience bringing ML solutions to production & in life support and maintenance including model drift [PREFERRED] 
 

Our leadership standards

Looking in:
Leading inclusively and Safely
I inspire and build trust through self-awareness, honesty and integrity.
Owning outcomes
I take the right decisions that benefit the broader organisation.

Looking out:
Delivering for the customer
I execute brilliantly on clear priorities that add value to our customers and the wider business.
Commercially savvy
I demonstrate strong commercial focus, bringing an external perspective to decision-making.

Looking to the future:
Growth mindset
I experiment and identify opportunities for growth for both myself and the organisation.
Building for the future
I build diverse future-ready teams where all individuals can be at their best.