Senior Data Engineer

Pearson Carter

Senior Data Engineer 

About the Role

We are seeking a Senior Data Engineer / Consultant to lead the delivery of data engineering solutions across client engagements. This is a hands-on, delivery-focused role combining strong technical expertise with consulting and leadership responsibilities.

You will own engineering outcomes, contribute to solution design, mentor team members, and act as a key technical contact for clients.

Key Responsibilities

Data Engineering

  • Design, build, and maintain scalable data pipelines across data lakes, lakehouses, and data warehouses
  • Develop high-quality, well-tested, maintainable code
  • Build and optimise data transformations for analytics and AI/ML use cases
  • Apply data modelling techniques (star and snowflake schemas)
  • Work with Databricks (Delta Live Tables, workflows, notebooks)
  • Troubleshoot and resolve technical issues efficiently

Infrastructure & DevOps

  • Implement and maintain CI/CD pipelines and environment management
  • Use version control systems (Git, Azure DevOps) following best practices
  • Support automated testing, validation, and performance optimisation

Quality & Testing

  • Design and execute unit and integration testing
  • Ensure data accuracy, reliability, and performance standards are met
  • Maintain strong documentation and engineering quality standards

Consulting & Client Engagement

  • Act as the primary engineering contact for client engagements
  • Translate business requirements into technical solutions
  • Communicate progress, risks, and delivery updates clearly
  • Contribute to project estimation, scoping, and planning

Leadership & Mentoring

  • Mentor junior and intermediate engineers
  • Lead peer reviews and uphold engineering standards
  • Contribute to continuous improvement of frameworks, tools, and processes

What You’ll Bring

Experience

  • 6 years in data engineering or a related field
  • Strong hands-on experience with Databricks (Delta Live Tables, workflows, notebooks)
  • Proficiency in Python and SQL
  • Strong understanding of data modelling and Medallion architecture
  • Experience with CI/CD, DevOps practices, and automation
  • Exposure to Microsoft Fabric concepts
  • Experience with data visualisation tools (e.g. Power BI)
  • Experience with testing and data quality frameworks

Nice to Have

  • Databricks certifications (Associate/Professional)
  • Experience with modern cloud-native data platforms

Key Skills & Attributes

  • Strong communication and stakeholder management skills
  • High attention to detail and quality
  • Self-motivated, proactive, and results-driven
  • Ability to manage multiple priorities and deadlines
  • Strong collaboration and interpersonal skills
  • Analytical problem-solving mindset
  • Professional, adaptable, and positive attitude

What Success Looks Like

  • Delivery of scalable, high-quality data solutions
  • Ownership of technical planning and execution
  • Strong client relationships and communication
  • Continuous improvement of engineering practices
  • Active mentorship and team development
 
 
 
Login to apply