Data Engineer

g. Compressed 9-day fortnight. Reports to: Engineering Manager Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications.

Role Summary: The Data engineer role will have a specific focus on data and integration, ensuring that they drive a single version of the truth by developing and maintaining reliable solutions to store and manage key data. The role will source, model, and provide data in a form which is ready for report/dashboard building. They support the data team and participate in the design, development, and maintenance activities for LCCCs databases and data warehouse, as well as ensure following the defined data systems standards that conform to the data architecture.

They will also build and maintain key data governance and management artefacts. , Flow Diagram, Data Dictionary. Identify patterns, anomalies, and structure of data in preparation for Extract Load and Transformation.

Perform data validation, quality checks, and reconciliation across source and target systems. , restorability, traceability, ease to support, etc. Help design and maintain the modern DataWarehouse architecture, implementation, administration, and support Essential: Considerable experience in developing data structures using highly scalable database systems Experience developing, maintaining, and supporting data pipelines and data engineering solutions using Python (preferably PySpark) and SQL.

Experience optimising SQL queries, Python code, and data processing workloads to improve performance, scalability, and reliability.

Requirements

and translate them into effective data engineering solutions. Highly desirable: Experience building and maintaining reliable, scalable ETL/ELT solutions on big data platforms and working with a variety of data infrastructure technologies. g.

Benefits

too.

that may be available depending on the role include: Annual performance based bonus, up to 10% 25 days annual leave, plus eight bank holidays Up to 8% pension contribution Financial support and time off for study relevant to your role, plus a professional membership subscription Employee referral scheme (up to £1500), and colleague recognition scheme Family friendly policies, including enhanced maternity leave and shared parental leave Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service Three paid volunteering days a year Season ticket loan and cycle to work schemes Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers Employee resource groups