Lead Data Engineer

• Details
• Reference number
• 475805
• Salary
• £56,900 - £69,765
• National: £56,900 - £64,510

London: £62,595 - £69,765 (pro-rata for part-time hours) + This vacancy is being offered on the Government Digital and Data Framework and can include an allowance of up to £10,000 over time depending on skills, qualifications, and experience.

Further details on the framework can be found on https://ddat-capability-framework.service.gov.uk/role/data-engineer#lead-data-engineer

A Civil Service Pension with an employer contribution of 28.97%

GBP

• Job grade
• Grade 7
• Contract type
• Permanent
• Business area
• DESNZ - Integrated Corporate Services - Digital
• Type of role
• Digital
• Information Technology
• Working pattern
• Flexible working, Full-time, Job share, Part-time
• Number of jobs available
• 1
• Contents

• Location
• About the job
• Benefits
• Things you need to know
• Apply and further information

Location

Birmingham, Bristol, Cardiff, Darlington, Edinburgh, London, Salford

About the job

Job summary

The Integrated Corporate Services (ICS) is a shared corporate service. It provides corporate services (HR, Finance, Digital, Commercial, Security and Estates) across the Department for Energy Security & Net Zero (DESNZ) and the Department for Science, Innovation & Technology (DSIT).

Our team of over 400 professionals will be leading the way in how these functions will be delivered in the future. Our ambition is to be the leading provider of integrated corporate services for government and set the standard for quality, efficiency, and innovation in our field.

We offer great working benefits including a world-class pension, flexible working options and a career where your learning and development is taken seriously. We are enormously proud to be a Disability Confident Leader employer. We support candidates with adjustments throughout our recruitment process. Information about disability confidence and just some examples of the adjustments that you can request can be found in the reasonable adjustment section below.

Find Out More

You can also follow our LinkedIn Careers Page: https://www.linkedin.com/showcase/desnz-careers/

Job description

Join ICS Digital, where innovation meets expertise to create digital solutions. We are a cohesive digital community who work in the open, solving problems together and fostering a culture of transparency and collaboration. Our commitment to user-focused design and data-driven decision-making ensures that we deliver accessible services tailored to the needs of our customers.

The Data and Development team is part of the D3 (Data, Delivery and Design) function within ICS Digital. We are a data-driven team that delivers data-focused services and products for colleagues across DESNZ and other government departments or bodies. Our close-knit team brings together Data Engineers, Data Scientists, Data Analysts, Data Transparency Specialists and Software Developers, working collaboratively to deliver insight, innovation and value.

We are looking for a Lead Data Engineer to join the team and own the development of the Data Management System, which provides end to end data ingestion, processing and storage capabilities that are used to provide insights and decision-making inputs that are core to the challenges that face the Departments today. For example, we have recently worked on projects that have enabled grants to be paid out to citizens and businesses as part of the Energy Affordability programme. Additionally, we have provided insights into key Energy Efficiency projects that have been at the heart of key Department delivery commitments.

Visit our blog to learn more about us and our work: https://icsdigital.blog.gov.uk/

To find out more about the Government Digital & Data profession visit: https://dsit.pagetiger.com/bzwfhzv/1

Person specification

• Design, build and evolve secure, data pipelines that reliably support complex operational needs.
• Define and enforce standards for data engineering to ensure solutions are scalable, maintainable and safe to change.
• Provide strong technical leadership to the team, including setting direction, reviewing critical code, mentoring engineers and upholding high engineering standards.
• Build a high performing, motivated team by fostering a culture of learning, experimentation and professionalism, by being an effective, supportive line manager.
• Owning Data Engineering best practice through building a community of practice across the government departments ICS delivers for.

The above responsibilities are not exhaustive, and the post holders may be required to undertake some additional tasks not listed above, within the remit of their grade, to support the team.

As a line manager, you will be responsible for working with your members of staff to define their objectives, as well as managing their development and performance.

Essential Criteria

• Accomplished expert data engineer with experience of producing, maintaining and updating data models which solve business problems and are optimised for data analysis.
• Extensive experience using and managing an Azure based Data Platform with expertise in Azure Databricks, using Pyspark to build data pipelines; and using their experience to continuously improve the codebase and reliability of solutions.
• Experience transforming complex structured and semi-structured data into structures and layers that enable analysis, defining and promoting best practices for creating repeatable, reliable and reusable data solutions that therefore drive impact and value.
• Can listen to and interpret the needs of technical and non-technical stakeholders, manage their expectations and influence outcomes
• Experience of providing technical leadership, guiding and mentoring engineering teams.
• Experience in unit testing, end-to-end testing and quality assurance in a Data Engineering context.
• Analytical and problem-solving capabilities; self-starter willing to pro-actively problem-solve by researching, learning, testing, and deploying new code solutions independently.
• Experience writing code in Python and SQL.

Desirable Criteria

• Knowledge and experience of data modelling, analytical technologies, data visualisation.
• Experience in DevOps practices including Azure CI/CD, YAML pipelines, git and Terraform.

When completing your CV as part of the application please ensure to include the time you have worked for your organisations/employers, and your key objectives in each role.

It is unusual that all candidates will meet all the desirable criteria. If your skills and experience look slightly different from what we have identified and you think you can bring value to the Lead Data Engineer role and the team, we strongly encourage you to apply. We'd love to hear from you!

Behaviours

We'll assess you against these behaviours during the selection process:

• Making Effective Decisions
• Changing and Improving
• Developing Self and Others

We only ask for evidence of these behaviours on your application form:

• Making Effective Decisions

Technical skills

We'll assess you against these technical skills during the selection process:

• Programming and build (data and analytics engineering) (Level: practitioner)
• Data integration design (Level: expert)

Benefits

Alongside your salary of £56,900, Department for Energy Security & Net Zero contributes £16,483 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides .

The Department for Energy Security and Net Zero offers a competitive mix of benefits including:

• A culture of flexible working, such as job sharing, homeworking and compressed hours.
• Automatic enrolment into the Civil Service Pension Scheme, with an employer contribution of 28.97%.
• A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
• An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
• Access to a range of retail, travel and lifestyle employee discounts.

Office attendance

The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.

Things you need to know

Artificial intelligence

Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use.

Selection process details

This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills.

As part of the application process you will be asked to complete behavioural statements, a CV and personal statement. Further details around what this will entail are listed on the application form.

Please use your personal statement (in no more than 750 words) to describe how your past experience relate to the essential criteria outlined in this job description, focusing on your most recent career history.

In the event of a large number of applicants, applications will be sifted on the personal statement only.

The interview will consist of behaviour and technical questions.

The link to the technical/professional competency framework that candidates will be assessed against, for their reference: https://ddat-capability-framework.service.gov.uk/role/data-engineer#lead-data-engineer

Sift and interview dates to be confirmed.

Further Information

Reasonable Adjustment

We are proud to be a disability confident leader and we welcome applications from disabled candidates and candidates with long-term conditions.

Information about the Disability Confident Scheme (DCS) and some examples of adjustments that we offer to disabled candidates and candidates with long-term health conditions during our recruitment process can be found in our DESNZ Candidate Guidance. A DESNZ Plain Text Version of the guidance is also available.

We encourage candidates to discuss their adjustment needs by emailing the job contact which can be found under the contact point for applicants section.

If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.

If successful and transferring from another Government Department a criminal record check may be carried out.

New entrants are expected to join on the minimum of the pay band.

A location based reserve list of successful candidates will be kept for 12 months. Should another role become available within that period you may be offered this position.

Candidates who meet the minimum benchmark may be placed on a Reserve List for consideration for similar roles, including those at a lower grade. Candidates who narrowly miss the benchmark and are not placed on the Reserve List may still be considered for an offer in a similar role at a lower grade.

Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.

Any move to the Department for Energy, Security and Net Zero from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare; for further information visit the Childcare Choices website.

DESNZ does not normally offer full home working (i.e. working at home); but we do offer a variety of flexible working options (including occasionally working from home).

DESNZ cannot offer Visa sponsorship to candidates through this campaign. DESNZ holds a Visa sponsorship licence but this can only be used for certain roles and this campaign does not qualify.

In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service/Disclosure Scotland on your behalf.

However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading.

For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email Info@disclosurescotland.co.uk

Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment.

A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5 year period following a dismissal for carrying out internal fraud against government.

For further information on National Security Vetting please visit the Demystifying Vetting website.

Feedback

Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a basic (or equivalent) criminal record check.

Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .

See our vetting charter .

People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements

This job is broadly open to the following groups:

• UK nationals
• nationals of the Republic of Ireland
• nationals of Commonwealth countries who have the right to work in the UK
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
• individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
• Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Further information on nationality requirements

Working for the Civil Service

The Civil Service Code sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles .

The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria.

The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service Diversity and Inclusion Strategy .

Apply and further information

This vacancy is part of the Great Place to Work for Veterans initiative.

The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window).

Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Contact point for applicants

Job contact :

• Name : People & Development Team
• Email : peopleanddevelopment@ics.gov.uk

Recruitment team

• Email : desnzresourcing.grs@cabinetoffice.gov.uk

Further information

Appointment to the Civil Service is governed by the Civil Service Commission’s Recruitment Principles. If you feel that your application has not been treated in accordance with the recruitment principles, and wish to make a complaint, then you should contact in the first instance DESNZrecruitment.grs@cabinetoffice.gov.uk. If you are not satisfied with the response that you receive, then you can contact the Civil Service Commission. For further information on bringing a complaint to the Civil Service Commission please visit their web pages: Click here to visit Civil Service Commission/Complaints