Data Engineer

Contract Term: 6 Months

Contracting Authority: DWP

Location: Leeds, Manchester, Blackpool, Newcastle and Sheffield (Hybrid working)

The Department for Work and Pensions (DWP) is responsible for welfare, pensions, and child maintenance policy. As the UK's biggest public service department, it administers the State Pension and a range of working age, disability and ill health benefits to around 20 million claimants and customers. As such, we operate on a scale that is almost unmatched anywhere in Europe and most people in Britain come into contact with us at some point in their lives.

Working with DWP, you will be helping us to drive our priorities to:

• Run an effective welfare system that enables people to achieve financial independence by providing assistance and guidance into employment
• Increase saving for, and security in later life
• Create a fair and affordable welfare system which improves the life chances of children
• Deliver outstanding services to our customers and claimants
• Deliver efficiently: transform the way we deliver our services to reduce costs and increase productivity

As a Data Engineer your main responsibilities will be:

• Translate business requirements to ensure they are clear and robust and can be transformed into reusable production ready code and / or effective data models.
• Define version control mechanisms and strategies for the source code of products.
• Support Quality Assurance colleagues and Data Managers responsible for the day-to-day testing and live running of data products and services.
• Shape solutions in a fit for purpose way; following the agreed principles and contribute to the overall Data Engineer Development lifecycle.
• Perform data profiling and quality measurements.
• Designing and developing reusable metadata libraries.
  

Owning the stability of new products designed, including the on-going robustness, resilience and stability of these products.

Identifying, managing and resolving issues preventing the delivery or continuous development of products; and

• Supporting the growth of the team, by keeping abreast of market and industry trends, and

You'll have relevant experience in:

• Strong experience of programming languages
• Python
• Pyspark
• SQL (Hive SQL/Spark SQL)
• Bash
• Hue
• GitHub/Lab (*Version Controls),
• Azkaban (or similar scheduling tools)
• CI/CD (*Concourse or similar)
• R-Studio
• Juypter-Lab
• Kafka

If this role sounds like something that you would be interested in, please click the link to apply or get in touch with Rishon Reid