Data Developer / Data Engineer

Full-time Office for National Statistics in Newport

Data Engineer / Data Developer Working pattern - Flexible working, Full-time, (Job share / Part-time options)

Hours - 37 hrs F/T - minimum 32 hrs P/T

Working for the Office for National Statistics means a career where everything you do counts.

The Data Engineering team are responsible for digesting, transforming and developing a range of data. The Data Engineering team ensure all requirements are established in liaison with suppliers and ADR-UK, together with key business areas within the ONS. The team are responsible for developing data specifications, understanding the Data Journey and establishing clear technical requirements needing to be applied to each dataset.

Utilising and exploring the Hadoop ecosystem, you will play a pivotal role in processing datasets using HUE, Cloudera Data Science Workbench and HDFS.

Key Responsibilities: • Implementing and developing standard data validation, structuring and standardisation protocols to deliver and support the Data Engineering strategy, working to help ensure data is used consistently. • To develop, test, and document the end-to-end process for developing ETL data pipelines to ingest and transform data. • Using Data Specifications to develop efficient and re-usable code for the Data Engineering team.

Skills and Experience Essential: The applicant should also be able to demonstrate a strong level of experience with one of the following programming languages: • Python • SQL

Desirable: • SAS • Spark (PySpark or Scala)

Max. 33 MB. Recommended formats: PDF, RTF, DOC, ODT.
or cancel

« Go back to category
Published at 17-05-2019
Viewed: 74 times