Data Engineer Lead

I'm currently recruiting for a Data Engineering lead to join a client of mine on a remote contract basis. This role will be paying £600 per day inside IR35.

You will work in the Data Engineering and Enablement- Data Science Hub (DaSH) team in the Data operation directorate as a Senior Engineer, developing data pipelines to support data science and visualisation products for a variety of stakeholders, data scientists and engineers.

Essential skills / Knowledge:
* Strong at Python, unit testing (pytest) and pep8 standards.
* Writing robust data pipeline code that can run unattended.
* Pandas data validation, manipulation, merging, joining and at times visualisation.
* Unix environment, server health and management of ongoing running processes.
* Github, git, pull requests, CI and code review.
* Experience of AWS services including Sagemaker Notebooks, Athena, S3 buckets and Jupiter Labs.
* Experience of Azure Data Factory, Data Bricks and Synapse.
* Logging and reporting pragmatically.
* Ability to troubleshoot and solve numerical and technical problems.
* Data engineering experience using Python, SQL, Spark and AWS.

Please apply for further details.

Lawrence Harvey is acting as an Employment Business in regards to this position. Visit our website and follow us on Twitter for all live vacancies (lawharveyjobs)