Data Transformation Developer

Data Transformation Developer

Job Title: Data Transformation Developer
Contract Type: Contract
Location: Milan, Italy
Salary: €480 - €520 per day
Start Date: ASAP
Reference: EA00DTD_1546429559
Contact Name: Ellie Atkinson
Contact Email:
Job Published: January 02, 2019 11:45

Job Description

My client based in Milan require Data Transformation Developers with various levels of experience. You will join a migration project to migrate data from relational databases using Python and SQL.

Key tasks and responsibilities:
* Hands-on database queries with SQL
* Develop data transformations involving data-type conversions, joins, filters, translations, aggregation, de-/normalisation of large sets of data using both SQL and PySpark
* Develop code pipelines to transform and manipulate data, aggregating them and computing new variables through mathematical computations
* Collaborate the development of a custom built-in solution for data transformation process management interacting with Foundry REST API

Skills Required:
* Knowledge/working experience of Hadoop eco system (HDFS, Hive, Impala) as well as specific file format (Avro/Parquet)
solid skills in PySpark programming language
* Programming language and code developing experience
* Solid skills of SQL language
* Previous experience on Foundry platform (Magritte syncs, Compass transformations, Health checks module) is a very strong plus

Lawrence Harvey is acting as an Employment Business in regards to this position.
Visit our website and follow us on Twitter for all live vacancies @lawharveyjobs