Connecting...

W1siziisinrozw1lx2fzc2v0cy9syxdyzw5jzs1oyxj2zxkvanbnl2pvyl9kzwzhdwx0x2jhbm5lci5qcgcixv0

Big Data Engineer

Job Title: Big Data Engineer
Contract Type: Contract
Location: Slough
Industry:
Salary: £500.00 - £525.00 per day
Start Date: ASAP
Reference: HQ00061819_1505112924
Contact Name: Neil Metcalf
Contact Email: n.metcalf@lawrenceharvey.com
Job Published: September 11, 2017 07:55

Job Description

Big Data Engineer
My client, a leading Storage as a Service organisation (STaaS), are seeking an experienced Big Data Engineer to join their pioneering Smart Data Centre project and become a leading member of our data engineering team.
You will work hands-on with the team to develop a solution high-volume sensor data processing pipeline based on open source big data technologies, including Hadoop (Hive & Spark), Java, Kafka, Docker, and Python. The ideal Big Data Engineer will have experience of working in environments of up to 10TB of live data.
The ideal Big Data Engineer will have the following:
Mandatory Skills:
Technical Leadership Skills
Hands-on background in Hadoop 2.0+ including Hive and Spark
Java programming
Git / GitHub
Docker
Experience with stream processing (e.g. Kafka, Spark Streaming, Storm, etc.)
Desired Skills:
Python and PySpark programming
AWS or IBM Bluemix experience
Data warehousing experience (ETL, star schema, etc.)
Jenkins
Kafka
Hadoop administration experience, including YARN and HDFS admin.
Nice to Have
Tableau
Postgres
Kubernetes
Hadoop ecosystem technologies such as Ambari, Oozie, Flume, and Sqoop

If you are available for new roles and seeking your next Big Data Engineer job opportunity please send me your updated CV and I will give you a call to discuss the opportunity.


Lawrence Harvey is acting as an Employment Business in regards to this position.
Visit our website www.lawrenceharvey.com and follow us on Twitter for all live vacancies @lawharveyjobs