Big Data Engineer
|Job Title:||Big Data Engineer|
|Salary:||£500.00 - £525.00 per day|
|Contact Name:||Neil Metcalf|
|Job Published:||September 11, 2017 07:55|
My client, a leading Storage as a Service organisation (STaaS), are seeking an experienced Big Data Engineer to join their pioneering Smart Data Centre project and become a leading member of our data engineering team.
You will work hands-on with the team to develop a solution high-volume sensor data processing pipeline based on open source big data technologies, including Hadoop (Hive & Spark), Java, Kafka, Docker, and Python. The ideal Big Data Engineer will have experience of working in environments of up to 10TB of live data.
The ideal Big Data Engineer will have the following:
Technical Leadership Skills
Hands-on background in Hadoop 2.0+ including Hive and Spark
Git / GitHub
Experience with stream processing (e.g. Kafka, Spark Streaming, Storm, etc.)
Python and PySpark programming
AWS or IBM Bluemix experience
Data warehousing experience (ETL, star schema, etc.)
Hadoop administration experience, including YARN and HDFS admin.
Nice to Have
Hadoop ecosystem technologies such as Ambari, Oozie, Flume, and Sqoop
If you are available for new roles and seeking your next Big Data Engineer job opportunity please send me your updated CV and I will give you a call to discuss the opportunity.
Lawrence Harvey is acting as an Employment Business in regards to this position.
Visit our website www.lawrenceharvey.com and follow us on Twitter for all live vacancies @lawharveyjobs
Get similar jobs like these by email
By submitting your details you agree to our T&C's