Big Data Engineer

Big Data Engineer

Job Title: Big Data Engineer
Contract Type: Permanent
Location: Glasgow, Scotland
Salary: £60000 - £100000 per annum + bonus, pension, medical
Reference: 001_1533801425
Contact Name: Sophie Rigney
Contact Email:
Job Published: August 09, 2018 08:57

Job Description

Big Data Engineer required for a fast growing, forward thinking, global Digital Business.

Our client is a Fortune 500 company that is experiencing rapid growth and requires a Big Data Engineer for it's Big Data service line which is part of the Digital Business/Artificial Intelligence and Analytics business unit. You will be part of one of the quickest growing and revenue generating service lines within the organisation.

As a Big Data Engineer, you will be integral member of the team helping to identify, develop and implement practical solutions and deliver use cases for a market leading, global brand.

Using your experience of building data pipelines, you will work collaboratively within a team on the clients site implementing and supporting the Agile practices of the Development team.

For this role we are looking for a Big Data Engineer with the following essential skills and qualifications:

*Good knowledge of Spark and Scala
*Good implementation experience in AWS/Azure/GCP cloud platforms
*Good experience with Big Data and Data Integration
*Unix Shell Scripting
*Flexibility to travel
*Batch and streamed data flows in and out of Data Platforms
*Skills in data modelling (both structured and unstructured) data
*Skills in data acquisition (ingestion and metadata)
*Experience building and operating scalable infrastructure software or distributed systems
*Demonstrable track record as an owner: someone who can take a concept and make it real.
*A thirst for knowledge and continuous improvement.

Desirable skills and qualifications that our client is looking for:

*Experience in Agile/SCRUM enterprise-scale software development
*Familiar with building secure software using modern security principles
*Demonstrated ability to achieve stretch goals in a highly innovative and fast paced environment
*Data management and analytics
*Generation of data catalogues/models to user communities (e.g. ERWIN)
*Knowledge of Cloudera platform: HDFS, Hbase, Hive, Impala.
*Python Programming
*Skills in data manipulation: Lambda, Solr etc

If you want to be part of a innovative, market leading, fast tech 25 company the please click apply

Lawrence Harvey is acting as an employment agency in regards to this position.
Visit our website and follow us on Twitter for all live vacancies @lawharveyjobs