Sr. Data Engineer

Sr. Data Engineer

Job Title: Sr. Data Engineer
Contract Type: Permanent
Location: Manhattan, New York
Salary: US$170000.00 - US$180000.00 per annum
Start Date: ASAP
Reference: HQ00092824_1554327602
Contact Name: Tim Tirabassi
Contact Email:
Job Published: April 03, 2019 22:40

Job Description

We are looking to a Sr. Data Engineer to join one of the largest management consultancies in the world, as they continue to be a market leader within Advanced Technologies. We are building an Advanced Engineering group and the Sr. Data Engineer will play a crucial role in building pipelines, provisioning data, streamlining data and cleaning it to be analysed by ETL work that will allow the analytics group to do real-time analytics on data lakes in the cloud.
We are looking for engineers that have been leveraging cloud technologies such as AWS, and Azure. You will be working in the cloud environment and expected to be well versed in technologies such as EMR, AWS, CLI, S3, Glacier, DynamoDB, Redshift, Redshift Spectrum, or Lambda, or Azure equivalent tools.

Must Haves:
PySpark (Spark is fine but PySpark ideal)
Java or Scala

Must Have qualifications:
Top tier consultant firm experience
8-10 years building products and architecting solutions.
Experience advising clients on Data Modernization initiatives. Ability to deal with structured, semi-structured, unstructured and streaming data.
Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Experience in sales, pre-sales functions, leading pursuits, proposal development, and statement of works.
Ability to work in the United StatesÂ
Technical Requirements:
Experience designing, developing, optimizing and troubleshooting complex data-intensive applications using Spark, HDFS, Kafka, MapReduce, MongoDB and other big data related technologies.
Must know PySpark, Python and SQL; comfortable with Java and/or Scala.
Comfortable designing and implementing data warehouse and pipelinessuch as ETL, data integration, and streamingto support teams focused in Analytics.
Experienced in AWS Cloud Platform. Hands on experience on 3 or more in the following list (EMR, AWS CLI, S3, Glacier, DynamoDB, Redshift, Redshift Spectrum, and Lambda).
Ability to engineer for performance, scalability, latency, & reliability
DevOps and automation experience highly desired

Lawrence Harvey is acting as an employment agency in regards to this position. Visit our website and follow us on Twitter for all live vacancies @lawharveyjobs