Sr. Data Engineer
|Job Title:||Sr. Data Engineer|
|Location:||Manhattan, New York|
|Salary:||US$170000.00 - US$180000.00 per annum|
|Contact Name:||Tim Tirabassi|
|Job Published:||April 03, 2019 22:40|
We are looking to a Sr. Data Engineer to join one of the largest management consultancies in the world, as they continue to be a market leader within Advanced Technologies. We are building an Advanced Engineering group and the Sr. Data Engineer will play a crucial role in building pipelines, provisioning data, streamlining data and cleaning it to be analysed by ETL work that will allow the analytics group to do real-time analytics on data lakes in the cloud.
We are looking for engineers that have been leveraging cloud technologies such as AWS, and Azure. You will be working in the cloud environment and expected to be well versed in technologies such as EMR, AWS, CLI, S3, Glacier, DynamoDB, Redshift, Redshift Spectrum, or Lambda, or Azure equivalent tools.
PySpark (Spark is fine but PySpark ideal)
Java or Scala
Must Have qualifications:
Top tier consultant firm experience
8-10 years building products and architecting solutions.
Experience advising clients on Data Modernization initiatives. Ability to deal with structured, semi-structured, unstructured and streaming data.
Ability to lead proofs-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialization.
Serve as an expert; envision and integrate emerging data technologies, anticipate new trends to solve complex business and technical problems.
Experience in sales, pre-sales functions, leading pursuits, proposal development, and statement of works.
Ability to work in the United StatesÂ
Experience designing, developing, optimizing and troubleshooting complex data-intensive applications using Spark, HDFS, Kafka, MapReduce, MongoDB and other big data related technologies.
Must know PySpark, Python and SQL; comfortable with Java and/or Scala.
Comfortable designing and implementing data warehouse and pipelinessuch as ETL, data integration, and streamingto support teams focused in Analytics.
Experienced in AWS Cloud Platform. Hands on experience on 3 or more in the following list (EMR, AWS CLI, S3, Glacier, DynamoDB, Redshift, Redshift Spectrum, and Lambda).
Ability to engineer for performance, scalability, latency, & reliability
DevOps and automation experience highly desired
Lawrence Harvey is acting as an employment agency in regards to this position. Visit our website www.lawrenceharvey.com and follow us on Twitter for all live vacancies @lawharveyjobs
Get similar jobs like these by email
By submitting your details you agree to our T&C's
Sr. Manager - Healthcare Data Science Consultant
US$145000.00 - US$185000.00 per annum
US$120000.00 - US$140000.00 per annum
£400 - £500 per day
San Francisco, California
US$120000.00 - US$160000.00 per annum + 10% + extensive benefits