DevOps Big data engineer - Banking

Recruiter
Empiric Solutions
Location
London
Salary
550.00 GBP Daily
Posted
01 Dec 2016
Closes
29 Dec 2016
Contract Type
Contract
Hours
Full Time

DevOps engineer, Big data, continuous integration, Java, python, DevOps, jenkins

I have a great new opportunity for a DevOps engineer with a good understanding of Big data. My client is working on a large big data program and looking to bolster there resources to work on a number of projects as helping to drive a DevOps environment with the big data area.

Key responsibilities:

  • Responsible for managing the data science technology stack
  • Available to help with quality control of Spark code written by data scientists
  • Available to trouble-shoot Spark jobs running on the Analytical environment

Key skills:

  • Expert in YARN, Spark.
  • Excellent knowledge on Hadoop administration
  • Good knowledge of data formats (Parquet, Avro)
  • Good knowledge of Java and Python, Scala(desired)
  • Knowledge installing/administrating notebooks (Jupyter)
  • Knowledge of DevOps automation tool (puppet/chef)
  • Excellent knowledge on CI (maven, Nexus, Jenkins)

For more information please apply now.