DevOps Big data engineer - Banking

Empiric Solutions
550.00 GBP Daily
01 Dec 2016
09 Dec 2016
Contract Type
Full Time

DevOps engineer, Big data, continuous integration, Java, python, DevOps, jenkins

I have a great new opportunity for a DevOps engineer with a good understanding of Big data. My client is working on a large big data program and looking to bolster there resources to work on a number of projects as helping to drive a DevOps environment with the big data area.

Key responsibilities:

  • Responsible for managing the data science technology stack
  • Available to help with quality control of Spark code written by data scientists
  • Available to trouble-shoot Spark jobs running on the Analytical environment

Key skills:

  • Expert in YARN, Spark.
  • Excellent knowledge on Hadoop administration
  • Good knowledge of data formats (Parquet, Avro)
  • Good knowledge of Java and Python, Scala(desired)
  • Knowledge installing/administrating notebooks (Jupyter)
  • Knowledge of DevOps automation tool (puppet/chef)
  • Excellent knowledge on CI (maven, Nexus, Jenkins)

For more information please apply now.