DevOps Big data engineer - Banking
DevOps engineer, Big data, continuous integration, Java, python, DevOps, jenkins
I have a great new opportunity for a DevOps engineer with a good understanding of Big data. My client is working on a large big data program and looking to bolster there resources to work on a number of projects as helping to drive a DevOps environment with the big data area.
- Responsible for managing the data science technology stack
- Available to help with quality control of Spark code written by data scientists
- Available to trouble-shoot Spark jobs running on the Analytical environment
- Expert in YARN, Spark.
- Excellent knowledge on Hadoop administration
- Good knowledge of data formats (Parquet, Avro)
- Good knowledge of Java and Python, Scala(desired)
- Knowledge installing/administrating notebooks (Jupyter)
- Knowledge of DevOps automation tool (puppet/chef)
- Excellent knowledge on CI (maven, Nexus, Jenkins)
For more information please apply now.