Data Systems Engineer

Recruiter
Worldpay
Location
London
Salary
Competitive
Posted
13 Apr 2018
Closes
22 Apr 2018
Sectors
Engineering
Contract Type
Permanent
Hours
Full Time

Why is our Data Transformation team the next step for you?

Worldpay is one of the largest global payments (Fintech) businesses in the world that has put data at the centre of the business by creating a new Data Transformation team that spans business and technology. The Enterprise Data Platform (EDP) is an innovative use of "Big Data" technologies to provide powerful analytic capabilities for Worldpay. For this, we currently use two Hadoop clusters in a HA and DR configuration with an expansion plan to many hundred nodes; based on the Hortonworks Data Platform. Your key responsibility will be to ensure that the Hadoop platform at the heart of this initiative is secure, available, performant and fit for purpose.

This is a great opportunity to expand your existing skills in the Hortonworks Data Platform and the related tools in an innovative and passionate environment.

How will you add value on a day-to-day basis?

You'll be a leading the Hadoop development operation and administration of the Enterprise Data Platform Clusters while working in collaboration with other team members. It would include maintenance of a mission critical HA and DR solution. You will be involved in the end-to-end performance tuning of Hadoop clusters and Hadoop Map/Reduce routines against very large data sets. Also monitoring and managing Hadoop cluster performance and capacity planning. You will be implementing and managing additional nodes on the Hadoop cluster including its connectivity and security within a highly secure environment (Knox, Ranger, Kerberos, Active Directory, TLS, SPNEGO).

What will make you the ideal candidate?

Historically coming from a strong unix or database administration background and having moved in to Big Data is what is we are looking in you. You will be experienced on Hadoop administration with supporting multi-terabyte Hadoop Infrastructure and associated Apache project. Your skills will include but not limited to Hadoop, HDFS, Hive, Oozie, Spark, Kafka. You will have a strong experience in Linux, including, command line editors, scripting (shell, Python, Perl, etc.). Any Solr knowledge and experience would be great.

How is Worldpay changing the world?

We are leaders in modern money. Each and every time you use your debit card or credit card to pay for something, whether online or face-to-face, there's a good chance it happened because of us. On an annual basis our innovations, systems and technology enable billions of money transactions globally. Working with customers large and small, we help them to take your payments quickly, safely and reliably, allowing them to grow their businesses and making your life more convenient in the process. As a leader in global fintech and the largest London IPO since 2011, this is a great time to join us in building for the next phase of the Worldpay journey.

More searches like this