BigData DevOps Engineer

Driven by regulatory demand, our client, a top tier investment bank has to establish Global Operational Continuity in Resolution (OCIR) framework across the existing fragmented local solutions, harmonizing taxonomy, processes and procedures and increasing transparency on dependencies and risks in order to ensure and support going concern during resolution or stress situation.

Objective of our project is to provide a global analytics and MI solution using approved data sources, standardize and improve data quality. This global solution has to allow flexible configuration of regulatory rules to enable decommissioning of local fragmented solutions as well as flexible data models, business rules, documentation standards to ensure that capabilities and solutions are scalable, transparent and facilitate:

• Restructuring - timely execution of a bank's recovery and resolution plan
• Reacting to ad-hoc regulatory requests or rules changes
• Adaptation to a long-term roadmap

• Responsible for infrastructure management for the team (DEV, QA, UAT and PROD environments)
• Develop Python or Bash scripts to automate deployment process
• Deploying configurations and application in each environment
• Debug critical problems on production environment with minimal turnaround time
• Responsible for in-house monitoring and maintenance of software
• Run DEV, QA, UAT and PROD data pipelines
• Ingesting data in HDFS using Sqoop, lftp
• Creating and scheduling tasks using Airflow
• Setting up Kerberized cluster
• Perform common SCM practices such as branching, tagging and code merge
• Managing and reviewing HDFS log files
• Resolving issues in Cluster performance, SPARK and HIVE jobs

• Minimum 5 years of experience in a similar role
• Linux knowledge, bash scripting
• Knowledge of Python and automation tools like Ansible or Salt
• 2+ years of hands on experience with Apache Hadoop Ecosystem (Cloudera)
• Docker, git, svn
• Good interpersonal skills, able communicator and team player, highly autonomous
• Clear written communication skills when documenting processes and features and communicating via e-mail
• Outstanding problem solving skills
• Comfortable working in an Agile environment

• Able to develop, monitor, debug and maintain a CI/CD pipeline that feeds into a production deployment, plus one or more staging and testing environments
• Experience with Apache AirFlow, Postgresql, Saltstack, Kerberos, Solr is a plus
• Experience with Microsoft Azure or GCP is a plus
• Experience with CI/CD pipelines for Java applications is a plus
• Any of Tomcat, Nginx, MongoDB would be advantageous
• Financial Services experience is a plus

• Competitive salary
• Luxoft Training Center
• Access to e-learning Library
• Individual development plans
• Long-term cooperation with possibility to gain experience in different projects and technologies
• A significant number of professional communities (Agile Community, Tech Community, Business Analysis Community, etc.)

• Group Life Insurance
• Private healthcare insurance – LuxMed. Unlimited access to specialist consultations with Dental Care included
• Medical costs reimbursement for employees (up to certain amount per quarter)
• Travel Insurance
• Benefit Program - Cafeteria and Multisport Card

• Various communities (sport, recreation activities, trips, board games, cultural and educational activities)
• Discounts program for employees – BeLux (banking offer, car leasing offer and cafeteria program discount)
• Convenient locations in a modern offices with game rooms
• Multinational projects for clients all over the world