Senior Ingestor Big Data Developer

Luxoft is an industry-leading software engineering and solution house for automakers & automotive suppliers. There are millions of cars on the road today with solutions designed & implemented by us focusing on Autonomous Drive, Embedded Applications, Digital Cockpit, Connected Mobility & overall excellence in delivery.

Software inside vehicles used to be a self-contained environment. Equipping cars with perception, intelligence & connecting them changed a lot for the vehicle manufacturer. Our goal is to empower our customers with smart solutions to help them develop the cars of the future.

About the Project:

The Big Data Developer is part of the WW offering build team. (S)He works with respective automotive accounts, Hadoop experts, experienced software developers, data scientists and technology experts to deliver analytic solutions for our customers.

The goal of the program is to solve the 'billion-mile validation challenge' by providing end-to-end features and service for Level 3+ Autonomous Driving software development and validation that can be deployed as a collaboration eco-system accessible to the automotive market worldwide.

• Performance tuning of high data volume ingests into Hadoop ecosystem clusters
• R&D driven feature development around ingest pipeline optimization, filtering, data consistency
• Performance benchmarking on bare metal, hybrid cloud - heavy load, penetration testing
• Develop Airflow central ingest orchestration and ingestor auto deployment
• Define and implement improvements in technologies, infrastructure and software or architecture components
• Design and develop prototypes & proof-of-concept solutions in support of presales activities as well as support the development of standardized analytic offerings across multiple industries
• Establish demos to showcase ingest capabilities for DXC clients and fairs/congresses

• Bachelor or Master degree required in informatics, business informatics, business administration or equivalent qualification
• Minimum 2+ years of experience with Hadoop distributions and innovative technologies in Hadoop ecosystem (e.g. Spark, Hive, HBase)
• Proven experience in all phases of a Big Data project: Concept & design, development, implementation, change and operation
• Advanced know how in Python (3+ years)
• Hands-on experience in CI/CD, Ansible playbooks & deployment automation, Jenkins (2+ years)
• MapR DB/Key value or Hbase project experience
• Monitoring experience, e.g. Kafka
• Strong customer focus, assertiveness and precise method of operation
• Possesses an understanding of architectural dependencies of technologies in the customer's analytic environments
• Able to communicate and present internally and externally in a confident manner
• Highly motivated team player

• Experience in MapR streams
• Job scheduling/orchestration, e.g. Airflow
• Docker, Kubernetes (1+ years hands-on experience)

• Competitive salary
• Luxoft Training Center
• Access to e-learning Library
• Individual development plans
• Long-term cooperation with possibility to gain experience in different projects and technologies
• A significant number of professional communities (Agile Community, Tech Community, Business Analysis Community, etc.)

• Group Life Insurance
• Private healthcare insurance – LuxMed. Unlimited access to specialist consultations with Dental Care included
• Medical costs reimbursement for employees (up to certain amount per quarter)
• Travel Insurance
• Benefit Program - Cafeteria and Multisport Card

• Various communities (sport, recreation activities, trips, board games, cultural and educational activities)
• Discounts program for employees – BeLux (banking offer, car leasing offer and cafeteria program discount)
• Convenient locations in a modern offices with game rooms
• Multinational projects for clients all over the world