#

Spark Data Engineer

Hays Poland

Warszawa, mazowieckie

Hays Poland

Spark Data Engineer

Warszawa
Spark Data Engineer
Warszawa
NR REF.: 1158102

Hays IT Contracting is an up-to-date B2B form of employment for IT specialists with innovate and developmental projects for TOP Clients close at hand.

For our Client we are currently looking for qualified Candidates for the position of:

Spark Data Engineer

Location: remote / Warsaw
Branch: fintech / payments company
Job type: B2B (with Hays Poland)
Length: long-term cooperation, first contract for 6 months (onboarding lasts 2-3 months)
Rate: 150-180 PLN/h net for Senior Engineer; 130-150 PLN/h net for Mid Engineer
Start date: ASAP
Working hours: business hours
Remote work: currently – 100% remote, after covid – hybrid model (office in Warsaw)
Methodology: Agile


About the role:

Responsible for development, design and maintenance of event streaming solutions and ETL processes, as well as relational and non-relational databases. Creates stable and reliable systems and management methods to efficiently process, store and access data. Works as consultants for other members in the company to improve processes and deliver efficient access to data. Creates data ingestion jobs as well as prepares data layer for analytical purposes. Experienced with building ETL processes specifically with Spark as well as streaming applications, specifically with Kafka, good knowledge of PySpark and Scala will be an advantage.

Responsibilities:

  • Design stable, reliable and effective databases, ETL processes and event streaming solutions
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Ensure all database programs meet company and performance requirements
  • Research and suggest new database products, services and protocols
  • Modify databases and streaming systems according to specifications and perform tests
  • Performance tuning, optimization and maintenance of data systems
  • Provide data management support to users
  • Solve database usage issues and malfunctions
  • Liaise with other developers to improve applications and establish best practices
  • Gather user requirements and identify new features

Requirements: 

  • Min. 4-5 years of experience in a similar position within a dynamic and fast paced environment
  • Working experience with Spark, Spring Boot 2, Java, Scala or PySpark
  • Working experience with SQL databases and Mongo DB
  • Knowledge of software development and REST API
  • Experience with data pipeline and workflow management tools
  • An ability to understand front-end users requirements and a problem-solving attitude
  • Proven work experience as a Database and ETL developer
  • English B2+

Nice to have:

  • Knowledge of Kafka / Confluent / KSQL
  • Experience with building streaming application

Our offer:

  • Working for a global fintech and payments company
  • Fast recruitment process (only 1 meeting and a fast decision – even the next day)
  • Competitive rate
  • Preferential conditions for benefits: medical and sport package
Prosimy o aplikowanie poprzez przycisk znajdujący się po prawej stronie ogłoszenia.
Hays Poland

Czy chcesz otrzymywać oferty pracy na podobne stanowiska?

Utwórz powiadomienie e-mail
Zapisz mnie

Zapisani kandydaci otrzymują informacje jako pierwsi.

Podziel się ze znajomymi