#

Big Data Platform Administrator

Devire

Kraków, małopolskie

Devire
Devire to międzynarodowa firma specjalizująca się w usługach rekrutacji, outsourcingu i employer brandingu.
Od ponad 30 lat reprezentujemy wiodących pracodawców na rynku europejskim, prowadząc kompleksowe projekty poszukiwań menedżerów i wyspecjalizowanej kadry, wdrażając najnowsze rozwiązania z obszaru usług IT oraz wspierając w budowaniu wizerunku pracodawcy z wyboru.

Nasze biura zlokalizowane są w Warszawie, Wrocławiu, Poznaniu, Katowicach oraz Monachium, Frankfurcie, Pradze i Hradec Kralove.

Big Data Platform Administrator

Lokalizacja: Kraków

Currently, for our Client – a leading consulting company - we are looking for an candidate for the position of:

Big Data Platform Administrator

 

The Big Data Platform Admin will be responsible for Enterprise Analytics platform administration, stability, performance, enablement of new capabilities, multi-tenant management, and making sure physical implementation matches solution architecture and fulfills solution requirements.

The role holds primary responsibility for supporting solutions on the Cloudera platform built on AWS Virtual Private Cloud. It provides subject matter expertise on Big Data techniques and tools and contributes to the Big Data Reference Architecture. Also assists technical teams with piloting advanced platform capabilities. and with conducting POCs for further innovation and capability roll-out.

The candidate will work closely with the Enterprise Architecture team, Data Science and Analytics teams, and the Big Data Operations/Engineering Leader, within the Cloud and Enterprise Platform Services division of Technology.

Responsibilities include the following:

  • “AWS based Cloudera Big Data Platform” design, system administration, performance optimization, and trouble shooting
  • Deploying and maintaining services such as Cloudera Manager, AWS services, Cloudera Navigator, Ansible Playbook, Cloudera Data Science Workbench, HDFS, SQOOP, Hive, Impala, PIG, Kafka, Kudu, Zookeeper, Spark, Hue, Yarn etc.
  • Independent contributor to manage/maintain/monitor Cloudera hadoop cluster on AWS
  • Capacity planning, and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
  • Adding and removing nodes using cluster monitoring tools like Cloudera Manager
  • Configuring the high availability nodes, and keeping a track of all the running hadoop jobs
  • Develop/review detailed designs for any implementations/pilot’s/POCs to enable new workloads and addition of new technical capabilities
  • Provide full visibility into the health and utilization of the Cloudera based platform through use of real-time dashboards, alerts, and other mechanisms
  • Performing configuration, patching, upgrades of the Cloudera environments, and associated tools
  • Manage workloads and enable workload optimization including managing resource allocation and scheduling to fulfill SLAs
  • Coordinate activities with Cloud Infrastructure and other enabling IT teams and Vendors

Skills/Knowledge Required:

  • Minimum of 5+ years of hands-on experience with Big Data/Hadoop technologies (including Hadoop, Spark, Hive. Robust experience with Cloudera is a plus
  • Minimum of 3+ years of experience in Cloud environments (preferably AWS)
  • Minimum of 3+ years working in a Big Data service delivery (or equivalent) roles focusing on the following disciplines:
    o Big Data Platform Administration
    o Deployment of Big Data Solution Architecture
    o Analytics / Business Intelligence Tools like Tableau, PowerBI, Qlik, etc.,
    o AWS S3 Creating Buckets/Tokens etc.,
    o Big Data/Hadoop ecosystem experience (prefer Cloudera 5.14 or 5.15)
  • Preferred:
    o Experience with NoSQL/Graph databases (ex: Mongo, Couchbase, etc.)
    o Experience with Ingestion/ETL tools (ex: StreamSets, Informatica BDM)
    o Solid security expertise, in particular with Kerberos and Active Directory
    o Hands on experience with managing solutions deployed in the Cloud, preferably on AWS
    o Experience working in a Global company, working in a DevOps model is a plus
    o Experience with Data Cataloging tools such as Alation, Unifi, etc.
    o GDPR and general regulatory compliance experience
    o Cloudera/AWS Certification

We offers:

  • Salary based on B2B contract
  • Long-term employment
  • Working for a leading corporation with a stable market position
  • Possibility to work in an international environment
Devire Devire Devire Devire

Czy chcesz otrzymywać oferty pracy na podobne stanowiska?

Utwórz powiadomienie e-mail
Zapisz mnie

Zapisani kandydaci otrzymują informacje jako pierwsi.

Podziel się ze znajomymi