Data Engineer
WroclawData Engineer
Wroclaw
NR REF.: 1147139
Hays IT Contracting matches IT Contractors with the best employers. Our passion lies in helping people develop their professional careers in IT sector - quite simply, we power the world of work.
For our Client we are currently looking for qualified Candidates for the position of:
Data Engineer
Location: Wroclaw (remote)
Job type: contract B2B
Length: long term cooperation
Responsibilities:
Requirements:
Our offer:
Wroclaw
NR REF.: 1147139
Hays IT Contracting matches IT Contractors with the best employers. Our passion lies in helping people develop their professional careers in IT sector - quite simply, we power the world of work.
For our Client we are currently looking for qualified Candidates for the position of:
Data Engineer
Location: Wroclaw (remote)
Job type: contract B2B
Length: long term cooperation
Responsibilities:
- Build and run Azure based Data Platform
- Handle multiple Terabytes of different domains data with focus on IoT data using Stream and Batch processing
- Craft and maintain world-class, high traffic analytical applications and services with a team of experienced data engineers and scientists
- Develop data models and process raw data at scale to make it available for analysis
- Build scalable data pipelines using state-of-the-art technologies in the Microsoft Azure Cloud
- Implement, run and deploy algorithms in cooperation with data scientists using the Hadoop ecosystem (e.g. Spark, Hive, HDFS) and the Microsoft Azure Stack
Requirements:
- Certification University degree in Computer Science or related fields of study (Mathematics, Physics)
- 3-5 Years of experience architecting and building Data Lake, Azure Big Data architecture, Enterprise Analytics Solutions, and optimizing 'big data' data pipelines, architectures and data sets.
- Advanced hands-on SQL, TSQL, Python, pySpark, Hive, HDFS (2+ of these) knowledge and experience working with relational databases for data querying and retrieval.
- Experience with Design and Architecture of Azure big data frameworks Azure Data Lake, Azure Data Factory, Azure Databricks, Azure ML, SQL Data Warehouse, HDInsights, Stream Analytics - or their Open Source counterparts: Kafka, Spark, Blob Storages. Experience with Design and Architecture of relational SQL and NoSQL databases
- Knowledge of DevOps Processes (including CI/CD) and infrastructure as a code fundamentals
- Profound knowledge of Data Quality issues and methods of dealing with them
- Fluent in English, German language will be considered as a plus
Our offer:
- Competitive rate
- Variety of international projects to participate in development
- Being a part of an international team in a non-corporate environment
- Possibility to work with new technologies
- Private medical care
- Multisport card
Prosimy o aplikowanie poprzez przycisk znajdujący się po prawej stronie ogłoszenia.