Big Data Expert
Warszawa Big Data Expert
Warszawa
NR REF.: 1116850
Hays IT Contracting is an up-to-date B2B form of employment for IT specialists with innovate and developmental projects for TOP Clients close at hand. For our Client we are currently looking for qualified Candidates for the position of Big Data Expert
Location: Warsaw
Job type: contract B2B
Length: long-term cooperation
Rate: up to 1000 PLN net per day
Requirements:
Tasks:
Warszawa
NR REF.: 1116850
Hays IT Contracting is an up-to-date B2B form of employment for IT specialists with innovate and developmental projects for TOP Clients close at hand. For our Client we are currently looking for qualified Candidates for the position of Big Data Expert
Location: Warsaw
Job type: contract B2B
Length: long-term cooperation
Rate: up to 1000 PLN net per day
Requirements:
- Bachelor, Master or PhD degree in Business Informatics, Computer Science, Mathematics, Industrial Engineering, Physics, Statistics or equivalent education
- At least 8 years of relevant work experience
- Experience and expertise in designing and managing big data environments (e.g. Hadoop), evaluating and configuring components (e.g. Spark, DB), customizing and developing algorithms for customer solutions
- Hands-on experience with Big Data ecosystem in Hadoop, Map/Reduce, Yarn, Apache Spark, Kafka, Nimble, Storm as well as basic knowledge of one of the programming languages, e.g. Python, Java, R, Scala, Javascript
- Knowledge of agile methods for all steps (design, architecture, development, testing, application)
- Basic knowledge of mathematics and statistical methods is required
- Experience in two of the following methods is desirable: clustering, classification, modeling, regression, text analysis, pattern recognition, neural networks
- Basic understanding of machine learning principles and methods and knowledge of privacy and security challenges and solutions in IoT and data analytics, e.g. privacy by design, anonymization, privacy preserving storage
- Experience in two of the following application areas is required: IoT analytics, time series analytics, social media analytics, site data analytics, safety data analytics, customer data analytics, signal processing, anomaly detection
Tasks:
- Develop suitable product enhancements and roadmaps with product management to drive the IoT data analytics architecture strategy forward
- Design, build, and integrate data from various resources into datamarts & warehouses
- Build large scale data processing pipelines in the context of top data analytics projects
- Use automated software frameworks for data acquisition, validation, blending and modeling to make sure data is accessible and cleaned for further analysis
- Define big data architecture (ingest, store, analyze, visualize etc.) and specify technical requirements on product design
- Optimizing performance of big data systems and researching how Spark, Kafka, Hadoop (HDFS, Hive), Flink, Cassandra and other distributed systems can work together at scale
- You come up with entirely new ideas to build world class data integration systems one step ahead of the industry
- Support in designing efficient and robust ETL workflows (extract, transform, load) on large datasets and creating big data warehouses that can be used for reporting or analysis by Data Scientists.
Prosimy o aplikowanie poprzez przycisk znajdujący się po prawej stronie ogłoszenia.
