iRekruter to inteligentna, innowacyjna, w pełni automatyczna platforma rekrutacyjna w fazie projektowania i implementacji i jednocześnie spółka z polskim kapitałem, specjalizująca się w rekrutacji kadr dla branży IT. Naszą misją jest zapewnienie specjalistycznych kadr w zawodach informatycznych.
Data Engineer with Python
Workplace: Warszawa
Nr ref.: SRWO
Responsibilities:
- Design and build data pipelines for modern cloud-based analytics
- Work with big data and complex and large datasets to be presented in a structured way to the business
- Ensure that data format and storage options are the best fit for end-user needs
- Optimize data pipelines performance and security
- Monitor and maintain existing data pipelines
- Run PoC’s to select and maintain relevant data engineering tools
Requirements:
- Eagerness to develop software to address data processing challenges
- Experience with:
o working with Spark/PySpark and NiFi
o development and interest in the extensive use of Python
o data storage or engineering solutions in Azure or another cloud platform
o monitoring and orchestrating data pipelines in a DevOps context
o quantitative analyses and processing large data volumes
o Docker containers
o Kubernetes
o Linux-based applications - Team-oriented, detail-oriented, efficient, and solution-oriented attitude
- Superb analytical and problem-solving skills
- Excellent communication and interpersonal skills
- Flexibility and ability to work independently and in a team
- Good Polish and English skills (written and spoken)
We offer:
- Permanent Contract
- Challenging job in an international and multilingual environment
- Professional development
- Localization: Warsaw/Remote