Big Data Developer

For our klient we are looking for Hadoop/Scala/Big Data Developer.

Project Description: We are building a new customer account reporting engine to (over the coming years) replace our existing legacy customer account reporting solutions across our home markets. A pre-requisite is that we consolidate all account and payment transaction data in the bank to Hadoop, so we have dozens of data formats and integration points both upstream and downstream.

Responsibilities: As an Big Data Developer you will be responsible for a successful design and implementation of a high-performing, flexible, robust, scalable and easily maintainable global reporting solution.

• Knowledge and experience with: Apache Hadoop, Hive, Oozie, Pig, Sqoop, Impala, Kafka
• Experience with NoSQL databases: MongoDB, Cassandra, HBase or similar
• Experience with building ETL/ETL pipelines
• Production experience with performance tuning of Hadoop/Spark solutions
• Familiar with OOD and design patterns
• Experience from large-scale system integration projects
• Working with RDBMS and knowledge of SQL
• Knowledge and experience with web servers such as Tomcat, Jetty or Weblogic
• Knowledge and experience with tools like Maven, Git, and the Atlassian suite (Stash/Bitbucket, Jira, Confluence)
• Hands on experience with Redhat, Linux shell scripting
• Hands-on experience with writing Apache Spark-based applications in Scala
• 3+ years of software development

• Attractive salary
• Stable employment and professional development in an international environment
• Choice of preferred form of employment
• Work for the most recognizable Polish and global brands
• Training and coaching
• Long-term and interesting projects
• Non-wage benefits (e.g. premium private health care package and sports card), good working atmosphere and integration meetings
• Ongoing support from ASTEK Polska's supervison
• Cooperation with specialists in their fields