Senior IT Developer

Developer hired for this position will be working in our Data Engineering team on Data Quality capabilities for analyzing and reporting the quality of ingested data. These capabilities enable Data Owners to automate their Data Quality Management.

Data Quality capabilities consist of:

• development of tooling which allows setting up automated measurements that will support analysis of the data quality
• ingestion of data quality results (including metadata) in a common format
• reporting foundation that is used to create automated Data Quality Reporting
• Key responsibilities include:
• Support and develop Data Quality Spark application used to measure quality of ingested data
• Building new Data Quality Reporting foundation
• Work closely with DevOps, QA and Product Management teams in a Continuous Delivery environment

• Experience in Scala and Spark
• Knowledge of:
  o Hadoop stack: YARN, Oozie, Hive
  o SQL and RDBMS
• Hands on development experience with Jenkins or Bamboo, JIRA, Bitbucket and Git
• Ideally you also have:
• Experience in: Kubernetes and Docker
  o Processing Big Data in cloud (AWS, Snowflake)
• Excellent communication skills and experience of distributed global teams
• Data driven thinking capabilities
• Experience in using Agile methods