Data Engineer with PySpark

As an Data Engineer, you will help clients transform their business, mostly driven by digital opportunities and technology. In a typical program, you are working at the intersection of business and technology with a sound understanding of the business drivers and the capabilities of IT and how these can contribute to run an organization better or different.

You will be working in a fast-paced Agile environment and expected to facilitate, guide, and influence the clients and teams towards right information technology architecture and becoming interface between Business leadership, Tech leadership and the delivery teams. You would be expected to complex design and high performance architecture in AWS and Big Data technologies

Essential Skills (Mandatory Skills)

Strong experience in the following areas.

• Big Data tools/technologies: Python, PySpark, Apache Spark and other data processing technologies
• AWS Cloud tools/technologies: S3, EMR, EC2, Lambda.
• Experience in any Big Data Orchestration/Scheduling tool like Airflow,

Nice to Have Skills.

• Good to have experience in any CICD tool like Jenkins, CircleCI and exposure to Github/Bitbucket.
• Experience in any DWH-on-Cloud solution like Redshift, Snowflake etc.
• Experience in developing cloud native application (API based) would be good to have
• Excellent communication and interpersonal skills
• Good experience in working in Agile with Agile mind-set and innovative

Qualifications:

• Engineer degree or relevant degree.