Senior Data Engineer

Organization:

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer

Location: Bangalore

Business & Team:

The Chief Data and Analytics Office (CDAO) is accountable for leading the Group data agenda by ensuring we build, consume and protect the best data assets to maximize customer experience and rebuild trust. The team is in place to realise a data-driven organisation for Commonwealth Bank Group, solve complex problems around data for the business and activate data for strategic and sustained competitive advantage

Impact & contribution:

Senior Data Engineer is responsible for maintaining and enhancing the analytics capability in the CoE team, which will deliver actionable insights for the COO area. This role will also be supporting the operations framework.

This will mean working closely with our customers, stakeholders and colleagues. As a result, you will be required to forge strong relationships with business stakeholders and other COO teams to drive outcomes

Roles & Responsibilities:

• Possesses hands-on technical experience working in AWS. Individual should be well versed in working with AWS services like: S3, EMR, Athena, Amazon Managed Workflow for Apache Airflow (MWAA).
• Possesses hands-on technical experience working in Ab>Initio, preferably experienced in building data pipelines using PDL, meta-programming, Express>It and Conduct>It.
• Well versed in Unix Shell scripting, Python scripting and PL/SQL.
• Passionate about Cloud/DevOps/Automation and possess a keen interest to solve complex problems in a systematic approach.
• Possess the ability work independently and propose designs/solutions along with collaborating closely with Technology Leads and Architects.
• Exhibit a proactive approach, constantly seeking innovative solutions to complex technical challenges.
• Develop relationships with members of the operations community, as well as other internal stakeholders.
• Demonstrate Group values as part of delivering your responsibilities
• Offer mentorship to junior engineers, contributing effectively both as an individual and as a team member

Essential Skills:

• At least 9 years’ experience in an analytics function
• Experience with AWS services (S3, EMR, Athena, Glue)
• Experience with Ab>Initio product suite.
• Experience with CI/CD tools (Jenkins, GitHub etc)
• Experience in working with schedulers like : Apache Airflow
• Experience automating processes using Python, shell scripting, etc.
• Experience in writing and debugging complex PL/SQLs.
• Experience in working on Big Data Platforms (Hadoop/Hive)
• Experience in implementing large scale self-service enterprise data frameworks highly desirable.
• Exposure to open table format like Iceberg is desirable.
• Experience of working in Agile Methodology

Qualifications: Bachelor’s degree in Engineering in Computer Science/Information Technology