Cloud Data Engineer | Kaipuhanga Kapua Data

Join an organisation contributing to meaningful outcomes, About Aotearoa, for Aotearoa - data that improves lives today and for generations to come.

About Us | Ko m tou

Stats NZ | Tatauranga Aotearoa is a Central Government employer of 1200+ people across Aotearoa. We provide data and statistics to support the decisions of Government, M ori and Iwi organisations, businesses, NGOs, and New Zealanders. Our work is About Aotearoa, for Aotearoa - data that improves lives today and for generations to come. We welcome every gender, ethnicity, ability, religion, age, and background and encourage all our people to be their authentic selves.

What's in it for you? | Ng hua ka riro ki a koe

We encourage you to go to our careers site to learn more about the Way We Work at Stats NZ and also check out our benefits. We want working for us to work for you!!

Starting salary: $82,988- $110,825 negotiable + superannuation

Other benefits of joining Stats NZ include:

• Balance life and work commitments
• Develop and grow your career (coaching, training, study support, secondments)
• Contribute to meaningful work that makes a difference to all people in Aotearoa
• 3 extra annual leave days (taken during Christmas office closure)
• City based offices that cater to a variety of working styles and needs
• State of the art, 6-star green building in Wellington

The role | Te tunga

As a Cloud Data Engineer, you'll play a pivotal role in architecting, designing, and building cutting-edge data processing systems in a cloud environment with Databricks. This is your opportunity to shape the future of a high-impact data platform, leveraging your expertise while continuously expanding your skills and growing your career.

You'll be at the forefront of modern data engineering, driving the development of CI/CD pipelines, scalable data solutions, and best practices for the entire data ecosystem. Beyond building robust infrastructure, you'll also collaborate with the team to elevate the Data practice and optimize cloud integrations.

This is a permanent position starting in March 2025.

There are several key areas of work that require supporting, including:

• Optimizing Databricks Workloads - Tuning cluster configurations, job execution, and caching strategies to enhance performance and cost efficiency.
• Real-Time & Batch Data Processing - Building scalable ETL/ELT pipelines for streaming and batch data processing using Delta Lake, Apache Spark, and Structured Streaming.
• Core infrastructure: Provisioning and maintaining Azure Databricks workspaces, storage, and compute resources.
• Security & compliance: Implementing role-based access control (RBAC), identity management via AAD, and monitoring compliance.
• Data governance: Enforcing metadata management, data lineage tracking, and data quality standards in coordination with Data Domain owners and Data Governance groups.
• Platform automation: Using Infrastructure-as-Code (IaC) for provisioning and Continuous Integration/Continuous Deployment (CI/CD) pipelines.
• Service monitoring & support: Ensuring availability and performance via Azure Monitor and Databricks service logs.

To be considered for this role you will have:

• Experience with Python, SQL, R, or Spark for data processing.
• Strong knowledge of data architecture principles, ETL pipelines, and data governance frameworks.
• 3 to 5 years' experience in deploying and designing secure data-based systems with skills around computing, networking, databases, developer tools and security.

What you bring | Nou te rourou

We understand transferable skills can come from experience gained from outside of work. We encourage you to be you in your application.

We are committed to diversity, equity, inclusion and lifting our cultural capability. You don't need to be knowledgeable in all these areas already, but you do need to be on board with learning and have a genuine interest and willingness to grow on this journey with us.

Tell us about yourself in your cover letter, what attracted you to this role, and what you would bring to Stats NZ.

How to apply | Me pehea te tuku tono

If this sounds like you, click on the Apply now button to be redirected to the application page on our careers site. The position description is located on the right-hand side of the page.

We will be screening applications as we receive them to move swiftly to interview. You may be asked to complete a pre-interview screen via phone or video. Please let us know in your application if we need to make any specific accommodations during our process.

Please reach out to recruitment@stats.govt.nz if you have any questions.

You must have the right to live and work in Aotearoa New Zealand. Background and various pre-employment checks are part of our recruitment process.

Note to Recruitment Agencies: unsolicited CVs will not be accepted.