Data Engineer

Location: Parramatta, New South Wales
Contract Type: Contract
Specialisation: Technology & Digital
Salary: AU$130000 - AU$140000 per annum + + super
REF: BBBH244320_1601526153

This is an exciting opportunity to join a leading Australian health insurance company on a 12-month fixed term contract. You will play a key role in supporting them on their journey to migrate inhouse data to Azure cloud platform.

We need someone with a strong technical background who can understand the business data assets and build/design a data warehouse and data lake in Azure.

Key areas of responsibility:

  • Designing and deploying an appropriate data architecture for Azure Data Warehouse
  • Building robust data pipelines
  • Enhancing current ETL process
  • Lift and shift data from the inhouse platform to Azure
  • Deploy data governance techniques and Automate APRA report

Required experience & skills:

  • Proven experience working on an Azure migration project and building/designing an Azure Data Warehouse
  • Manage data flowing across platforms
  • Utilise tools like Python, R, Hadoop
  • Designing and developing data pipelines using Azure Data Factory, Azure Data Lake Gen 2, Azure SQL, and Data Brick
  • Big data pre-processing & reporting workflows, including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
  • Expertise in querying languages like SQL
  • Ability to understand DevOps process and can use DevOps tools
  • Excellent communication and stakeholder management skills
  • Power BI (desirable)