Data Engineer

Hays · Gold Coast · Full time
KEY POINTS WE FOUND
  • Build data pipelines and structures to migrate data from legacy SQL databases into Snowflake.
  • Develop ETL/ELT processes, data models and enterprise data warehouse structures, with a focus on data quality, reconciliation and performance.
  • Work hands-on with internal teams and third-party vendors to contribute to the strategy and delivery of a large-scale data platform transformation.

Looking for Data Engineer - Gold Coast based - Coolangatta

About the Role:
Project Description: Data Platform / Snowflake Transformation - Requirement

  • The organisation is currently undertaking a large-scale data platform transformation, working alongside a third-party implementation/vendor partner.
  • They are looking to bring in experienced contract resources to supplement the vendor team and internal capability, particularly around the technical strategy and delivery of the new data environment.
  • The initial requirement is likely to be around four roles, although two are immediate priorities.
  • They are looking for people who can start within the next 2-3 weeks.
  • Initial contracts will be for 6 months, with the potential for the right individuals to move into permanent positions longer term.
  • The vendor is ready to commence, so these resources are needed quickly to work alongside the vendor and help shape and execute the data strategy.
  • Key experience required:
    • Strong experience delivering large-scale data platform / data transformation programs.
    • Proven experience migrating legacy SQL databases into a modern Enterprise Data Warehouse (EDW) environment.
    • Strong Snowflake experience, with Snowflake sitting at the centre of the target data architecture.
    • Experience designing and/or delivering data ingestion pipelines.
    • Experience with cloud-hosted data solutions, ideally across Azure or AWS.
    • Comfortable working closely with third-party vendors/consultancies, internal stakeholders and technical teams.
    • They need senior, hands-on people rather than junior resources. Someone who can come in, understand the environment quickly and contribute to both the strategy and delivery rather than needing significant direction.

Data Engineer skill requirement:
The Data Engineer builds the pipelines and data structures that move data from the legacy environment into Snowflake and make it usable.

  • Extracting data from legacy SQL databases
  • Designing and building ingestion pipelines
  • ETL/ELT development
  • Transforming and loading data into Snowflake
  • SQL development
  • Data modelling and EDW structures
  • Data quality and reconciliation
  • Pipeline orchestration
  • Performance optimisation
  • Potentially tools such as DBT, Azure Data Factory, Databricks, Airflow or Snowflake-native tooling, depending on their chosen architecture

What you need to do now:
If you're interested in this role, click 'APPLY NOW' to forward an up-to-date copy of your CV, or call now (Himanshu Gupta - +61 (07) 3243 3014 / Himanshu.Gupta@Hays.com.au
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

Stay Safe While Job Hunting

We vet all employer accounts and do our best to keep job ads safe, but scams can still occur. Be cautious when sharing personal information — never provide financial details or make payments during the application process. For extra security, use the Apply button on our site when proceeding.

Skills

0 of 23 matched
Apache airflowAwsAzure data factoryData ingestion pipelinesData migrationData modellingData platform transformationData qualityData reconciliationDatabricksDbtEltEnterprise data warehousingEtlIndependent workingMicrosoft azurePerformance optimisationPipeline orchestrationSnowflakeSqlStakeholder collaborationTechnical strategyVendor collaboration