Data Engineer

  • Brisbane
  • Randstad
Randstad are currently working with a large Queensland Government Department to find a Data Engineer for an initial contract until 13/12/2024 with potential of extension past this point. This role is based in Brisbane CBD with WFH flexibility.Role Overview:The Data Engineer will be required to source, integrate, and make data available for use by business intelligence analysts, data scientists and other data users. The role requires significant experience in cloud-based technologies which enable the design, build and delivery of an enterprise-wide data consumption model. Working with a team of business and data analysts, and system and policy subject matter experts, the Data Engineer will enhance and optimise existing anomaly detection data models, leveraging Machine Learning, to meet future business requirements. The Data Engineer will work closely with a Business Intelligence Analyst to identify and bridge data intelligence gaps that must be addressed for the requirements to be met in full.Key Responsibilities:• Develop and implement data solutions which ingest, integrate and make data available in cloud- based technologies.• Analysis of existing on premise data assets including their transformation and use.• Design, build and deliver data marts for enterprise wide use, which provide strong quality and security controls.• Cloud platform migration from existing On-premise data warehouse to AWS including establishing effective ingestion patterns, applying security controls and ensuring solutions facilitate the development of data marts, artificial intelligence and machine learning solutions.• Potentially migrate existing data assets to AWS S3 Data Lake, Matillion and Snowflake.• Repoint migrated solutions to existing Tableau and PowerBI solutions.• Source data from databases and warehouses for ingestion into AWS.• Build optimised data pipelines and automated data marts which are scalable enterprise wide in Redshift, Glue, Snowflake and Matillion.• Develop and deliver test scripts and government data security controls which ensure data integrity and quality.• Optimise business critical requirements and curate data models which meet business needs and deliver organisational change.• Extract and combine data from various heterogeneous data sources to enhance and optimise data consumption models.If interested, please hit "APPLY" or email your CV over to At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.skillsCloud, Business Intelligence, Data migration, AWS, AWS S3 Data Lake, Matillion, Snowflake, Redshift, GluequalificationsAny relevant qualifications desired.educationSecondary School/High School