Email: Call: West Sector: Technology Job Summary Flexible working arrangementsAward winning businessExcellent package and benefits Job Description Our client is seeking a highly experienced Data Engineer to join their technology team on a permanent basis. The role will play a pivotal part in the business's data transformation initiative. The ideal candidate will possess a can-do attitude, be a team player, and have a passion for making a significant impact.Key responsibilities:Create and deploy data storage solutions on AWS platforms, including Amazon RDS, Amazon Redshift, and Amazon S3Establish and manage data pipelines for data extraction, transformation, and loadingEnhance data systems for improved performance and scalabilityWork closely with internal analysts and business stakeholders to comprehend their data requirementsMonitor and troubleshoot data systems and pipelinesDevelop and update documentation for data systems and processesEnforce best practices throughout the team to ensure data cleanlinessPossess effective communication and collaboration skills to collaborate with cross-functional teamsSupervise a support staff member and offer technical leadership and guidanceTransition from the current BI tool to either PowerBI or Amazon QuickSightRequirements:Minimum of five years of experience in data engineeringProficient programming skills, particularly in Python or JavaProficiency in AWS services like AWS Glue, AWS Data Pipeline, Amazon RDS, Amazon Redshift, and Amazon S3Expertise in data warehousing, ETL processes, and data modelingExperience with DatabricksKnowledge of big data technologiesExperience with database management systems such as MySQL and PostgreSQLUnderstanding of data modeling and ETL best practicesStrong analytical and problem-solving abilitiesAwareness of data privacy and security best practicesPreferred experience in a collaborative, Agile development environmentExperience in managing a data warehouse or data lake house is essentialAWS certifications like AWS Certified Big Data - Specialty or AWS Certified Data Analytics - Specialty or equivalent are requiredPlease note, our client cannot sponsor candidates and as such only candidates with no work restrictions will be considered.All Rights Reserved West Recruitment Pty Ltd