Our client is seeking a highly experienced Data Engineer to join their technology team on a permanent basis. The role will play a pivotal part in the business's data transformation initiative. The ideal candidate will possess a can-do attitude, be a team player, and have a passion for making a significant impact.
Key Responsibilities:
* Create and deploy data storage solutions on AWS platforms, including Amazon RDS, Amazon Redshift, and Amazon S3.
* Establish and manage data pipelines for data extraction, transformation, and loading.
* Enhance data systems for improved performance and scalability.
* Work closely with internal analysts and business stakeholders to comprehend their data requirements.
* Monitor and troubleshoot data systems and pipelines.
* Develop and update documentation for data systems and processes.
* Enforce best practices throughout the team to ensure data cleanliness.
* Possess effective communication and collaboration skills to collaborate with cross-functional teams.
* Supervise a support staff member and offer technical leadership and guidance.
* Transition from the current BI tool to either PowerBI or Amazon QuickSight.
Requirements:
* Minimum of five years of experience in data engineering.
* Proficient programming skills, particularly in Python or Java.
* Proficiency in AWS services like AWS Glue, AWS Data Pipeline, Amazon RDS, Amazon Redshift, and Amazon S3.
* Expertise in data warehousing, ETL processes, and data modeling.
* Experience with Databricks.
* Knowledge of big data technologies.
* Experience with database management systems such as MySQL and PostgreSQL.
* Understanding of data modeling and ETL best practices.
* Strong analytical and problem-solving abilities.
* Awareness of data privacy and security best practices.
* Experience in managing a data warehouse or data lake house is essential.
* AWS certifications like AWS Certified Big Data – Specialty or AWS Certified Data Analytics – Specialty or equivalent are required.
Please note, our client cannot sponsor candidates and as such only candidates with no work restrictions will be considered.
#J-18808-Ljbffr