About Our Client
Our client is a retail giant in Australia who provides fresh produce, general merchandise, liquor, and fuel to millions of customers.
We are seeking a highly skilled and experienced Data Engineer to join our team.
Job Description
We require a professional with broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.
Key Responsibilities:
* Design, construct, install, test, and maintain highly scalable data management systems.
* Develop and implement data pipelines in Azure Data Factory (ADF).
* Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
* Work closely with data science and engineering teams to provide direct and indirect data-related support.
* Ensure systems meet business requirements and industry practices.
* Integrate up-and-coming data management and software engineering technologies into existing data structures.
* Develop set processes for data mining, data modeling, and data production.
* Research new uses for existing data.
Requirements
The ideal candidate will have:
* Strong experience in data engineering with a strong track record in Azure and PySpark applications.
* Technical Skills: Proficient in designing and maintaining scalable data systems, developing data pipelines with Azure Data Factory, and implementing real-time streaming with Spark.
* Problem-Solving: Excellent analytical and troubleshooting skills, with the ability to optimize data processes and integrate new technologies.
* Collaboration: Proven ability to work effectively with data science and engineering teams to meet data requirements and support business needs.
* Adaptability: Experience with emerging data management technologies and a knack for developing innovative solutions.
* Communication: Strong communication skills to clearly articulate technical concepts and collaborate with cross-functional teams.
What's on Offer
A competitive remuneration package including:
* Flexible Work Arrangements: Enjoy a hybrid work model with the flexibility to work from home and occasional office visits in Melbourne.
* Competitive Rate: Up to $1,100/day incl. super for a 6-month contract.
* Career Development: Opportunity to work on high-impact projects and advance your career in a leading data-centric role.
* Inclusive Culture: A commitment to a diverse and inclusive workplace with ongoing DEI initiatives.
* On-site cafe.
* Fitness club facilities.