A leading Australian bank is seeking a skilled Lead Engineer - Big Data to support and enhance its big data platform. This role is designed for a motivated data engineering professional who excels in building and managing robust, future-ready data solutions within the financial sector.
Key Responsibilities:
* Design, develop, test, and support data solutions across batch and near real-time pipelines.
* Produce detailed solution designs and act as a technical lead, supporting data engineers and testers.
* Demonstrate expertise in data architectures, big data, data modeling, analytics, cloud platforms, and data governance.
* Lead proof-of-concept and demo sessions for innovative data solutions.
* Collaborate closely with internal and external consultants on consulting and delivery engagements.
* Mentor junior team members in data engineering practices and project delivery.
What You Need to Succeed:
* Minimum 5 years’ experience in solution design, development, or tech leadership within IT consulting, ideally in banking or financial services.
* At least 3 years’ hands-on experience with Big Data/Data Lake technologies in cloud and on-premise settings.
* Expertise with NoSQL databases (e.g., HBase) and distributed streaming platforms (e.g., Apache Kafka).
* Proficiency in data modeling concepts, ETL, data warehousing, and BI solutions.
* Strong coding skills in Scala, Python, SQL, and shell scripting.
* Hands-on experience with cloud platforms such as Azure, AWS, or GCP.
* Solid understanding of containerization, virtualization, infrastructure, and networking.
#scr-hannah-macleod
At Randstad Digital, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.