Lead Data Engineer
12-month contract with possible extension. Location: ACT, NSW, QLD. Must be able to obtain Negative Vetting Level 1.
DFP Recruitment is seeking a Lead Data Engineer for our federal government client.
Key Responsibilities:
* Management of the agency's Azure Databricks platforms
* Data and Analytics pipeline development, design, and solution management
* Data modelling
* Effectively manage competing priorities to deliver project outcomes.
* Automate reconciliations and validations
* Develop and manage a range of stakeholder relationships.
* Contribute to data design and overall data architecture
* Evolving technologies, platforms, and code accordingly
* Build, deploy, and maintain ETL code and pipelines for data ingestion and analysis
* Standardise data extraction queries and establish CI/CD pipelines accordingly
Requirements:
* Demonstrated experience in data engineering preferably using DataBricks
* Proficiency in data warehousing, data modelling, developing data pipelines
* Expertise in SQL and Python with an ability to analyse transactional datasets to troubleshoot and proactively find gaps in requirements, modelling, and source systems