This role is responsible for the design and implementation of AUSTRAC Application Programming Interface (APIs) or key internal and external interfaces, primarily for the Reporting Entity System Transformation (REST) program. The design and implementation of these APIs are vital to the provision of high throughput as well as being intuitive for internal and external clients to use (e.g. follow best practice for documentation).
This role is also responsible for the coordination of the weekly release process, which delivers changes into the production environments. The Data Engineer will work collaboratively with management and across development teams to assist with the delivery and enhancement of new and existing projects.
The Data Engineer will have the following skills:Degree in Computer Science or equivalent.Excellent development skills in Java and Scala.Extensive experience in building and documenting client-facing interfaces (i.e. APIs) using the Spring Boot framework.Hands-on experience using parallel processing technologies including Apache Spark, Kafka, and the Elastic stack (Kibana, Logstash, Elasticsearch).Experience in choosing & writing efficient processing algorithms.Ability to coordinate a release across a medium-sized team, including release documentation for sign-off.Ability to write complex and optimized queries against both SQL and NoSQL data stores.Previous experience with containerization tools and processes.An understanding of Continuous Delivery techniques and tools (including Jenkins).Knowledge of the methodology used by the DTA. #J-18808-Ljbffr