Data Streaming Pipeline & Warehouse PoC for an Australian Mutual Bank

The Opportunity

An Australian Mutual Bank (like many Mutual banks) had restricted access to their core banking data, this resulted in high touch and high-cost reporting for both internal and external requirements, a restricted view of ‘the customer’ and delayed reporting.

This created delays in decision-making and impeded risk management.

Our Approach

As a Proof of Concept (PoC), Sida4 (as 4impact) developed a cloud-based data streaming pipeline using Apache Kafka delivered on Confluents (fully managed) cloud-based management platform.

The pipeline ingested the extracted core data, then normalised, cleansed and formatted before inserting into a data warehouse. 
The PoC demonstrated that the solution could be executed in scalable and repeatable manner, fully capable of managing production data when required.

Project Outcomes

Demonstration of how (closed) core banking data can be extracted, normalised and formatted was a key requirement of the PoC.

Once the (PII Obfuscated) data was at hand, the PoC moved into the implementation of a cloud-based Data Warehousing solution combined with Data visualisation and reporting Dashboards.

Key Services, Technologies and Toolkits

Details are contained in the full Case Study, download below.