BDO Automapper

Project description

BDO is a big accountancy firm that operates globally.
They get sent financial data by customers with a wide variety of formats.
Mapping this data to a common format, used for the BDO data pipeline is a time consuming manual press.
The goal of the project is to design a solution that can map any incoming data to the right format so that it can immediately be sent to the data pipeline for processing.

Context

BDO is a big accountancy firm that operates globally.

Results

We have implemented a proof of concept system which implements GPT along with crew ai for the data mapping.
The system consists of multiple containers that are responsible for taking in the data, cleaning the data, creating a mapping and outputting the data in the right format.
An architecture and deployment scripts for deployment in Azure have also been delivered.

About the project group

We have worked on the BDO Automapper for the past 15 with our project group that consists of only 2 members.
We both have a background in software with specialisations in scalable architecture design and data science.