Original text
Rate this translation
Your feedback will be used to help improve Google Translate

Cookie Consent

By clicking “Accept Cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage and assist in our marketing efforts. More info

case studies

GeneralPublished on: Fri Feb 10 2023

Resolved the Data storage issue & upgraded the ETL process from Manual to Automatic

About the Company

Our client is a U.S.-based financial Services firm. The company is a FinTech firm redefining the relationship between asset managers and their back office. Our client is dedicated to excelling in settlements, clearances, record maintenance, regulatory compliance, accounting, and IT services & administration.

Challenges:

The Client was facing data storage errors due to the absence of a properly normalized database. Moreover, the data is calculated with the help of a python code script.

Solutions:

Hexaview Technologies and our Client have been in business contact for a long time. Both organizations share a strong bond of trust. The performance of our client grew once Hexaview's solutions were deployed, making it clear how much effort we put into finding a solution. Due to a lack of a properly normalized database, the Client was experiencing data storage issues. Furthermore, a Python script is used to calculate the data.

Hexaview created a highly scalable data pipeline and fetched data from various sources using AWS (Amazon Web Services) Lamba. We used AWS Glue for performing ETL tasks and updated the data in PostgreSQL. We resolved all the scalability issues of the Client by using event-based architecture. Moreover, our Solution enables the Client to get automatic data updation, perform ETL work, and put data in SQL tables for immediate consumption in a brief time.

Tech Stack

Python, Pyspark, Pandas, Jenkins, Postgresql, Paramiko, AWS glue, AWS lambda, AWS EC2, AWS S3, AWS eventbridge, AWS Cloudwatch, AWS RDS.

Key Results

Our Solution resolved scalability issues and improved data availability at the client end. The entire ETL process is automated, thereby reducing the turnaround time.

Key Benefits:

·        Improved Scalability

·        Increased Data Availability

·        Faster Data Extraction

·        Provided Data Backup

·        Timely fulfillment of client needs

·        Consolidated Data View