Client Overview
IG Group is a global leader in online trading and investments, enabling individuals and institutions to access financial markets with confidence and control. Headquartered in the United Kingdom and operating across multiple international markets, IG offers a comprehensive suite of trading and investing products, including CFDs, spread betting, options, and share dealing, across thousands of financial instruments.
Over the years, IG has built a reputation for trust, transparency, and advanced technology. The company serves 1000+ clients worldwide, empowering them with intuitive platforms, real-time market access, and expert insights. IG Group is committed to helping traders and investors achieve better outcomes through education, powerful tools, and a customer-centric approach—making them a cornerstone in the global fintech and trading ecosystem.
Business Objective
IG Group sought to modernize its data ingestion process on Google Cloud Platform to support the growing demand for secure, efficient, and reusable integration pipelines. Their primary requirement was to lay a foundation for scalable data integration with security and compliance, specifically with respect to Personally Identifiable Information (PII), to enhance operational control and delivery speed.
Challenges Faced by IG Group
Our client IG faced some critical challenges while implementing a robust data ingestion framework:
- Lack of reusable pipelines for varied datasets leads to inefficient duplication of effort.
- On-the-fly PII encryption was required but difficult to implement securely across ingestion points.
- Inconsistent post-integration data integrity checks and lacked automation.
- Slow iteration speed and reliability due to absence of a CI/CD pipeline for deployment.
- No standard error-handling framework, making troubleshooting slow and fragmented.
- Technical issues with configuring VPC Service Controls (VPC SC) for secure connectivity in Application Integration.
How NeosAlpha Helped?
As a Google Application Integration Partner, we collaborated closely with IG Group to evaluate their existing workflows and provide a scalable integration solution.
1. Assessment and Solution Design
First, we analyzed their existing ingestion workflows to identify pain points and architectural constraints. The analysis phase helped our team design a scalable, modular, and secure integration solution tailored to the specific business needs of IG.
2. Resuable and Asynchronous Pipelines
By utilizing Google Application Integration, we built reusable, asynchronous data pipelines. This approach removed fragmented ingestion flows and enabled IG to ingest diverse standards. As a result, it minimized duplication of effort, enhanced maintainability, and reduced setup time for new data sources.
3. On-the-Fly PII Encryption with DLP
To address the key concerns related to security and compliance, we implemented a real-time PII encryption using Google Cloud Data Loss Prevention. This approach allowed IG to protect sensitive data as it moved through ingestion pipelines ensuring GDPR and compliance with internal standards.
4. Standardized Error Handling Framework
Our GCP team introduced a consistent error handling framework that can capture, log and route errors for appropriate handling across the integration ecosystem. This gave IG better visibility into issues and reduced resolution times for operational teams.
5. Secure VPC SC & HTTP Connector Configuration
To address the IG’s security and architecture requirements, we configured secure connectivity using VPC Service Controls and HTTP connectors. This approach of setup ensured that sensitive data is moving securely between GCP environments without breaching the network boundaries.
6. CI/CD Implementation via GitLab
We used GitLab to setup CI/CD pipeline to automate deployment workflows.This enabled version-controlled, repeatable deployments, reduced manual intervention, and allowed IG’s development teams to make changes with greater confidence and speed.
7. Knowledge Transfer and Enablement
To ensure the IG team can manage the ongoing operations and maintenance of the evolving integration framework independently, we also transferred the knowledge and best practices.
Technology Stack
- Google Cloud Platform (GCP)
- Google Cloud Data Loss Prevention (DLP)
- GitLab CI/CD
- VPC Service Controls (VPC SC)
- HTTP Connectors
Results
Our collaboration with IG Group completely transformed its data integration approach and built a future-ready foundation for high-volume data flow.
- Reusable and scalable data pipelines with built-in security and performance.
- Enabled on-the-fly encryption of sensitive data, meeting compliance needs with minimal friction.
- A robust error-handling framework to reduce resolution time and enhance reliability.
- Enhanced secure and compliant connectivity with VPC SC and HTTP connectors.
- Implemented CI/CD automation, reducing deployment cycles and improving developer productivity.
