Data & AI Case Studies
Data platforms, LLM pipelines and AI agents we have built and run in production for startups and scale-ups in the US, UK, Europe and beyond. Client names are withheld under NDA.
LLM Supplier Entity-Matching Platform on GCP
Supplier-data integration partner
Technologies
1The Challenge
Supplier and vendor records from many systems had to be matched to a third-party supplier-data platform in real time. Name-based rules gave too many false matches, and runs that took several hours failed with no way to resume.
2Our Solution
Built about 90% of the platform. It started as an AWS build (Amazon MQ, Lambda, MWAA, ECS Fargate, Bedrock, Redshift) and we led its 2026 rebuild on GCP with RabbitMQ, Cloud Composer, GKE and Snowflake. Matching uses three LLMs (Gemini, Claude, GPT) and only accepts a match when they agree.
3Outcomes
Running in production on GCP
Three-model consensus matching reduces false positives from any one model
Incremental checkpointing lets multi-hour runs resume after a failure
Idempotent event handling, 5 containerised stages, CI/CD across 5 services
Config-Driven GCP Data Platform for Music Streaming
Music streaming platform
Technologies
1The Challenge
Every new data source needed custom pipeline code, data quality problems were found too late, and creator-facing analytics were too slow.
2Our Solution
Built a production GCP platform where Airflow DAGs are generated from YAML, so a new source needs config instead of code. Added a custom data-quality framework and moved Creator Studio analytics to ClickHouse.
3Outcomes
New sources onboarded with config, not new code
Sub-second Creator Studio analytics on ClickHouse
Automated data-quality checks before data reaches consumers
Slack alerts on Airflow failures
Snowflake Data Platform & PostgreSQL CDC
US delivery-tech unicorn
Technologies
1The Challenge
Data from production databases, partner APIs, FTP drops and mobile app events lived in separate places, so the company had no single source of truth for reporting.
2Our Solution
Designed a Snowflake platform with log-based PostgreSQL CDC through Meltano, Dagster orchestration on AKS, a fault-tolerant FTP ingestion service, and a Cube.js semantic layer feeding Looker. Snowflake roles and permissions are managed in Terraform.
3Outcomes
One Snowflake warehouse for databases, APIs and app events
Log-based CDC instead of full-table reloads
Snowflake access managed as code with Terraform and CI/CD
Consistent metrics for BI through a Cube.js semantic layer
DataOps AI Agent That Fixes Pipeline Failures
US delivery-tech unicorn
Technologies
1The Challenge
Engineers were being woken up for pipeline failures that had well-known fixes, such as out-of-memory errors and stuck PostgreSQL replication slots.
2Our Solution
Built a multi-agent system with LangGraph that monitors Dagster, uses an LLM to read failure logs, and applies the known fix: it scales compute and restarts the job, or for replication alerts it stops the job, removes the stuck slot and starts a partial refresh.
3Outcomes
Common failures fixed automatically, without paging an engineer
Replication-slot incidents handled end to end
Agent actions visible in Grafana
Multilingual Social Media Ingestion Platform
Media-intelligence company
Technologies
1The Challenge
Analysts needed a single narrative feed covering social and news sources in many languages, but each source had its own format.
2Our Solution
Built a PySpark pipeline on Databricks that pulls Meltwater (X, Facebook, Instagram, Weibo, Douyin, WeChat, news), Reddit, Telegram and Webz into one standard schema, enriches it, validates metrics, and writes Delta tables.
3Outcomes
One standard schema across 10+ source platforms
Multilingual support including Arabic, Chinese, Japanese and Korean
Metric validation and timeout alerting
1The Challenge
Lawyers needed answers grounded in their legal content, not general chatbot responses.
2Our Solution
Built the full RAG pipeline (ingestion, embeddings, Pinecone retrieval, LangChain orchestration) behind a FastAPI service on AWS, with MLflow model versioning.
3Outcomes
Answers based on retrieved legal sources
CI/CD and auto-scaling on AWS
Model versioning with MLflow
Multi-Tenant E-Commerce Analytics
E-commerce analytics provider
Technologies
1The Challenge
Each new merchant meant rebuilding the same integrations for stores, ad platforms and payments.
2Our Solution
Built custom connectors and reusable ingestion logic for Shopify, Meta Ads, Google Analytics, Uplisting and payment providers. The data feeds automated insights for product and commercial teams.
3Outcomes
One ingestion layer shared by every tenant
Automated insights instead of manual reporting
GCP Analytics Platform with ClickHouse Reverse ETL
Growth-stage SaaS company
Technologies
1The Challenge
Operational databases, APIs and marketing platforms were not connected, and user-level insights never made it back into the product.
2Our Solution
Combined the sources in BigQuery with Airflow on Cloud Composer, designed ClickHouse tables for fast user-level processing, and built reverse ETL to send results back to downstream applications.
3Outcomes
One BigQuery source for reporting and BI
Tuned ClickHouse tables and queries
User-level data sent back to the apps that need it
Ready to Write Your Success Story?
Let's discuss how we can help you achieve similar transformative results.
Start Your Transformation