Meet Voyager Labs
On an average day, 10 billion records are being collected. With an average of 1 KB per record, the daily amount of data collected accounts to roughly 10 TB. The data ingestion need to support at least 120K events/second to keep up with the volume of collected data.
The Challenge
Voyager Labs needed the capability to analyze billions of data points and reveal deep actionable insights from collected data. They process 10 billion records daily, requiring support for at least 120K events per second with roughly 10 TB of daily data volume.
The Solution
DoiT International implemented an AWS-based solution prioritizing elasticity, managed services, and security. The architecture uses AWS managed services including Amazon Kinesis, Kinesis Firehose, Amazon S3, and Amazon SageMaker for data ingestion, storage, processing, and analytics.
Results
- Fully managed Spark clusters with elastic scaling of nodes and spot instances
- 300% cost reduction on disk capacity due to migration to Amazon S3
- Relies on managed services without the maintenance burden
- Serverless data ingestion using Amazon Kinesis and Kinesis Firehose
- Consistent research experience with Amazon SageMaker
Solution Architecture
After careful evaluation, DoiT International prioritized three key solution features: Elasticity for easy scaling, managed AWS services to increase development speed, and security through Amazon Identity and Access Management for centralized governance. The AWS Cloud provides building blocks for a secure, flexible, and cost-effective data collection, storage and analytics platform.
Implementation Results
Following solution delivery by DoiT International, Voyager Labs now benefits from fully managed Spark clusters with elastic scaling, 300% cost reduction on disk capacity through Amazon S3 migration, serverless data ingestion using Amazon Kinesis and Kinesis Firehose, and consistent research experience with Amazon SageMaker.
See how DoiT helps cloud teams control spend
Explore how DoiT Cloud Intelligence helps teams improve visibility, governance, and unit economics across cloud environments.
More customer stories
Promptly saves $600K and ships AI in weeks
- $600K
- Annual cloud cost savings
- 3 months
- of engineering time saved
Extenda Retail Cuts SSD Waste, Speeds AI
Wicked Reports Ships GenAI 3 Months Faster
- 3 months saved
- of development time saved using DoiT's Cloud Accelerator
- 25% faster
- prototype-to-production timeline compared to internal estimates
- $0 additional spend
- zero additional infrastructure spend during prototype build thanks to AWS credits and DoiT's optimization
DaySmart
DaySmart Ships AI Capability in 90 Days
- 90 days
- From POC to deployment
- 90 days
- From POC to deployment with zero internal engineering time required
- 6x
- Engineers worth of resource saved
Vivaticket cuts AWS environment setup from 3 days to 15 minutes
- 15min
- Environment creation time
- 15min
- Environment creation time (vs 3 days before)
- 20min
- Application deployment in immutable mode
Blumira scales SOC Auto-Focus with cost control
Luxury Escapes Saves $10K+ on AWS
Promptly saves $600K and ships AI in weeks
- $600K
- Annual cloud cost savings
- 3 months
- of engineering time saved
Extenda Retail Cuts SSD Waste, Speeds AI
Wicked Reports Ships GenAI 3 Months Faster
- 3 months saved
- of development time saved using DoiT's Cloud Accelerator
- 25% faster
- prototype-to-production timeline compared to internal estimates
- $0 additional spend
- zero additional infrastructure spend during prototype build thanks to AWS credits and DoiT's optimization
DaySmart
DaySmart Ships AI Capability in 90 Days
- 90 days
- From POC to deployment
- 90 days
- From POC to deployment with zero internal engineering time required
- 6x
- Engineers worth of resource saved
Vivaticket cuts AWS environment setup from 3 days to 15 minutes
- 15min
- Environment creation time
- 15min
- Environment creation time (vs 3 days before)
- 20min
- Application deployment in immutable mode
Blumira scales SOC Auto-Focus with cost control
What they say
What I really like about DoiT's approach is that you're very hands-on and proactive. Satyam would ping me a few times a sprint, letting me know about the most current features, checking in on how things are going. When we are going through a peak time, that proactiveness makes a real difference. Satyam always comes through whenever we need support and helps us leverage the right experts to get us where we need to be.
Chiamaka Ibeme, Engineering Manager, Platform
SELECT has made important cost data readily accessible. I will often pull it up during engineering design reviews so we can quickly evaluate cost impact and projections and factor that into our design decisions.
Douglas Zickuhr, Senior Data Platform Engineer at Personio
I love clicking through SELECT to understand how our environment and workloads are evolving. I probably check it every day. It's coffee and SELECT for me every morning.
Ian Fahey, Senior Analytics Engineer at Loop
You guys have the best UI experience that I've had of any software. It's like you just read my mind where, like, oh, I wish I could click there. Oh, I can
Diana Koshy, Sr. Director of Data Engineering at Kargo
SELECT feels like exactly what Paul and I would have built if we had locked ourselves in a room for 18 months to create our ideal monitoring solution.
Devin McGee, Data Engineering Lead at Home Chef
SELECT dramatically lowers the cognitive load to understanding Snowflake costs. I'm able to sit there and easily understand what's driving the cost. Not to blow smoke up your ass, but it's just so easy to do in your platform
Blake Baggett, Head of Data Operations at Entain
One of the most helpful cost rituals we've setup from SELECT is the weekly spend digest sent to Slack. I can start high level and ensure things are in check. If not, I can very quickly drill down into specific workloads which may have driven the cost spike and remediate them before they become a bigger issue.
Michael Revelo, Manager of data and analytics engineering at ClickUp
Through SELECT's automated savings feature and deep cost visibility, we were able to instantly lower our Snowflake spend by over 40% and achieve a 20X ROI on our SELECT investment.
Skyler Chi, SVP, GTM Productivity & Excellence at Exiger
Our costs had jumped up 3X as we scaled, so we're talking about 60% savings in Snowflake spend after adopting SELECT.
Edward Mancey, GTM Lead at Synthesia
DoiT was a true partner, not a vendor. They helped us understand the problem, refine the vision, and build something production-ready far faster than we could have on our own. Their expertise, responsiveness, and commitment made all the difference.
Dr. Anish Kapur, Founder & CEO, Promptly
DoiT's Customer Success and Forward Deployed Engineering teams work very closely with us. The regular sessions with our CSM keep us focused on the right priorities, and the FDEs provide the deep technical guidance we need to validate decisions and optimize our environment. That combination has been genuinely valuable for us.
Alexander Lundberg Santos, Platform Engineer at Extenda Retail
Every customer has unique usage patterns. Manual resource optimization simply didn't scale—we needed automation to ensure every customer, regardless of size, had right-sized infrastructure without consuming our team's capacity.
Brad Quinn, Lead Platform Engineer, PlayHQ
PerfectScale allowed us to grow capacity without growing cost. We effectively absorbed 30% more usage for free.
Thomas Comtet, Senior Staff Engineer, SNCF
Your cloud bill shouldn't be a mystery
Let us show you what ships this week.