This page is also available in Deutsch, Español, Français, Italiano, 日本語, and Português.

Lightricks Ingests 1B Events a Day on Google Cloud

DoiT guides the migration to BigQuery, Dataflow, and GKE, eliminating bottlenecks and powering real-time analytics across Lightricks' creator apps.

The Challenge

Lightricks' original hybrid system struggled to meet growing demand and support increasingly complex machine learning and analytics needs. The infrastructure created bottlenecks during critical business moments, with data uploads reaching limits and clusters shutting down during funding rounds and peak usage periods.

The Solution

Lightricks migrated to Google Cloud, leveraging BigQuery and Dataflow for automated data ingestion and analysis. The team deployed Google Kubernetes Engine for containerized infrastructure and utilized Vertex AI for machine learning models. DoiT International provided ongoing architectural support and problem-solving expertise.

Results

Processes around 1 billion events per day with BigQuery and Dataflow
Deployed working Kubernetes infrastructure on GKE in just weeks with minimal engineering resources
Eliminated infrastructure bottlenecks that previously caused system failures during critical business periods
Enabled real-time business intelligence for optimizing ad campaigns on terabytes of data

When, for instance, we wanted to create a cluster on GKE and attach it to our machine learning systems, DoiT ensured that our data lakes that we use for research and our on-premises compute functionality synched. We have an elaborate machine learning construction and DoiT provides ongoing support for everything from architecture to problem-solving.
Ofir Bibi, VP Research, Lightricks

Meeting the Challenge of Scale

Lightricks quickly found market success with apps like Facetune, Videoleap, and Photoleap. However, rapid growth exposed limitations in their hybrid cloud-on-premises infrastructure. The system struggled with GPU usage demands and couldn't support increasingly complex machine learning and analytics requirements. Critical failures occurred during funding rounds and peak usage periods, creating urgent need for a more robust platform.

Automating Data Ingestion at Scale

BigQuery and Dataflow became the foundation of Lightricks' data platform transformation. The company now ingests around 10,000 events per second, totaling a billion events daily. Dataflow's autoscale feature eliminated previous bottlenecks where data uploads reached system limits. This automation enables real-time business intelligence, allowing teams to optimize ad campaigns on terabytes of data and instantly target users from successful marketing campaigns.

Empowering Small Teams with Big Infrastructure

Google Kubernetes Engine dramatically reduced infrastructure complexity for Lightricks' lean engineering team. Within weeks, just a few engineers and DevOps personnel deployed a working Kubernetes infrastructure that would have been impossible with their previous system. The separation of storage and compute eliminated the infrastructure obstacles that previously hindered development, allowing teams to focus on delivering business value instead of maintaining systems.

Enhancing Machine Learning Capabilities

Google Cloud solved Lightricks' compute availability challenges for machine learning workloads. The team migrated from experimental cloud training in 2014 to a robust platform where compute resources are available on demand. Marketing, product optimization, and recommendation engine teams now create machine learning models on Compute Engine, with migration to Vertex AI enabling even faster scaling for recommendation systems and user interaction optimization.

Securing Third-Party Integrations

Google Cloud's integration capabilities enable Lightricks to securely connect with third-party services like Cloudinary and Elasticsearch. The platform provides secure traffic forwarding outside private networks without exposing systems to the public Internet. This security framework supports Lightricks' backend development as they build services on open-source technologies while maintaining robust protection.

Future Growth and Platform Expansion

Lightricks plans major backend service expansion in 2022, including shared profiles across apps and media upload capabilities. This growth will generate more data and require enhanced machine learning models. With Google Cloud's support, the company can achieve rapid, cost-effective scaling while developing their creators' platform and maintaining state-of-the-art content creation services.

See how DoiT helps cloud teams control spend

Explore how Cloud Intelligence™ helps teams improve visibility, governance, and unit economics across cloud environments.

Visit DoiT Talk to our team

What they say

We have worked with DoiT for many years, and there has been an increasing number of capabilities and features in DoiT Cloud Intelligence. We've embedded features such as Cloud Analytics and Reports in our own FinOps processes, it's become core to what we do.

Martin Lee, Director of Operations

DoiT gave us the confidence to move from experimentation to production. They helped us understand the right way to build AI for the real world.

Milad Rezazadeh, CTO

Attribute™'s cost grouping technology took our cost visibility and allocation to a whole new level. Now, our teams are fully accountable for their budgets, significantly improving our cloud efficiency and helping us minimize unnecessary costs.

Eli Zilbershtein, Head of DevOps, Hippo

You can't tag a customer in a multi-tenant environment. Attribute™ finally shows us what each customer costs and what's driving those costs.

Omri Cohen, Director of Engineering, Platform

Attribute™'s data is truly unmatched. No other solution on the market could deliver the precise customer cost and usage profiles we needed in such a complex infrastructure. Within weeks, the data from Attribute™ transformed our understanding of cost structures, influencing key strategic decisions in pricing, renegotiations, and market positioning.

Jonathan Langer, COO, Claroty

Attribute™ simplified tracking customer costs in our multi-tenant environments. Customer cost measurement is now clear and standardized, and finance gets the business context they need. Integration was quick and required no changes.

Kfir Lippmann, CFO, Salt Security

Attribute™ translates complex cloud bills into actionable, business-centric insights that empower our engineering teams to take true ownership of their costs.

Balamurugan Mohandossgandhi, Head of IT and Infrastructure, PropertyGuru

This has let us get a better idea of what our cost of goods sold really is. It's not every day you come across something that delivers value as quickly as yours did for us. I was seeing useful insights inside the POC, and we had only deployed it to a couple of real clusters.

Jason Moore, Principal DevOps Engineer, Accrete AI

Eliminating the need to tag thousands of resources has freed up my team and we've invested our efforts in enhancing our platform significantly.

Ziv Sivan, VP of Engineering

PerfectScale by DoiT has become an important part of how we optimize Kubernetes at scale at OneFootball. It gives our platform team the visibility, automation, resiliency insights, and confidence we need to balance cost efficiency with production readiness, especially as we prepare for major global football moments like the 2026 FIFA World Cup.

Andrea Benfatto, Platform/Cloud Runtime Engineering Manager

Cloudflow's new RDS End of Life alerts have allowed us to be more proactive on keeping our database instances up-to-date. The new solution gives us internal visibility ahead of time so that we can prepare for upgrades, instead of having to upgrade under pressure while incurring extended support costs.

Jon Fairbanks, Site Reliability Engineering Manager

PerfectScale cut 40% off our total EKS spend, and the automations handle what used to take our team 20 hours a month. Now we spend that time on reliability and performance instead of chasing cost metrics.

Caio Cristo, Director of Infrastructure/SRE

What I really like about DoiT's approach is that you're very hands-on and proactive. Satyam would ping me a few times a sprint, letting me know about the most current features, checking in on how things are going. When we are going through a peak time, that proactiveness makes a real difference. Satyam always comes through whenever we need support and helps us leverage the right experts to get us where we need to be.

Chiamaka Ibeme, Engineering Manager, Platform

Your cloud bill shouldn't be a mystery

Let us show you what ships this week.

Book a demo