Engineering Blog

With Google BigQuery ML you can now predict your Google Cloud spend in just a few minutes and without leaving your BigQuery Console UI.

One of the popular question I am getting often is “how do I break down my Google Cloud costs by location?”. Today, I am going to show how to make Iris and Cloud Intelligence™ work together to collect and visualize this information for you.

Many applications need to be whitelisted by consumers based on source IP address, usually for security reasons. As of today, Google Kubernetes Engine doesn’t support assigning a static pool of addresses to GKE cluster and requires the deployment of a complex NAT based solution which is expensive, hard to maintain and requires a complex set of rules for load-balancing and redundancy.

Meet Banias — high performance analytics pipeline built on top of Kubernetes, Apache Beam and Google BigQuery

Missing the automatic AWS name tags for your Google Cloud resources? Here is Iris come to the rescue.

Like many public cloud providers, Google Cloud follows a network pricing model which doesn’t charge you for ingress traffic but will charge you for egress traffic to other zones, regions and internet.

UPDATE: User-defined request headers are not longer free;

Google Compute Engine offers a really unique technology called “Live Migration” which keeps your instances running even when a host undergo downtime such as during software or hardware update.

A few months ago, Google has announced OpenCensus, a vendor-neutral open source library for telemetry and tracing collection. OpenCensus makes it easy to collect metrics from your app and to trace the progression or requests.

Running non-production environments in the cloud is great. They are conveniently available to you at any time, right when you need them. But this convenience sometimes comes with a price tag.

Cloud Dataproc is an amazingly fast to provision, easy-to-use, fully-managed cloud service for running Apache Spark and Apache Hadoop clusters in a simple and very cost-efficient way.

Stackdriver estimations off and gsutil du too slow? Use Cloud Functions, Pub/Sub, and BigQuery to automatically calculate accurate GCS bucket sizes from Storage Logs.