Thank you for reading and for those kind words. I write in the hope to help other, and I'm happy it works!

Anyway, for your question, I will answer with another one. Why do you need data in BigQuery?

Indeed, it's a valid pattern to extract data from Cloud SQL and to store them in BigQuery for analytics. But most of the time, the most simple solution is to use Federated queries and allow BigQuery to query Cloud SQL.

But it requires a public IP on your Cloud SQL instance, not always accepted (and understood) by the security team, and you can't use that feature

As alternative, Datastream is a pretty good solution. And will be better soon (announcements are coming at Cloud Next 22)

Sign up to discover human stories that deepen your understanding of the world.

Free

Distraction-free reading. No ads.

Organize your knowledge with lists and highlights.

Tell your story. Find your audience.

Membership

Read member-only stories

Support writers you read most

Earn money for your writing

Listen to audio narrations

Read offline with the Medium app

guillaume blaquiere
guillaume blaquiere

Written by guillaume blaquiere

GDE cloud platform, Group Data Architect @Carrefour, speaker, writer and polyglot developer, Google Cloud platform 3x certified, serverless addict and Go fan.

Responses (1)

Write a response

We need the data in BigQuery because that is where our larger summary level analytics are taking place, the Cloud SQL Postgres version is optimized for running the app and specific interations.
As you mentioned we can't have a public IP for the Cloud…