How to calcuate the cost when moving data from azure datalake to google BigQuery

Question

We have a Datafactory pipeline in Azure to move a on-premise SQL table to Azure blob storage Gen2 in parquet format. I think the majority cost would come from the Azure storage, right?

Now we want to move those data to BigQuery. Due to our security policy, we still need the Datafactory pipeline to read from SQL table. So we create a databrick notebook to read the parquet file and move to BigQuery using the Spark BigQuery connector. Now I need to estimate the total cost. On top of the Azure storage, do we have to pay some kind of egress cost to move data out of Azure storage? And does google would charge us some kind of ingress cost to move data to BQ?

question from:https://stackoverflow.com/questions/65832481/how-to-calcuate-the-cost-when-moving-data-from-azure-datalake-to-google-bigquery

Answer 1

• All inbound or ingress data transfers to Azure data centers from on-premises environments are free. However, outbound data transfers incur charges.

• Data migration from other platforms into BigQuery is free.

• To estimate the cost of Google Cloud Platform services, you can use the Google Cloud Pricing Calculator.