How should you design the data ingestion?

TerramEarth plans to connect all 20 million vehicles in the field to the cloud. This increases the volume to 20 million 600 byte records a second for 40 TB an hour.

How should you design the data ingestion?
A . Vehicles write data directly to GCS
B . Vehicles write data directly to Google Cloud Pub/Sub
C . Vehicles stream data directly to Google BigQuery
D . Vehicles continue to write data using the existing system (FTP)

View Answer

Answer: B

Explanation:

Streamed data is available for real-time analysis within a few seconds of the first streaming insertion into a table.

Instead of using a job to load data into BigQuery, you can choose to stream your data into BigQuery one record at a time by using the tabledata().insertAll() method. This approach enables querying data without the delay of running a load job.

References: https://cloud.google.com/bigquery/streaming-data-into-bigquery