1
I have a routine that returns me daily 2900 lines. This information is sent to Bigquery. Is there any way to send these 2900 lines today in a Bigquery table and tomorrow add another 2900 lines in this same table?
1 answer
0
This question is very broad, it is not reproducible, BUT I will provide my 2 cents. There is a cloud service called Stitchdata which basically integrates data sources with a data Warehouse like Bigquery.
I for example have an API that records in a database in Postgres the usage logs of the API. These data are important for further analysis and so I send every 30 minutes the new lines to a table in Bigquey. To run this incremental mode it is enough to have an incremental field in the table, such as an ID, or some field with temporal information, such as a timestamp.
Browser other questions tagged google
You are not signed in. Login or sign up in order to post.