ARTICLE AD BOX
I'm having random data missing/not showing up in BigQuery issues. I would seemingly write data without issues, but SELECT * would return nothing.
The control panel shows no errors. None of the quotas show up as exceeded. I get no exceptions and response.getInsertErrors() is always null. The issue seems to happen when doing intensive writes. They are batched.
I'm using this library (I've tried the latest one and the issue is still there):
<dependency> <groupId>com.google.cloud</groupId> <artifactId>google-cloud-bigquery</artifactId> <version>2.28.0</version> </dependency>Like so:
GoogleCredential credential = new GoogleCredential.Builder().setTransport(new NetHttpTransport()) .setJsonFactory(new JacksonFactory()) .setClientSecrets("clientId", "clientSecret") .build() .setFromTokenResponse(new TokenResponse().setRefreshToken("refreshtoken"); Bigquery bigquery = new Bigquery.Builder(new NetHttpTransport(), new JacksonFactory(), credential) .setApplicationName("name").build(); List<TableDataInsertAllRequest.Rows> rowList = new ArrayList<TableDataInsertAllRequest.Rows>(); TableRow rowWrapper = new TableRow(); rowWrapper.set("date", item.GetDate()); rowWrapper.set("value", item.GetValue()); TableDataInsertAllRequest.Rows insertRowRequest = new TableDataInsertAllRequest.Rows(); rowList.add(insertRowRequest); TableDataInsertAllRequest content = new TableDataInsertAllRequest().setRows(rowList); InsertAll op = bigquery.tabledata().insertAll("project", "dataset", "table", content); TableDataInsertAllResponse response = op.execute(); if (response.getInsertErrors() == null) { ; // all good }Has anyone had this issue? how to fix it? thank you.
