Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- abr 02, 2019 5:38:59 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
- INFORMACIÓN: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 186 files. Enable logging at DEBUG level to see which files will be staged.
- [EL Info]: 2019-04-02 17:39:01.053--ServerSession(1491860739)--EclipseLink, version: Eclipse Persistence Services - 2.5.0.v20130507-3faac2b
- Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
- Tue Apr 02 17:39:01 CLST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
- Tue Apr 02 17:39:02 CLST 2019 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification.
- [EL Info]: connection: 2019-04-02 17:39:03.356--ServerSession(1491860739)--file:/C:/Users/zenta/Documents/FTS_ACME/dl_upg_acme_ssim/target/classes/_Eclipselink_JPA login successful
- abr 02, 2019 5:41:12 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:12 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:14 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:14 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:16 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:16 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:19 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:19 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:23 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:23 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:30 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:30 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:38 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:38 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:41:53 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:41:53 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:42:19 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:42:19 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- abr 02, 2019 5:42:37 PM org.apache.beam.sdk.util.RetryHttpRequestInitializer$LoggingHttpBackOffHandler handleResponse
- ADVERTENCIA: Request failed with code 403, performed 0 retries due to IOExceptions, performed 0 retries due to unsuccessful status codes, HTTP framework says request can be retried, (caller responsible for retrying): https://www.googleapis.com/bigquery/v2/projects/sp-cm-acme-intg-r6yo/jobs
- abr 02, 2019 5:42:37 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl executeWithRetries
- INFORMACIÓN: Ignore the error and retry the request.
- com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- Exception in thread "main" java.lang.IllegalArgumentException: Validation of query "SELECT airport_code,country_code,continent_code FROM ref_commercial_us.geographic_model_airports" failed. If the query depends on an earlier stage of the pipeline, This validation can be disabled using #withoutValidation.
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:707)
- at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:640)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:656)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:660)
- at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:311)
- at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:245)
- at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:458)
- at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:575)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:310)
- at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
- at com.latam.rm.upg.StarterPipelineAcmeReader.main(StarterPipelineAcmeReader.java:159)
- Caused by: java.io.IOException: Unable to dry run query: {flattenResults=true, query=SELECT airport_code,country_code,continent_code FROM ref_commercial_us.geographic_model_airports, useLegacySql=true}, aborting after 9 retries.
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:863)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl$JobServiceImpl.dryRunQuery(BigQueryServicesImpl.java:293)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryIO$TypedRead.validate(BigQueryIO.java:698)
- ... 11 more
- Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 403 Forbidden
- {
- "code" : 403,
- "errors" : [ {
- "domain" : "global",
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo.",
- "reason" : "accessDenied"
- } ],
- "message" : "Access Denied: Project sp-cm-acme-intg-r6yo: The user dataflow-service-acme@sp-cm-acme-intg-r6yo.iam.gserviceaccount.com does not have bigquery.jobs.create permission in project sp-cm-acme-intg-r6yo."
- }
- at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
- at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
- at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1065)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
- at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
- at org.apache.beam.sdk.io.gcp.bigquery.BigQueryServicesImpl.executeWithRetries(BigQueryServicesImpl.java:854)
- ... 13 more
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement