Skip to content

Error aws->postgresql unexpected EOF #6431

@castaples

Description

@castaples

After upgrading to the latest version CQ and AWS/Postgres plugins I get the following output in the logs after the sync exits after only 7 mins running (usual runs for close to 3 hours) having gathered credentials and started syncing tables.

Error: failed to write for aws->postgresql: failed to CloseAndRecv client: rpc error: code = Internal desc = Context done: context canceled and failed to wait for plugin: failed to execute batch: unexpected EOF

We've gone from CQ 1.3.7 to 2.0.31, AWS from v3.5.0 to v9.1.1 and Postgres from v1.3.9 to v2.0.1

We're running CQ in a docker container on AWS ECS with Aurora Serverless v1 Postgres (pre-scaled to 16 ACU before sync called), this has worked fairly well for some time on a daily schedule. We have 350+ AWS accounts with only a few tables in the CQ config ignore list, mainly 'aws_inspector2_findings' and all the lightsail tables.

Please let me know what else you'd need to diagnose this.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions