From d77b5205e94a75d5f42797e1c94cdb801e8703b3 Mon Sep 17 00:00:00 2001 From: CloudQuery Bot <102256036+cq-bot@users.noreply.github.com> Date: Wed, 18 Jun 2025 16:57:15 +0100 Subject: [PATCH 1/5] chore(deps): Update module github.com/cloudquery/plugin-sdk/v4 to v4.84.2 (#2192) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [github.com/cloudquery/plugin-sdk/v4](https://redirect.github.com/cloudquery/plugin-sdk) | require | patch | `v4.84.1` -> `v4.84.2` | --- ### Release Notes
cloudquery/plugin-sdk (github.com/cloudquery/plugin-sdk/v4) ### [`v4.84.2`](https://redirect.github.com/cloudquery/plugin-sdk/releases/tag/v4.84.2) [Compare Source](https://redirect.github.com/cloudquery/plugin-sdk/compare/v4.84.1...v4.84.2) ##### Bug Fixes - Add time delay in DeleteStaleAll test for destinations ([#​2191](https://redirect.github.com/cloudquery/plugin-sdk/issues/2191)) ([d98a293](https://redirect.github.com/cloudquery/plugin-sdk/commit/d98a29334ac8d34fb2e85cea5600bf326c7c90ea)) - **deps:** Update module github.com/aws/aws-sdk-go-v2/config to v1.29.15 ([#​2189](https://redirect.github.com/cloudquery/plugin-sdk/issues/2189)) ([9860e20](https://redirect.github.com/cloudquery/plugin-sdk/commit/9860e20cb37ca3be41b1b7723cfe2e980469b88c)) - **deps:** Update module github.com/aws/aws-sdk-go-v2/service/licensemanager to v1.31.1 ([#​2186](https://redirect.github.com/cloudquery/plugin-sdk/issues/2186)) ([7647d77](https://redirect.github.com/cloudquery/plugin-sdk/commit/7647d778e746ab2b016a5912b311f053746cd85a)) - **deps:** Update module google.golang.org/grpc to v1.72.2 ([#​2187](https://redirect.github.com/cloudquery/plugin-sdk/issues/2187)) ([a999c81](https://redirect.github.com/cloudquery/plugin-sdk/commit/a999c818c057c34468b0ad2c865c31dbf57fb7ad)) - **deps:** Update module google.golang.org/grpc to v1.73.0 ([#​2190](https://redirect.github.com/cloudquery/plugin-sdk/issues/2190)) ([2e3c192](https://redirect.github.com/cloudquery/plugin-sdk/commit/2e3c192ff2f2455de31f51f0b6d4c16577d15c41)) - Error handling in StreamingBatchWriter ([#​1921](https://redirect.github.com/cloudquery/plugin-sdk/issues/1921)) ([6d71fb1](https://redirect.github.com/cloudquery/plugin-sdk/commit/6d71fb1099792438f6527f5854a6dc37eaf298ec))
--- ### Configuration ๐Ÿ“… **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). ๐Ÿšฆ **Automerge**: Disabled by config. Please merge this manually once you are satisfied. โ™ป **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. ๐Ÿ”• **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://redirect.github.com/renovatebot/renovate). --- examples/simple_plugin/go.mod | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/simple_plugin/go.mod b/examples/simple_plugin/go.mod index fbab1f2ed4..4532f6ff9d 100644 --- a/examples/simple_plugin/go.mod +++ b/examples/simple_plugin/go.mod @@ -4,7 +4,7 @@ go 1.24.3 require ( github.com/apache/arrow-go/v18 v18.3.0 - github.com/cloudquery/plugin-sdk/v4 v4.84.1 + github.com/cloudquery/plugin-sdk/v4 v4.84.2 github.com/rs/zerolog v1.34.0 ) From d220f6354c0d2a901eba541126580137254b82b0 Mon Sep 17 00:00:00 2001 From: CloudQuery Bot <102256036+cq-bot@users.noreply.github.com> Date: Sat, 21 Jun 2025 02:16:43 +0100 Subject: [PATCH 2/5] fix(deps): Update aws-sdk-go-v2 monorepo (#2193) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit This PR contains the following updates: | Package | Type | Update | Change | Pending | |---|---|---|---|---| | [github.com/aws/aws-sdk-go-v2](https://redirect.github.com/aws/aws-sdk-go-v2) | require | patch | `v1.36.3` -> `v1.36.4` | `v1.36.5` | | [github.com/aws/aws-sdk-go-v2/config](https://redirect.github.com/aws/aws-sdk-go-v2) | require | patch | `v1.29.15` -> `v1.29.16` | `v1.29.17` | | [github.com/aws/aws-sdk-go-v2/service/licensemanager](https://redirect.github.com/aws/aws-sdk-go-v2) | require | patch | `v1.31.1` -> `v1.31.2` | `v1.31.3` | | [github.com/aws/aws-sdk-go-v2/service/marketplacemetering](https://redirect.github.com/aws/aws-sdk-go-v2) | require | patch | `v1.29.0` -> `v1.29.1` | `v1.29.2` | --- ### Release Notes
aws/aws-sdk-go-v2 (github.com/aws/aws-sdk-go-v2) ### [`v1.36.4`](https://redirect.github.com/aws/aws-sdk-go-v2/compare/v1.36.3...v1.36.4) [Compare Source](https://redirect.github.com/aws/aws-sdk-go-v2/compare/v1.36.3...v1.36.4)
--- ### Configuration ๐Ÿ“… **Schedule**: Branch creation - "before 3am on Saturday" (UTC), Automerge - At any time (no schedule defined). ๐Ÿšฆ **Automerge**: Disabled by config. Please merge this manually once you are satisfied. โ™ป **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. ๐Ÿ‘ป **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://redirect.github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://redirect.github.com/renovatebot/renovate). --- examples/simple_plugin/go.mod | 24 +++++++++--------- examples/simple_plugin/go.sum | 48 +++++++++++++++++------------------ go.mod | 24 +++++++++--------- go.sum | 48 +++++++++++++++++------------------ 4 files changed, 72 insertions(+), 72 deletions(-) diff --git a/examples/simple_plugin/go.mod b/examples/simple_plugin/go.mod index 4532f6ff9d..acb98d5f82 100644 --- a/examples/simple_plugin/go.mod +++ b/examples/simple_plugin/go.mod @@ -12,20 +12,20 @@ require ( github.com/adrg/xdg v0.5.3 // indirect github.com/apache/arrow/go/v13 v13.0.0-20230731205701-112f94971882 // indirect github.com/apapsch/go-jsonmerge/v2 v2.0.0 // indirect - github.com/aws/aws-sdk-go-v2 v1.36.3 // indirect - github.com/aws/aws-sdk-go-v2/config v1.29.15 // indirect - github.com/aws/aws-sdk-go-v2/credentials v1.17.68 // indirect - github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30 // indirect - github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34 // indirect - github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34 // indirect + github.com/aws/aws-sdk-go-v2 v1.36.4 // indirect + github.com/aws/aws-sdk-go-v2/config v1.29.16 // indirect + github.com/aws/aws-sdk-go-v2/credentials v1.17.69 // indirect + github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31 // indirect + github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35 // indirect + github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35 // indirect github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 // indirect github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3 // indirect - github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15 // indirect - github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1 // indirect - github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0 // indirect - github.com/aws/aws-sdk-go-v2/service/sso v1.25.3 // indirect - github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1 // indirect - github.com/aws/aws-sdk-go-v2/service/sts v1.33.20 // indirect + github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16 // indirect + github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2 // indirect + github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1 // indirect + github.com/aws/aws-sdk-go-v2/service/sso v1.25.4 // indirect + github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2 // indirect + github.com/aws/aws-sdk-go-v2/service/sts v1.33.21 // indirect github.com/aws/smithy-go v1.22.2 // indirect github.com/bahlo/generic-list-go v0.2.0 // indirect github.com/buger/jsonparser v1.1.1 // indirect diff --git a/examples/simple_plugin/go.sum b/examples/simple_plugin/go.sum index 0f8037a010..f2578b6eba 100644 --- a/examples/simple_plugin/go.sum +++ b/examples/simple_plugin/go.sum @@ -11,34 +11,34 @@ github.com/apache/thrift v0.21.0 h1:tdPmh/ptjE1IJnhbhrcl2++TauVjy242rkV/UzJChnE= github.com/apache/thrift v0.21.0/go.mod h1:W1H8aR/QRtYNvrPeFXBtobyRkd0/YVhTc6i07XIAgDw= github.com/apapsch/go-jsonmerge/v2 v2.0.0 h1:axGnT1gRIfimI7gJifB699GoE/oq+F2MU7Dml6nw9rQ= github.com/apapsch/go-jsonmerge/v2 v2.0.0/go.mod h1:lvDnEdqiQrp0O42VQGgmlKpxL1AP2+08jFMw88y4klk= -github.com/aws/aws-sdk-go-v2 v1.36.3 h1:mJoei2CxPutQVxaATCzDUjcZEjVRdpsiiXi2o38yqWM= -github.com/aws/aws-sdk-go-v2 v1.36.3/go.mod h1:LLXuLpgzEbD766Z5ECcRmi8AzSwfZItDtmABVkRLGzg= -github.com/aws/aws-sdk-go-v2/config v1.29.15 h1:I5XjesVMpDZXZEZonVfjI12VNMrYa38LtLnw4NtY5Ss= -github.com/aws/aws-sdk-go-v2/config v1.29.15/go.mod h1:tNIp4JIPonlsgaO5hxO372a6gjhN63aSWl2GVl5QoBQ= -github.com/aws/aws-sdk-go-v2/credentials v1.17.68 h1:cFb9yjI02/sWHBSYXAtkamjzCuRymvmeFmt0TC0MbYY= -github.com/aws/aws-sdk-go-v2/credentials v1.17.68/go.mod h1:H6E+jBzyqUu8u0vGaU6POkK3P0NylYEeRZ6ynBpMqIk= -github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30 h1:x793wxmUWVDhshP8WW2mlnXuFrO4cOd3HLBroh1paFw= -github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30/go.mod h1:Jpne2tDnYiFascUEs2AWHJL9Yp7A5ZVy3TNyxaAjD6M= -github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34 h1:ZK5jHhnrioRkUNOc+hOgQKlUL5JeC3S6JgLxtQ+Rm0Q= -github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34/go.mod h1:p4VfIceZokChbA9FzMbRGz5OV+lekcVtHlPKEO0gSZY= -github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34 h1:SZwFm17ZUNNg5Np0ioo/gq8Mn6u9w19Mri8DnJ15Jf0= -github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34/go.mod h1:dFZsC0BLo346mvKQLWmoJxT+Sjp+qcVR1tRVHQGOH9Q= +github.com/aws/aws-sdk-go-v2 v1.36.4 h1:GySzjhVvx0ERP6eyfAbAuAXLtAda5TEy19E5q5W8I9E= +github.com/aws/aws-sdk-go-v2 v1.36.4/go.mod h1:LLXuLpgzEbD766Z5ECcRmi8AzSwfZItDtmABVkRLGzg= +github.com/aws/aws-sdk-go-v2/config v1.29.16 h1:XkruGnXX1nEZ+Nyo9v84TzsX+nj86icbFAeust6uo8A= +github.com/aws/aws-sdk-go-v2/config v1.29.16/go.mod h1:uCW7PNjGwZ5cOGZ5jr8vCWrYkGIhPoTNV23Q/tpHKzg= +github.com/aws/aws-sdk-go-v2/credentials v1.17.69 h1:8B8ZQboRc3uaIKjshve/XlvJ570R7BKNy3gftSbS178= +github.com/aws/aws-sdk-go-v2/credentials v1.17.69/go.mod h1:gPME6I8grR1jCqBFEGthULiolzf/Sexq/Wy42ibKK9c= +github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31 h1:oQWSGexYasNpYp4epLGZxxjsDo8BMBh6iNWkTXQvkwk= +github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31/go.mod h1:nc332eGUU+djP3vrMI6blS0woaCfHTe3KiSQUVTMRq0= +github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35 h1:o1v1VFfPcDVlK3ll1L5xHsaQAFdNtZ5GXnNR7SwueC4= +github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35/go.mod h1:rZUQNYMNG+8uZxz9FOerQJ+FceCiodXvixpeRtdESrU= +github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35 h1:R5b82ubO2NntENm3SAm0ADME+H630HomNJdgv+yZ3xw= +github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35/go.mod h1:FuA+nmgMRfkzVKYDNEqQadvEMxtxl9+RLT9ribCwEMs= github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 h1:bIqFDwgGXXN1Kpp99pDOdKMTTb5d2KyU5X/BZxjOkRo= github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3/go.mod h1:H5O/EsxDWyU+LP/V8i5sm8cxoZgc2fdNR9bxlOFrQTo= github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3 h1:eAh2A4b5IzM/lum78bZ590jy36+d/aFLgKF/4Vd1xPE= github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3/go.mod h1:0yKJC/kb8sAnmlYa6Zs3QVYqaC8ug2AbnNChv5Ox3uA= -github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15 h1:dM9/92u2F1JbDaGooxTq18wmmFzbJRfXfVfy96/1CXM= -github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15/go.mod h1:SwFBy2vjtA0vZbjjaFtfN045boopadnoVPhu4Fv66vY= -github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1 h1:p5ujIGg9D4KndIP9S4RL3ZEbbFeZ9JBm7M3ufijKd3I= -github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1/go.mod h1:FEnHotPAuDu2NbRcGHQj3vUS0cAFjbexAurh5WrfwI8= -github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0 h1:ReXrjtwv4LSfi8bLmbMparantI0YnRb1NlPMf8gAVCQ= -github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0/go.mod h1:ctydsY6pVUtI6JnPssiu5YZabqUt4ZNONqJHehtiKBo= -github.com/aws/aws-sdk-go-v2/service/sso v1.25.3 h1:1Gw+9ajCV1jogloEv1RRnvfRFia2cL6c9cuKV2Ps+G8= -github.com/aws/aws-sdk-go-v2/service/sso v1.25.3/go.mod h1:qs4a9T5EMLl/Cajiw2TcbNt2UNo/Hqlyp+GiuG4CFDI= -github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1 h1:hXmVKytPfTy5axZ+fYbR5d0cFmC3JvwLm5kM83luako= -github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1/go.mod h1:MlYRNmYu/fGPoxBQVvBYr9nyr948aY/WLUvwBMBJubs= -github.com/aws/aws-sdk-go-v2/service/sts v1.33.20 h1:oIaQ1e17CSKaWmUTu62MtraRWVIosn/iONMuZt0gbqc= -github.com/aws/aws-sdk-go-v2/service/sts v1.33.20/go.mod h1:cQnB8CUnxbMU82JvlqjKR2HBOm3fe9pWorWBza6MBJ4= +github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16 h1:/ldKrPPXTC421bTNWrUIpq3CxwHwRI/kpc+jPUTJocM= +github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16/go.mod h1:5vkf/Ws0/wgIMJDQbjI4p2op86hNW6Hie5QtebrDgT8= +github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2 h1:MjBN7fAGxGVvz5iqreBinOSDBxvVY5EMWIh3qT/8EwA= +github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2/go.mod h1:XfHyFBEw57n5OJKvr1dlCfMrXdMPyU3Dfsv2YSqv5B8= +github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1 h1:aahRBfDls/bA4XQRyoV6KXE0pE9sFY3IEiTnzMMC0CQ= +github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1/go.mod h1:bu3K16ekVdDRQaZPidZobJT4kzwGJ385/lZseG17HTE= +github.com/aws/aws-sdk-go-v2/service/sso v1.25.4 h1:EU58LP8ozQDVroOEyAfcq0cGc5R/FTZjVoYJ6tvby3w= +github.com/aws/aws-sdk-go-v2/service/sso v1.25.4/go.mod h1:CrtOgCcysxMvrCoHnvNAD7PHWclmoFG78Q2xLK0KKcs= +github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2 h1:XB4z0hbQtpmBnb1FQYvKaCM7UsS6Y/u8jVBwIUGeCTk= +github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2/go.mod h1:hwRpqkRxnQ58J9blRDrB4IanlXCpcKmsC83EhG77upg= +github.com/aws/aws-sdk-go-v2/service/sts v1.33.21 h1:nyLjs8sYJShFYj6aiyjCBI3EcLn1udWrQTjEF+SOXB0= +github.com/aws/aws-sdk-go-v2/service/sts v1.33.21/go.mod h1:EhdxtZ+g84MSGrSrHzZiUm9PYiZkrADNja15wtRJSJo= github.com/aws/smithy-go v1.22.2 h1:6D9hW43xKFrRx/tXXfAlIZc4JI+yQe6snnWcQyxSyLQ= github.com/aws/smithy-go v1.22.2/go.mod h1:irrKGvNn1InZwb2d7fkIRNucdfwR8R+Ts3wxYa/cJHg= github.com/bahlo/generic-list-go v0.2.0 h1:5sz/EEAK+ls5wF+NeqDpk5+iNdMDXrh3z3nPnH1Wvgk= diff --git a/go.mod b/go.mod index 66a348c351..415244b7ab 100644 --- a/go.mod +++ b/go.mod @@ -4,10 +4,10 @@ go 1.24.3 require ( github.com/apache/arrow-go/v18 v18.3.0 - github.com/aws/aws-sdk-go-v2 v1.36.3 - github.com/aws/aws-sdk-go-v2/config v1.29.15 - github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1 - github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0 + github.com/aws/aws-sdk-go-v2 v1.36.4 + github.com/aws/aws-sdk-go-v2/config v1.29.16 + github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2 + github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1 github.com/bradleyjkemp/cupaloy/v2 v2.8.0 github.com/cloudquery/cloudquery-api-go v1.13.9 github.com/cloudquery/codegen v0.3.28 @@ -50,16 +50,16 @@ require ( github.com/adrg/xdg v0.5.3 // indirect github.com/apache/arrow/go/v13 v13.0.0-20230731205701-112f94971882 // indirect github.com/apapsch/go-jsonmerge/v2 v2.0.0 // indirect - github.com/aws/aws-sdk-go-v2/credentials v1.17.68 // indirect - github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30 // indirect - github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34 // indirect - github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34 // indirect + github.com/aws/aws-sdk-go-v2/credentials v1.17.69 // indirect + github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31 // indirect + github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35 // indirect + github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35 // indirect github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 // indirect github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3 // indirect - github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15 // indirect - github.com/aws/aws-sdk-go-v2/service/sso v1.25.3 // indirect - github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1 // indirect - github.com/aws/aws-sdk-go-v2/service/sts v1.33.20 // indirect + github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16 // indirect + github.com/aws/aws-sdk-go-v2/service/sso v1.25.4 // indirect + github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2 // indirect + github.com/aws/aws-sdk-go-v2/service/sts v1.33.21 // indirect github.com/aws/smithy-go v1.22.2 // indirect github.com/bahlo/generic-list-go v0.2.0 // indirect github.com/buger/jsonparser v1.1.1 // indirect diff --git a/go.sum b/go.sum index 7f36873236..06276cd85c 100644 --- a/go.sum +++ b/go.sum @@ -11,34 +11,34 @@ github.com/apache/thrift v0.21.0 h1:tdPmh/ptjE1IJnhbhrcl2++TauVjy242rkV/UzJChnE= github.com/apache/thrift v0.21.0/go.mod h1:W1H8aR/QRtYNvrPeFXBtobyRkd0/YVhTc6i07XIAgDw= github.com/apapsch/go-jsonmerge/v2 v2.0.0 h1:axGnT1gRIfimI7gJifB699GoE/oq+F2MU7Dml6nw9rQ= github.com/apapsch/go-jsonmerge/v2 v2.0.0/go.mod h1:lvDnEdqiQrp0O42VQGgmlKpxL1AP2+08jFMw88y4klk= -github.com/aws/aws-sdk-go-v2 v1.36.3 h1:mJoei2CxPutQVxaATCzDUjcZEjVRdpsiiXi2o38yqWM= -github.com/aws/aws-sdk-go-v2 v1.36.3/go.mod h1:LLXuLpgzEbD766Z5ECcRmi8AzSwfZItDtmABVkRLGzg= -github.com/aws/aws-sdk-go-v2/config v1.29.15 h1:I5XjesVMpDZXZEZonVfjI12VNMrYa38LtLnw4NtY5Ss= -github.com/aws/aws-sdk-go-v2/config v1.29.15/go.mod h1:tNIp4JIPonlsgaO5hxO372a6gjhN63aSWl2GVl5QoBQ= -github.com/aws/aws-sdk-go-v2/credentials v1.17.68 h1:cFb9yjI02/sWHBSYXAtkamjzCuRymvmeFmt0TC0MbYY= -github.com/aws/aws-sdk-go-v2/credentials v1.17.68/go.mod h1:H6E+jBzyqUu8u0vGaU6POkK3P0NylYEeRZ6ynBpMqIk= -github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30 h1:x793wxmUWVDhshP8WW2mlnXuFrO4cOd3HLBroh1paFw= -github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.30/go.mod h1:Jpne2tDnYiFascUEs2AWHJL9Yp7A5ZVy3TNyxaAjD6M= -github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34 h1:ZK5jHhnrioRkUNOc+hOgQKlUL5JeC3S6JgLxtQ+Rm0Q= -github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.34/go.mod h1:p4VfIceZokChbA9FzMbRGz5OV+lekcVtHlPKEO0gSZY= -github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34 h1:SZwFm17ZUNNg5Np0ioo/gq8Mn6u9w19Mri8DnJ15Jf0= -github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.34/go.mod h1:dFZsC0BLo346mvKQLWmoJxT+Sjp+qcVR1tRVHQGOH9Q= +github.com/aws/aws-sdk-go-v2 v1.36.4 h1:GySzjhVvx0ERP6eyfAbAuAXLtAda5TEy19E5q5W8I9E= +github.com/aws/aws-sdk-go-v2 v1.36.4/go.mod h1:LLXuLpgzEbD766Z5ECcRmi8AzSwfZItDtmABVkRLGzg= +github.com/aws/aws-sdk-go-v2/config v1.29.16 h1:XkruGnXX1nEZ+Nyo9v84TzsX+nj86icbFAeust6uo8A= +github.com/aws/aws-sdk-go-v2/config v1.29.16/go.mod h1:uCW7PNjGwZ5cOGZ5jr8vCWrYkGIhPoTNV23Q/tpHKzg= +github.com/aws/aws-sdk-go-v2/credentials v1.17.69 h1:8B8ZQboRc3uaIKjshve/XlvJ570R7BKNy3gftSbS178= +github.com/aws/aws-sdk-go-v2/credentials v1.17.69/go.mod h1:gPME6I8grR1jCqBFEGthULiolzf/Sexq/Wy42ibKK9c= +github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31 h1:oQWSGexYasNpYp4epLGZxxjsDo8BMBh6iNWkTXQvkwk= +github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.31/go.mod h1:nc332eGUU+djP3vrMI6blS0woaCfHTe3KiSQUVTMRq0= +github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35 h1:o1v1VFfPcDVlK3ll1L5xHsaQAFdNtZ5GXnNR7SwueC4= +github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.35/go.mod h1:rZUQNYMNG+8uZxz9FOerQJ+FceCiodXvixpeRtdESrU= +github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35 h1:R5b82ubO2NntENm3SAm0ADME+H630HomNJdgv+yZ3xw= +github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.35/go.mod h1:FuA+nmgMRfkzVKYDNEqQadvEMxtxl9+RLT9ribCwEMs= github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3 h1:bIqFDwgGXXN1Kpp99pDOdKMTTb5d2KyU5X/BZxjOkRo= github.com/aws/aws-sdk-go-v2/internal/ini v1.8.3/go.mod h1:H5O/EsxDWyU+LP/V8i5sm8cxoZgc2fdNR9bxlOFrQTo= github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3 h1:eAh2A4b5IzM/lum78bZ590jy36+d/aFLgKF/4Vd1xPE= github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.12.3/go.mod h1:0yKJC/kb8sAnmlYa6Zs3QVYqaC8ug2AbnNChv5Ox3uA= -github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15 h1:dM9/92u2F1JbDaGooxTq18wmmFzbJRfXfVfy96/1CXM= -github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.15/go.mod h1:SwFBy2vjtA0vZbjjaFtfN045boopadnoVPhu4Fv66vY= -github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1 h1:p5ujIGg9D4KndIP9S4RL3ZEbbFeZ9JBm7M3ufijKd3I= -github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.1/go.mod h1:FEnHotPAuDu2NbRcGHQj3vUS0cAFjbexAurh5WrfwI8= -github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0 h1:ReXrjtwv4LSfi8bLmbMparantI0YnRb1NlPMf8gAVCQ= -github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.0/go.mod h1:ctydsY6pVUtI6JnPssiu5YZabqUt4ZNONqJHehtiKBo= -github.com/aws/aws-sdk-go-v2/service/sso v1.25.3 h1:1Gw+9ajCV1jogloEv1RRnvfRFia2cL6c9cuKV2Ps+G8= -github.com/aws/aws-sdk-go-v2/service/sso v1.25.3/go.mod h1:qs4a9T5EMLl/Cajiw2TcbNt2UNo/Hqlyp+GiuG4CFDI= -github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1 h1:hXmVKytPfTy5axZ+fYbR5d0cFmC3JvwLm5kM83luako= -github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.1/go.mod h1:MlYRNmYu/fGPoxBQVvBYr9nyr948aY/WLUvwBMBJubs= -github.com/aws/aws-sdk-go-v2/service/sts v1.33.20 h1:oIaQ1e17CSKaWmUTu62MtraRWVIosn/iONMuZt0gbqc= -github.com/aws/aws-sdk-go-v2/service/sts v1.33.20/go.mod h1:cQnB8CUnxbMU82JvlqjKR2HBOm3fe9pWorWBza6MBJ4= +github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16 h1:/ldKrPPXTC421bTNWrUIpq3CxwHwRI/kpc+jPUTJocM= +github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.12.16/go.mod h1:5vkf/Ws0/wgIMJDQbjI4p2op86hNW6Hie5QtebrDgT8= +github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2 h1:MjBN7fAGxGVvz5iqreBinOSDBxvVY5EMWIh3qT/8EwA= +github.com/aws/aws-sdk-go-v2/service/licensemanager v1.31.2/go.mod h1:XfHyFBEw57n5OJKvr1dlCfMrXdMPyU3Dfsv2YSqv5B8= +github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1 h1:aahRBfDls/bA4XQRyoV6KXE0pE9sFY3IEiTnzMMC0CQ= +github.com/aws/aws-sdk-go-v2/service/marketplacemetering v1.29.1/go.mod h1:bu3K16ekVdDRQaZPidZobJT4kzwGJ385/lZseG17HTE= +github.com/aws/aws-sdk-go-v2/service/sso v1.25.4 h1:EU58LP8ozQDVroOEyAfcq0cGc5R/FTZjVoYJ6tvby3w= +github.com/aws/aws-sdk-go-v2/service/sso v1.25.4/go.mod h1:CrtOgCcysxMvrCoHnvNAD7PHWclmoFG78Q2xLK0KKcs= +github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2 h1:XB4z0hbQtpmBnb1FQYvKaCM7UsS6Y/u8jVBwIUGeCTk= +github.com/aws/aws-sdk-go-v2/service/ssooidc v1.30.2/go.mod h1:hwRpqkRxnQ58J9blRDrB4IanlXCpcKmsC83EhG77upg= +github.com/aws/aws-sdk-go-v2/service/sts v1.33.21 h1:nyLjs8sYJShFYj6aiyjCBI3EcLn1udWrQTjEF+SOXB0= +github.com/aws/aws-sdk-go-v2/service/sts v1.33.21/go.mod h1:EhdxtZ+g84MSGrSrHzZiUm9PYiZkrADNja15wtRJSJo= github.com/aws/smithy-go v1.22.2 h1:6D9hW43xKFrRx/tXXfAlIZc4JI+yQe6snnWcQyxSyLQ= github.com/aws/smithy-go v1.22.2/go.mod h1:irrKGvNn1InZwb2d7fkIRNucdfwR8R+Ts3wxYa/cJHg= github.com/bahlo/generic-list-go v0.2.0 h1:5sz/EEAK+ls5wF+NeqDpk5+iNdMDXrh3z3nPnH1Wvgk= From 140b6f3d90e2b0d37f74308a50ff5f61cfeaf20c Mon Sep 17 00:00:00 2001 From: CloudQuery Bot <102256036+cq-bot@users.noreply.github.com> Date: Thu, 26 Jun 2025 14:46:58 +0100 Subject: [PATCH 3/5] fix(deps): Update module github.com/cloudquery/plugin-pb-go to v1.26.13 (#2196) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [github.com/cloudquery/plugin-pb-go](https://redirect.github.com/cloudquery/plugin-pb-go) | require | patch | `v1.26.12` -> `v1.26.13` | --- ### Release Notes
cloudquery/plugin-pb-go (github.com/cloudquery/plugin-pb-go) ### [`v1.26.13`](https://redirect.github.com/cloudquery/plugin-pb-go/releases/tag/v1.26.13) [Compare Source](https://redirect.github.com/cloudquery/plugin-pb-go/compare/v1.26.12...v1.26.13) ##### Bug Fixes - **deps:** Update module google.golang.org/grpc to v1.72.2 ([#​505](https://redirect.github.com/cloudquery/plugin-pb-go/issues/505)) ([d0161de](https://redirect.github.com/cloudquery/plugin-pb-go/commit/d0161de0ec3b71bcfff322064379b15123101005)) - **deps:** Update module google.golang.org/grpc to v1.73.0 ([#​507](https://redirect.github.com/cloudquery/plugin-pb-go/issues/507)) ([8fd4588](https://redirect.github.com/cloudquery/plugin-pb-go/commit/8fd4588b69391fbb35d507323cd2107c7d0d8d2d)) - Generate Go Code from `plugin-pb` ([#​508](https://redirect.github.com/cloudquery/plugin-pb-go/issues/508)) ([a7c294e](https://redirect.github.com/cloudquery/plugin-pb-go/commit/a7c294ec437913f3fbb91761801a6b9303adb5e1)) - Generate Go Code from `plugin-pb` ([#​509](https://redirect.github.com/cloudquery/plugin-pb-go/issues/509)) ([9cdaa50](https://redirect.github.com/cloudquery/plugin-pb-go/commit/9cdaa503017c1d524e81e3057077255f8ae5b8d2))
--- ### Configuration ๐Ÿ“… **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). ๐Ÿšฆ **Automerge**: Disabled by config. Please merge this manually once you are satisfied. โ™ป **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. ๐Ÿ”• **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://redirect.github.com/renovatebot/renovate). --- examples/simple_plugin/go.mod | 2 +- examples/simple_plugin/go.sum | 4 ++-- go.mod | 2 +- go.sum | 4 ++-- 4 files changed, 6 insertions(+), 6 deletions(-) diff --git a/examples/simple_plugin/go.mod b/examples/simple_plugin/go.mod index acb98d5f82..f4f2a602b0 100644 --- a/examples/simple_plugin/go.mod +++ b/examples/simple_plugin/go.mod @@ -32,7 +32,7 @@ require ( github.com/cenkalti/backoff/v5 v5.0.2 // indirect github.com/cloudquery/cloudquery-api-go v1.13.9 // indirect github.com/cloudquery/codegen v0.3.28 // indirect - github.com/cloudquery/plugin-pb-go v1.26.12 // indirect + github.com/cloudquery/plugin-pb-go v1.26.13 // indirect github.com/cloudquery/plugin-sdk/v2 v2.7.0 // indirect github.com/davecgh/go-spew v1.1.1 // indirect github.com/ghodss/yaml v1.0.0 // indirect diff --git a/examples/simple_plugin/go.sum b/examples/simple_plugin/go.sum index f2578b6eba..116fc44849 100644 --- a/examples/simple_plugin/go.sum +++ b/examples/simple_plugin/go.sum @@ -54,8 +54,8 @@ github.com/cloudquery/cloudquery-api-go v1.13.9 h1:XudJusEJ0+kPa2/GXoZPuphR8gTRv github.com/cloudquery/cloudquery-api-go v1.13.9/go.mod h1:ZhEjPkDGDL2KZKlQLUnsgQ0mPz3qC7qftr37q3q+IcA= github.com/cloudquery/codegen v0.3.28 h1:ppiTQDp9WKAPjQYxqfaVSRI1cUirxxDUhrnQzRcIy5M= github.com/cloudquery/codegen v0.3.28/go.mod h1:YmZITt9bM1qyddD3QS2Bke1QDD/vHRtKznjdwWrdHjw= -github.com/cloudquery/plugin-pb-go v1.26.12 h1:IXixFBeKeokGjkhp8piYR+XjsuKT5frOljPPZ0VtImQ= -github.com/cloudquery/plugin-pb-go v1.26.12/go.mod h1:CVC4fwf4GyGDD339Gyxbr3MqWsSBAVYFeku1quhtGik= +github.com/cloudquery/plugin-pb-go v1.26.13 h1:3AuIG7QfeN//c9cxvMWH8WO+V6vPMj/tFlW9R3c5viY= +github.com/cloudquery/plugin-pb-go v1.26.13/go.mod h1:tB3BdV4Trwqs/E2AxrvbJ/xw7i3B1k0tKaQgjcsfAO8= github.com/cloudquery/plugin-sdk/v2 v2.7.0 h1:hRXsdEiaOxJtsn/wZMFQC9/jPfU1MeMK3KF+gPGqm7U= github.com/cloudquery/plugin-sdk/v2 v2.7.0/go.mod h1:pAX6ojIW99b/Vg4CkhnsGkRIzNaVEceYMR+Bdit73ug= github.com/coreos/go-systemd/v22 v22.5.0/go.mod h1:Y58oyj3AT4RCenI/lSvhwexgC+NSVTIJ3seZv2GcEnc= diff --git a/go.mod b/go.mod index 415244b7ab..6a0c309f2f 100644 --- a/go.mod +++ b/go.mod @@ -11,7 +11,7 @@ require ( github.com/bradleyjkemp/cupaloy/v2 v2.8.0 github.com/cloudquery/cloudquery-api-go v1.13.9 github.com/cloudquery/codegen v0.3.28 - github.com/cloudquery/plugin-pb-go v1.26.12 + github.com/cloudquery/plugin-pb-go v1.26.13 github.com/cloudquery/plugin-sdk/v2 v2.7.0 github.com/goccy/go-json v0.10.5 github.com/golang/mock v1.6.0 diff --git a/go.sum b/go.sum index 06276cd85c..55d506775c 100644 --- a/go.sum +++ b/go.sum @@ -56,8 +56,8 @@ github.com/cloudquery/codegen v0.3.28 h1:ppiTQDp9WKAPjQYxqfaVSRI1cUirxxDUhrnQzRc github.com/cloudquery/codegen v0.3.28/go.mod h1:YmZITt9bM1qyddD3QS2Bke1QDD/vHRtKznjdwWrdHjw= github.com/cloudquery/jsonschema v0.0.0-20240220124159-92878faa2a66 h1:OZLPSIBYEfvkAUeOeM8CwTgVQy5zhayI99ishCrsFV0= github.com/cloudquery/jsonschema v0.0.0-20240220124159-92878faa2a66/go.mod h1:0SoZ/U7yJlNOR+fWsBSeTvTbGXB6DK01tzJ7m2Xfg34= -github.com/cloudquery/plugin-pb-go v1.26.12 h1:IXixFBeKeokGjkhp8piYR+XjsuKT5frOljPPZ0VtImQ= -github.com/cloudquery/plugin-pb-go v1.26.12/go.mod h1:CVC4fwf4GyGDD339Gyxbr3MqWsSBAVYFeku1quhtGik= +github.com/cloudquery/plugin-pb-go v1.26.13 h1:3AuIG7QfeN//c9cxvMWH8WO+V6vPMj/tFlW9R3c5viY= +github.com/cloudquery/plugin-pb-go v1.26.13/go.mod h1:tB3BdV4Trwqs/E2AxrvbJ/xw7i3B1k0tKaQgjcsfAO8= github.com/cloudquery/plugin-sdk/v2 v2.7.0 h1:hRXsdEiaOxJtsn/wZMFQC9/jPfU1MeMK3KF+gPGqm7U= github.com/cloudquery/plugin-sdk/v2 v2.7.0/go.mod h1:pAX6ojIW99b/Vg4CkhnsGkRIzNaVEceYMR+Bdit73ug= github.com/coreos/go-systemd/v22 v22.5.0/go.mod h1:Y58oyj3AT4RCenI/lSvhwexgC+NSVTIJ3seZv2GcEnc= From c5273da9f82e289452a9bfa54bb02b9f5c615a01 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Przemys=C5=82aw=20St=C4=99pie=C5=84?= Date: Fri, 27 Jun 2025 13:48:08 +0200 Subject: [PATCH 4/5] feat: Add handling of error messages to sdk (#2195) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit #### Summary This PR requires changes to plugin-pb --- Use the following steps to ensure your PR is ready to be reviewed - [ ] Read the [contribution guidelines](../blob/main/CONTRIBUTING.md) ๐Ÿง‘โ€๐ŸŽ“ - [ ] Run `go fmt` to format your code ๐Ÿ–Š - [ ] Lint your changes via `golangci-lint run` ๐Ÿšจ (install golangci-lint [here](https://golangci-lint.run/usage/install/#local-installation)) - [ ] Update or add tests ๐Ÿงช - [ ] Ensure the status checks below are successful โœ… --- internal/servers/plugin/v3/plugin.go | 10 ++++++++++ message/sync_message.go | 10 ++++++++++ scheduler/queue/scheduler.go | 4 +++- scheduler/queue/scheduler_test.go | 4 +++- scheduler/queue/worker.go | 11 +++++++++++ scheduler/scheduler.go | 3 +++ scheduler/scheduler_dfs.go | 7 +++++++ scheduler/scheduler_shuffle_queue.go | 2 +- 8 files changed, 48 insertions(+), 3 deletions(-) diff --git a/internal/servers/plugin/v3/plugin.go b/internal/servers/plugin/v3/plugin.go index 83dcc9a0c6..d2d968881c 100644 --- a/internal/servers/plugin/v3/plugin.go +++ b/internal/servers/plugin/v3/plugin.go @@ -259,6 +259,16 @@ func (s *Server) Sync(req *pb.Sync_Request, stream pb.Plugin_SyncServer) error { WhereClause: whereClause, }, } + case *message.SyncError: + if !req.WithErrorMessages { + continue + } + pbMsg.Message = &pb.Sync_Response_Error{ + Error: &pb.Sync_MessageError{ + TableName: m.TableName, + Error: m.Error, + }, + } default: return status.Errorf(codes.Internal, "unknown message type: %T", msg) } diff --git a/message/sync_message.go b/message/sync_message.go index 1be85f2999..912cded1d5 100644 --- a/message/sync_message.go +++ b/message/sync_message.go @@ -121,3 +121,13 @@ type SyncDeleteRecord struct { func (m SyncDeleteRecord) GetTable() *schema.Table { return &schema.Table{Name: m.TableName} } + +type SyncError struct { + syncBaseMessage + TableName string + Error string +} + +func (e SyncError) GetTable() *schema.Table { + return &schema.Table{Name: e.TableName} +} diff --git a/scheduler/queue/scheduler.go b/scheduler/queue/scheduler.go index 854ac3968c..a3f2a97dc5 100644 --- a/scheduler/queue/scheduler.go +++ b/scheduler/queue/scheduler.go @@ -4,6 +4,7 @@ import ( "context" "github.com/cloudquery/plugin-sdk/v4/caser" + "github.com/cloudquery/plugin-sdk/v4/message" "github.com/cloudquery/plugin-sdk/v4/scheduler/metrics" "github.com/cloudquery/plugin-sdk/v4/schema" "github.com/google/uuid" @@ -77,7 +78,7 @@ func NewShuffleQueueScheduler(logger zerolog.Logger, m *metrics.Metrics, seed in return scheduler } -func (d *Scheduler) Sync(ctx context.Context, tableClients []WorkUnit, resolvedResources chan<- *schema.Resource) { +func (d *Scheduler) Sync(ctx context.Context, tableClients []WorkUnit, resolvedResources chan<- *schema.Resource, msgChan chan<- message.SyncMessage) { if len(tableClients) == 0 { return } @@ -102,6 +103,7 @@ func (d *Scheduler) Sync(ctx context.Context, tableClients []WorkUnit, resolvedR d.invocationID, d.deterministicCQID, d.metrics, + msgChan, ).work(ctx, activeWorkSignal) return nil }) diff --git a/scheduler/queue/scheduler_test.go b/scheduler/queue/scheduler_test.go index c25134a12f..1d8c565def 100644 --- a/scheduler/queue/scheduler_test.go +++ b/scheduler/queue/scheduler_test.go @@ -5,6 +5,7 @@ import ( "fmt" "testing" + "github.com/cloudquery/plugin-sdk/v4/message" "github.com/cloudquery/plugin-sdk/v4/scheduler/metrics" "github.com/cloudquery/plugin-sdk/v4/schema" "github.com/cloudquery/plugin-sdk/v4/transformers" @@ -83,9 +84,10 @@ func TestScheduler(t *testing.T) { } resolvedResources := make(chan *schema.Resource) + msgs := make(chan message.SyncMessage, 10) go func() { defer close(resolvedResources) - scheduler.Sync(context.Background(), tableClients, resolvedResources) + scheduler.Sync(context.Background(), tableClients, resolvedResources, msgs) }() gotResources := make([]*schema.Resource, 0) diff --git a/scheduler/queue/worker.go b/scheduler/queue/worker.go index 556051f804..eff44dece5 100644 --- a/scheduler/queue/worker.go +++ b/scheduler/queue/worker.go @@ -10,6 +10,7 @@ import ( "github.com/cloudquery/plugin-sdk/v4/caser" "github.com/cloudquery/plugin-sdk/v4/helpers" + "github.com/cloudquery/plugin-sdk/v4/message" "github.com/cloudquery/plugin-sdk/v4/scheduler/metrics" "github.com/cloudquery/plugin-sdk/v4/scheduler/resolvers" "github.com/cloudquery/plugin-sdk/v4/schema" @@ -29,6 +30,8 @@ type worker struct { invocationID string deterministicCQID bool metrics *metrics.Metrics + // message channel for sending SyncError messages + msgChan chan<- message.SyncMessage } func (w *worker) work(ctx context.Context, activeWorkSignal *activeWorkSignal) { @@ -51,6 +54,7 @@ func newWorker( invocationID string, deterministicCQID bool, m *metrics.Metrics, + msgChan chan<- message.SyncMessage, ) *worker { return &worker{ jobs: jobs, @@ -61,6 +65,7 @@ func newWorker( deterministicCQID: deterministicCQID, invocationID: invocationID, metrics: m, + msgChan: msgChan, } } @@ -105,6 +110,12 @@ func (w *worker) resolveTable(ctx context.Context, table *schema.Table, client s logger.Error().Err(err).Msg("table resolver finished with error") tableMetrics.OtelErrorsAdd(ctx, 1) atomic.AddUint64(&tableMetrics.Errors, 1) + // Send SyncError message + syncErrorMsg := &message.SyncError{ + TableName: table.Name, + Error: err.Error(), + } + w.msgChan <- syncErrorMsg return } }() diff --git a/scheduler/scheduler.go b/scheduler/scheduler.go index c9718e6524..7b0107dc44 100644 --- a/scheduler/scheduler.go +++ b/scheduler/scheduler.go @@ -139,6 +139,8 @@ type syncClient struct { metrics *metrics.Metrics logger zerolog.Logger invocationID string + // message channel for sending SyncError messages + msgChan chan<- message.SyncMessage shard *shard } @@ -213,6 +215,7 @@ func (s *Scheduler) Sync(ctx context.Context, client schema.ClientMeta, tables s scheduler: s, logger: s.logger, invocationID: s.invocationID, + msgChan: res, } for _, opt := range opts { opt(syncClient) diff --git a/scheduler/scheduler_dfs.go b/scheduler/scheduler_dfs.go index 666ef31f76..592269d5c0 100644 --- a/scheduler/scheduler_dfs.go +++ b/scheduler/scheduler_dfs.go @@ -9,6 +9,7 @@ import ( "time" "github.com/cloudquery/plugin-sdk/v4/helpers" + "github.com/cloudquery/plugin-sdk/v4/message" "github.com/cloudquery/plugin-sdk/v4/scheduler/batchsender" "github.com/cloudquery/plugin-sdk/v4/scheduler/metrics" "github.com/cloudquery/plugin-sdk/v4/scheduler/resolvers" @@ -119,6 +120,12 @@ func (s *syncClient) resolveTableDfs(ctx context.Context, table *schema.Table, c logger.Error().Err(err).Msg("table resolver finished with error") tableMetrics.OtelErrorsAdd(ctx, 1) atomic.AddUint64(&tableMetrics.Errors, 1) + // Send SyncError message + syncErrorMsg := &message.SyncError{ + TableName: table.Name, + Error: err.Error(), + } + s.msgChan <- syncErrorMsg return } }() diff --git a/scheduler/scheduler_shuffle_queue.go b/scheduler/scheduler_shuffle_queue.go index 956439099e..0bc5867cd7 100644 --- a/scheduler/scheduler_shuffle_queue.go +++ b/scheduler/scheduler_shuffle_queue.go @@ -45,5 +45,5 @@ func (s *syncClient) syncShuffleQueue(ctx context.Context, resolvedResources cha Client: tc.client, }) } - scheduler.Sync(ctx, queueClients, resolvedResources) + scheduler.Sync(ctx, queueClients, resolvedResources, s.msgChan) } From 0e8e1c1c24a0304f867b9d091ad5568ac1be8349 Mon Sep 17 00:00:00 2001 From: CloudQuery Bot <102256036+cq-bot@users.noreply.github.com> Date: Fri, 27 Jun 2025 15:12:25 +0100 Subject: [PATCH 5/5] chore(main): Release v4.85.0 (#2194) :robot: I have created a release *beep* *boop* --- ## [4.85.0](https://github.com/cloudquery/plugin-sdk/compare/v4.84.2...v4.85.0) (2025-06-27) ### Features * Add handling of error messages to sdk ([#2195](https://github.com/cloudquery/plugin-sdk/issues/2195)) ([c5273da](https://github.com/cloudquery/plugin-sdk/commit/c5273da9f82e289452a9bfa54bb02b9f5c615a01)) ### Bug Fixes * **deps:** Update aws-sdk-go-v2 monorepo ([#2193](https://github.com/cloudquery/plugin-sdk/issues/2193)) ([d220f63](https://github.com/cloudquery/plugin-sdk/commit/d220f6354c0d2a901eba541126580137254b82b0)) * **deps:** Update module github.com/cloudquery/plugin-pb-go to v1.26.13 ([#2196](https://github.com/cloudquery/plugin-sdk/issues/2196)) ([140b6f3](https://github.com/cloudquery/plugin-sdk/commit/140b6f3d90e2b0d37f74308a50ff5f61cfeaf20c)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). --- .release-please-manifest.json | 2 +- CHANGELOG.md | 13 +++++++++++++ 2 files changed, 14 insertions(+), 1 deletion(-) diff --git a/.release-please-manifest.json b/.release-please-manifest.json index c8e9eb0a4d..f48cc7f57f 100644 --- a/.release-please-manifest.json +++ b/.release-please-manifest.json @@ -1,3 +1,3 @@ { - ".": "4.84.2" + ".": "4.85.0" } diff --git a/CHANGELOG.md b/CHANGELOG.md index 51e678d089..1920a89ca6 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -5,6 +5,19 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html). +## [4.85.0](https://github.com/cloudquery/plugin-sdk/compare/v4.84.2...v4.85.0) (2025-06-27) + + +### Features + +* Add handling of error messages to sdk ([#2195](https://github.com/cloudquery/plugin-sdk/issues/2195)) ([c5273da](https://github.com/cloudquery/plugin-sdk/commit/c5273da9f82e289452a9bfa54bb02b9f5c615a01)) + + +### Bug Fixes + +* **deps:** Update aws-sdk-go-v2 monorepo ([#2193](https://github.com/cloudquery/plugin-sdk/issues/2193)) ([d220f63](https://github.com/cloudquery/plugin-sdk/commit/d220f6354c0d2a901eba541126580137254b82b0)) +* **deps:** Update module github.com/cloudquery/plugin-pb-go to v1.26.13 ([#2196](https://github.com/cloudquery/plugin-sdk/issues/2196)) ([140b6f3](https://github.com/cloudquery/plugin-sdk/commit/140b6f3d90e2b0d37f74308a50ff5f61cfeaf20c)) + ## [4.84.2](https://github.com/cloudquery/plugin-sdk/compare/v4.84.1...v4.84.2) (2025-06-18)