Skip to content

feat: Purge stale data#565

Merged
roneli merged 7 commits into
cloudquery:mainfrom
roneli:feat/purge_stale_data
Apr 7, 2022
Merged

feat: Purge stale data#565
roneli merged 7 commits into
cloudquery:mainfrom
roneli:feat/purge_stale_data

Conversation

@roneli
Copy link
Copy Markdown
Contributor

@roneli roneli commented Apr 1, 2022

No description provided.

@roneli roneli changed the title wip feat: Purge stale data Apr 1, 2022
@github-actions github-actions Bot added the feat label Apr 1, 2022
Comment thread pkg/client/remove_stale.go Outdated
Comment thread pkg/client/schema.go
Comment thread pkg/plugin/manager.go Outdated
Comment thread pkg/plugin/manager.go
Comment thread pkg/client/storage.go
Comment thread pkg/ui/console/client.go Outdated
@roneli roneli force-pushed the feat/purge_stale_data branch from 8c78a9f to 53d926d Compare April 3, 2022 06:50
@roneli roneli self-assigned this Apr 3, 2022
@roneli roneli force-pushed the feat/purge_stale_data branch from cc22807 to f760f12 Compare April 5, 2022 17:33
@roneli roneli marked this pull request as ready for review April 5, 2022 17:34
@roneli roneli requested review from a team, bbernays and shimonp21 and removed request for a team and shimonp21 April 5, 2022 17:34
Copy link
Copy Markdown
Member

@disq disq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, maybe remove SimpleStorage if still unused

Copy link
Copy Markdown
Collaborator

@bbernays bbernays left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If I run the following command I would expect that no data should be deleted:

go run main.go provider purge aws --dry-run=true --last-update=0h

Comment thread pkg/ui/console/client.go Outdated
Comment thread pkg/ui/console/client.go Outdated
Copy link
Copy Markdown
Collaborator

@bbernays bbernays left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we need better documentation on what a duration value is. We cannot expect users to know go

Comment thread pkg/ui/console/client.go Outdated
@roneli roneli force-pushed the feat/purge_stale_data branch from 641add1 to 538f2c3 Compare April 6, 2022 12:56
@roneli roneli force-pushed the feat/purge_stale_data branch from 538f2c3 to a657762 Compare April 6, 2022 12:57
@disq
Copy link
Copy Markdown
Member

disq commented Apr 6, 2022

nit: Duration cmd help tells about how Go time.Duration string format works, doesn't describe how it's used in the context of purging.

@roneli roneli merged commit d06bad3 into cloudquery:main Apr 7, 2022
@roneli roneli deleted the feat/purge_stale_data branch April 7, 2022 11:48
TinLe pushed a commit to TinLe/cloudquery that referenced this pull request Apr 7, 2022
* upstream/main:
  feat: Purge stale data (cloudquery#565)
  feat: Add '--disable-fetch-check' flag (cloudquery#567)
  chore: Sync form .github (cloudquery#569)
  feat: Drift: Improvements (cloudquery#563)
  fix: Added error when connection configuration is not set (cloudquery#476)
  feat: Check for slashes in policy (cloudquery#561)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants