-
Notifications
You must be signed in to change notification settings - Fork 1.3k
[WIP] backup: veeam kvm integration #12991
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
shwstppr
wants to merge
137
commits into
apache:main
Choose a base branch
from
shapeblue:integration-veeam-kvm
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Changes from 1 commit
Commits
Show all changes
137 commits
Select commit
Hold shift + click to select a range
7c23b26
[WIP] plugins: veeam control service
shwstppr 065ec85
wip
shwstppr a30eb28
changes for discovery
shwstppr f52b114
changes
shwstppr 2784468
changes
shwstppr 81c3b5b
changes
shwstppr f396c5c
Basic working version-1
abh1sar 73df3cb
Create volume on the given storage pool
abh1sar 23ecb1f
Image server basic working version in SSVM.
abh1sar 5389fe6
Image server with disk upload
abh1sar aae158b
upload fix-1
abh1sar 10f65b6
image upload working
abh1sar 7b45d2e
wip: changes for imagetransfer handling
shwstppr 2350661
Added progress to upload Image Transfers
abh1sar 9ee9748
get Options to return capabilities for upload
abh1sar f83fd00
add license to image_server.py
abh1sar 2bc3114
fix precommit, license
shwstppr 3460a5d
veeam control changes
shwstppr b926c74
server changes
shwstppr da62e9a
Support multiple disks and checkpoints
abh1sar 4173947
extents(zero/dirty) and capabilities - working
abh1sar 91a081b
Patch (zero, data) + Flush support in image_server.py
abh1sar c36cd2c
Backup of stopped VMs
abh1sar ca4112e
api/server: create dummy KVM VM without volume and network is optional
weizhouapache a366929
worker vm deployment wip
shwstppr 586134d
Support file backend for cow format: api and server
abh1sar 6ca1c9b
Image server support for file backend (qcow2 upload)
abh1sar fba7c63
ut failure in UserVmManagerImplTest
abh1sar a89f872
wip
shwstppr 106fbdb
fixes to allow worker vm deployment
shwstppr b97f70c
userdata: defensive check for userdata validation
shwstppr 047595d
fix snapshot delete
shwstppr 2352c83
return job for async=false as well
shwstppr d9a7d2f
refactor, implement remaining endpoints
shwstppr 4853453
kvm hosts and clusters only
shwstppr a9c0215
oauth fix
shwstppr 894eef1
fix numbers in response
shwstppr aa7d4bc
changes for backup job fix
shwstppr 0b4b02d
changes to backup and checkpoints api
shwstppr c0b8aa6
plugin changes, fixes
shwstppr 3a02433
refactor
shwstppr 30136c8
Image server on kvm host - with image_server.py http server
abh1sar 0ff4dc5
remove image server from systmvm
abh1sar f907098
changes
shwstppr 27a2eb0
fix
shwstppr 18fbf76
fix
shwstppr 11592b0
fix image_server.py
abh1sar 8655f61
fix pre-commit
abh1sar 196dd7f
fix ovf end tag
shwstppr 0dadbad
fix start nbd server
shwstppr b68e541
remove hostIpaddress from startNbdCommand
abh1sar 824b05f
image server : support for range puts and blocking writes
abh1sar eac6943
fix put disk
shwstppr a0be1fb
temp fix for orphan image transfer listing and backup removal
shwstppr 05a5b03
changes for user assignement; refactor
shwstppr 10ad796
bug fixes
abh1sar 9974e48
changes for retrieving vm account from ovf
shwstppr f4a4c7a
fix for project owned resource
shwstppr 29dbf69
fix same vm restore
shwstppr d527762
Fix backup of stopped VMs by allowing multiple connections.
abh1sar a6c7e55
fix export bitmap in start backup of running vm
abh1sar 1f72a22
changes for restore with template; refactor
shwstppr 3bce25d
fix check for blank instance
shwstppr 90d87d0
restore with correct bios type
shwstppr 1e9a116
fix naming issue
shwstppr cb2d736
changes for default bios boot type
shwstppr 38c8b70
server,engine-schema: allow retrieving volume stats for stopped vms
shwstppr 50403f7
changes for allowed cidrs; refactor
shwstppr 5907d64
Use the upper ceiling (in gb) for the volume size during restore
abh1sar 3e7268e
modularize image server
abh1sar 81fc6d5
Agent communication with Image server via unix socket
abh1sar dad314a
Image server unittests
abh1sar bb213dc
extract constants used in image server
abh1sar 5b71847
fix network listing
shwstppr 8d42d5f
change name from IncrementalBackupService to KVMBackupExportService
abh1sar b6d480c
hide kvm backup export service apis behind a global config
abh1sar ca0ad93
Remove dependency on backup offering. Make backup export service excl…
abh1sar ce19b92
coalesce similar extents
abh1sar 9a7008a
change image server default port from 54323 to 54322
abh1sar 2bbbcae
Add tests for qcow2 file parallel range reads and puts
abh1sar ebdcf70
fix pre-commit failures
abh1sar e32a6ab
Make veeam-kvm exclusive with other providers
abh1sar 19a8509
Image server TLS support
abh1sar 260e6bc
storage pool type fix
shwstppr bad164c
fixes
shwstppr 414d96e
remove unused classes
shwstppr bf856ab
fix serviceoffering custom offering
shwstppr 5fd1b85
return internal CA certificate
shwstppr 2d2f740
Support local storage and shared mount point
abh1sar cdf4684
use shared=0 for unittests
abh1sar 6f4758d
expiry timeouts for idle image transfers
abh1sar 5310f29
fix tests
abh1sar 76793f0
enable TLS by default and add listen address to agent.properties
abh1sar ac25dc9
remove unused code
shwstppr b52daa2
changes for access checks
shwstppr d6055c9
create volume on storage refactor
abh1sar b84ff6b
move checkpoint to vm details
abh1sar dc480e0
Implement backend for delete vm checkpoint
abh1sar 6e420fe
fix config export to test backup apis
abh1sar c588e67
changes for adding syncqueueitem for backup to block other operations on
shwstppr 1669c0d
fix db list issue
shwstppr 800faa4
add log
shwstppr e836bab
fix vm tags
shwstppr 1078202
addressed with finalizing transfers before backup
shwstppr 1ddccaa
fix storagedomain retrieval
shwstppr f118fc2
add logs for unimplemented endpoints
shwstppr b7f8fa3
handle PUT on disks/{id}; refactor
shwstppr 259ba31
fix vms listing with tags, effectively tagged jobs
shwstppr d804b75
address orphan trnasfers
shwstppr 2f67356
cleanup; return tags with specific key only
shwstppr 40cadd0
merge fixes
shwstppr 605f7bf
Add stress test. Fix concurrency.
abh1sar ef1a47e
max writers as 1 for file backend
abh1sar 527db66
fix precommit
abh1sar 411122b
Fix fd double free in nbd backend
abh1sar ff12afb
don't allow image transfer creation if image transfer entry is alread…
abh1sar 1d20ecc
fix image transfer response object name
abh1sar 9af2c94
rename image_transfer disk_id to volume_id
abh1sar a9fb479
Use executor service for pollImageTransferProgress
abh1sar e2aac41
Add package dependency for python3-libnbd and socat
abh1sar e5fd64b
refactor tags
shwstppr 07bca60
Merge remote-tracking branch 'upstream/main' into fork/shapeblue/inte…
abh1sar c40b30b
Remove ImagetransferProgress Command
abh1sar 00d1dbc
Remove image server per-image concurrency locks
abh1sar fb82ca3
config: fix ManagementServer scope
shwstppr 82d062e
fix checkstyle error
shwstppr fac62ad
build fix
shwstppr 830044d
make bind address managementserver scoped
shwstppr 0c83842
fix updateconfiguration response scope
shwstppr c9a55c8
fix image_transfer column name
shwstppr daa910a
wait for inflight request before de-registering image transfer
abh1sar d263241
rename config
shwstppr 48119d7
fix test failures
shwstppr 39b2cef
fix protocol version and add logging
abh1sar 38a83d6
backend optimization
abh1sar 0bd4f0f
add ut
abh1sar 34960a0
fix precommit
abh1sar File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
api/server: create dummy KVM VM without volume and network is optional
- Loading branch information
commit ca4112e7d0ef3ca377b8de1652dc3cb133f7b352
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Returning from
allocate(...)when the template is a blank/dummy template likely aborts the rest of the VM allocation flow (beyond root volume allocation). If the intent is only to skip root volume allocation, avoidreturnhere and instead conditionally skipallocateRootVolume(...)while letting the method continue.