Skip to content

CLOUDSTACK-9989: Extend smoketests suite#2219

Merged
yadvr merged 4 commits into
apache:masterfrom
borisstoyanov:extend-smoketest
Nov 22, 2017
Merged

CLOUDSTACK-9989: Extend smoketests suite#2219
yadvr merged 4 commits into
apache:masterfrom
borisstoyanov:extend-smoketest

Conversation

@borisstoyanov
Copy link
Copy Markdown
Contributor

@borisstoyanov borisstoyanov commented Aug 2, 2017 •
edited
Loading

Adding few areas of tests to the smoketests since they are not covered when doing PR testing but important at the same time.

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Aug 4, 2017

@borisstoyanov can you confirm if these tests run okay with Trillian? I've had moved some component tests to run part of Travis that you may consider to include as well, however keep in mind some tests run longer than half a day, while a typical Trillian smoke tests may take about half a day or less.

@borisstoyanov
Copy link
Copy Markdown
Contributor Author

borisstoyanov commented Aug 7, 2017

Yes @rhtyd, I've run them on a Trillian env before moving them in the smoketests

@borisstoyanov
Copy link
Copy Markdown
Contributor Author

borisstoyanov commented Sep 8, 2017

ping @DaanHoogland @nvazquez @PaulAngus for review

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 17, 2017

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 17, 2017

@borisstoyanov as part of moving these tests, maybe we can include them in .travis.yml too?

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-1271

@borisstoyanov
Copy link
Copy Markdown
Contributor Author

borisstoyanov commented Nov 17, 2017

Thanks @rhtyd, I've pushed the change in travis yml file.

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 17, 2017

okay @borisstoyanov we might need to refactor/rearrange them at some point, I'll fire some tests.
@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-1272

@borisstoyanov
Copy link
Copy Markdown
Contributor Author

borisstoyanov commented Nov 17, 2017

@blueorangutan test

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

@borisstoyanov a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link
Copy Markdown

blueorangutan commented Nov 17, 2017

Trillian test result (tid-1660)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36581 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2219-t1660-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_host_annotations.py
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_templates.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 62 look OK, 5 have error(s)

Test Result Time (s) Test File
test_01_vpc_remote_access_vpn Failure 45.83 test_vpc_vpn.py
test_07_resize_fail Failure 15.37 test_volumes.py
test_04_rvpc_privategw_static_routes Failure 213.41 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Failure 157.98 test_privategw_acl.py
test_02_vpc_privategw_static_routes Failure 107.92 test_privategw_acl.py
test_01_vpc_privategw_acl Failure 46.61 test_privategw_acl.py
ContextSuite context=TestRedundantIsolateNetworks>:teardown Error 145.80 test_routers_network_ops.py
test_05_add_annotation_for_invalid_entityType Error 0.07 test_host_annotations.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_09_copy_delete_template Skipped 0.02 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.12 test_primary_storage.py
test_vm_nic_adapter_vmxnet3 Skipped 0.00 test_nic_adapter_type.py
test_03_nic_multiple_vmware Skipped 1.16 test_nic.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_list_ha_for_host_valid Skipped 0.03 test_hostha_simulator.py
test_list_ha_for_host_invalid Skipped 0.02 test_hostha_simulator.py
test_list_ha_for_host Skipped 0.02 test_hostha_simulator.py
test_hostha_enable_feature_without_setting_provider Skipped 0.02 test_hostha_simulator.py
test_hostha_enable_feature_valid Skipped 0.03 test_hostha_simulator.py
test_hostha_disable_feature_valid Skipped 0.02 test_hostha_simulator.py
test_hostha_configure_invalid_provider Skipped 0.02 test_hostha_simulator.py
test_hostha_configure_default_driver Skipped 0.03 test_hostha_simulator.py
test_ha_verify_fsm_recovering Skipped 0.03 test_hostha_simulator.py
test_ha_verify_fsm_fenced Skipped 0.02 test_hostha_simulator.py
test_ha_verify_fsm_degraded Skipped 0.02 test_hostha_simulator.py
test_ha_verify_fsm_available Skipped 0.02 test_hostha_simulator.py
test_ha_multiple_mgmt_server_ownership Skipped 0.03 test_hostha_simulator.py
test_ha_list_providers Skipped 0.02 test_hostha_simulator.py
test_ha_enable_feature_invalid Skipped 0.02 test_hostha_simulator.py
test_ha_disable_feature_invalid Skipped 0.02 test_hostha_simulator.py
test_ha_configure_enabledisable_across_clusterzones Skipped 0.02 test_hostha_simulator.py
test_configure_ha_provider_valid Skipped 0.02 test_hostha_simulator.py
test_configure_ha_provider_invalid Skipped 0.03 test_hostha_simulator.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 22, 2017

LGTM, the travis job TestStorageTags:tearDown failure is known intermittent failure.

@yadvr yadvr merged commit fd7eeb4 into apache:master Nov 22, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

status:testing

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@borisstoyanov @yadvr @blueorangutan @kiwiflyer