[ovirt-devel] discussing the future of the upgrade suite in ost

Hi All, I was reviewing the upgrade suites in ost and there are some issues that I am seeing in the suite tests-scenarios which I want to discuss and decide the future of. At it current state, I think we should remove the upgrade suite or most of the post test-scenarios as it is not testing what it should. The tests currently only test engine upgrade and basic sanity after the upgrade. This is problematic in a few ways: 1. upgrade should test the upgrade of rhv and not just a clean engine upgrade (i.e host, storage, vm). 2. as we have limited resources I do not think that the upgrade suite should be longer then the basic suite (and as we are currently running the basic suite after the upgrade it is longer) That brings me to question what should be essential to test in upgrade in the CI? I would also need someone in dev to volunteer and take ownership of the testing scenarios for upgrade - is there anyone that can help? Thanks, Dafna