Browse Source

build(gha): Reduce backend test instances, change acceptance grouping (#21887)

* Reduce backend tests instances from 3 -> 2
  * Our slowest tests take around 18m, where as these backend tests take around 10m, to be more efficient with concurrent test runs we want tests to have similar durations.
* Change the acceptance test grouping strategy to be per test case instead of per file. This ensures (for now) a better balancing of our tests. Otherwise, there was one test instance that ran our 2 slowest test suites (issue details and eventsv2) and would always finish 4-5 minutes after the fastest acceptance suite. With round robin, we distribute tests between all 3 instances.
  * Previous acceptance test runs per instance would roughly take around 14m, 18m, and 16m
Billy Vong 4 years ago
parent
commit
1ba73dc39c

+ 1 - 0
.github/workflows/acceptance-py3.6.yml

@@ -18,6 +18,7 @@ jobs:
 
     env:
       MIGRATIONS_TEST_MIGRATE: 1
+      TEST_GROUP_STRATEGY: roundrobin
 
     steps:
       - uses: actions/checkout@v2

+ 1 - 0
.github/workflows/acceptance.yml

@@ -96,6 +96,7 @@ jobs:
 
     env:
       VISUAL_SNAPSHOT_ENABLE: 1
+      TEST_GROUP_STRATEGY: roundrobin
 
     steps:
       - uses: actions/checkout@v2

+ 1 - 1
.github/workflows/backend-test-py2.7.yml

@@ -13,7 +13,7 @@ jobs:
     timeout-minutes: 20
     strategy:
       matrix:
-        instance: [0, 1, 2]
+        instance: [0, 1]
 
     env:
       MIGRATIONS_TEST_MIGRATE: 1

+ 1 - 1
.github/workflows/backend-test-py3.6.yml

@@ -13,7 +13,7 @@ jobs:
     timeout-minutes: 30
     strategy:
       matrix:
-        instance: [0, 1, 2]
+        instance: [0, 1]
 
     env:
       MIGRATIONS_TEST_MIGRATE: 1