[vcpkg] Add commands to maintain and verify versions db integrity (#14999)

* [vcpkg] Add x-ci-verify-versions command

* Code cleanup

* Remove port version splitting from x-history

* Fix wrong message on success

* Parallelize versions file generator

* Use cpu_count()/2 to avoid crashes

* Check db SHA against local SHA

* Check baseline version with x-ci-verify-versions and make baseline generator much faster

* Implement x-add-version to update version db files

* Better checks for x-add-info and make x-ci-verify-versions silent on success

* Use find() instead of [] on maps

* Create version file if does not exist

* Allow redirection of ports/ and port_versions/

* add test ports

* WIP end-to-end tests

* Change pats in e2e tests

* Fix e2e args

* e2e once more

* Pass ersions feature flag to e2e

* Exit with code 1 if there are errors

* Files to test for failure cases

* Update test files

* Add test for x-add-version

* fix redirected ports in last test

* Add CI check (use dummy data)

* Add feature-flags=versions

* Ignore subdirectories inside ports

* Add --verify-git-trees switch

* [vcpkg] Fix build breaks

* [x-ci-verify-versions] PR comments

* [x-add-version] PR comments

* Fix merge conflicts

* Modify tests and pipeline

* Baselines should only have version-string

* Refactor x-add-version

* [vcpkg] Fix help message

* [vcpkg] Fix minor warnings

* `x-add-version --all` doesn't stop on first failure and reduced default verbosity

* [vcpkg] Fix default-baseline

* Load file instead of using paths provider

* Format

* Remove ci test

* Add fish port for testing

* Update version files

* Update fish port to cause SHA discrepancy

* Test for discrepancy between local SHA and declared SHA

* Missing = operator

* Check for error message since x-add-version exits with code 0

* Make x-add-version fail with non-zero exit code if not run with --all

Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
Co-authored-by: Robert Schumacher <ras0219@outlook.com>

5 files changed, 56 insertions, 0 deletions

diff --git a/scripts/testing/version-files/port_versions/baseline.json b/scripts/testing/version-files/port_versions/baseline.json
new file mode 100644
index 000000000..bfe49f984
--- /dev/null
+++ b/scripts/testing/version-files/port_versions/baseline.json
@@ -0,0 +1,20 @@
+{
+  "default": {
+    "cat": {
+      "version-string": "1.0",
+      "port-version": 0
+    },
+    "dog": {
+      "version-string": "2001-01-01",
+      "port-version": 0
+    },
+    "duck": {
+      "version-string": "mallard",
+      "port-version": 0
+    },
+    "mouse": {
+      "version-string": "1.0.0",
+      "port-version": 0
+    }
+  }
+}
diff --git a/scripts/testing/version-files/port_versions/c-/cat.json b/scripts/testing/version-files/port_versions/c-/cat.json
new file mode 100644
index 000000000..e39cd6d4e
--- /dev/null
+++ b/scripts/testing/version-files/port_versions/c-/cat.json
@@ -0,0 +1,9 @@
+{
+  "versions": [
+    {
+      "git-tree": "5dd257451526d5b9e560f5f35d7029ba40d88587",
+      "version": "1.0",
+      "port-version": 0
+    }
+  ]
+}
diff --git a/scripts/testing/version-files/port_versions/d-/dog.json b/scripts/testing/version-files/port_versions/d-/dog.json
new file mode 100644
index 000000000..49c086c38
--- /dev/null
+++ b/scripts/testing/version-files/port_versions/d-/dog.json
@@ -0,0 +1,9 @@
+{
+  "versions": [
+    {
+      "git-tree": "e170a2ed0da7ba5d434c4a0a98ffd7a3159e3200",
+      "version-date": "2001-01-01",
+      "port-version": 0
+    }
+  ]
+}
diff --git a/scripts/testing/version-files/port_versions/d-/duck.json b/scripts/testing/version-files/port_versions/d-/duck.json
new file mode 100644
index 000000000..4f4b209e2
--- /dev/null
+++ b/scripts/testing/version-files/port_versions/d-/duck.json
@@ -0,0 +1,9 @@
+{
+  "versions": [
+    {
+      "git-tree": "0a52a9d722c75b3bfe47d5f5db6c9eb1a64af156",
+      "version-string": "mallard",
+      "port-version": 0
+    }
+  ]
+}
diff --git a/scripts/testing/version-files/port_versions/m-/mouse.json b/scripts/testing/version-files/port_versions/m-/mouse.json
new file mode 100644
index 000000000..139c8450f
--- /dev/null
+++ b/scripts/testing/version-files/port_versions/m-/mouse.json
@@ -0,0 +1,9 @@
+{
+  "versions": [
+    {
+      "git-tree": "55ed624191e0a1905bd97af29fdf6a1d7f4e6d7c",
+      "version-semver": "1.0.0",
+      "port-version": 0
+    }
+  ]
+}