aboutsummaryrefslogtreecommitdiff
path: root/scripts/azure-pipelines
AgeCommit message (Collapse)Author
2021-01-12[vcpkg] Resolve macos host machines running out of disk space by reducing ↵Billy O'Neal
size and using fixed disks. (#15584)
2021-01-08[vcpkg] Add x64-windows-static-md to pipeline (#15411)ankurverma85
* Add x64-windows-static-md to pipeline * Update azure-pipelines.yml * Update test-modified-ports.ps1 * Replicate skip/fail from x64-windows-static * Add failures to ci.baseline * Update ci.baseline.txt * Update ci.baseline.txt * Update ci.baseline.txt * Update ci.baseline.txt Co-authored-by: ankurv <ankurv@microsoft.com>
2021-01-07[vcpkg] Add commands to maintain and verify versions db integrity (#14999)Victor Romero
* [vcpkg] Add x-ci-verify-versions command * Code cleanup * Remove port version splitting from x-history * Fix wrong message on success * Parallelize versions file generator * Use cpu_count()/2 to avoid crashes * Check db SHA against local SHA * Check baseline version with x-ci-verify-versions and make baseline generator much faster * Implement x-add-version to update version db files * Better checks for x-add-info and make x-ci-verify-versions silent on success * Use find() instead of [] on maps * Create version file if does not exist * Allow redirection of ports/ and port_versions/ * add test ports * WIP end-to-end tests * Change pats in e2e tests * Fix e2e args * e2e once more * Pass ersions feature flag to e2e * Exit with code 1 if there are errors * Files to test for failure cases * Update test files * Add test for x-add-version * fix redirected ports in last test * Add CI check (use dummy data) * Add feature-flags=versions * Ignore subdirectories inside ports * Add --verify-git-trees switch * [vcpkg] Fix build breaks * [x-ci-verify-versions] PR comments * [x-add-version] PR comments * Fix merge conflicts * Modify tests and pipeline * Baselines should only have version-string * Refactor x-add-version * [vcpkg] Fix help message * [vcpkg] Fix minor warnings * `x-add-version --all` doesn't stop on first failure and reduced default verbosity * [vcpkg] Fix default-baseline * Load file instead of using paths provider * Format * Remove ci test * Add fish port for testing * Update version files * Update fish port to cause SHA discrepancy * Test for discrepancy between local SHA and declared SHA * Missing = operator * Check for error message since x-add-version exits with code 0 * Make x-add-version fail with non-zero exit code if not run with --all Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: Robert Schumacher <ras0219@outlook.com>
2020-12-30[vcpkg] Teach `vcpkg install` `--no-build-missing` (#15139)Robert Schumacher
* [vcpkg] Teach `vcpkg install` `--no-build-missing` This switch causes failure to restore from cache to abort the build instead of performing a just-in-time build. This is useful in complex CI systems where the build was expected to have been performed previously, such as via another pipeline. * [vcpkg] Rename flag to require binary caching
2020-12-28[cmake] update to 3.19.2 (#14716)Jack·Boos·Yu
* [cmake] update to 3.19.0 * update vmss * [cmake] update to 3.19.1 * [solid3] Fix configure error, fix static definition * [flann] Add feature hdf5 and fix it * [highfive] Fix dependency hdf5 * [simage] Fix configure error * [aws-c-common] Fix configure error * [cmake] Update to 3.19.2 * Revert changes about cmake bug * [VMSS] Update cmake path on Windows * [cmake] Update cmake hash * [minc] Fix dependency hdf5 * [cmake] Update cmake package name and path on MacOS Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-12-28Add testing with VS2015 and VS2017 compilers. (#15257)Billy O'Neal
* Add testing with VS2015 and VS2017 compilers. * Apply Nicole CRs.
2020-12-23Update MacOS Software (#15258)Billy O'Neal
2020-12-22[opentracing] Update VMs 2020-12 (#15151)Billy O'Neal
* Add meson from https://github.com/microsoft/vcpkg/pull/12860/ * Add autoconf-archive from https://github.com/microsoft/vcpkg/pull/13081/ * Add kf5windowsystem libs from https://github.com/microsoft/vcpkg/pull/13467/ * Open the FTP and SFTP ports from https://github.com/microsoft/vcpkg/pull/14412/ * Add libxcb-util0-dev from https://github.com/microsoft/vcpkg/pull/14678/ * Add libasound2-dev from https://github.com/microsoft/vcpkg/pull/14774 * Remove no longer necessary apt-mark calls. * Update nasm on Linux. * Fix longstanding bug where Storage was publicly accessible and change to generate SAS token rather than File Share * Delete no longer necessary azure storage firewall rules. * Install the newer Windows SDK with the VS installer instead of manually. * Install the VS2015 and VS2017 compilers. * Update Powershell-Core to 7.1.0. * Update source of WDK. * Update pools. * [opentracing] Repair arm64-windows failures caused by mojibake in `expected.hpp` and errors in opentracing-cpp's lint for arm64 where it thinks exceptions are disabled when they are enabled. Fixes: C:\Dev\vcpkg\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\3rd_party\include\opentracing/expected/expected.hpp(1): warning C4828: The file contains a character starting at offset 0x4a77 that is illegal in the current source character set (codepage 65001). Fixes: D:\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\include\opentracing/tracer.h:223:5: error: cannot use 'try' with exceptions disabled [clang-diagnostic-error] try { ^ * [mmloader] Patch out overrides of CMAKE_C_FLAGS and CMAKE_CXX_FLAGS that inserted /WX. Note that this port sets /GS-, possibly because it may be for authoring shellcode. * Bump storage API version to 2020-04-08.
2020-12-21[vcpkg registries] support versions (#15114)nicole mazzuca
* [vcpkg registries] support versions This PR merges the Registries changes and the versioning changes, so that one can use both at the same time. There is one major difference between this PR and the RFC (#13590), which is that instead of version files looking like: ```json [ ... ] ``` version files look like: ``` { "versions": [ ... ] } ``` this is to support interop between this PR and existing demos and the like; fixing this, along with perhaps renaming `port_versions` to `port-versions` should be done after this is merged, should be a trivial change.
2020-12-17[vcpkg] `VCPKG_ENV_PASSTHROUGH_UNTRACKED` (#15115)ras0219
* [vcpkg] Add VCPKG_ENV_PASSTHROUGH_UNTRACKED * [vcpkg] CR comments Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-12-16[vcpkg ci] upload diff from clang-format to artifacts (#15141)nicole mazzuca
* [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-15[vcpkg] Refactor end-to-end tests (#15081)ras0219
* [vcpkg] Refactor end-to-end tests * [vcpkg] Cherry-pick x-builtin-ports-root from #14999 * [vcpkg] Move create test from unit tests to e2e Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-12-07[vcpkg_fixup_pkgconfig] Handle spaces in path, do not validate individual ↵ras0219
libraries (#13126)
2020-12-01[vcpkg docs] Check for documentation generation in CI (#14614)nicole mazzuca
* [vcpkg docs] Change how documenting port functions works Instead of using `##`, use comment blocks for documentation. Also, add some minor docs and change RST -> MD so we actually get docs generated. * add CI stuff * regenerate docs * fix vcpkg_find_acquire_program to not use _execute_process
2020-11-18[vcpkg] Add experimental x-azblob binary provider (#13626)ras0219
* [vcpkg] Add experimental x-azblob binary provider * [vcpkg] Test azblob storage provider in CI * [vcpkg] Address some CR comments from #13639 * [vcpkg] Fixup azure-pipelines * [vcpkg] Fix regression where the downloaded package is purged before decompressing * [vcpkg] Further refactor vcpkg::Downloads * [vcpkg] Enable OSX for x-azblob testing * [vcpkg] Reduce diff against master * [vcpkg] Extract Downloads::details::split_uri_view * [vcpkg] Address PR comments * [vcpkg] Add testing and metrics for x-azblob * [vcpkg] Add docs for x-azblob This includes a note that it is currently experimental * [vcpkg] Address CR comments * [vcpkg] Revert pipeline changes except OSX to minimize disruption Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-11-12[ampl-mp] Update version, separate port ampl-asl and fix arm build (#14518)Jack·Boos·Yu
* [ampl-asl] Separate port ampl-mp module asl to ampl-asl * [ampl-mp] Update version, separate port ampl-asl and fix arm build * update baseline * [VMSS] Pre-install ampl-mp:x86-windows * Update ports/ampl-asl/portfile.cmake
2020-10-28[vcpkg baseline] [vs-yasm] Build yasm instead of downloading it to work ↵Billy O'Neal
around memory corruption bugs in yasm itself. (#14003)
2020-10-28Delete use of vcpkg_test_cmake and vcpkg_common_functions. (#13065)Billy O'Neal
2020-10-27[vcpkg] Always publish failure logs, even on success. (#14260)Billy O'Neal
This way we get failure logs for things excluded by ci.baseline.txt in the nightly builds.
2020-10-19[cmake] upgrade to 3.18 (#12612)Stefano Sinigardi
Co-authored-by: JackBoosY <yuzaiyang@beyondsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-10-07Always accept = or space as delimiters when parsing common command line ↵Billy O'Neal
parameters. (#13857) Resolves #11456.
2020-10-06[vcpkg] Avoid computing triplet ABIs for editable packages (#13446)ras0219
* [vcpkg] Avoid computing triplet ABIs for editable packages * [vcpkg] Address PR comments * [vcpkg-end-to-end-tests] Add tests for --no-binarycaching, binarycaching by default, and --editable Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-10-06[vcpkg macos ci] modify README slightly (#13829)nicole mazzuca
Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-09-29[vcpkg osx ci] update 2020-09-28 (#13799)nicole mazzuca
* [vcpkg osx ci] update to newer bits these ones should actually work! * update vagrantfile * correct scripts, reformat, add docs * Finish Get-InternalBaseBox, move archives In order to avoid people maliciously deleting the boxes, the archives share and file share are in different users now. * baseline libqcow to be fixed later * actually check for the mount point * fix Install-Prerequisites again * add +x to Get-InternalBaseBox.ps1 additionally, fix some errors
2020-09-28Add MSVC-internal testing scripts to public GitHub. (#13748)Billy O'Neal
2020-09-25[vcpkg] Fix Windows pipeline's outdated Ninja reference (#13722)Robert Schumacher
2020-09-24[vcpkg macos ci] Switch to using our own base boxes, to fix bringing up mac ↵nicole mazzuca
machines (#13619) * [vcpkg ci:osx] Remove brew install * add instructions for creating a new vagrant box * fix the vagrant scripts for the new box * finish fixing the setup * [mecab jxrlib] fix ports for CI mecab needed to use an actual ref that wasn't master, and jxrlib needed a patch for xcode 12 CLTs. Additionally, this fixes the mecab version to be a date, the date of the last commit, since `1.0` is not the correct version (mecab doesn't have released versions) * [many ports] fix compile with Xcode 12 CLTs This mostly means fixing errors on implicit-function-declaration, and removing some Werrors * alac-decoder * apr * argtable2 * arrow * hyperscan * mcpp * minizip * mosquitto * stormlib * [many ports] even more Xcode 12 CLT fixes * [jxrlib darknet] fix the last ports! (hopefully) * CRs, plus minor wip changes to osx scripts
2020-09-21[vcpkg] Add build scripts to produce signed vcpkg binaries. (#13508)Billy O'Neal
2020-09-14[vcpkg manifest] Add documentation! (#13488)nicole mazzuca
* [vcpkg docs] add docs for manifest files These are just for the maintainer docs, not user docs. * [vcpkg] EBNF-ify platform expression parsing this modifies nothing about what strings are accepted or rejected, it just moves stuff around. also adds tests. * [vcpkg docs] add manifest mode example * [wip] docs for augustin also fix tabs * [vcpkg manifest] switch to using maps for features * Apply suggestions from code review * un-experimentize format-manifest * flesh out the user manifest mode docs * CRs * billy CRs * final personal pass-thru
2020-08-27[skia, ompl, capnproto] Update VMs for 2020-08-12 (including VS 16.7) (#12884)Billy O'Neal
Co-authored-by: Nicole Mazzuca <mazzucan@outlook.com>
2020-08-26Allow use of VS LLVM clang-format. (#13142)Billy O'Neal
2020-08-25[VMSS] Fix the printed error message (#13107)Jack·Boos·Yu
* check error message * Remove https:// * Revert test changes
2020-08-22Sort file lists and failure logs together. (#13067)Billy O'Neal
2020-08-10[vcpkg] Add `vcpkg export` to E2E tests. Enable E2E tests on all platforms. ↵ras0219
(#12198) * [vcpkg] Add `vcpkg export` to E2E tests. Enable E2E tests on MacOS. * [vcpkg] Fix export --raw --output-dir=/path/ by changing directory to new export root Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-08-02[vcpkg format-manifest] Add convert-control flag (#12471)nicole mazzuca
* [vcpkg format-manifest] initial convert-control attempt TODO: manifest comments! we should keep $directives * Finalize x-format-manifest First, fix Json::parse -- "\c", for any c, was incorrectly parsed. It would emit the escaped character, and then parse the character, so that `\b` would give you { '\b', 'b' }. Second, canonicalize source paragraphs as we're parsing them. This found an error in qt5 -- The `declarative` feature was listed twice, and we now catch it, so I removed the second paragraph. Add PlatformExpression::complexity to allow ordering platform expressions in a somewhat reasonable way. Notes: - We allow `all_modules` as a feature name for back-compat with paraview - In order to actually convert CONTROL to vcpkg.json, we'd need to rename the qt5 `default` feature. - We need to add support for $directives in x-format-manifest * fix qt5 port * format * fix compile * fix tests for canonicalization * Clean up code * add error message for nothing to format * add extra_info field * add `const X&` overloads for `Object::insert[_or_replace]` * fix compile * simple CRs * add tests * format * Fix mosquitto port file also unmerge a line * fail the tests on malformed manifest * fix format_all * fix coroutine port-version * format manifests
2020-08-01[mpg123] Allow cross-compiling, fix previous builds tainting rebuilds (#11535)Kevin Lu
* [mpg123] Allow cross-compiling, fix previous builds tainting rebuilds * [mpg123] Rewrite to use vcpkg_configure_make * Update ports/mpg123/portfile.cmake Co-authored-by: Jack·Boos·Yu <47264268+JackBoosY@users.noreply.github.com> * [mpg123] Use vcpkg_execute_required_process * [mpg123] Bump CONTROL version * [mpg123] Remove unneeded legacy lines and strip out trailing newline from dumpmachine * pre-install yasm on OSX. Co-authored-by: Jack·Boos·Yu <47264268+JackBoosY@users.noreply.github.com> Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: JackBoosY <yuzaiyang@beyondsoft.com>
2020-07-31[cmake] Add cmake port to test qt (#10770)Alexander Neumann
* [cmake] add port for qt testing * only add cmcldeps on windows * [cmake] cleanup and fix portfile for osx build * [cmake] more cleanup * move cmake to scripts/test_ports * add the overlay scripts/test_ports to ci
2020-07-31[vcpkg-ci] fix macos setup scripts (#12639)nicole mazzuca
* [vcpkg-ci] fix macos setup scripts * the disk feature is still experimental * fix Get-InstalledVirtualBoxExtensionPacks * use new bash install script for brew instead of old-style ruby
2020-07-29[vcpkg] Improve format check failure message (#12460)Jack·Boos·Yu
* [docs] Add format document * improve the error message * Check the error message * Finish test * restore file list
2020-07-14[libb2] Add supports and install pkg-conifg on macOS VM (#12398)Phoebe
* [libb2] Add supports and install pkg-conifg on macOS VM * Add blank line to the end of the json file * vcpkg x-format-manifest --all * Remove failed ports in ci baseline file
2020-07-13[vcpkg-ci] Always publish file lists (#12384)ras0219
Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-09[vcpkg] Move default binary cache from `$root/archives` to user-wide ↵ras0219
directory (#12256) * [vcpkg] Move default binary cache from `$root/archives` to user-wide directory Teach nuget/nugetconfig binary sources to use read/write. * [vcpkg] Reformat Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-09[vcpkg manifests] fix some issues (#12227)nicole mazzuca
Fixes #12190 Fixes #12208 Fixes #12234 Fixes #12286 Fixes #12315 Fixes #12186 Fixes #12331 Fixes googleapis/google-cloud-cpp#4487
2020-07-08[vcpkg] Fix MSBuild regressions #12062 and #12086. (#12257)ras0219
This PR also renames the VcpkgUserTriplet MSBuild variable to VcpkgTriplet to minimize user confusion compared to previous practice and documentation. Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-07[vcpkg ci] Update formatting CI (#12314)nicole mazzuca
* stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-06[vcpkg] Format the C++ in CI (#11655)nicole mazzuca
* [vcpkg] Format the C++ in the CI * format the C++ * CR
2020-07-06[vcpkg] Added python script to generate all packages file list, added to ↵Leo Yao
azur… (#12177) * Added python script to generate all packages file list, added to azure pipeline to build at the end of the run * fixed an issue that causes some leading slashes were being removed * Header Database now includes hpp files for C++ header files * Changed Header Database to include all files under \include\ folder * Apply suggestions from code review, changing condition from eq to ne Co-authored-by: Billy O'Neal <bion@microsoft.com> * Update last condition from eq to ne Co-authored-by: Billy O'Neal <bion@microsoft.com>
2020-07-02[vcpkg] Remove the tombstones and 'ignore' baseline concepts. (#12197)Billy O'Neal
This changes our PR builds to treat 'fail' in the ci.baseline.txt as 'skip' instead of using tombstones. We currently have large numbers of spurious failures that get enshrined in PRs through no fault of a PR author, removing the tombstones concept will fix those by allowing the user to retry. This does mean we accept some risk of not detecting when a port is 'fixed', but that failure is reasonable for us to handle after we see it in CI, but that seems worth it given that it lets us get rid of the tombstone concept. This also helps out the binary caching feature, because we don't have to figure out how to productize tombstones.
2020-07-01[vcpkg] Implement --x-write-nuget-packages-config= setting for `install` and ↵ras0219
`x-set-installed` (#12138) * [vcpkg] Implement --x-write-nuget-packages-config= setting for `install` and `x-set-installed`. * [vcpkg] Add end-to-end testing suite for install, remove, and binary caching * [vcpkg] Define `$TestingRoot in end-to-end-tests.ps1 * [vcpkg] Address CR comments Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-01[vcpkg] VM Update (#12176)Billy O'Neal
* [qt5] Add more dependent Linux packages for https://github.com/microsoft/vcpkg/pull/11596/ * [vcpkg] Add LLVM 10 to Windows CI machines for https://github.com/microsoft/vcpkg/pull/11655/ * [vcpkg] Add missing Param block to InstallLLVM function. * [vcpkg] Add throw after all Write-Error calls for consistency with https://github.com/microsoft/vcpkg/pull/12172