aboutsummaryrefslogtreecommitdiff
path: root/scripts/azure-pipelines/windows
AgeCommit message (Collapse)Author
2021-09-28[ci] Don't emit warnings for absence of failure logs (#20316)Kai Pastor
* No warning for absence of failure logs * Update condition for osx and linux Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2021-09-28[ci] Move formatting and doc checks into x86-windows (#20402)Billy O'Neal
* [ci] Move formatting and doc checks into x86-windows to avoid burning a whole job for that 1 run, don't run file lists generation in PRs. * Deduplicate x86-windows and restore PR file lists, as requested/suggested by @dg0yt * More quotes Co-authored-by: nicole mazzuca <83086508+strega-nil-ms@users.noreply.github.com> Co-authored-by: nicole mazzuca <83086508+strega-nil-ms@users.noreply.github.com>
2021-09-15Back out "cascades" enforcement because it caused too many stealth merge ↵Billy O'Neal
conflicts. (#20181) Mostly reverts https://github.com/microsoft/vcpkg/pull/20140 See https://github.com/microsoft/vcpkg/discussions/20180 for further discussion.
2021-09-14Add "cascades" enforcement (#20140)Billy O'Neal
* Add "cascades" enforcement as requested by https://github.com/microsoft/vcpkg/pull/20074#issuecomment-916565430 * Add counts. * Fix arm-uwp count. * Update counts. * Update counts
2021-09-11Update pwsh to 7.1.14, separate image minting from vmss minting, and update ↵Billy O'Neal
VMs. (#20064) * Update Powershell-Core to 7.1.4. * Add deployment of .NET 4.7.2 targeting pack, extracted from https://github.com/microsoft/vcpkg/pull/19320 * Separate image minting from vmss minting. * Update pools. * Fix image minting typo on Windows.
2021-09-03Decouple the storage account used for binary caching from the images. (#19912)Billy O'Neal
* Decouple the storage account used for binary caching from the images. We are being forced to change infrastructure somewhat more frequently than we would like, so change the binary caches to use a shared storage account like we already use for asset caching. * blob blob blob * Add quotes * Avoid name stomping.
2021-08-13Update VMs for Patch Tuesday, 2021-08-11 (#19508)Billy O'Neal
* Deploy SDKs with full features first to ensure we get Debugging Tools for Windows. * Update VMs for Patch Tuesday, 2021-08-11
2021-08-02Avoid rmdir the downloads directory is nonexistent. (#19314)Billy O'Neal
2021-08-02Clean the downloads directory every CI run. (#19311)Billy O'Neal
Now that vcpkg has artifact caching, meaning downloading artifacts usually doesn't have to leave the datacenter, there's no need to potentially dirty different runs with leftover downloads from each other. This resulted in some "impossible" results in https://github.com/microsoft/vcpkg/pull/18687 where a previous PR run accidentially downloaded the Windows version of nodejs to /mnt/vcpkg-ci/downloads/node-v14.17.4-linux-x64.tar.xz
2021-07-28Add AZP logging markup for versioning errors (#19104)Kai Pastor
2021-07-15Change VM size to Standard_D32ds_v4. For some reason they are cheaper than ↵Billy O'Neal
D16 right now??? (#18953) Remove no longer used "unstable" scaffolding. Use ephemeral OS disks for better latency. Add ability to change whether temp disks are used or explicitly provisioned disks are used; explicitly provisioned disks turned out to be more expensive than expected before. Disable Windows Updates in the scale set because the machines are very short lived; working on a mechanism of patching the images instead.
2021-06-29Update vcpkg tool to resolve leak of the asset cache token (#18720)Billy O'Neal
2021-06-22Update VMs and pick up VS2019 16.10 (#18233)Billy O'Neal
* Cherry-pick https://github.com/microsoft/vcpkg/pull/15598 * Hook deploy-inteloneapi into create-vmss.ps1. * Add script to resolve https://github.com/microsoft/vcpkg/issues/17521 * Move tls settings deployment to the front and respond to script triggering a reboot. * Go back to provisioning an extra disk to workaround https://github.com/microsoft/vcpkg/issues/18379 * Disallow public access to blob storage and require TLS 1.2. * Update Pools. * Update tool to 2021-06-19 * [simage] Skip simage on uwp platforms as it appears broken by 16.10. * [tensorflow-cc] Skip because changes in our MacOS hardware broke the port.
2021-06-04[vcpkg] Add experimental $X_VCPKG_ASSET_SOURCES for source caching (#13639)ras0219
* [vcpkg] Add experimental $VCPKG_X_READWRITE_MIRROR_URL_TEMPLATE for source caching * [vcpkg] Use prerelease version for testing * [docs] Add assetcaching.md * Revert bootstrap changes * [vcpkg_download_distfile] Deprecate SILENT_EXIT * cmake_parse_arguments() always defines option arguments * Adjust CI baseline * [vcpkg_download_distfile] Address CR comments, restore ARIA2 * [CI] Add source caching to Linux and OSX CI passes * [ci.baseline.txt] Skip chartdir on more platforms
2021-05-26[scripts-audit] Rollup 2021-05-21 (#18112)nicole mazzuca
* [scripts-audit] vcpkg_acquire_msys (#17687) * [vcpkg.cmake] Change find_package function -> macro in order to shorten trace (#17997) switch from function to macro * [scripts-audit] z_vcpkg_apply_patches (#18013) * [scripts-audit] z_vcpkg_escape_regex_control_characters (#18013) * [scripts-audit] vcpkg_fail_port_install (#18054) Note that this change allows existing failures; it changes MATCHES to STREQUAL, meaning that vcpkg_fail_port_install(ON_ARCH "arm") now succeeds on arm64; this change in behavior is fine (IMO) since it strictly succeeds when it used to fail.
2021-04-26Update VMs, CMake to 3.20.1, CUDA to 11.3, and pwsh to 7.1.3 (#17331)Billy O'Neal
* Update to CUDA 11.3 on Windows. * Update PowerShell to 7.1.3. * Update CUDA to 11.3 on Linux. * "Explode" VM provisioning scripts for more consistent feedback during deploy. This resolves the deployment script often hanging with no feedback as to why. * [libdatachannel] Fix use of deprecated result_type typedef. Submitted upstream as https://github.com/paullouisageneau/libdatachannel/pull/413 * [libvpx] Get the libvpx outputs from the correct place. (Perhaps VS2019 version 16.10 moved where these are placed? I've been defensive and left an attempt to find from the old location in place.) * [chromaprint] Support implementations where lrintf is an intrinsic. * Add provision-entire-image script. * [cudnn] Disable download-on-the-fly due to licensing concerns. * Add libnccl to Linux VMs. * [wangle] Disable x64-windows due to an ICE. * [cmake] Update cmake to 3.20.1 to avoid https://gitlab.kitware.com/cmake/cmake/-/issues/21571 race * [libudis86] Fix passing a bogus working directory which fails on CMake 3.20.x * [dartsim] Disable unit tests, examples, and tutorials, some of which have CMake authoring errors rejected by 3.20.1. * Add thrust to the cuda installees. * [tensorflow] Put .bzl in CURRENT_BUILDTREES_DIR to avoid running out of disk space in CI and to respect --clean-after-build. * [dimcli] Skip port broken by changes in VS2019 project system. * [upb] Disable an additional warning. * [libhv] Fix typo DISABLE_PARALLEL => DISABLE_PARALLEL_CONFIGURE * Update pools
2021-02-04[vcpkg] Download vcpkg.exe rather than building it in bootstrap on Windows. ↵Billy O'Neal
(#15474) This reduces bootstrap cost for Windows customers, resolving the issue initially submitted as #12502 . The `toolsrc` tree was extracted to https://github.com/microsoft/vcpkg-tool. `bootstrap.sh` was changed to download the right source tarball, extract, and build it. This was chosen over the previous attempt, a submodule, over concerns of accidentally destroying people's local modifications.
2021-02-02[vcpkg] Miscellaneous internal improvements extracted from #15424 (#15677)ras0219
* [vcpkg] Miscellaneous internal improvements extracted from #15424 * [vcpkg] CR comments * [armadillo] Use vcpkg_from_git() to workaround gitlab missing archive Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2021-01-16[vcpkg-ci] Move version validation after CI build passes (#15686)ras0219
2021-01-14Reorder CI checks (#15662)Victor Romero
* Reorder CI checks * Modify error message on local port changes * Modify error message on local port changes - pt.2
2021-01-14[vcpkg] Add CI check for version files and update maintainer's guideline ↵Victor Romero
(#15655) * Add CI check using dummy version files * Fix ci test * Update maintainer's guideline * Point CI check to actual version files * Remove --git-verify-trees * Fix typo * Fix more typoes * Even more typos * Even more typos
2021-01-13[vcpkg] Add sources for TLS 1.2 downloader tool. (#15516)Billy O'Neal
2020-12-28[cmake] update to 3.19.2 (#14716)Jack·Boos·Yu
* [cmake] update to 3.19.0 * update vmss * [cmake] update to 3.19.1 * [solid3] Fix configure error, fix static definition * [flann] Add feature hdf5 and fix it * [highfive] Fix dependency hdf5 * [simage] Fix configure error * [aws-c-common] Fix configure error * [cmake] Update to 3.19.2 * Revert changes about cmake bug * [VMSS] Update cmake path on Windows * [cmake] Update cmake hash * [minc] Fix dependency hdf5 * [cmake] Update cmake package name and path on MacOS Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-12-28Add testing with VS2015 and VS2017 compilers. (#15257)Billy O'Neal
* Add testing with VS2015 and VS2017 compilers. * Apply Nicole CRs.
2020-12-22[opentracing] Update VMs 2020-12 (#15151)Billy O'Neal
* Add meson from https://github.com/microsoft/vcpkg/pull/12860/ * Add autoconf-archive from https://github.com/microsoft/vcpkg/pull/13081/ * Add kf5windowsystem libs from https://github.com/microsoft/vcpkg/pull/13467/ * Open the FTP and SFTP ports from https://github.com/microsoft/vcpkg/pull/14412/ * Add libxcb-util0-dev from https://github.com/microsoft/vcpkg/pull/14678/ * Add libasound2-dev from https://github.com/microsoft/vcpkg/pull/14774 * Remove no longer necessary apt-mark calls. * Update nasm on Linux. * Fix longstanding bug where Storage was publicly accessible and change to generate SAS token rather than File Share * Delete no longer necessary azure storage firewall rules. * Install the newer Windows SDK with the VS installer instead of manually. * Install the VS2015 and VS2017 compilers. * Update Powershell-Core to 7.1.0. * Update source of WDK. * Update pools. * [opentracing] Repair arm64-windows failures caused by mojibake in `expected.hpp` and errors in opentracing-cpp's lint for arm64 where it thinks exceptions are disabled when they are enabled. Fixes: C:\Dev\vcpkg\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\3rd_party\include\opentracing/expected/expected.hpp(1): warning C4828: The file contains a character starting at offset 0x4a77 that is illegal in the current source character set (codepage 65001). Fixes: D:\buildtrees\opentracing\src\b67575dab0-0250653c81.clean\include\opentracing/tracer.h:223:5: error: cannot use 'try' with exceptions disabled [clang-diagnostic-error] try { ^ * [mmloader] Patch out overrides of CMAKE_C_FLAGS and CMAKE_CXX_FLAGS that inserted /WX. Note that this port sets /GS-, possibly because it may be for authoring shellcode. * Bump storage API version to 2020-04-08.
2020-12-16[vcpkg ci] upload diff from clang-format to artifacts (#15141)nicole mazzuca
* [vcpkg ci] upload diff from clang-format to artifacts this allows people who do not have access to clang-format to format their code via diff
2020-12-01[vcpkg docs] Check for documentation generation in CI (#14614)nicole mazzuca
* [vcpkg docs] Change how documenting port functions works Instead of using `##`, use comment blocks for documentation. Also, add some minor docs and change RST -> MD so we actually get docs generated. * add CI stuff * regenerate docs * fix vcpkg_find_acquire_program to not use _execute_process
2020-10-27[vcpkg] Always publish failure logs, even on success. (#14260)Billy O'Neal
This way we get failure logs for things excluded by ci.baseline.txt in the nightly builds.
2020-10-19[cmake] upgrade to 3.18 (#12612)Stefano Sinigardi
Co-authored-by: JackBoosY <yuzaiyang@beyondsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-09-28Add MSVC-internal testing scripts to public GitHub. (#13748)Billy O'Neal
2020-09-25[vcpkg] Fix Windows pipeline's outdated Ninja reference (#13722)Robert Schumacher
2020-09-21[vcpkg] Add build scripts to produce signed vcpkg binaries. (#13508)Billy O'Neal
2020-09-14[vcpkg manifest] Add documentation! (#13488)nicole mazzuca
* [vcpkg docs] add docs for manifest files These are just for the maintainer docs, not user docs. * [vcpkg] EBNF-ify platform expression parsing this modifies nothing about what strings are accepted or rejected, it just moves stuff around. also adds tests. * [vcpkg docs] add manifest mode example * [wip] docs for augustin also fix tabs * [vcpkg manifest] switch to using maps for features * Apply suggestions from code review * un-experimentize format-manifest * flesh out the user manifest mode docs * CRs * billy CRs * final personal pass-thru
2020-08-27[skia, ompl, capnproto] Update VMs for 2020-08-12 (including VS 16.7) (#12884)Billy O'Neal
Co-authored-by: Nicole Mazzuca <mazzucan@outlook.com>
2020-08-26Allow use of VS LLVM clang-format. (#13142)Billy O'Neal
2020-08-25[VMSS] Fix the printed error message (#13107)Jack·Boos·Yu
* check error message * Remove https:// * Revert test changes
2020-08-22Sort file lists and failure logs together. (#13067)Billy O'Neal
2020-08-10[vcpkg] Add `vcpkg export` to E2E tests. Enable E2E tests on all platforms. ↵ras0219
(#12198) * [vcpkg] Add `vcpkg export` to E2E tests. Enable E2E tests on MacOS. * [vcpkg] Fix export --raw --output-dir=/path/ by changing directory to new export root Co-authored-by: Robert Schumacher <roschuma@microsoft.com> Co-authored-by: Billy Robert O'Neal III <bion@microsoft.com>
2020-08-02[vcpkg format-manifest] Add convert-control flag (#12471)nicole mazzuca
* [vcpkg format-manifest] initial convert-control attempt TODO: manifest comments! we should keep $directives * Finalize x-format-manifest First, fix Json::parse -- "\c", for any c, was incorrectly parsed. It would emit the escaped character, and then parse the character, so that `\b` would give you { '\b', 'b' }. Second, canonicalize source paragraphs as we're parsing them. This found an error in qt5 -- The `declarative` feature was listed twice, and we now catch it, so I removed the second paragraph. Add PlatformExpression::complexity to allow ordering platform expressions in a somewhat reasonable way. Notes: - We allow `all_modules` as a feature name for back-compat with paraview - In order to actually convert CONTROL to vcpkg.json, we'd need to rename the qt5 `default` feature. - We need to add support for $directives in x-format-manifest * fix qt5 port * format * fix compile * fix tests for canonicalization * Clean up code * add error message for nothing to format * add extra_info field * add `const X&` overloads for `Object::insert[_or_replace]` * fix compile * simple CRs * add tests * format * Fix mosquitto port file also unmerge a line * fail the tests on malformed manifest * fix format_all * fix coroutine port-version * format manifests
2020-07-29[vcpkg] Improve format check failure message (#12460)Jack·Boos·Yu
* [docs] Add format document * improve the error message * Check the error message * Finish test * restore file list
2020-07-13[vcpkg-ci] Always publish file lists (#12384)ras0219
Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-07[vcpkg ci] Update formatting CI (#12314)nicole mazzuca
* stage checking formatting this means that the port CI won't run if the formatting failed * fix invalid names * add formatting of manifests * fix dependsOn name * fix a thing * CRs * oops, typo
2020-07-06[vcpkg] Format the C++ in CI (#11655)nicole mazzuca
* [vcpkg] Format the C++ in the CI * format the C++ * CR
2020-07-06[vcpkg] Added python script to generate all packages file list, added to ↵Leo Yao
azur… (#12177) * Added python script to generate all packages file list, added to azure pipeline to build at the end of the run * fixed an issue that causes some leading slashes were being removed * Header Database now includes hpp files for C++ header files * Changed Header Database to include all files under \include\ folder * Apply suggestions from code review, changing condition from eq to ne Co-authored-by: Billy O'Neal <bion@microsoft.com> * Update last condition from eq to ne Co-authored-by: Billy O'Neal <bion@microsoft.com>
2020-07-02[vcpkg] Remove the tombstones and 'ignore' baseline concepts. (#12197)Billy O'Neal
This changes our PR builds to treat 'fail' in the ci.baseline.txt as 'skip' instead of using tombstones. We currently have large numbers of spurious failures that get enshrined in PRs through no fault of a PR author, removing the tombstones concept will fix those by allowing the user to retry. This does mean we accept some risk of not detecting when a port is 'fixed', but that failure is reasonable for us to handle after we see it in CI, but that seems worth it given that it lets us get rid of the tombstone concept. This also helps out the binary caching feature, because we don't have to figure out how to productize tombstones.
2020-07-01[vcpkg] Implement --x-write-nuget-packages-config= setting for `install` and ↵ras0219
`x-set-installed` (#12138) * [vcpkg] Implement --x-write-nuget-packages-config= setting for `install` and `x-set-installed`. * [vcpkg] Add end-to-end testing suite for install, remove, and binary caching * [vcpkg] Define `$TestingRoot in end-to-end-tests.ps1 * [vcpkg] Address CR comments Co-authored-by: Robert Schumacher <roschuma@microsoft.com>
2020-07-01[vcpkg] VM Update (#12176)Billy O'Neal
* [qt5] Add more dependent Linux packages for https://github.com/microsoft/vcpkg/pull/11596/ * [vcpkg] Add LLVM 10 to Windows CI machines for https://github.com/microsoft/vcpkg/pull/11655/ * [vcpkg] Add missing Param block to InstallLLVM function. * [vcpkg] Add throw after all Write-Error calls for consistency with https://github.com/microsoft/vcpkg/pull/12172
2020-06-25[vcpkg] Add disk space report to Windows PR/CI (#12113)Billy O'Neal
* [vcpkg] Add disk space report to PR/CI Example output: ``` Disk Label Size Free Space ---- ----- ---- ---------- C: Sabrent 1907 GiB 1239 GiB D: Dev 447 GiB 383 GiB E: Samsung 960 Pro 1908 GiB 1084 GiB H: Rocket 3815 GiB 863 GiB R: 0 B 0 B S: 0 B 0 B ```
2020-06-25[vcpkg] Commonize pipelines build powershell and don't use binary caching in ↵Billy O'Neal
CI (rather than PR) builds (#12082)
2020-06-21[vcpkg] Use SSH keys instead of password authentication when minting Linux ↵Billy O'Neal
scale sets (#11999)