Commit Graph

892 Commits

Author SHA1 Message Date
Heikki Halmet
dc0ba63a36 Provisioning: Install Nodejs using pkg instead of Brew
Openssl is one of Nodejs dependencies when installing it via
Homebrew which is causing issues with actual openssl source build during
provisioning

Task-number: QTQAINFRA-4402
Change-Id: I711c0f2bb7faebb3e5cbe2f415f34b2ac2d38a66
Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
(cherry picked from commit 26c97222c1)
2021-04-12 07:21:41 +03:00
Heikki Halmet
ba149a162b Provisioning: Reset Time Zone for macOS 10.13
Setting Time Zone for macOS 10.13 seems to be flaky. Let's reset it. If
it still fails to set it then exit the script execution.

Task-number: QTBUG-92174
Change-Id: I07b28d0511d8fc097a1da43b78de9a5131f6bfa7
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2021-03-30 11:29:50 +03:00
Heikki Halmet
b66e4773c8 Provisioning: get-pip.py address changed for python 2.7
For python27 get-pip file's location has been changed and we
need to use two different get-pip files for different python
versions.
Let's also cache these python files and use cache as primary
url.

Task-number: QTQAINFRA-4210
Change-Id: Iebc00f6f319bb914f7548d4737e13fed9ac2b292
Reviewed-by: Qt CI Bot <qt_ci_bot@qt-project.org>
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 6d20944daf)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2021-02-09 09:37:08 +00:00
Heikki Halmet
17c654f600 Provisioning: Latest pip versions don't support Python 2 anymore
We can't upgrade pip anymore to the latest version.
pip 20.3 was the last version of pip that supported Python 2

Task-number: QTQAINFRA-4235
Change-Id: I2add6939614f282416a39b00734bc1d22906de47
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit d6e3aa0869)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2021-02-09 09:37:06 +00:00
Heikki Halmet
d45b374657 Provisioning: Use prebuilt Android openssl if available
Android openssl configuration is flaky. Some cases it can't find perl.
Let's use prebuilt package from local cache. If not available then
download sources and configure it.

Task-number: QTQAINFRA-3993
Change-Id: I4b15cba763d88d85dfe7908fa22c2ce5f461f5cc
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 25dbd78d3f)
2021-01-24 09:53:01 +02:00
Heikki Halmet
105f54c090 Provisioning: Add --ignore-signature to ICC installation
ICC installation fails when checking digital signature

Task-number: QTQAINFRA-4174
Change-Id: Idcbca27a852abbd0824938f825807121a4f60c3e
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit d238c03742)
2021-01-20 20:17:04 +02:00
Heikki Halmet
e3c294489f Provisioning: Remove brew cask list query
brew cask list --versions don't work anymore with macOS 10.13:
Calling brew cask list is disabled!

Pick-to: 5.15
Pick-to: 5.12.7
Change-Id: I44d64bea36577212d0d8ff1fbd4f40111b8cadee
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2021-01-12 12:55:29 +02:00
Heikki Halmet
c470301c34 Provisioning: Install p7zip using --build-from-source parameter
brew install p7zip isn't working anymore with macOS 10.13 and 10.12.
Let's use --build-from-source parameter with brew installation

Pick-to: 5.12.7
Task-number: QTQAINFRA-4128
Change-Id: Ib1a2db1cd3176955cca450e5ebe0d0fc1bee3aa4
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2021-01-12 12:55:28 +02:00
Heikki Halmet
5d4d997cbe Provisioning: Remove signing tools script
Tools aren't needed anymore

Change-Id: Iac4dd282dbbd67b62d843925751903e57c934000
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 5d7dae8dcb)
2020-12-23 07:39:50 +02:00
Heikki Halmet
9a00450454 Update macOS 10.13 Tier1 image
Software updates are disabled from tier1 image.
It seems, that without this macOS 10.13 keep on crashing.
This is related to QTQAINFRA-4104

Change-Id: I92f0039102d93268358301bfb789765ca39fd1ae
Reviewed-by: Toni Saario <toni.saario@qt.io>
2020-12-18 15:48:04 +00:00
Heikki Halmet
883b9a4192 Provisioning: Install Azure tool
Task-number: QTQAINFRA-4042
Change-Id: I8e29190f4caf8b766cced40042bfe60ec2601a8e
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit cdea442a3a)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2020-12-11 10:06:50 +00:00
Heikki Halmet
5888d1c9ba Provisioning: Install Dotnet SDK 2.1
Dotnet is needed for Azure installation

Task-number: QTQAINFRA-4042
Change-Id: I6dd9d965f536d28554bbce6e76b19a3861f55ff2
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 8846d0d52d)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2020-12-11 10:06:49 +00:00
Heikki Halmet
9390cd1b70 Provisioning: Install Microsoft Visual C++ Redistributable
Script will install  Microsoft Visual C++ Redistributable for
Visual Studio 2015, 2017 and 2019

Change-Id: I4366855c8d5679e3b7b201d79a82e47199b3ad8c
Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
(cherry picked from commit 01752b6e21)
2020-11-04 18:44:18 +02:00
Johanna Äijälä
3693ea212c Provisioning: update Squish installation to 6.6.1
Update Squish installation to Qt5.12 based Squish 6.6.1.
Also update scripts to the new style, where pre-installed
Squish archives are used. The old style did the Squish
installation from a scratch.

Change-Id: I298ecee5e66d48c9e02d2cd4bc8d01311df65261
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2020-11-03 07:29:49 +02:00
Heikki Halmet
08a384605a Upgrade msys2 package and the installation script
This change will upgrade the msys2 package

Change also updates the script to use cached
prebuilt package if available.

This will also remove unneeded x86 installation

Task-number: QTQAINFRA-3986
Change-Id: Ia6299f9d4750376676276a75613e7f1098de4102
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 134c2a1cb0)
2020-11-03 07:29:46 +02:00
Heikki Halmet
9de232ba66 Provisioning: Add system GCC versions to versions.txt
Currently GCC versions which comes with the system are missing from
versions.txt. This change will add those

Task-number: QTQAINFRA-3933
Change-Id: I1934e6257acf92d72dcb382884aad60503b7b32f
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit dff15e0a71)
2020-11-03 08:29:44 +03:00
Heikki Halmet
a7b8f5abd8 Provisioning: Retry python installation if failure occurs
Python installation is flaky and we haven't be able to determine the
root cause for it. Re-running the installation might help.
(Might) because we can't reproduce this manually.

Task-number: QTQAINFRA-3875
Change-Id: Id46d250a02e01007f03dfbb886d75b23c23a6216
Reviewed-by: Toni Saario <toni.saario@qt.io>
(cherry picked from commit 6e3cb240df)
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2020-11-03 08:29:42 +03:00
Heikki Halmet
26457902b1 Provisioning: Install colorlog
Needed by packaging scripts

Task-number: QTQAINFRA-3918
Change-Id: I30861ecb5f12f79683ad2fec58484b97dee31d7f
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit c053e70593)
2020-11-03 07:29:40 +02:00
Heikki Halmet
3b07ea9741 Provisioning: Enable access to SMB server in Windows 10 x64
Windows don't allow insecure guest login anymore by default. It need
to be enabled through Group Policy restrictions

Task-number: QTQAINFRA-3980
Change-Id: I767e9c87ca3ee4737e312142ecefb94ee2b2b828
Reviewed-by: Timur Pocheptsov <timur.pocheptsov@qt.io>
(cherry picked from commit 586856e180)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2020-10-21 23:52:37 +00:00
Heikki Halmet
448a19766e Provisioning: Enable access to SMB server
Windows don't allow insecure guest login anymore by default. It need
to be enabled through Group Policy restrictions

Task-number: QTQAINFRA-3974
Change-Id: I5fd918882c51c01985cd4c1b9f9ed4dec62e07dd
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 90a6ab728f)
Reviewed-by: Qt Cherry-pick Bot <cherrypick_bot@qt-project.org>
2020-10-20 14:39:09 +00:00
Konstantin Tokarev
a825b4965d Provisioning: Update Conan to 1.29.0
Task-bumber: QTQAINFRA-3916
Change-Id: I52d8a0255efcc7b4b139ec5050cf3d59003f12a9
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit f73fa57088)
Reviewed-by: Toni Saario <toni.saario@qt.io>
2020-10-02 17:12:28 +03:00
Heikki Halmet
c2877e7ea9 Provisioning: Disable unneeded services
To speed up things and release CPU we need to disable
unneeded services

Change-Id: I067ad6eb0b3b5df72edc00aa244cc1bff35c4232
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2020-10-02 14:12:24 +00:00
Konstantin Tokarev
b5eb36d689 Provisioning: Update Conan packages
* Update libjpeg-turbo to 2.0.5
* Replace MinGW 7 packages with MinGW 8
* Remove zlib packages as Qt is consistently built with -qt-zlib now

Task-bumber: QTQAINFRA-3916
Change-Id: Ie15bbb0f0f5b3a4c1a5d08f2341e9eb16a80cce7
Reviewed-by: Konstantin Tokarev <annulen@yandex.ru>
(cherry picked from commit 27d187eb32)
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2020-10-02 17:12:18 +03:00
Heikki Halmet
90b3e55b84 Provisioning: Disable daily cron jobs from SLES 15
Task-number: QTQAINFRA-3919
Change-Id: Iabf03aeadb3f0fa7091428ef3ea6075b199d9c77
Reviewed-by: Alexandru Croitor <alexandru.croitor@qt.io>
(cherry picked from commit dd2111cf9f)
2020-09-24 11:26:15 +03:00
Heikki Halmet
b7f18fd9a1 Provisioning: Disable btrfs balance jobs
Btrfs use lot's of CPU while running

Task-number: QTQAINFRA-3919
Change-Id: I08b89b57c92d90f752dde76375711e61ed173c2c
Reviewed-by: Alexandru Croitor <alexandru.croitor@qt.io>
(cherry picked from commit 51fc48896c)
2020-09-24 11:26:14 +03:00
Heikki Halmet
3240e1713d Provisioning: Disable fstrim.timer
fstrim scans the filesystem and sends 'UNMAP' commands for each
unused block it finds. Let's disable it so it won't cause unexpected
situations.

Task-number: QTQAINFRA-3919
Change-Id: I20c97441fd47728a3063ae50f87fe6347186bdbd
Reviewed-by: Alexandru Croitor <alexandru.croitor@qt.io>
(cherry picked from commit 031bc19ae6)
Reviewed-by: Toni Saario <toni.saario@qt.io>
(cherry picked from commit 11cd0f1d75)
2020-09-24 11:26:13 +03:00
Heikki Halmet
e08a64b852 Provisioning: Update expired QNX license
Task-number: QTQAINFRA-3708
Change-Id: Id2d6d10d88fc50c9985014c44df0b1cf51cc3410
(cherry picked from commit 71043ca243)
Reviewed-by: Samuli Piippo <samuli.piippo@qt.io>
2020-09-05 10:15:45 +03:00
Heikki Halmet
325840d753 Provisioning: Renew iPhone signing tools
Task-number: QTQAINFRA-3434
Change-Id: I53665bf4e0799da7a23ba60aff37e26052d0374a
Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
Reviewed-by: Iikka Eklund <iikka.eklund@qt.io>
(cherry picked from commit c1b06ec3e5)
2020-08-28 09:16:48 +03:00
Heikki Halmet
efb34cb7bd Provisioning: Update OpenSSL to version 1.1.1g
Task-number: QTQAINFRA-3819
Change-Id: Ie7d0f3a0c73d123c3f3536e6b2dd2eb8608eb9cd
(cherry picked from commit 2ac3dd2d6f)
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2020-08-18 04:57:34 +00:00
Toni Saario
573c35b164 Update windows tier1 image
Changes in coin to virtual machine template exposed a bug where older
windows version deadlocks jom in multithreaded environment.
-16 version of the windows 10 image is latest to include msvc2017,
update to this.

Task-number: COIN-598
Change-Id: Icc75ad4a6029332ebcd4acaad563156a139dc280
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2020-07-31 12:24:14 +00:00
Heikki Halmet
5b70bb480e Provisioning: Use signed opengl32 package
Task-number: QTBUG-80252
Change-Id: Ife9942796ed64c4e2894fb3342259c674cf5d7ed
Reviewed-by: Laszlo Agocs <laszlo.agocs@qt.io>
(cherry picked from commit 9c33fe844a)
Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
2020-06-11 08:09:30 +03:00
Heikki Halmet
0f0ff063d2 Provisioning: Enable RPMS for Redhat 6.6
Needed RPMS are currently in disabled state in Tier 1 image and those
need to be enabled.

Task-number: COIN-563
Change-Id: Ib803be03ad859a180bf941a52deaf0cf00412400
Reviewed-by: Matti Paaso <matti.paaso@qt.io>
2020-04-20 13:20:13 +03:00
Heikki Halmet
7759daa6ff Provisioning: Activate subscriptions
Task-number: QTQAINFRA-3638
Change-Id: Ide5599a45b918dcbd44a7d60a78c3a4811d80943
(cherry picked from commit 5148639647)
Reviewed-by: Matti Paaso <matti.paaso@qt.io>
2020-04-16 08:48:38 +03:00
Dimitrios Apostolou
09dcc777ee Execute a specific version of homebrew install script
Also first try to download it from local mirror.

This install script appears to be doing a lot of git-cloning and downloading
itself though, so it is still far from the ideal solution: to only download
from locally cached endpoints.

Task-number: QTQAINFRA-3134
Change-Id: I32131045d6e62f302ec666b4ac055ca5ee9662d5
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit c0033df4b9)
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
2020-04-02 10:35:07 +03:00
Simo Fält
dc70564fa0 Add installer-framework specific platform configs
Task-number: COIN-287
Change-Id: If9de982bc40ae86176fe0a233efea150b0a2811e
Reviewed-by: Katja Marttila <katja.marttila@qt.io>
Reviewed-by: Matti Paaso <matti.paaso@qt.io>
2020-03-09 09:33:16 +02:00
Konstantin Tokarev
11c702414f Provisioning: update Conan and Conan packages to latest versions
Task-number: QTQAINFRA-3556
Change-Id: If9c600a6bb3aae893924f9372c8b248d3e58f887
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit b73e61a458)
Reviewed-by: Konstantin Tokarev <annulen@yandex.ru>
2020-03-07 11:42:48 +02:00
Simo Fält
e4d68cf15e Remove pip installation
RHEL 6.6 is having too old python3 to support latest
version of pip.

Change-Id: Ib8f9996b668ae02070986a1607c43885284560c1
Reviewed-by: Tim Jenssen <tim.jenssen@qt.io>
2020-02-20 12:02:45 +02:00
Heikki Halmet
fca65a7dfb Provisioning: Update signing tools for macOS
Update expired certificates

Task-number: QTQAINFRA-3540
Change-Id: I21e718901cb3f5c901273c0c122430f5caaea3d0
Reviewed-by: Eike Ziller <eike.ziller@qt.io>
Reviewed-by: Tim Jenssen <tim.jenssen@qt.io>
(cherry picked from commit fd7bfcc0c5)
2020-02-18 10:35:35 +02:00
Dimitrios Apostolou
9e4446b646 Fix openssl build in SLES-15
Upstream changes of binutils or elfutils broke the build. Error was:

/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /usr/lib64/libc_nonshared.a(elf-init.oS): unable to initialize decompress status for section .debug_info
/usr/lib64/gcc/x86_64-suse-linux/7/../../../../x86_64-suse-linux/bin/ld: /usr/lib64/libc_nonshared.a: error adding symbols: file format not recognized
collect2: error: ld returned 1 exit status

Task-number: QTQAINFRA-3527.
Change-Id: I50b677598b4415a281abbf0ddb2db39613646b36
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit eee60c0824)
Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
2020-02-18 08:35:27 +00:00
Dimitrios Apostolou
3c29b705c3 08-pythondev build should not execute external script
The important bits of the script were copied and modified.

NOTE that we no longer build openssl from source, the distro (SLES15) provides
a version that works well.

Task-number: QTQAINFRA-3528
Change-Id: Iad63d75055a7efc3e104789e4a515b8511cf0880
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit db23c64876)
Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
2020-02-18 08:35:20 +00:00
Dominik Holland
533daaa537 Provisioning: Update jinja2 to 2.10.3
This makes sure we don't run into CVE-2019-10906 when using
jinja2 in QtIvis Autogenerator.

Change-Id: If51bf54bd26858c6b5faa3dd6a6627f2979b862d
Reviewed-by: Robert Griebl <robert.griebl@qt.io>
Reviewed-by: Jani Heikkinen <jani.heikkinen@qt.io>
(cherry picked from commit 7b4b2f86a0)
Reviewed-by: Jukka Jokiniva <jukka.jokiniva@qt.io>
2020-02-18 08:35:13 +00:00
Liang Qi
b540aedf0a Merge remote-tracking branch 'origin/5.12.6' into 5.12
Conflicts:
	.gitmodules

Change-Id: I82e695715beec4fd0cd58e31b11606e24afc4b0f
2020-01-10 12:19:10 +01:00
Heikki Halmet
770d9d70bf Provisioning: Change JDK script to use 'Remove' function from helpers
Task-number: QTQAINFRA-3369
Change-Id: I2e873eb50d9129c48d92370af80fe121039d172e
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit dcfef7226f)
Reviewed-by: Simo Fält <simo.falt@qt.io>
2019-12-03 08:00:06 +02:00
Dimitrios Apostolou
255e87ea24 Docker installation: do not depend on external repositories
Also updated the docker-compose binary to the latest one.

Task-number: QTQAINFRA-3279
Change-Id: Ie09a772ca8247aa5f5bd6d36774b68b6bb846386
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit a270bcdb6b)
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2019-11-20 12:35:38 +02:00
Dimitrios Apostolou
74195b12e6 DownloadURL last argument (targetFile) is now optional
Change-Id: I0864bcb052cddcc9753c056758b6e65fd561d928
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit 6cc2215b8c)
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2019-11-20 12:35:32 +02:00
Dimitrios Apostolou
1f1832b5da Fix for DownloadURL to try alternative URL
Change-Id: I7e9a77815ef8f4c258dda44bda6fdd4eb3736ef4
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit 518e114dc7)
2019-11-20 12:35:26 +02:00
Dimitrios Apostolou
2217a2db89 DownloadURL now works with either wget or curl
The reason is that Ubuntu does not have curl at the very beginning of
provisioning scripts, and also does not have the repositories configured
in order to install it.

Change-Id: Ia485c1672f894bc800f199b742d238b2945938e5
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit 4e3a0f79fb)
2019-11-20 12:35:20 +02:00
Dimitrios Apostolou
8ed03772f7 Refactor DownloadURL.sh
Auto-detects and verifies all kinds of hashes, not only SHA1.
Hash verification is now an autonomous function.
If the file is found at the destination, skip redownloading it if the
hash is OK.
Runs on POSIX sh, not requiring bash.
Retain compatibility with previous version.

Change-Id: I9930336030aa776f49dc460fe766f3e831700255
Reviewed-by: Tony Sarajärvi <tony.sarajarvi@qt.io>
(cherry picked from commit c0fce7a3b3)
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
2019-11-20 12:35:13 +02:00
Tony Sarajärvi
fcf4ccab36 Remove more of update notifiers
Change-Id: I507f584ef82b5f41f6b1cbc22fdd4ff6eff5e911
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit 2eab420e80)
(cherry picked from commit 7285bbee64)
2019-11-20 12:35:06 +02:00
Tony Sarajärvi
2cd2ec8723 Change local Ubuntu repo mirror in provisioning
The old mirror host Qt company used to sync their local mirror
from, stopped syncing from Ubuntu in October 2018.
The mirror mechanism was changed so that in the future if
addresses change, we don't have to touch the provisioning scripts
as the address is more general. Also a duplicate entry was removed.

Task-number: QTQAINFRA-3279
Change-Id: I65ada052d308eaef0411eb9caad893304eb05ab6
Reviewed-by: Heikki Halmet <heikki.halmet@qt.io>
(cherry picked from commit 5b77e74a5e)
Reviewed-by: Liang Qi <liang.qi@qt.io>
(cherry picked from commit 439fbad1c9)
2019-11-20 12:35:00 +02:00