summaryrefslogtreecommitdiff
path: root/script/autobuild.py
AgeCommit message (Collapse)AuthorFilesLines
2020-10-22oss-fuzz: Always run the check, even on the oss-fuzz platformAndrew Bartlett1-1/+0
It is much harder to determine why we get messages like Step #6: Error occured while running fuzz_reg_parse: Step #6: /workspace/out/coverage/fuzz_reg_parse: error while loading shared libraries: libavahi-common.so.3: cannot open shared object file: No such file or directory instead this detects the failure to use RPATH (which is strictly required instead of the modern RUNPATH) otherwise. We do this by creating a new build_samba.sh after renaming build_samba.sh to do_build.sh because this is what oss-fuzz runs, meaning we don't need to coordinate a MR there as well. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-10-22oss-fuzz: standardise on RPATH for the static-ish binariesAndrew Bartlett1-1/+1
This includes a revert of commit e60df214998afc145ca482cab184691b3ddc3bb2. We strictly require RPATH, not the modern RUNPATH for the behaviour we need in oss-fuzz, which is that not just the first line of dependencies but the full set of libraries used by the program are looked for in the '$ORIGIN/lib' directory. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz> Autobuild-User(master): Douglas Bagnall <dbagnall@samba.org> Autobuild-Date(master): Thu Oct 22 14:10:04 UTC 2020 on sn-devel-184
2020-10-16test: Get the clusteredmember environment out of its smb1 cornerVolker Lendecke1-3/+3
Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Ralph Boehme <slow@samba.org> Autobuild-User(master): Ralph Böhme <slow@samba.org> Autobuild-Date(master): Fri Oct 16 18:30:18 UTC 2020 on sn-devel-184
2020-10-01autobuild: Merge no-modules test with the library --disable-python buildAndrew Bartlett1-7/+2
This avoids another full compile cycle. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-10-01autobuild: Remove more "make install" stepsAndrew Bartlett1-2/+0
Running a "make install" involves a full re-link which takes quite some time we really only need to test this in a couple of basic combinations, so remove from a few more targets. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-10-01autobuild: Remove the os.getpid() from the autobuild directoryAndrew Bartlett1-1/+6
This might help our CI runners get a ccache hit by keeping the path constant. Otherwise, we only get a good ccache hit rate if the docker container gives us the same pid each time. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-10-01build: Remove Python2 support from the buildAndrew Bartlett1-35/+0
BUG: https://bugzilla.samba.org/show_bug.cgi?id=14488 Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-10-01autobuild.py: Combine samba-static and samba-nopythonAndrew Bartlett1-19/+21
We expect these will complete in under an hour and reduce the number of parallel jobs. Hopefully there will be some ccache hits between these as well. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Douglas Bagnall <douglas.bagnall@catalyst.net.nz>
2020-06-10Add docs build to CIAndrew Bartlett1-1/+10
We did not check we could actually build the HTML of the Samba Developers guide and HTML of the manpages previously. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: David Disseldorp <ddiss@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Wed Jun 10 07:11:59 UTC 2020 on sn-devel-184
2020-05-24gitlab-ci: Create a single samba-fips runnerAndreas Schneider1-16/+4
Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2020-05-18autobuild: Use sane random sleep values for samba-admem-mitAndreas Schneider1-1/+1
Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Alexander Bokovoy <ab@samba.org>
2020-05-18autobuild: Add ad_member_fips targetAndreas Schneider1-0/+12
Reviewed-by: Alexander Bokovoy <ab@samba.org>
2020-05-15selftest: Avoid running the slowest of the "none" tests in samba-o3Andrew Bartlett1-1/+2
This job is already quite long and these tests are unlikely to vary between hosts or under the -O3 compile Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Volker Lendecke <vl@samba.org>
2020-04-08gitlab-ci: Add runner for fips compliance testingAndreas Schneider1-0/+11
Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Guenther Deschner <gd@samba.org> Autobuild-User(master): Andreas Schneider <asn@cryptomilk.org> Autobuild-Date(master): Wed Apr 8 14:45:18 UTC 2020 on sn-devel-184
2020-04-03autobuild: Add ad_dc_default_smb1 to autobuild jobsNoel Power1-1/+5
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03autobuild: Add nt4_dc_smb1_done to autobuild jobsNoel Power1-0/+3
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03autobuild: Add fileserver_smb1_done to autbuild jobsNoel Power1-0/+3
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03autobuild: Add ad_dc_smb1_done to autobuild jobsNoel Power1-1/+5
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03autobuild: Add ad_dc_default_smb1 to autobuild jobsNoel Power1-1/+5
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03autobuild: Add new nt4_dc_smb1 env to jobsNoel Power1-0/+3
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03script: Add ad_dc_smb1 to autobuild jobsNoel Power1-1/+5
Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03script: Add testenv fileserver_smb1 to autobuild jobsNoel Power1-0/+3
Adjust the existing autobuild jobs that currently include/exclude test env fileserver to also use fileserver_smb1. Signed-off-by: Noel Power <noel.power@suse.com> Reviewed-by: Ralph Boehme <slow@samba.org>
2020-04-03selftest: allow SMB1 in clusteredmember envRalph Boehme1-3/+3
This is a relatively new test environment that only uses very few tests yet. Skip the env name rename dance for this env, but someone has to convert the tests later on. Signed-off-by: Ralph Boehme <slow@samba.org> Reviewed-by: Noel Power <npower@samba.org>
2020-04-02script/autobuild.py: allow write_system_info commands to failStefan Metzmacher1-1/+4
These commands are just there as hints to debug possible problems. In order to support autobuild.py on non-linux platforms we should just ignore errors here. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Stefan Metzmacher <metze@samba.org> Autobuild-Date(master): Thu Apr 2 07:36:07 UTC 2020 on sn-devel-184
2020-04-02script/autobuild.py: use more portable 'cp -R -a -l'Stefan Metzmacher1-1/+1
On platforms like FreeBSD 12 cp doesn't accept the long options, using the one letter options works there and keeps working on Linux as well. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2020-04-02script/autobuild.py: add support git worktreeStefan Metzmacher1-1/+1
.git is not always a directory, with 'git worktree' it's a file. Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2020-03-23autobuild: Merge samba-simpleserver into samba-nt4Andrew Bartlett1-12/+2
This saves CI resources (20mins build time) at the expense of making the samba-nt4 job take 45min (5 min longer). The new maximum job time is 1:15 by samba-o3 on the different hosts. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org> Autobuild-User(master): Andreas Schneider <asn@cryptomilk.org> Autobuild-Date(master): Mon Mar 23 14:45:59 UTC 2020 on sn-devel-184
2020-03-23autobuild: Merge the samba-ktest-heimdal and samba-fileserver jobsAndrew Bartlett1-12/+3
This avoids a full compile of Samba just to test Kerberos with a system Heimdal while still providing an environment to test other fileserver features. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
2020-03-23build: Require --without-ad-dc for --without-adsAndrew Bartlett1-1/+1
Building an AD DC while setting --without-ads makes no sense and just wastes compile time on our build hosts. To allow samba-nt4 to build --without-ad-dc we set rpc.spoolss.notify (which is built on the NTVFS fileserver for the callbacks) to run in the ad_member environment rather than nt4_dc and ad_dc. This is also just more realistic in any case. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org>
2020-03-09autobuild: Run the none env in the samba-o3 buildAndreas Schneider1-9/+2
This includes tests which should make sure that certain code is not optimized away, like memset_s(). Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Andrew Bartlett <abartlet@samba.org> Autobuild-Date(master): Mon Mar 9 23:42:26 UTC 2020 on sn-devel-184
2020-02-19autobuild: samba-ctdb does not need an AD DCVolker Lendecke1-0/+1
Speed up the build a bit Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net> Autobuild-User(master): Martin Schwenke <martins@samba.org> Autobuild-Date(master): Wed Feb 19 11:28:56 UTC 2020 on sn-devel-184
2020-02-19autobuild: Split a long lineVolker Lendecke1-1/+7
Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net>
2020-02-19autobuild: Run a simple test for clustered sambaVolker Lendecke1-0/+5
Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net>
2020-02-19autobuild: Avoid clusteredmember in normal environmentsVolker Lendecke1-0/+2
Signed-off-by: Volker Lendecke <vl@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net>
2020-02-04build: Do not check if system perl modules should be bundledAndrew Bartlett1-1/+1
We do not ship any perl modules in third_party at this time, so this check is pointless and breaks the build for --bundled-libraries=ALL. As reported by aaptel on https://gitlab.com/samba-team/samba/-/merge_requests/1104#note_281050331 This changes our autobuild script to cover this case in the samba-static job. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz>
2019-12-11autobuild: extend autobuild with samba-fuzz job to build the fuzzers in AFL ↵Andrew Bartlett1-2/+10
mode using oss-fuzz scripts This helps ensure the build_samba.sh file keeps working and the fuzzers build (because they are excluded from the main build). This is not in the default autobuild because it uses too much space on sn-devel (4GB). Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Gary Lockyer <gary@samba.org>
2019-12-11autobuild.py: Avoid listing jobs twiceAndrew Bartlett1-32/+11
We use the tasks table instead, to avoid the issue shown in the previous commit. Now we just have to keep .gitlab-ci.yml and the tasks table in sync. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org> Reviewed-by: Gary Lockyer <gary@samba.org>
2019-12-11autobuild.py: Add missing samba-simpleserver jobAndrew Bartlett1-0/+1
This was missed when the job was split out in f0e8dd1a08698884209873bb84002d7b34db016c. Signed-off-by: Andrew Bartlett <abartlet@samba.org> Reviewed-by: Andreas Schneider <asn@samba.org> Reviewed-by: Gary Lockyer <gary@samba.org>
2019-11-13autobuild: Add test for build with system heimdal libraryChristof Schmitt1-0/+12
The configure option --with-system-heimdalkrb5 requires --without-ad-dc. BUG: https://bugzilla.samba.org/show_bug.cgi?id=14179 Signed-off-by: Christof Schmitt <cs@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2019-11-04gitlab-ci: Run 'samba' tests also with MIT KerberosAndreas Schneider1-0/+52
This runs the tests of the ktest environment. Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Alexander Bokovoy <ab@samba.org> Autobuild-User(master): Andreas Schneider <asn@cryptomilk.org> Autobuild-Date(master): Mon Nov 4 14:19:17 UTC 2019 on sn-devel-184
2019-10-22autobuild: rename samba-ad-member-* to samba-admem-*Ralph Boehme1-4/+4
Needed to come around MAX pathlen limit for UNIX domain socket triggered by the new samba-ad-member-mitkrb5 target added in samba-ad-member-mitkrb5. Signed-off-by: Ralph Boehme <slow@samba.org> Reviewed-by: Martin Schwenke <martin@meltin.net> Autobuild-User(master): Ralph Böhme <slow@samba.org> Autobuild-Date(master): Tue Oct 22 14:53:17 UTC 2019 on sn-devel-184
2019-10-20autobuild: harden samba-xc test suiteUri Simchoni1-0/+10
Add more checks which directly test the behavior of --cross-answers and --cross-execute. Previous test tested things in a round-about way, checking that running in all three modes (native, cross-execute, cross-answers) yields the same result. It was vulnerable to a degradation in which cross-compilation modes didn't work at all and were running native tests, which is what happened with the upgrade of waf. The added tests check the following: - That cross-excute with cross-answers sets the cross-answers file - That the content of cross-answers file actually affects the build configuration - That a missing line in cross-answers fails the build BUG: https://bugzilla.samba.org/show_bug.cgi?id=13846 Signed-off-by: Uri Simchoni <uri@samba.org> Reviewed-by: Andrew Bartlett <abartlet@samba.org> Autobuild-User(master): Uri Simchoni <uri@samba.org> Autobuild-Date(master): Sun Oct 20 13:29:58 UTC 2019 on sn-devel-184
2019-10-12gitlab-ci: Run several AD tests with MIT KDCAndreas Schneider1-14/+44
This will avoid introducing regressions in either client or server code. Signed-off-by: Andreas Schneider <asn@samba.org> Reviewed-by: Stefan Metzmacher <metze@samba.org>
2019-10-09selftest: split fileserver testenv into simpleserver and fileserverRalph Boehme1-2/+12
The simpleserver testenv continues to be built with minimal dependencies. fileserver otoh will be built with bells and whistles including JSON which I need for using the env as target for Spotlight tests. Signed-off-by: Ralph Boehme <slow@samba.org> Reviewed-by: Noel Power <noel.power@suse.com>
2019-08-06script/autobuild.py: remove explicit --picky-developer"Stefan Metzmacher1-6/+6
Signed-off-by: Stefan Metzmacher <metze@samba.org> Reviewed-by: Noel Power <npower@samba.org>
2019-06-20script/autobuild.py: make code more pythonicJoe Guo1-43/+31
Signed-off-by: Joe Guo <joeg@catalyst.net.nz> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2019-06-20script/autobuild.py: avoid nested try except blockJoe Guo1-11/+12
Signed-off-by: Joe Guo <joeg@catalyst.net.nz> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2019-06-20script/autobuild.py: rm redundant empty str in optionsJoe Guo1-20/+20
Signed-off-by: Joe Guo <joeg@catalyst.net.nz> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2019-06-20script/autobuild.py: define cwd for builder and avoid chdirJoe Guo1-5/+3
We can pass cwd in Popen, no need to chdir for each cmd. Signed-off-by: Joe Guo <joeg@catalyst.net.nz> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>
2019-06-20script/autobuild.py: improve run_cmd with check_outputJoe Guo1-4/+4
Signed-off-by: Joe Guo <joeg@catalyst.net.nz> Reviewed-by: Gary Lockyer <gary@catalyst.net.nz> Reviewed-by: Andrew Bartlett <abartlet@samba.org>