Signed-off-by: Philip Puk <philip.puk@arm.com>
Signed-off-by: Adam Johnston <adam.johnston@arm.com>

Define a base job that could be modified by downstream projects
that audits its pipeline test result based on a JSON test list,
EXPECTED_TESTS_FILE and will pass/fail the job based on the
result.

Changelog: feature
Signed-off-by: Philip Puk <philip.puk@arm.com>
Signed-off-by: Adam Johnston <adam.johnston@arm.com>

Add pre-commit cspell parser to transform its output
to be Gitlab Code Quality parser compatible.

Signed-off-by: Philip Puk <philip.puk@arm.com>

Add pre-commit yamllint parser to transform its
output to be Gitlab Code Quality parser compatible.

Signed-off-by: Philip Puk <philip.puk@arm.com>

Add pre-commit shellcheck parser to transform its output
to be Gitlab Code Quality parser compatible.

The situation that the check fails without any error
message is also covered in the parser.

Signed-off-by: Philip Puk <philip.puk@arm.com>

Due to deprecation of code climate-based Code Quality checks
in Gitlab, we have decided to switch to pre-commit
framework. This commit creates the job definition for
the pre-commit code quality check job.

It also includes the oelint-adv parser that transform its
output format to be Gitlab Code Quality compatible.

Changelog: feature

Signed-off-by: Philip Puk <philip.puk@arm.com>

Current .fetch_file only limits for downloading one file
under the same job which would be difficult for downloading
different parser script in pre-commit in the future.

Hence, creating a new .fetch_files that allows for fetching
multiple scripts under the same job.

Signed-off-by: Philip Puk <philip.puk@arm.com>

The test test_report_can_be_read was fetching the last pipeline
in the schedule, which corresponds to the currently running test.
Since no test report is generated at that stage, this caused the
nightly build to fail.

This fix ensures that only successful pipelines are considered,
preventing failures due to missing reports.

Signed-off-by: Philip Puk <philip.puk@arm.com>

Fix fetch_test_reports so that test_reports in the parent pipeline
would be collected if there is no downstream pipeline.

Add test to fetch_test report which checks that test report from
the last schedule pipeline on this project can be read and checked.
(E2E test)

Signed-off-by: Philip Puk <philip.puk@arm.com>

Improve unit test cases clarity by correcting the assignment
of expected and result variable.

Signed-off-by: Philip Puk <philip.puk@arm.com>

The purpose of the script is to audit test results from a given
CI pipeline and produce pass/fail results based on a machine
readable list of tests which are expected to pass.

The script will first read the list of expected pass tests from
a json file. Also, relying on the predefined CI variables
and gitlab-python module to access the pipeline test reports.
By comparing list of expected pass test and passed tests extracted
from actual test reports, the script will print "FAIL" to stderr if
there are missing tests that are expected to pass or "PASS" if all
expected tests passed.

Signed-off-by: Philip Puk <philip.puk@arm.com>

Signed-off-by: Adam Johnston <adam.johnston@linaro.org>

`download_url` has shifted from `extra` to the JSON root
Update .complete-lava-job

Changelog: bug
Signed-off-by: Adam Johnston <adam.johnston@linaro.org>

When using a central hash server we are likely to be using a cache
area that is shared with other projects so we should not allow people
to fully delete the cache area or prune the cache.

Changelog: other
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Changelog: bug
Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>

Fix minor yamllint issue.
Add yamllint to the dictionary.

Changelog: other
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Vishal Bhoj authored Dec 11, 2023 and Drew Reed committed Dec 14, 2023

Need to keep the artifacts private since they may
include credentials

Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>

Correct the regex logic order when determining if the platform is
supported via tuxsuite or lava directly.
Bump version number to v1.6.1

Changelog: bug
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Lava test jobs can be submitted through tuxsuite to allow testing in an
auto scaling environment so we should support it as a way to start/stop
lava based testing.

Changelog: feature
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

To allow the use of rules around the pipeline source to be used
correctly within a child pipeline it's important to know the actual
source of the parent pipeline.

Bump version number to v1.5.4

Changelog: bug
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

By default GitLab only does a git fetch to a depth of 20 but with some
weekly sync merge requests containing 20+ commits this leaves the
danger bot unable to find the common point in the history and so it
fails.

Bump version number to v1.5.3

Changelog: bug
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Due to an upstream buildah project compromise all the tagged images have
been removed and only the latest version is currently available so we
have to adopt it to continue building containers.

Bump version to v1.5.2

Changelog: bug
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Signed-off-by: Drew Reed <drew.reed@arm.com>

Ziad Elhanafy authored Jul 18, 2023 and Drew Reed committed Jul 18, 2023

Gitlab CI by default just fetches 20 commits
from the repository and doesn't do a full clone.

If we have files which were not changed for a long time
(Before those 20 fetched commits).
When codeclimate-headercheck runs and it calls this BQA tools method:
https://gitlab.oss.arm.com/engineering/ais/bqa-tools/-/blob/main/tools/qa-checks/header_check.py#L294


It tries to get the history for each file
(Which was last changed before those 20 commits),
the method fails and it goes to the last return statement
"return time.gmtime(os.path.getmtime(path))"
which just gives the file's local time in which it was cloned,
so it gives the error saying
"Copyright final year doesn't match the file's last modification"
Because it thinks the file was modified in the current year
but in reality it was not.

Set GIT_STRATEGY variable to clone and set
GIT_DEPTH to 0 to clone the complete history of the
repository.

Changelog: bug
Signed-off-by: Ziad Elhanafy <ziad.elhanafy@arm.com>

Signed-off-by: Drew Reed <Drew.Reed@arm.com>

To enable the differentiation of the runner tags between server we allow
the setting of the RUNNER_TAG_SCOPE variable whose value will be added
to the end of the 3 required runner tags.

Changelog: feature
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

Some projects and kas container versions may not wish to run as the non
default UID/GID so we should not set the default UID/GID in the
template.

Changelog: bug
Signed-off-by: Drew Reed <Drew.Reed@arm.com>

The default location for CI scripts is now `scripts` (it used to be
`.gitlab/scripts`). Update the default values for `FETCH_SCRIPT` in
`Collate-Results` and `complete-lava-job`.

When they are updated, projects which still use the old location must
either move their scripts or override the value of `FETCH_SCRIPT`.

Changelog: other
Signed-off-by: Adam Johnston <adam.johnston@linaro.org>