To see options, run

    python utils/cloud_helper/aws_device_update.py --help
    python utils/cloud_helper/aws_device_update.py import --help
    python utils/cloud_helper/aws_device_update.py attach-policy --help
    python utils/cloud_helper/aws_device_update.py deploy --help
    python utils/cloud_helper/aws_device_update.py cleanup --help
    python utils/cloud_helper/aws_device_update.py delete-all --help
    python utils/cloud_helper/aws_device_update.py delete-thing --help

The following variables need to be set in the CI environment:
* AWS_REGION
* IOT_OTA_ROLE_NAME
* IOT_OTA_CERT_ID

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>

Azure devices are for kept in portal for 7 days after pipeline is run.
This was done to enable developers to rerun the CI jobs. But This seems
to be creating a huge number of devices in Azure portal. To limit this:

- Delete devices if pipeline was successful.
- Delete devices if pipeline was finished more than a day ago.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>

Enable copyrights checks for yaml and yml files as
part of the license checks.

Signed-off-by: Anna Matczak <anna.matczak@arm.com>

Artur Tynecki authored Jun 26, 2023 and Hugues Kamba Mpiana committed Jul 05, 2023

Signed-off-by: Artur Tynecki <artur.tynecki@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Remove invalid references in documentation and replace with accessible
urls.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

To enable it for all repositories in the IoT-M group which use
the developer-tools.

Signed-off-by: Anna Matczak <anna.matczak@arm.com>

Setting in template files doesn't merge well when settings are also
present in Group variables. Remove from here and set only in Group
variables.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Git ls-remote has limitations. Hence, clone the repositories and find
tags.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

If a component had never an MR before, it should be picked for updating
even if `days_between_updates` is greater than 0.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Add configuration for autobot to control the update targets and
frequency.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Signed-off-by: autobot <autobot-noreply@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

As these may not be needed by all consumer repositories move them to
separate files.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Artur Tynecki authored Mar 24, 2023 and Vincent Coubard committed Mar 26, 2023

Exclude .zap and .matter files from the license check.
These are auto-generated text-based files.

Signed-off-by: Artur Tynecki <artur.tynecki@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

To workaround with `gitlab-ci-local` limitations, use single file
template.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

In azure_device_update.py, functions wrapped with the click module can
be called from command line, but they cannot be called from another
Python script like normal functions because click overrides function
parameters.

To allow Azure Device Update functions to be called from another Python
script, put implementation code in regular functions and make click-
wrapped commands call those implementation functions.

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

This deletes all updates, device groups, device classes and associated
devices and deployments from the ADU instance. This is for housekeeping
of the ADU instance and must be used with caution, as it can interfere
with any ongoing CI runs that involve ADU.

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Since Python 3.6, f-strings is the modern, readable way to format
strings. Most other scripts in this repository already use f-strings, so
for consistency, use only f-strings instead of concatenations and
`.format()` in `azure_device_update.py`.

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Azure Device Update has a per-instance limit of 100 device groups and 80
device classes. Once the limit is reached, no more groups or device
classes can be created and this results in deployment failures in CI
runs.

Add deletion of group and device class to the cleanup command. Because
Azure only allows deleting empty groups which have no devices or
deployments, we also query and delete the group's associated device and
deployment.

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Azure has a small delay before a newly imported update becomes
deployable to its compatible device group. Add a delay after importing,
with 10 sec as the default which should be more than enough.

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Hugues Kamba Mpiana authored Feb 09, 2023 and Lingkai Dong committed Feb 21, 2023

Python's `click` library already indicates what options are required, so
there is no need to say what is optional. Enable `show_default=True` so
the user can see the default value.

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>

Hugues Kamba Mpiana authored Feb 08, 2023 and Lingkai Dong committed Feb 21, 2023

The script should exit with an error return code in case of error
so the CI can acknowledge the failure.

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>

Hugues Kamba Mpiana authored Feb 07, 2023 and Lingkai Dong committed Feb 21, 2023

Signed-off-by: Hugues Kamba-Mpiana <hugues.kambampiana@arm.com>

Saheer Babu authored Feb 06, 2023 and Lingkai Dong committed Feb 21, 2023

Azure device update doesn't work with `_`.

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

* Enable create release
* Disable tpip-checker in MR

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Lingkai Dong authored Jan 12, 2023 and Hugues Kamba Mpiana committed Jan 31, 2023

To see options, run

    python utils/cloud_helper/azure_device_update.py --help
    python utils/cloud_helper/azure_device_update.py import --help
    python utils/cloud_helper/azure_device_update.py deploy --help
    python utils/cloud_helper/azure_device_update.py cleanup --help

The following variables need to be set in the CI environment:
* AZURE_CLIENT_ID
* AZURE_CLIENT_SECRET
* AZURE_TENANT_ID
* AZURE_DEVICE_UPDATE_ENDPOINT
* AZURE_DEVICE_UPDATE_INSTANCE
* AZURE_STORAGE_URL
* AZURE_STORAGE_CONTAINER
* AZURE_STORAGE_CONN_STR
* AZURE_STORAGE_SAS_TOKEN

Signed-off-by: Lingkai Dong <lingkai.dong@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>

Signed-off-by: autobot <autobot-noreply@arm.com>

Signed-off-by: Saheer Babu <saheer.babu@arm.com>