FIX

FIX

Make batch-rebase independent of the lisa package. Also make it try to
load the conf as JSON before trying as YAML. If it is indeed valid json,
that also removes the dependency over ruamel.yaml.

FIX

Conditions within '' are not picked up by the gitlab CI

Edwin Basil James authored Jan 29, 2024 and Douglas Raillard committed Jan 31, 2024

Add gitlabci yaml and scripts required for Gitlab migration

FIX

Remove impact of set iteration order from the toolchain selection
process.

Also give priority to android target CROSS_COMPILE triplets when the
target is an Android device.

Hongyan Xia authored Jan 23, 2024 and Douglas Raillard committed Jan 25, 2024

FEATURE

Upstream has now removed struct util_est and effectively merged
util_est.enqueued and util_est.ewma in a single int field. Provide a new
trace event for it so the new kernel can trace it.

This also fixes LISA not being able to compile and load the module on
the new kernel. We detect whether struct util_est exists to decide if
the new signal should be used.

Morten Rasmussen authored Jan 24, 2024 and Douglas Raillard committed Jan 25, 2024

FIX

Pandas 2.2.0 GroupBy.apply() no longer includes the group column by
default. It must be explicitly selected.

FIX

Some classes like dict can now be parametrized, e.g. dict[int, str].
They do not behave exactly like their deprecated typing counterpart
(e.g. typing.Dict), so ensure they are handled consistently by exekall.

FIX

Avoid a FutureWarning related to inplace operation on view objects that
will not work anymore in pandas 3.0

FIX

Warn about toolchain mismatching what the kernel was compiled with in
absolute terms.

FEATURE

Make toolchain detection complain at warning level with a clear error if
a non-ideal toolchain has been selected.

c60737c78 [Android] Fix use-before-initialization during initialization of ApkInfo

git-subtree-dir: external/devlib
git-subtree-split: c60737c78e00204ebfaf9708e80185084db2693c

Dietmar Eggemann authored Jan 16, 2024 and Douglas Raillard committed Jan 18, 2024

Set CONFIG_MODPROBE_SMALL=n and CONFIG_STATIC=y to allign the busybox
binary of the rootfs with that of devlib (refer to
$LISA/tools/recipes/busybox.recipe).

Set CONFIG_MODPROBE_SMALL=n to avoid an issue with insmod related to its
return value.

Moreover, set CONFIG_FEATURE_PS_ADDITIONAL_COLUMNS=y so that /bin/ps
supports the '-o nice' specifier. This is needed to evaluate issues
related to lisa-test during load related PELT Invariance tests on the
target they happen. Load depens on task priority, i.e. task nice value.

Signed-off-by: Dietmar Eggemann <dietmar.eggemann@arm.com>

FEATURE

Do not show the full set of available events as it typically is very
large and makes the output hard to read. Instead, only show the closest
matches for the events that are missing.

Update subtrees

remote: https://github.com/ARM-Software/devlib.git

f60e341d6 target: Fix read_sysctl()
46219ace0 android: Fix typo in ApkInfo

git-subtree-dir: external/devlib
git-subtree-split: f60e341d6e57ff01d62c325d4c7ef59567f535d2

Update subtrees

4589b4698 target: Fix typo Changed target variable to self because it is not defined in the file.
56746fdb3 ssh: Fix tools detection
c347861db android: Ensure we use the detected fastboot
3f9ce8ba7 android: Fix tool detections

git-subtree-dir: external/devlib
git-subtree-split: 4589b4698ed4bac2af93a3bdbce6b4c1e4fca495

remote: https://github.com/ARM-Software/devlib.git

update subtrees

remote: https://github.com/ARM-Software/workload-automation.git

0eb17bf8f build(deps): bump paramiko from 3.1.0 to 3.4.0
f166ac742 utils/misc: Fix linters violation
6fe4bce68 Remove Python 2 support
28b78a93f utils/misc: Replace deprecated __import__ by importlib
77ebefba0 wa: Remove dependency on "imp" module
41f798424 fw/rt_config: Add unlock_screen config option in runtime_parameters
23fcb2c12 framework/plugin: Fix typo at suppoted_targets
e38b51b24 build(deps): bump cryptography from 41.0.4 to 41.0.6
ea08a4f9e build(deps): bump urllib3 from 1.26.17 to 1.26.18
5b56210d5 UIBenchJankTests:modification to support Android 14 version "--user <USER_ID" (current user: 0) option is added to activity manager (am) command because of "Invalid userId" command. Tested with other benchmarks (geekbench) as well.
0179202c9 build(deps): bump urllib3 from 1.26.15 to 1.26.17
617306fdd build(deps): bump cryptography from 41.0.3 to 41.0.4

git-subtree-dir: external/workload-automation
git-subtree-split: 0eb17bf8f0c72333e43312da6ed6611b0c4fa1cc

f30fb0b3f utils/ssh: Ensure the detected sshpass is used
c39d40c6f utils/ssh: Remove _check_env()
926aee183 utils/android: Remove PATH manipulation
19c51547d utils/android: Cleanup android tool detection
52485fbaa setup.py: Re-add "future" PyPI package
416e8ac40 devlib: Remove Python 2 dead code
ea4eccf95 setup.py: Remove use of "imp" module
b8bf2abf3 AndroidTarget: Skip ungrantable Android permission
9f71c818c android: Add adb_port connection setting
0579a814f android: Add a retry logic for background command PID detection
900531b41 android: Fix background command PID detection
14b4e2069 target: Add helper function to check Android screen's locking state
07294251c target: Handle dozing case in checking Android screen state
2f48b84e6 target: Fix indentation of a misaligned line
5a1eb4a77 UIBenchJankTests:modification to support Android 12/14 versions dex file search is modified. It collects all the available methods under the package name. Tested with other benchmarks (geekbench,pcmark,jankbench in Android 12) as well.
d7d1deedd collector/dmesg: Query systcl kernel.dmesg_restrict
18d2a343c target: Add Target.read_systcl()
5104002f1 target: Update kernel version parsing for Android GKI kernels
90973cac0 devlib: Make add_trip_point and add_thermal_zone private
403a0faf9 devlib: Add ThermalZone type and policy support to thermal module

git-subtree-dir: external/devlib
git-subtree-split: f30fb0b3fd5032c083bd646cfc3697bd930e8df9

remote: https://github.com/ARM-Software/devlib.git

FIX

Specify that meta event field names must be unique.

BREAKING CHANGE

trace_printk@... meta events now require a bprint event, bputs is not
supported anymore.

FIX

Add a blank line as reST requires to finish a bullet point list.

In order to support trace_printk meta events more easily in upcoming
parsers, restrict the format that is accepted so that:

* the format string is only used to infer the format of the event
* the variable arguments buffer is used for the values
* we must get a bprint, not bputs event

Remove support for trace_printk@func meta event support. It had a number
of issues:
* Harder to support for new parsers
* The function name is not stable due to multiple symbols sometimes
  covering the same address range
* The function name may or may not be what the user expects due to
  inlining.

BREAKING CHANGE

Remove support for positional field ("__positional") for meta events
such as trace_printk@* or userspace@* events. This feature was not used
and complexifies parsers for little gain.

Update from 2023 to 2024

FIX

Use lazy umount of chroot folders to avoid failing if a process is still
accessing it. There seems to be some processes alive for a short
duration after we finished building that otherwise intermittently make
cleanup fail.

FIX

Avoid using install_libs which attempts to build a shared object, when
we only want a static binary.

FIX

Require a callable rather than limiting it to types.

Morten Rasmussen authored Dec 14, 2023 and Douglas Raillard committed Dec 22, 2023

FIX

It looks like the appearance of userspace generated ftrace events has
changed. What appears to be a compiler ID hash has been added to the event
meta data breaking the prefiltering of trace data in
_select_userspace().

The event used contain the keyword 'tracing_mark_write:', but now has
the format: 'tracing_mark_write.<ID_hash>:'.

Example:
   rt-app-21908 [001] 4470442.464974: print:
tracing_mark_write.10e87ffbd993ed977ebcbff93a794b6d: rtapp_main:
event=end

Fix the event filtering to handle new format without breaking backwards
compatibility.

Dietmar Eggemann authored Nov 27, 2023 and Douglas Raillard committed Dec 19, 2023

The kernel commit 7bc263840bc3 ("sched/topology: Consolidate and clean
up access to a CPU's max compute") removed rq->cpu_capacity_orig so we
can't use it anymore to retrieve the original CPU capacity nor for
setting the FREQ_INVARIANCE kernel feature in LISA.

Split the micro-architectural part of the Invariance from the
FREQ_INVARIANCE into its own kernel feature UARCH_INVARIANCE.

Use a copy of the Arm64 (+ Arm, Riscv) kernel implementation (per-cpu
cpu_scale variable in drivers/base/arch_topology.c) also in the lisa
trace module code.

Tested on Juno-r0 with 'lisa-load-kmod --conf target_conf.yml' by
evaluating the 'capacity_orig' field of the 'lisa__sched_cpu_capacity'
trace event.

Signed-off-by: Dietmar Eggemann <dietmar.eggemann@arm.com>

FEATURE

Update rt-app with a saner calibration procedure to avoid pLoad=0 issue.