Skip to content
README.md 7.04 KiB
Newer Older
# Template Structure for SystemReady Compliance Reports
This repo structure is the template for collecting compliance evidence for a
SystemReady certification.

## General Instructions
General instructions for collecting SystemReady compliance logs:

Grant Likely's avatar
Grant Likely committed
### `./report.txt`
Fill in with information about the system being certified
Grant Likely's avatar
Grant Likely committed
### `./acs-console.log`
If using serial console, capture a full console log from first power on
until completion of ACS tests. Must include all output from firmware.
Should end at a Linux busybox shell prompt after running FWTS tests.
### `./acs_results/`
Place an entire copy of the `LUV-Results` or `acs_results` partitions, as
Grant Likely's avatar
Grant Likely committed
follows:
For Enterprise ACS, under the `LUV-Results` partition:
Grant Likely's avatar
Grant Likely committed
    /luv-results-<date>
        /sbsa_results
Grant Likely's avatar
Grant Likely committed
            /linux
        /SCT_RUN
        /sdei_results

For ACS-ES and ACS-IR, under the `acs_results` partition:
Grant Likely's avatar
Grant Likely committed

    /fwts
    /linux
    /linux_dump
    /sct_results
    /uefi
    /uefi_dump

For ACS-IR, also include the `results.md` output from running the SCT results
parser script from https://gitlab.arm.com/systemready/edk2-test-parser.

Grant Likely's avatar
Grant Likely committed
### `./manual-results/`

Place any results from manually performed tests in this directory tree.
Manual test results must include both a console log of the commands
executed and the result files (if any) generated by the test.

### `./manual-results/bsa-linux/`

Place any BSA or SBSA results collected manually from Linux.

#### Enterprise-ACS Examples:

SBSA Linux results can be collected by running the following commands
after booting LUVOS:

    insmod /lib/modules/4.18.0-luv/extra/sbsa_acs.ko
    sbsa -l 3

You can include verbose output (-v):

    sbsa -l 3 -v 2

To skip a specific problematic test, use -skip <testnum>. For example:

    sbsa -l 3 -v 2 -skip 20,36

### `./manual-results/bsa-uefi/`

Place any BSA or SBSA results collected manually from UEFI Shell

#### Enterprise-ACS Examples:
Grant Likely's avatar
Grant Likely committed
SBSA UEFI results can be collected by running the following
commands after booting LUVOS:
Grant Likely's avatar
Grant Likely committed
    sbsa.efi -l 3
Grant Likely's avatar
Grant Likely committed
You can include verbose output (-v):
Grant Likely's avatar
Grant Likely committed
    sbsa.efi -l 3 -v 2
Grant Likely's avatar
Grant Likely committed
To skip a specific problematic test, use -skip <testnum>
Grant Likely's avatar
Grant Likely committed
    sbsa.efi -l 3 -v 2 -skip 407
Grant Likely's avatar
Grant Likely committed
### `./manual-results/fwts/`
Place any additional FWTS results collected manually by running:
Grant Likely's avatar
Grant Likely committed
    fwts -r stdout -q –sbbr
Grant Likely's avatar
Grant Likely committed
### `./manual-results/sct/`
Place any additional SCT results collected manually
Grant Likely's avatar
Grant Likely committed
    FS2:\SCT>SCT.efi -a –v
Grant Likely's avatar
Grant Likely committed
If there are issues with specific cases, can skip them by running the UI with sct -u
and selecting/unselecting specific test cases
Grant Likely's avatar
Grant Likely committed
### `./docs/`
Place any firmware or device documentation, manuals, user guides, build instructions, etc..
Grant Likely's avatar
Grant Likely committed
### `./fw/`
Grant Likely's avatar
Grant Likely committed
#### `./fw/screenshots/`
Place some screenshots showing the FW menus (such as UEFI Setup, BMC
web console, uboot shell)
Grant Likely's avatar
Grant Likely committed
#### `./fw/u-boot-sniff.log`
Run the following commands at U-Boot prompt and attach the logs:
Grant Likely's avatar
Grant Likely committed
    u-boot=> help
    u-boot=> version
    u-boot=> printenv
    u-boot=> printenv -e
    u-boot=> bdinfo
    u-boot=> rtc list
    u-boot=> sf probe
    u-boot=> usb reset
    u-boot=> usb info
    u-boot=> mmc rescan
    u-boot=> mmc list
    u-boot=> mmc info
    u-boot=> efidebug devices
    u-boot=> efidebug drivers
    u-boot=> efidebug dh
    u-boot=> efidebug memmap
    u-boot=> efidebug tables
    u-boot=> efidebug boot dump
    u-boot=> bootefi hello ${fdtcontroladdr}
    u-boot=> bootefi selftest ${fdtcontroladdr}

#### `./fw/uefi-sniff.log`
Run the following commands in UEFI Shell and attach the logs (if not
already done by ACS). The UEFI Shell can be run from the ACS image by
pressing a key at the UEFI timeout prompt before tests begin to
execute.

    Shell> pci
    Shell> drivers
    Shell> devices
    Shell> devtree
    Shell> dmpstore
    Shell> dh -d -v
    Shell> memmap
    Shell> smbiosview
    Shell> acpiview -l
    Shell> acpiview
    Shell> acpiview -r 2
    Shell> acpiview -s DSDT -d  (if DSDT table is present)
    Shell> acpiview -s SSDT -d (if SSDT table is present)
    Shell> CapsuleApp.efi -P
    Shell> CapsuleApp.efi -E

### `./os-logs/`

#### `./os-logs/linux-[distroname]-[distroversion]/`
Create a directory for each Linux distro used for testing.

Install the OS to a disk, and boot it.
Collect the installation and OS boot logs and save in single text file.
The install log must begin when the platform is released from reset and
must include:

- All firmware output
- Output from Linux installer
- Output of reboot into installed OS.
- Output of following commands from Linux shell:

```
dmesg
lspci -vvv
lscpu
lsblk
dmidecode
uname -a
efibootmgr
tar cfz sys-firmware.tar.gz /sys/firmware
```

Copy the resulting sys-firmware.tar.gz into the results directory.

#### `./os-logs/esxi/`
Install VMWare ESXi to a disk, and boot it.
Connect to vSphere web console over network and capture screenshots.
Run the following commands and attach the logs:

```
dmesg
lspci
irqinfo
localcli hardware pci list
localcli storage core adapter list
```

#### `./os-logs/winpe/`
Boot WinPE from USB key, or Install Windows a disk, and boot it.
Include screenshots and video of WinPE booting (from FW menu to OS startup,
and keyboard working in command prompt)

Run the following commands and attach the logs:

```
pnputil/enum-devices
pnputil/enum-drivers
Systeminfo
ver
```

## Band Specific Examples

## SystemReady IR results

For IR, after collecting the results the directory tree should look like this:

```
.
├── acs-console.log
├── acs_results/
│   ├── results.md
│   ├── app_output/
│   │   ├── CapsuleApp_ESRT_table_info.log
│   │   └── CapsuleApp_FMP_protocol_info.log
│   ├── fwts/
│   │   └── FWTSResults.log
│   ├── linux_dump/
│   │   └── lspci.log
│   ├── sct_results/
│   │   ├── EfiCompliantBBTest/
│   │   │   └── EfiCompliant.ini
│   │   ├── Overall/
│   │   │   ├── Summary.ekl
│   │   │   └── Summary.log
│   │   └── Sequence/
│   │       ├── EBBR_manual.seq
│   │       └── EBBR.seq
│   ├── uefi/
│   │   └── BsaResults.log
│   └── uefi_dump/
│       ├── acpiview_l.log
│       ├── acpiview.log
│       ├── acpiview_r.log
│       ├── bcfg.log
│       ├── devices.log
│       ├── dh.log
│       ├── dmpstore.log
│       ├── drivers.log
│       ├── memmap.log
│       ├── pci.log
│       └── smbiosview.log
├── docs/
├── fw/
│   ├── readme.txt
│   └── u-boot-sniff.log
├── manual-results/
├── os-logs/
│   ├── esxi/
│   ├── linux-distro1-version/
│   │   ├── console.log
│   │   └── sys-firmware.tar.gz
│   ├── linux-distro2-version/
│   │   ├── console.log
│   │   └── sys-firmware.tar.gz
│   ├── screenshots/
│   └── winpe/
├── README.md
└── report.txt

19 directories, 28 files
```