16.03/TestReports/20160204
From Apertis
Testing results considerations:
- All manual test cases were executed on Target i386 and SDK i386 image, and were executed as needed by the development team on the Target ARM and Target AMD64 images.
- All automated test cases already integrated into LAVA system were executed on images: Target ARM, Target AMD64, Development AMD64, Target i386, Development i386, SDK i386 and SDK AMD64.
- Test cases marked as 'under development' were skipped during this testing round.
- Failures and partial failures were noted in the Release notes document for further analyse.
The platform image used for these tests are :
- Target AMD64 (2016-02-04)
- Development AMD64 (2016-02-04)
- Target i386 (2016-02-04)
- Development i386 (2016-02-04)
- SDK i386 (2016-02-04)
- SDK AMD64 (2016-02-04)
ID | Description | Type | Target ARM | Target AMD64 | Development AMD64 | Target i386 | Development i386 | SDK i386 | SDK AMD64 | Tested By | Notes |
---|---|---|---|---|---|---|---|---|---|---|---|
Booting | |||||||||||
image-bootable | Test whether the image is bootable. | Not Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Parthiban Boopathi Piyush | |
image-x-start | Test whether the image starts a graphical environment. | Not Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Parthiban Boopathi Piyush | |
HW Acceleration | |||||||||||
x-hw-accelerated | Test whether the correct GLES2 render is used. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
GStreamer | |||||||||||
clutter-playback-gstreamer1.0 | Test video and audio playback using clutter-gst and GStreamer1.0. | Not Integrated | FAILED | PARTIAL | N/A | PARTIAL | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | bug 550 bug 634 |
gstreamer1.0-decode | Test video and audio decoders and demuxers on a list of media. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [1] [2] [3] [4] [5] [6] [7] |
Multitouch | |||||||||||
clutter-actors-bigger-reactive-area | Test that Clutter allows an actor's pick area to be larger than its paint area. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Boopathi Piyush | |
clutter-mt-rotate | Test that clutter properly performs rotation gestures. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
clutter-mt-touch-events | Test multi-touch support in Clutter. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
clutter-mt-zoom | Test that clutter properly performs zoom gestures. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
clutter-transparent-stage | Test that clutter transparent stages are correctly handled by the graphics stack. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
webkit-mt-touch-events | Test implementation of W3C touch events API in webkit-clutters. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
xephyr-mt-touch-events | Test that X clients within Xephyr receive touch events forwarded from the host X display. This test is used for both touchscreen *and* support for the Magic Trackpad. So please, do test for both cases below: |
Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | FAILED | Parthiban | bug 598 |
WebKit | |||||||||||
webkit-actor-tiles | Test implementation of actor-based tiled backing store in webkit-clutter. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-event-handling-redesign | Test WebKit-Clutter ability to scroll by touch with inertial behaviour after the touch ended. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-layout-tests | Layout tests are used to check the correctness of the renderer. It involves loading pages in a test renderer (DumpRenderTree) and comparing the rendered output tree against an expected output file. | Integrated | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [8] [9] [10] [11] [12] [13] [14] |
Webkit-AC | |||||||||||
webkit-ac-3d-rendering | Test that 3D transforms are applied correctly. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-ac-animations | Test that Clutter actors created for representing layers animate properly. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-ac-scrolling | Test that actors created for representing layers scroll properly. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
Gettext | |||||||||||
clutter-i18n-gettext | Check that internationalization (translation) of Clutter applications using gettext works. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
gettext-i18n | Check that gettext internationalization works. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [15] [16] [17] [18] [19] [20] [21] |
Meta Data Management | |||||||||||
gupnp-services | Run a few tests related to service browsing, introspection, etc. | Integrated | PARTIAL | PARTIAL | PASSED | PASSED | PASSED | PASSED | PARTIAL | Araujo | [22] [23] [24] [25] [26] [27] [28] |
librest-unit | Run the unit tests that ship with the library against the running system. | Integrated | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [29] [30] [31] [32] [33] [34] [35] |
libsoup-unit | Run the unit tests that ship with the library against the running system. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [36] [37] [38] [39] [40] [41] [42] |
tracker-indexing-local-storage | Check tracker indexing of local storage and journal behaviour. | Integrated | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [43] [44] [45] [46] [47] [48] [49] (bug 594) |
tracker-indexing-mass-storage | Check tracker indexes mass storage devices on insertion. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
tumbler-thumbnailing | Check that all thumbnailing features of tumbler are working properly (large, small, videos, documents, images). | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [50] [51] [52] [53] [54] [55] [56] |
Grilo | |||||||||||
grilo | Check grilo metadata notifications, and filesystem browsing. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [57] [58] [59] [60] [61] [62] [63] |
DBus | |||||||||||
dbus-dos-reply-time | Check the reply time of a few D-Bus method calls while dbus-daemon is loaded by D-Bus traffic. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [64] [65] [66] [67] [68] [69] [70] |
Networking | |||||||||||
bluez-avrcp-volume | Test the AVRCP volume up and down commands. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
bluez-phone | Test all BlueZ features needing interaction with a phone (Pairing, OBEX, PBAP, AVRCP, A2DP, HSP, HFP, PAN). | Not Integrated | PARTIAL | PARTIAL | N/A | PARTIAL | N/A | PARTIAL | PARTIAL | Parthiban Boopathi Piyush | bug 592 |
bluez-setup | Test setup of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
connman | Runs some automated tests using the ConnMan D-Bus API. It guarantees most of the basic features are working. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [71] [72] [73] [74] [75] [76] [77] |
connman-new-supplicant | Test the wpa_supplicant interface. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [78] [79] [80] [81] [82] [83] [84] |
connman-pan-tethering | Test ConnMan support for PAN connectivity. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
connman-services | Tests ConnMan services. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Boopathi Parthiban Piyush | |
connman-usb-tethering | Test ConnMan support for USB tethering (connection side). | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
ofono-sms-receive | Test receiving SMS messages with oFono. | Not Integrated | N/A | N/A | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Piyush | |
ofono-sms-send | Test sending of SMS with oFono. | Not Integrated | N/A | N/A | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Piyush | |
Folks | |||||||||||
folks-alias-persistence | Ensures user-set contact aliases persist. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [85] [86] [87] [88] [89] [90] [91] |
folks-eds-compatibility | Checks that contacts created within Evolution Data Server (as will happen when phone contacts get synchronized to an Apertis machine) show up in other contact-based programs. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [92] [93] [94] [95] [96] [97] [98] |
folks-metacontacts-linking | Ensures linking meta-contacts works properly. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [99] [100] [101] [102] [103] [104] [105] |
folks-metacontacts-unlinking | Ensures unlinking meta-contacts works properly. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [106] [107] [108] [109] [110] [111] [112] |
folks-telepathy-retrieve-contacts | Ensures that Folks can correctly retrieve Telepathy contacts. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [113] [114] [115] [116] [117] [118] [119] |
Telepathy | |||||||||||
telepathy-gabble-unit | Run telepathy-gabble test suite. | Integrated | PARTIAL | FAILED | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [120] [121] [122] [123] [124] [125] [126] |
telepathy-rakia | Test Telepathy rakia integration | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
SDK Development | |||||||||||
sdk-ide-build-run-program | Creates a simple test project and confirms that compiling and executing work. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Parthiban | |
sdk-nested-wm | Tests that Devilspie scripts can be applied to windows running within Mutter. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | FAILED | Parthiban | bug 598 |
Apparmor Basic | |||||||||||
apparmor-basic-profiles | Test basic apparmor profiles. Only parsing and syntax of profiles are tested for now. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [127] [128] [129] [130] [131] [132] [133] |
CGroups | |||||||||||
cgroups-resource-control | Run cgroup resource control tests | Integrated | PARTIAL | PASSED | NOT TESTED | PARTIAL | PARTIAL | PARTIAL | PASSED | Araujo | [134] [135] [136] [137] [138] [139] [140] |
SDK | |||||||||||
sdk-performance-tools-gprof-smoke-test | Checks basic gprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [141] [142] |
sdk-performance-tools-sysprof-smoke-test | Checks basic sysprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | FAILED | Araujo | [143] [144] (bug 633) |
sdk-debug-tools-gdb-smoke-test | Checks basic gdb functionality by stopping a program at a set point and checking its backtrace matches expectations. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [145] [146] |
sdk-debug-tools-strace-smoke-test | Checks basic strace functionality by checking its output when run on a simple command line program. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [147] [148] |
sdk-debug-tools-valgrind-smoke-test | Checks basic valgrind functionality by running a program with and without memory leaks, ensuring expected results from valgrind. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [149] [150] |
sdk-dbus-tools-bustle-smoke-test | Test that bustle-dbus-monitor shows services on the session bus. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Parthiban | |
sdk-dbus-tools-d-feet-smoke-test | Test that D-Feet both shows services on the session bus and that new services appear automatically. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Parthiban | |
sdk-code-analysis-tools-gcov-smoke-test | Checks basic gcov functionality by running a sample program a few different ways and ensuring that a sufficient portion of its code paths are executed | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [151] [152] |
sdk-code-analysis-tools-splint-smoke-test | Checks basic splint functionality by checking its output when run on a simple source file. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [153] [154] |
sdk-vb-fullscreen | Tests that the SDK VM can be fullscreened in VirtualBox | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | FAILED | Parthiban | bug 598 |
Eclipse | |||||||||||
eclipse-sysroot-management | Test sysroot management and update within Eclipse. It will go through configuring an existing sysroot in Eclipse, and then updating it from the web with the latest version. | Not Integrated | N/A | N/A | N/A | N/A | N/A | FAILED | FAILED | Parthiban | bug 427 |
eclipse-install-to-target | Test copying files to the remote device from within Eclipse. It will create a dummy project and then create a configuration to copy the binary file to a remote device and debug it remotely using Eclipse. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Parthiban | |
eclipse-remote-debugging | Test remote debugging within Eclipse. It will create a dummy project and then create a configuration to copy the binary file to a remote device and debug it remotely using Eclipse. | Not Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Parthiban | |
Contacts | |||||||||||
evolution-sync-bluetooth | Synchronizing Bluetooth-paired phone contacts to Evolution. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
folks-metacontacts-antilinking | Ensures anti-linking meta-contacts works properly. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [155] [156] [157] [158] [159] [160] [161] |
Clutter Multitouch | |||||||||||
xoo-soft-keys-emulation | Test that 'xoo' allows one to pass-in Xephyr-nested key events from clicking UI buttons | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PARTIAL | Araujo | [162] [163] |
clutter-performance | Test performance of Clutter | Integrated | FAILED | FAILED | PARTIAL | PARTIAL | PARTIAL | PARTIAL | FAILED | Araujo | [164] [165] [166] [167] [168] [169] [170] (bug 390) |
x-out-of-screen-events-buttond | Test that buttond generates correct keystrokes in response to simulated touch screen input | Integrated | PASSED | PASSED | PASSED | PASSED | PARTIAL | PASSED | PASSED | Araujo | [171] [172] [173] [174] [175] [176] [177] |
mxkineticscrollview-smooth-pan | Some low-resolution touch screens send touch events in widely separate time intervals, which causes MxKineticScrollView widget to jump from one position to the next one without any visible transition. This test case implements a long list to scroll through to make sure there are no visible "jumps" when scrolling. | Not Integrated | PARTIAL | PARTIAL | N/A | PARTIAL | N/A | PARTIAL | PARTIAL | Parthiban Boopathi Piyush | bug 543 |
Connectivity | |||||||||||
bluez-hfp | Test Hands Free Profile (HFP) BlueZ feature. | Not Integrated | N/A | N/A | N/A | PASSED | N/A | N/A | N/A | Piyush | |
rfkill-toggle | Test that rfkill is functional. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
telepathy-ring | Support making and receiving phone calls in Telepathy manually, with a bluetooth-paired phone. | Not Integrated | PARTIAL | PARTIAL | N/A | PARTIAL | N/A | PARTIAL | PARTIAL | Parthiban Boopathi Piyush | bug 156 |
telepathy-ring-automated | Support making and receiving phone calls in Telepathy. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [178] [179] |
Contacts | |||||||||||
folks-ofono-backend | Reading contacts from 3G modem SIM card. | Not Integrated | N/A | N/A | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Piyush | |
folks-search-contacts | Ensures that Folks can correctly search contacts. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [180] [181] [182] [183] [184] [185] [186] |
abstract-contact-addressbook-creation | A way to be able to create abstract addressbook is needed in SyncEvolution, so that separate addressbooks can be created for each paired device. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [187] [188] [189] [190] [191] [192] [193] |
folks-sync-only | Test SYNCHRONIZE_ONLY flag for persona stores in Folks. | Integrated | N/A | N/A | N/A | N/A | N/A | PASSED | PASSED | Araujo | [194] [195] |
storage-arbitrary-data-contacts | Support for storing arbitrary data in contacts in Folks. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [196] [197] [198] [199] [200] [201] [202] |
Multimedia | |||||||||||
webkit-gstreamer1.0 | Tests html5 video playback with GStreamer 1.0 in WebKit-Clutter | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
clutter-buffering-2.0 | Test clutter-gst stream buffering support against gstreamer 1.0. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
clutter-live-media-2.0 | Test clutter-gst live media improvements support against gstreamer 1.0. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
traffic-control-basic | Test basic traffic control support. This test does not use tcmmd but it could catch missing support in the kernel or misbehaving traffic control. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Boopathi Parthiban Piyush | |
traffic-control-tcmmd | Test traffic control support with tcmmd and wget. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Boopathi Parthiban Piyush | |
traffic-control-tcdemo | Test traffic control demo with tcmmd and tcdemo. | Not Integrated | PARTIAL | PARTIAL | N/A | PARTIAL | N/A | N/A | N/A | Boopathi Piyush | bug 634 |
gstreamer-buffering | Test the download-buffering playback mode of clutter-gst-3.0. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
gstreamer-splash | Test whether the gstreamer splash plugin is working. | Not Integrated | NOT TESTED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | Camera cable corrupted |
video-animation-on-boot | Test whether Plymouth is able to display a graphical theme. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
gstreamer-viv-direct-texture | Test the GStreamer integration of the Vivante direct texture extension, which enables fast video playback on i.MX6. | Not Integrated | PASSED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | |
Robustness | |||||||||||
glib-gio-fs | Run the GLib gio tests that do I/O on the local filesystem. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [203] [204] [205] [206] [207] [208] [209] |
sqlite-veryquick | Run the "veryquick" tests shipped with SQLite. | Integrated | PASSED | PARTIAL | PARTIAL | PASSED | PASSED | PASSED | PARTIAL | Araujo | [210] [211] [212] [213] [214] [215] [216] |
Security | |||||||||||
apparmor | Functional testing for AppArmor functionalities. | Integrated | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [217] [218] [219] [220] [221] [222] [223] |
apparmor-chaiwala-system | Test that AppArmor's system wide rules works according to Apertis security goals. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [224] [225] [226] [227] [228] [229] [230] |
apparmor-functional-demo | Show some main AppArmor functionalities, like transitions, net access or resource permissions, under the form of tests. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [231] [232] [233] [234] [235] [236] [237] |
apparmor-utils | Test apparmor_parser and other tools in apparmor package can be executed. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [238] [239] [240] [241] [242] [243] [244] |
apparmor-session-lockdown-denies | Test that the MxLauncher profile is indeed limited to what is allows. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
apparmor-session-lockdown-launcher-whitelist | Make sure our demo/test launcher is applying the white-list approach properly. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
apparmor-session-lockdown-no-deny | Test that the session lockdown profile is not blocking more than it should | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
apparmor-gstreamer1.0 | Test that AppArmor profiles provided in GStreamer 1.0 works without Auditd complaining | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [245] [246] [247] [248] [249] [250] [251] |
apparmor-pulseaudio | Test that AppArmor profiles provided in PulseAudio 2.1 work without Auditd complaining. | Integrated | PARTIAL | FAILED | PASSED | PASSED | PASSED | PARTIAL | PARTIAL | Araujo | [252] [253] [254] [255] [256] [257] [258] |
apparmor-webkit-clutter | Tests that the webkit-clutter abstraction doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [259] [260] [261] [262] [263] [264] [265] |
apparmor-bluez-automated | Test AppArmor profile for support for SPP profile (bluez-spp) and core functionalities (bluez-core). | Not Integrated | N/A | N/A | N/A | PASSED | N/A | N/A | N/A | Piyush | |
apparmor-bluez-avrcp-volume | Test AppArmor profile for Bluez AVRCP volume up and down commands. | Not Integrated | FAILED | FAILED | N/A | FAILED | N/A | N/A | N/A | Boopathi Piyush | bug 511 |
apparmor-bluez-setup | Test AppArmor profiles for setting up of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices. | Not Integrated | N/A | N/A | N/A | FAILED | N/A | N/A | N/A | Piyush | bug 511 |
apparmor-folks | Test that AppArmor profiles provided in Folks package work without unexpected auditd log entries. | Integrated | PARTIAL | FAILED | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [266] [267] [268] [269] [270] [271] [272] |
apparmor-geoclue | Test that geoclue apparmor profiles are working properly | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [273] [274] [275] [276] [277] [278] [279] |
apparmor-libreoffice | Tests that the libreoffice profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. | Integrated | PARTIAL | FAILED | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [280] [281] [282] [283] [284] [285] [286] |
apparmor-ofono | Test that AppArmor profiles provided in ofono package work without unexpected auditd log entries. | Not Integrated | N/A | N/A | N/A | PASSED | N/A | N/A | N/A | Piyush | |
apparmor-tracker | Tests that the tracker abstraction and tracker profiles don't cause false negatives and that it does not allow arbitrary reading of files in the home directory. | Integrated | PARTIAL | FAILED | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [287] [288] [289] [290] [291] [292] [293] (bug 594) |
apparmor-tumbler | Tests that the tumbler profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [294] [295] [296] [297] [298] [299] [300] |
iptables-basic | Test the firewall automatically. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [301] [302] [303] [304] [305] [306] [307] |
iptables-nmap | Test the firewall using nmap from another computer. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
apparmor-dbus | Functional testing for AppArmor D-Bus mediation. | Integrated | PASSED | FAILED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [308] [309] [310] [311] [312] [313] [314] |
System Update | |||||||||||
updater-update-platform | Test that chaiwala-updater is capable of performing a full platform update. | Not Integrated | PASSED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | |
btrfs-snapshot-management | Test subvolume management using Btrfs for system upgrades. | Integrated | PASSED | PASSED | NOT TESTED | PASSED | PASSED | PASSED | PASSED | Araujo | [315] [316] [317] [318] [319] [320] [321] |
factory-reset-tool | Check if the system can be restored to a factory reset state. | Not Integrated | FAILED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | bug 386 |
last-resort-message | Test whether U-Boot last resort image is displayed on boot failure | Not Integrated | PASSED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | |
limited-functionality-manual | Test whether the limited functionality mode can be triggered. | Not Integrated | NOT TESTED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | Camera cable corrupted |
v4l-automated | Test the v4l codepaths of chaiwala-v4l2fb. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [322] [323] [324] [325] [326] [327] [328] |
boot-performance | Test boot performance. | Not Integrated | FAILED | N/A | N/A | N/A | N/A | N/A | N/A | Boopathi | bug 467 |
boot-performance-automated | Test boot performance. | Integrated | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | PASSED | Araujo | [329] [330] [331] [332] [333] [334] [335] |
Webkit | |||||||||||
webkit-aligned-scroll | Test that scrolling is pinned in a given direction when started mostly towards it. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | N/A | N/A | Boopathi Piyush | |
webkit-lazy-click | Test touch adjustment (lazy click) support in WebKit-Clutter | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-drag-and-drop | Test HTML5 drag-and-drop support in WebKit-Clutter | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PARTIAL | PARTIAL | Boopathi Parthiban Piyush | bug 576 |
webkit-contextual-zoom | This test case is about zooming parts of a web page to make it easier to read on devices with limited screen area. The scope of the test is the zooming functionality that takes into account the content in the clicked area, other functionality that belongs to a real browser isn't to be tested here. | Not Integrated | PASSED | PASSED | N/A | PASSED | N/A | PASSED | PASSED | Parthiban Boopathi Piyush | |
webkit-clutter-javascriptcore | JavaScriptCore tests are implementation of the Mozilla JavaScript Test Suite. This test suite covers the functionality of the core JavaScript engine. This includes several JavaScript objects such as Arrays, Booleans, Dates, Functions, Global Object, Math, Numbers, Objects, Regular Expressions and Strings. In addition the JavaScript tests cover parsing, lexical conventions, expressions, statements, type conversion, and exception handling. | Integrated | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | PARTIAL | Araujo | [336] [337] [338] [339] [340] [341] [342] |
PASSED - All tests passed. | |||||||||||
PARTIAL - Tests mostly passed, with some minor problems. | |||||||||||
FAILED - One or more tests failed. | |||||||||||
NOT TESTED - Test not run due to some issue, like WIP, Disabled, lacking proper hardware. |