16.06/TestReports/20160526

From Apertis
Jump to: navigation, search

Testing results considerations:

  1. All manual test cases were executed on Target i386 and SDK i386 image, and were executed as needed by the development team on the Target ARM and Target AMD64 images.
  2. All automated test cases already integrated into LAVA system were executed on images: Target ARM, Target AMD64, Development AMD64, Target i386, Development i386, SDK i386 and SDK AMD64.
  3. Test cases marked as 'under development' were skipped during this testing round.
  4. Failures and partial failures were noted in the Release notes document for further analyse.



The platform image used for these tests are :

ID Description Type Target ARM Target AMD64 Development AMD64 Target i386 Development i386 SDK i386 SDK AMD64 Tested By Notes
Booting
image-bootable Test whether the image is bootable. Not Integrated PASSED FAILED FAILED PASSED PASSED PASSED PASSED Piyush Murali Boopathi Vijeth T1771
image-x-start Test whether the image starts a graphical environment. Not Integrated PASSED FAILED FAILED PARTIAL PARTIAL PASSED PASSED Piyush Murali Boopathi Vijeth T1771 T1827
HW Acceleration
x-hw-accelerated Test whether the correct GLES2 render is used. Not Integrated FAILED FAILED N/A FAILED N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1824
GStreamer
clutter-playback-gstreamer1.0 Test video and audio playback using clutter-gst and GStreamer1.0. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A FAILED FAILED Piyush Boopathi Murali Vijeth T1771 T1832 bug 742
gstreamer1.0-decode Test video and audio decoders and demuxers on a list of media. Integrated FAILED PASSED NOT TESTED PASSED PASSED PASSED PASSED Araujo [1] [2] [3] [4] [5] [6] [7] T1690
Multitouch
clutter-actors-bigger-reactive-area Test that Clutter allows an actor's pick area to be larger than its paint area. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
clutter-mt-rotate Test that clutter properly performs rotation gestures. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
clutter-mt-touch-events Test multi-touch support in Clutter. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
clutter-mt-zoom Test that clutter properly performs zoom gestures. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
clutter-transparent-stage Test that clutter transparent stages are correctly handled by the graphics stack. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A N/A N/A Piyush Boopathi Murali T1771 T1832
webkit-mt-touch-events Test implementation of W3C touch events API in webkit-clutters. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
xephyr-mt-touch-events Test that X clients within Xephyr receive touch events forwarded from the host X display.

This test is used for both touchscreen *and* support for the Magic Trackpad. So please, do test for both cases below:

Not Integrated N/A N/A N/A N/A N/A FAILED FAILED Vijeth T1842
WebKit
webkit-actor-tiles Test implementation of actor-based tiled backing store in webkit-clutter. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-event-handling-redesign Test WebKit-Clutter ability to scroll by touch with inertial behaviour after the touch ended. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-layout-tests Layout tests are used to check the correctness of the renderer. It involves loading pages in a test renderer (DumpRenderTree) and comparing the rendered output tree against an expected output file. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [8] [9] [10] [11] [12] [13] [14]
Webkit-AC
webkit-ac-3d-rendering Test that 3D transforms are applied correctly. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-ac-animations Test that Clutter actors created for representing layers animate properly. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-ac-scrolling Test that actors created for representing layers scroll properly. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
Gettext
clutter-i18n-gettext Check that internationalization (translation) of Clutter applications using gettext works. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
gettext-i18n Check that gettext internationalization works. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [15] [16] [17] [18] [19] [20] [21]
Meta Data Management
gupnp-services Run a few tests related to service browsing, introspection, etc. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [22] [23] [24] [25] [26] [27] [28]
librest-unit Run the unit tests that ship with the library against the running system. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [29] [30] [31] [32] [33] [34] [35]
libsoup-unit Run the unit tests that ship with the library against the running system. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [36] [37] [38] [39] [40] [41] [42]
tracker-indexing-local-storage Check tracker indexing of local storage and journal behaviour. Not Integrated FAILED NOT TESTED N/A PASSED N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1836 T1771
tracker-indexing-mass-storage Check tracker indexes mass storage devices on insertion. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771
tumbler-thumbnailing Check that all thumbnailing features of tumbler are working properly (large, small, videos, documents, images). Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [43] [44] [45] [46] [47] [48] [49]
Grilo
grilo Check grilo metadata notifications, and filesystem browsing. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [50] [51] [52] [53] [54] [55] [56]
DBus
dbus-dos-reply-time Check the reply time of a few D-Bus method calls while dbus-daemon is loaded by D-Bus traffic. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PASSED PASSED Araujo [57] [58] [59] [60] [61] [62] [63] T1862
Networking
bluez-avrcp-volume Test the AVRCP volume up and down commands. Not Integrated FAILED NOT TESTED N/A FAILED N/A N/A N/A Boopathi T1830 T1771
bluez-phone Test all BlueZ features needing interaction with a phone (Pairing, OBEX, PBAP, AVRCP, A2DP, HSP, HFP, PAN). Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Murali Piyush bug 711
bluez-setup Test setup of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Murali Piyush T1771
connman Runs some automated tests using the ConnMan D-Bus API. It guarantees most of the basic features are working. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [64] [65] [66] [67] [68] [69] [70]
connman-new-supplicant Test the wpa_supplicant interface. Integrated PASSED PASSED NOT TESTED PASSED PASSED PASSED PASSED Araujo [71] [72] [73] [74] [75] [76]
connman-pan-tethering Test ConnMan support for PAN connectivity. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Murali Piyush T1771
connman-services Tests ConnMan services. Not Integrated PASSED NOT TESTED N/A FAILED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771 T1847
connman-usb-tethering Test ConnMan support for USB tethering (connection side). Not Integrated PASSED NOT TESTED N/A FAILED N/A N/A N/A Boopathi Piyush Murali T1847 T1771
ofono-sms-receive Test receiving SMS messages with oFono. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth T1837 T1771
ofono-sms-send Test sending of SMS with oFono. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth T1837 T1771
Folks
folks-alias-persistence Ensures user-set contact aliases persist. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [77] [78] [79] [80] [81] [82] [83]
folks-eds-compatibility Checks that contacts created within Evolution Data Server (as will happen when phone contacts get synchronized to an Apertis machine) show up in other contact-based programs. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [84] [85] [86] [87] [88] [89] [90]
folks-metacontacts-linking Ensures linking meta-contacts works properly. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [91] [92] [93] [94] [95] [96] [97]
folks-metacontacts-unlinking Ensures unlinking meta-contacts works properly. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [98] [99] [100] [101] [102] [103] [104]
folks-telepathy-retrieve-contacts Ensures that Folks can correctly retrieve Telepathy contacts. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [105] [106] [107] [108] [109] [110] [111]
Telepathy
telepathy-gabble-unit Run telepathy-gabble test suite. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [112] [113] [114] [115] [116] [117] [118]
telepathy-rakia Test Telepathy rakia integration Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
SDK Development
sdk-ide-build-run-program Creates a simple test project and confirms that compiling and executing work. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED Vijeth
sdk-nested-wm Tests that Devilspie scripts can be applied to windows running within Mutter. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED| Vijeth
Apparmor Basic
apparmor-basic-profiles Test basic apparmor profiles. Only parsing and syntax of profiles are tested for now. Integrated NOT TESTED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [119] [120] [121] [122] [123] [124]
CGroups
cgroups-resource-control Run cgroup resource control tests Integrated PARTIAL PASSED PASSED PARTIAL PARTIAL PARTIAL PASSED Araujo [125] [126] [127] [128] [129] [130] [131]
SDK
sdk-performance-tools-gprof-smoke-test Checks basic gprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [132] [133]
sdk-performance-tools-sysprof-smoke-test Checks basic sysprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [134] [135]
sdk-debug-tools-gdb-smoke-test Checks basic gdb functionality by stopping a program at a set point and checking its backtrace matches expectations. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [136] [137]
sdk-debug-tools-strace-smoke-test Checks basic strace functionality by checking its output when run on a simple command line program. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [138] [139]
sdk-debug-tools-valgrind-smoke-test Checks basic valgrind functionality by running a program with and without memory leaks, ensuring expected results from valgrind. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [140] [141]
sdk-dbus-tools-bustle-smoke-test Test that bustle-dbus-monitor shows services on the session bus. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED Vijeth
sdk-dbus-tools-d-feet-smoke-test Test that D-Feet both shows services on the session bus and that new services appear automatically. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED| Vijeth
sdk-code-analysis-tools-gcov-smoke-test Checks basic gcov functionality by running a sample program a few different ways and ensuring that a sufficient portion of its code paths are executed Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [142] [143]
sdk-code-analysis-tools-splint-smoke-test Checks basic splint functionality by checking its output when run on a simple source file. Integrated N/A N/A N/A N/A N/A PASSED PASSED Araujo [144] [145]
sdk-vb-fullscreen Tests that the SDK VM can be fullscreened in VirtualBox Not Integrated N/A N/A N/A N/A N/A PASSED PASSED Vijeth
Eclipse
eclipse-sysroot-management Test sysroot management and update within Eclipse. It will go through configuring an existing sysroot in Eclipse, and then updating it from the web with the latest version. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED Vijeth
eclipse-install-to-target Test copying files to the remote device from within Eclipse. It will create a dummy project and then create a configuration to copy the binary file to a remote device and debug it remotely using Eclipse. Not Integrated N/A N/A N/A N/A N/A PASSED PASSED Vijeth
eclipse-remote-debugging Test remote debugging within Eclipse. It will create a dummy project and then create a configuration to copy the binary file to a remote device and debug it remotely using Eclipse. Not Integrated N/A N/A N/A N/A N/A FAILED FAILED Vijeth T1843
Contacts
evolution-sync-bluetooth Synchronizing Bluetooth-paired phone contacts to Evolution. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
folks-metacontacts-antilinking Ensures anti-linking meta-contacts works properly. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [146] [147] [148] [149] [150] [151] [152]
Clutter Multitouch
xoo-soft-keys-emulation Test that 'xoo' allows one to pass-in Xephyr-nested key events from clicking UI buttons Integrated N/A N/A N/A N/A N/A PARTIAL PARTIAL Araujo [153] [154]
clutter-performance Test performance of Clutter Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL NOT TESTED Araujo [155] [156] [157] [158] [159] [160]
x-out-of-screen-events-buttond Test that buttond generates correct keystrokes in response to simulated touch screen input Integrated FAILED FAILED FAILED FAILED FAILED FAILED FAILED Araujo [161] [162] [163] [164] [165] [166] [167]
mxkineticscrollview-smooth-pan Some low-resolution touch screens send touch events in widely separate time intervals, which causes MxKineticScrollView widget to jump from one position to the next one without any visible transition. This test case implements a long list to scroll through to make sure there are no visible "jumps" when scrolling. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PARTIAL PARTIAL Boopathi Vijeth bug 543 T1771
Connectivity
bluez-hfp Test Hands Free Profile (HFP) BlueZ feature. Not Integrated FAILED NOT TESTED N/A FAILED N/A N/A N/A Boopathi Piyush Murali bug 712 T1771
rfkill-toggle Test that rfkill is functional. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
telepathy-ring Support making and receiving phone calls in Telepathy manually, with a bluetooth-paired phone. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Piyush Murali bug 156 T1771
telepathy-ring-automated Support making and receiving phone calls in Telepathy. Integrated N/A N/A N/A N/A N/A PARTIAL PARTIAL Araujo [168] [169]
Contacts
folks-ofono-backend Reading contacts from 3G modem SIM card. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Piyush Murali T1837 T1771
folks-search-contacts Ensures that Folks can correctly search contacts. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [170] [171] [172] [173] [174] [175] [176]
abstract-contact-addressbook-creation A way to be able to create abstract addressbook is needed in SyncEvolution, so that separate addressbooks can be created for each paired device. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [177] [178] [179] [180] [181] [182] [183]
folks-sync-only Test SYNCHRONIZE_ONLY flag for persona stores in Folks. Integrated N/A N/A N/A N/A N/A PARTIAL PARTIAL Araujo [184] [185]
storage-arbitrary-data-contacts Support for storing arbitrary data in contacts in Folks. Integrated PASSED PASSED PASSED PASSED PASSED PARTIAL PASSED Araujo [186] [187] [188] [189] [190] [191] [192]
Multimedia
webkit-gstreamer1.0 Tests html5 video playback with GStreamer 1.0 in WebKit-Clutter Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Piyush Murali bug 742 T1771 T1832
clutter-buffering-2.0 Test clutter-gst stream buffering support against gstreamer 1.0. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
clutter-live-media-2.0 Test clutter-gst live media improvements support against gstreamer 1.0. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
traffic-control-basic Test basic traffic control support. This test does not use tcmmd but it could catch missing support in the kernel or misbehaving traffic control. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
traffic-control-tcmmd Test traffic control support with tcmmd and wget. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
traffic-control-tcdemo Test traffic control demo with tcmmd and tcdemo. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
gstreamer-buffering Test the download-buffering playback mode of clutter-gst-3.0. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Piyush Murali T1830 T1771
gstreamer-splash Test whether the gstreamer splash plugin is working. Not Integrated NOT TESTED N/A N/A N/A N/A N/A N/A Boopathi Camera cable corrupted
video-animation-on-boot Test whether Plymouth is able to display a graphical theme. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
gstreamer-viv-direct-texture Test the GStreamer integration of the Vivante direct texture extension, which enables fast video playback on i.MX6. Not Integrated PASSED N/A N/A N/A N/A N/A N/A Boopathi
Robustness
glib-gio-fs Run the GLib gio tests that do I/O on the local filesystem. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [193] [194] [195] [196] [197] [198] [199]
sqlite-veryquick Run the "veryquick" tests shipped with SQLite. Integrated NOT TESTED NOT TESTED PASSED PASSED PASSED PASSED NOT TESTED Araujo [200] [201] [202] [203]
Security
apparmor Functional testing for AppArmor functionalities. Integrated FAILED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [204] [205] [206] [207] [208] [209] [210] T1696
apparmor-chaiwala-system Test that AppArmor's system wide rules works according to Apertis security goals. Integrated NOT TESTED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [211] [212] [213] [214] [215] [216] T1696
apparmor-functional-demo Show some main AppArmor functionalities, like transitions, net access or resource permissions, under the form of tests. Integrated NOT TESTED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [217] [218] [219] [220] [221] [222] T1696
apparmor-utils Test apparmor_parser and other tools in apparmor package can be executed. Integrated NOT TESTED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [223] [224] [225] [226] [227] [228] T1696
apparmor-session-lockdown-denies Test that the MxLauncher profile is indeed limited to what is allows. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
apparmor-session-lockdown-launcher-whitelist Make sure our demo/test launcher is applying the white-list approach properly. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
apparmor-session-lockdown-no-deny Test that the session lockdown profile is not blocking more than it should Integrated FAILED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [229] [230] [231] [232] [233] [234] [235] T1859
apparmor-gstreamer1.0 Test that AppArmor profiles provided in GStreamer 1.0 works without Auditd complaining Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [236] [237] [238] [239] [240] [241] T1696 T1860
apparmor-pulseaudio Test that AppArmor profiles provided in PulseAudio 2.1 work without Auditd complaining. Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [242] [243] [244] [245] [246] [247] T1696
apparmor-webkit-clutter Tests that the webkit-clutter abstraction doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [248] [249] [250] [251] [252] [253] T1696
apparmor-bluez-automated Test AppArmor profile for support for SPP profile (bluez-spp) and core functionalities (bluez-core). Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
apparmor-bluez-avrcp-volume Test AppArmor profile for Bluez AVRCP volume up and down commands. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Piyush Boopathi Murali T1771
apparmor-bluez-setup Test AppArmor profiles for setting up of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices. Not Integrated PASSED NOT TESTED N/A PASSED N/A N/A N/A Boopathi Piyush Murali T1771
apparmor-folks Test that AppArmor profiles provided in Folks package work without unexpected auditd log entries. Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [254] [255] [256] [257] [258] [259] T1696
apparmor-geoclue Test that geoclue apparmor profiles are working properly Integrated PASSED PASSED PASSED PASSED PASSED PARTIAL PARTIAL Araujo [260] [261] [262] [263] [264] [265] [266]
apparmor-libreoffice Tests that the libreoffice profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [267] [268] [269] [270] [271] [272] T1696
apparmor-ofono Test that AppArmor profiles provided in ofono package work without unexpected auditd log entries. Not Integrated PASSED NOT TESTED N/A FAILED N/A N/A N/A Boopathi Piyush Murali T1771 T1848
apparmor-tracker Tests that the tracker abstraction and tracker profiles don't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Not Integrated FAILED NOT TESTED N/A FAILED N/A FAILED FAILED Boopathi Vijeth Piyush Murali T1532
apparmor-tumbler Tests that the tumbler profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated NOT TESTED PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [273] [274] [275] [276] [277] [278] T1696 T1861
iptables-basic Test the firewall automatically. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [279] [280] [281] [282] [283] [284] [285]
iptables-nmap Test the firewall using nmap from another computer. Not Integrated PASSED NOT TESTED N/A PASSED N/A PASSED PASSED Boopathi Vijeth Piyush Murali T1771
apparmor-dbus Functional testing for AppArmor D-Bus mediation. Integrated NOT TESTED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [286] [287] [288] [289] [290] [291] T1696
System Update
updater-update-platform Test that chaiwala-updater is capable of performing a full platform update. Not Integrated FAILED N/A N/A N/A N/A N/A N/A Boopathi bug 675 T1865
factory-reset-tool Check if the system can be restored to a factory reset state. Not Integrated FAILED N/A N/A N/A N/A N/A N/A Boopathi bug 386
last-resort-message Test whether U-Boot last resort image is displayed on boot failure Not Integrated PASSED N/A N/A N/A N/A N/A N/A Boopathi
limited-functionality-manual Test whether the limited functionality mode can be triggered. Not Integrated NOT TESTED N/A N/A N/A N/A N/A N/A Boopathi Camera cable corrupted
v4l-automated Test the v4l codepaths of chaiwala-v4l2fb. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [292] [293] [294] [295] [296] [297] [298]
boot-performance Test boot performance. Not Integrated FAILED NOT TESTED N/A N/A N/A N/A N/A Boopathi Murali bug 467 T1771
boot-performance-automated Test boot performance. Integrated PASSED PASSED PASSED PASSED PASSED PASSED PASSED Araujo [299] [300] [301] [302] [303] [304] [305]
Webkit
webkit-aligned-scroll Test that scrolling is pinned in a given direction when started mostly towards it. Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A N/A N/A Piyush Boopathi Murali T1771 T1832
webkit-lazy-click Test touch adjustment (lazy click) support in WebKit-Clutter Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Murali Boopathi Vijeth T1771 T1832
webkit-drag-and-drop Test HTML5 drag-and-drop support in WebKit-Clutter Not Integrated PARTIAL NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-contextual-zoom This test case is about zooming parts of a web page to make it easier to read on devices with limited screen area. The scope of the test is the zooming functionality that takes into account the content in the clicked area, other functionality that belongs to a real browser isn't to be tested here. Not Integrated NOT TESTED NOT TESTED N/A PARTIAL N/A PASSED PASSED Piyush Boopathi Murali Vijeth T1771 T1832
webkit-clutter-javascriptcore JavaScriptCore tests are implementation of the Mozilla JavaScript Test Suite. This test suite covers the functionality of the core JavaScript engine. This includes several JavaScript objects such as Arrays, Booleans, Dates, Functions, Global Object, Math, Numbers, Objects, Regular Expressions and Strings. In addition the JavaScript tests cover parsing, lexical conventions, expressions, statements, type conversion, and exception handling. Integrated PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL Araujo [306] [307] [308] [309] [310] [311] [312]
PASSED - All tests passed.
PARTIAL - Tests mostly passed, with some minor problems.
FAILED - One or more tests failed.
NOT TESTED - Test not run due to some issue, like WIP, Disabled, lacking proper hardware.
Personal tools
Namespaces

Variants
Actions
Navigation
Tools