15.03/TestReports/20150313

From Apertis
Jump to: navigation, search

Testing results considerations:

  1. This test only included automated test cases that integrated into LAVA system were executed on images: Target ARM, Target AMD64, Development AMD64, Target x86, Development x86 and SDK x86.
  2. Test cases marked as 'under development' were skipped during this testing round.
  3. Failures and partial failures were noted in the Release notes document for further analyse.




ID Description Type Target ARM Devel ARM Target AMD64 Development AMD64 Target x86 Devel x86 SDK x86 Tested By Notes
Booting
gstreamer1.0-decode Test video and audio decoders and demuxers on a list of media. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
webkit-layout-tests Layout tests are used to check the correctness of the renderer. It involves loading pages in a test renderer (DumpRenderTree) and comparing the rendered output tree against an expected output file. Integrated NOT TESTED N/A N/A FAILED FAILED FAILED FAILED alee Doesn't run on arm: bug 130. Fails: bug 70
gettext-i18n Check that gettext internationalization works. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
gupnp-services Run a few tests related to service browsing, introspection, etc. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
librest-unit Run the unit tests that ship with the library against the running system. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
libsoup-unit Run the unit tests that ship with the library against the running system. Integrated PARTIAL N/A PASSED PASSED PARTIAL PARTIAL PARTIAL alee bug 71
tracker-configuration Check if tracker indexing is configured properly. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
tracker-indexing-local-storage Check tracker indexing of local storage and journal behaviour. Integrated PARTIAL N/A PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL alee bug 72
tumbler-thumbnailing Check that all thumbnailing features of tumbler are working properly (large, small, videos, documents, images). Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Grilo
grilo Check grilo metadata notifications, and filesystem browsing. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Networking
connman Runs some automated tests using the ConnMan D-Bus API. It guarantees most of the basic features are working. Integrated PARTIAL N/A PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL alee Wait for packaging: bbz:74
connman-new-supplicant Test the wpa_supplicant interface. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Folks
folks-alias-persistence Ensures user-set contact aliases persist. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
folks-eds-compatibility Checks that contacts created within Evolution Data Server (as will happen when phone contacts get synchronized to an Apertis machine) show up in other contact-based programs. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
folks-metacontacts-linking Ensures linking meta-contacts works properly. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
folks-metacontacts-unlinking Ensures unlinking meta-contacts works properly. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
folks-telepathy-retrieve-contacts Ensures that Folks can correctly retrieve Telepathy contacts. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
Telepathy
telepathy-gabble-unit Run telepathy-gabble test suite. Integrated NOT TESTED N/A PARTIAL N/A NOT TESTED NOT TESTED NOT TESTED alee Test does not run: bug 131. Fails: bug 75
Apparmor Basic
apparmor-basic-profiles Test basic apparmor profiles. Only parsing and syntax of profiles are tested for now. Integrated NOT TESTED N/A PASSED N/A PASSED PASSED PASSED alee
CGroups
cgroups-resource-control Run cgroup resource control tests Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
SDK
sdk-performance-tools-gprof-smoke-test Checks basic gprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-performance-tools-sysprof-smoke-test Checks basic sysprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-debug-tools-gdb-smoke-test Checks basic gdb functionality by stopping a program at a set point and checking its backtrace matches expectations. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-debug-tools-strace-smoke-test Checks basic strace functionality by checking its output when run on a simple command line program. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-debug-tools-valgrind-smoke-test Checks basic valgrind functionality by running a program with and without memory leaks, ensuring expected results from valgrind. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-code-analysis-tools-gcov-smoke-test Checks basic gcov functionality by running a sample program a few different ways and ensuring that a sufficient portion of its code paths are executed Integrated N/A N/A N/A N/A N/A N/A PASSED alee
sdk-code-analysis-tools-splint-smoke-test Checks basic splint functionality by checking its output when run on a simple source file. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
Contacts
folks-metacontacts-antilinking Ensures anti-linking meta-contacts works properly. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
Clutter Multitouch
xoo-soft-keys-emulation Test that 'xoo' allows one to pass-in Xephyr-nested key events from clicking UI buttons Integrated N/A N/A N/A N/A N/A N/A FAILED alee bug 154
clutter-performance Test performance of Clutter Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
x-out-of-screen-events-buttond Test that buttond generates correct keystrokes in response to simulated touch screen input Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Connectivity
telepathy-ring-automated Support making and receiving phone calls in Telepathy. Integrated N/A N/A N/A N/A N/A N/A FAILED alee bug 155 [1]
Contacts
folks-search-contacts Ensures that Folks can correctly search contacts. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
abstract-contact-addressbook-creation A way to be able to create abstract addressbook is needed in SyncEvolution, so that separate addressbooks can be created for each paired device. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
folks-sync-only Test SYNCHRONIZE_ONLY flag for persona stores in Folks. Integrated N/A N/A N/A N/A N/A N/A PASSED alee
storage-arbitrary-data-contacts Support for storing arbitrary data in contacts in Folks. Integrated PASSED N/A PASSED N/A PASSED PASSED PASSED alee
Meta Data Management
grilo-playlist-browsing Test playlist browsing from grilo, that is basically Grilo can inspect playlist contents and show its entries as if they were Grilo Media objects. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Robustness
glib-gio-fs Run the GLib gio tests that do I/O on the local filesystem. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
sqlite-veryquick Run the "veryquick" tests shipped with SQLite. Integrated PARTIAL N/A PARTIAL N/A PARTIAL PARTIAL PARTIAL alee Fails: bug 80
Security
apparmor Functional testing for AppArmor functionalities. Integrated NOT TESTED N/A NOT TESTED N/A PARTIAL PARTIAL PARTIAL alee Test does not run:bug 118. fails:bug 99 [2] [3] [4]
apparmor-chaiwala-system Test that AppArmor's system wide rules works according to Apertis security goals. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-functional-demo Show some main AppArmor functionalities, like transitions, net access or resource permissions, under the form of tests. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-utils Test apparmor_parser and other tools in apparmor package can be executed. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-gstreamer1.0 Test that AppArmor profiles provided in GStreamer 1.0 works without Auditd complaining Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-pulseaudio Test that AppArmor profiles provided in PulseAudio 2.1 work without Auditd complaining. Integrated PASSED N/A PASSED PASSED PASSED N/A N/A alee
apparmor-webkit-clutter Tests that the webkit-clutter abstraction doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated NOT TESTED N/A PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL alee bug 87
apparmor-folks Test that AppArmor profiles provided in Folks package work without unexpected auditd log entries. Integrated NOT TESTED N/A PASSED PASSED PARTIAL PARTIAL PARTIAL alee bug 88 [5] [6] [7]
apparmor-geoclue Test that geoclue apparmor profiles are working properly Integrated PARTIAL N/A PARTIAL PARTIAL PARTIAL PARTIAL PARTIAL alee bug 99 [8] [9] [10] [11] [12] [13]
apparmor-libreoffice Tests that the libreoffice profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-tracker Tests that the tracker abstraction and tracker profiles don't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated NOT TESTED N/A NOT TESTED N/A PASSED PASSED PASSED alee
apparmor-tumbler Tests that the tumbler profile doesn't cause false negatives and that it does not allow arbitrary reading of files in the home directory. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
iptables-basic Test the firewall automatically. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
apparmor-dbus Functional testing for AppArmor D-Bus mediation. Integrated NOT TESTED N/A PASSED PASSED PASSED PASSED PASSED alee
System Update
btrfs-snapshot-management Test subvolume management using Btrfs for system upgrades. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
v4l-automated Test the v4l codepaths of chaiwala-v4l2fb. Integrated N/A N/A PASSED PASSED PASSED PASSED N/A alee
boot-performance-automated Test boot performance. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
Webkit
webkit-clutter-javascriptcore JavaScriptCore tests are implementation of the Mozilla JavaScript Test Suite. This test suite covers the functionality of the core JavaScript engine. This includes several JavaScript objects such as Arrays, Booleans, Dates, Functions, Global Object, Math, Numbers, Objects, Regular Expressions and Strings. In addition the JavaScript tests cover parsing, lexical conventions, expressions, statements, type conversion, and exception handling. Integrated PASSED N/A PASSED PASSED PASSED PASSED PASSED alee
PASSED - All tests passed.
PARTIAL - Tests mostly passed, with some minor problems.
FAILED - One or more tests failed.
NOT TESTED - Test not run due to some issue, like WIP, Disabled, lacking proper hardware.
Personal tools
Namespaces

Variants
Actions
Navigation
Tools