oFono upstream test results_20120913

Hello all,

Please find the test report of oFono v1.10 commit 006a37c.

During this testing, we ran 462 functional positive cases. 348 cases passed and 114 are blocked due to missing software/missing hardware/Feature not supported. The pass rate is 75% (-1%) which is similar to previous test cycle (v1.10 commit 2d2075c).

We found, reopened and verified no issue.

If you have any comment about this report, contact me please.

Test Objective

The aim of this test cycle was to validate the state of oFono upstream by testing all its features over all material we had (according to what feature was supported and by priority order: 3G dongle and phonesim). oFono has been installed and tested on Ubuntu 12.04 device.

Test Environment

oFono: v1.10 (updated to commit 006a37c)

usb_modeswitch: v1.2.3

modeswitch data: 20120120

Hardware: Laptop

Ubuntu: v12.04

Modem: Huawei E173u-2 - Operator & SIM Card: Orange SIM Card (data only) - Phone number +33677646185 and other specific SIM Cards

Phonesim: v1.19 (updated to commit d7f1f1a)

Issue Summary

New bug:

None

Known bug:

None

Closed bug:

None

Test Result

SUMMARY

Total Test Case 462

Passed 348

Failed 0

Blocked 114

TCs completed 100,0%

Run rate 75% (-1%)

Pass rate total 75% (-1%)

Blocked rate total 25% (+1%)

Pass rate of executed 100%

FEATURES TOTAL PASS FAIL BLOCKED
PASS % MODEM USED

Modem 16 16 0 0
100% 3G Dongle

SIM 20 20 0 0
100% 3G Dongle

Phonebook 1 1 0 0
100% 3G Dongle

Network 18 18 0 0
100% 3G Dongle

Radio 22 17 0 5
77% 3G Dongle

Connectivity 28 28 0 0
100% 3G Dongle

Voice Calls 50 40 0 10
80% mainly on 3G Dongle (using appropriate SIM Card)

Messaging 24 22 0 2
92% 3G Dongle (using appropriate SIM Card)

Smart Messaging 15 15 0 0
100% Phonesim

Message Waiting 8 8 0 0
100% Phonesim

Cell Broadcast 15 13 0 2
87% Phonesim

Call Settings 13 9 0 4
69% 3G Dongle

Supplementary Services 59 55 0 4
93% mainly on Phonesim

Call Meter 15 5 0 10
33% mainly on Phonesim

Call Barring 49 33 0 16
67% 3G Dongle (using appropriate SIM Cards)

Call Forwarding 5 5 0 0
100% Phonesim

SimToolKit 104 43 0 61
41% Phonesim

Please find details in the attached file.

Notes

25% of cases are blocked due to:

Missing software (e.g.: Missing feature in Phonesim or missing a visual application for some blocked feature as Setup Idle ModeText, Select Item, Send SMS, etc.)

Missing hardware (e.g.: Missing other SIM (having appropriate service activated) or modem to be able to test certain feature or case (e.g.:
network simulator or smartphone device to test PIN/PIN2 cases, Call Barring etc.).

Feature not supported by oFono.

Best regards,

Nicolas