oFono upstream test results_20130603
Hello all,
Please find the test report of oFono v1.12 commit 53a0fa8.
During this testing, we ran 197 functional positive cases. 144 cases passed, 1 failed and 52 are blocked due to missing software/missing hardware/Feature not supported. No new issue has been found.
If you have any comment about this report, contact me please.
Test Objective
As there was only few changes (3) since the previous tests cycle, the aim of this session was to validate the state of oFono upstream by testing only major tests of most important features and all tests of features impacted by last commits (GSM shortcut of Supplementary Services and STK) over all material we had (according to what feature was supported and by priority
order: PR3, Network Simulator, 3G dongle, phonesim). oFono has been installed and tested on PR3 running Tizen 2.1 and Ubuntu 12.04 device.
Test Environment
For all Setup:
oFono: v1.12 (updated to commit 53a0fa8)
- Smartphone device Setup:
Image: Tizen Mobile 2.1
Operator & SIM Card: several french and UK SIM Cards according to features
- Laptop + 3G Dongle/Phonesim:
usb_modeswitch: v1.2.3
modeswitch data: 20120120
Hardware: Laptop
Ubuntu: v12.04
Modem: Huawei E173u-2 - Operator & SIM Card: several french and UK SIM Cards according to features
Phonesim: v1.19 (updated to commit c94e6c0)
- Laptop + HFP
HFP Server:
Hardware: Laptop
Ubuntu: v12.04
Bluez 4.101 (updated to commit 67ef3ac)
oFono has been installed with "--enable-bluez4" option instead of using default bluez5 plugin (unable to make HFP using this one)
HFP Client: Android JB device
Issue Summary
New bug: 0
None
Known bug: 1
Bug 25982 <https://bugs.meego.com/show_bug.cgi?id=25982> - Going back from a select item list releases the session
Closed bug: 0
None
Test Result
SUMMARY
Total Test Case 197
Passed 144
Failed 1
Blocked 52
TCs completed 100,0%
Run rate 74%
Pass rate total 73%
Blocked rate total 26%
Pass rate of executed 100%
FEATURES Total Pass Fail Blocked
Pass % Modem Used
Modem 5 5 0 0
100% Tested on smartphone using a real SIM Card and on Laptop
using 3G Dongle or using HFP
SIM 4 4 0 0
100% Tested on smartphone using a real SIM Card and on Laptop
using 3G Dongle
Network 2 2 0 0
100% Tested on smartphone using a real SIM
Connectivity 8 8 0 0
100% Tested on smartphone using a real SIM
Voice Calls 12 12 0 0
100% Tested on smartphone with appropriate SIM Card or using
Network Simulator
Messaging 2 2 0 0
100% Tested on smartphone using a real SIM
Message Waiting 1 1 0 0
100% Tested on Laptop using Phonesim
Supplementary Services 59 56 0 3 95%
Tested on smartphone with appropriate SIM Card
SimToolKit 104 54 1 49
52% Tested on Laptop using Phonesim
Please find details in the attached file.
Notes
Please note that I have found a crash of oFono when running two STK TCs in a row:
Bug <https://bugs.meego.com/show_bug.cgi?id=25998> 25998 - oFono crashes when doing a NAA Initialization+File Change Notification after having done a NAA Initialization+Full File Change Notification with Phonesim.
26% of cases are blocked due to:
- Missing software (e.g.: Missing feature in Phonesim or missing a
visual application for some blocked feature as Setup Idle ModeText, Select Item, Send SMS, etc.)
- Missing hardware (e.g.: Missing other SIM (having appropriate service
activated).
- Feature not supported by oFono
Best regards,
Nicolas