Skip to content

Software Testing Process

Jump to bottom
William Emfinger edited this page Jul 24, 2018 · 4 revisions

This document describes the software testing process for the Smart Evaluation App.

Requirements

You will need to install github-automation:

cd ~
git clone https://github.com/max-mobility/github-automation
cd github-automation
sudo npm install -g

Usage

There are two operations when testing:

  1. Performing a single test
  2. Generating the Software V&V Document from the Tests that have been run.

Performing a test and saving it

cd ~/evalapp/maxmobility
perform_test
# this will walk you through the process of testing
# when this is done a new test report will be saved (as JSON) in ./reports
# you will need to add and commit this file
git add reports
git commit -m '${Your Commit message here}'
git push

Turning the saved test data into a report document

# turns the data saved in ./reports into a valid report file
gen_report_doc

Example Test Report

Field Description
Requirement IDs
  • SEA-SRS-1-A: Pairing to the PushTracker
  • SEA-SRS-2-A: Connectivity to the PushTracker
  • SEA-SRS-3-A: Data Transmission with the PushTracker
  • SEA-SRS-4-A: Connectivity to the SmartDrive
  • SEA-SRS-5-A: Data Transmission with the SmartDrive
Revision A
Description App should support bluetooth communications with both PushTracker and SmartDrive.
Test Level System
Method Test 1 The app should be running and opened to the OTA page.
  • Press the 'Refresh Device List' button.
  • Press the 'Begin Updates' button.
  • Press the 'Force' button.
  • Press the 'Cancel' button.
Test 2 The app should be running and opened to the OTA page. A PushTracker running version 1.5 should be present and turned on.
  • On the PushTracker, begin pairing with the App.
  • Tell the PushTracker to connec to the app - then press the 'Refresh Device List' button on the app.
  • Press the 'Begin Updates' button.
  • Press the 'Start' button (and then the 'Force' button if it shows).
  • Press the 'Cancel' button.
Acceptance Criteria Test 1
  • After the 'Searching for Devices' dialog, the SmartDrive should show up as an item in the list.
  • The app should show 'Awaiting versions' as the OTA status - within 1 minute the app should show the versions of the SmartDrive BLE and MCU.
  • The SmartDrive should reboot and OTA should begin.
  • The SmartDrive should reboot and OTA should stop.
Test 2
  • The PushTracker should show pairing success - optionally after the user agrees to the pairing prompt on the phone.
  • The PushTracker should show up in the OTA device list.
  • The 'Start' button should display underneath the PushTracker.
  • The app should display 'Updating' underneath the PushTracker and the PushTracker should show the OTA status.
  • The PushTracker should reboot.
Start / End Dates 2018-07-23 2018-07-23
Tester Name William Emfinger
Output Sample quantity and test result Pass/Fail
#1 #2 #3 #4 #5 #6 #7
Test 1 PASS PASS PASS SKIP SKIP SKIP SKIP PASS
Test 2 PASS PASS PASS SKIP SKIP SKIP SKIP PASS
Results PASS
Notes

Clone this wiki locally