Thursday, September 28, 2017

BPI Acceptance Test – Examples

BPI Acceptance Test – Examples

The following is an example of the results from an Independent Verification and Validation (IV&V) of a Human Resources Information System. External Consultant conducted IV&V (or Acceptance Test) for a Public Services Client.

Logistic Information Technology Centre,
Chief of Staff - Human Resources

INDEPENDENT VERIFICATION AND VALIDATION TEST REPORT FOR AN INTEGRATED HUMAN RESOURCES INFORMATION
MANAGEMENT SYSTEM
Revised Draft
November 17, 2012

HUMAN RESOURCES INFORMATION MANAGEMENT SYSTEM
TEST REPORT
TABLE OF CONTENTS


1.     Summary Report of System Anomalies   
   
2.     Testing on Phase I of IHRIMS   
   
2.1     Description of Testing and Results:   
   
2.2     Login screen   
   
2.3     Gains Management   
   
2.4     Civilian Employee Information Management   
   
2.5     Military Employee Information Management   
   
2.6     Training Budget   
   
2.7     Position Information Management   

Summary Report of System Anomalies

Date: November 16, 2012
           
Modules Tested: Login,Civilian and Military Employee Information Management, Position Information Management, Gain Management, Training Budget
Test Conducted: Screen manipulations   
Test Conducted By: XXXXXXX
Description of Testing and                 Results:
               
           
All forms listed under modules tested were put through general operation testing. Checked to see if the screen could be called up using the menu options available, and then verified that data could be entered and saved     on the forms. All function buttons available on the screen were checked to verify operations (this includes items such as the Locate, Cancel, Save, Exit, etc.). Also, tried entering some incorrect data to see if the system would accept the entries. In general, the information entered could not be saved to the tables. This impacted the level and degree of testing. As a result of problems saving data to the tables, the focus of the system discrepancies was on formatting and consistency between screens. Some forms could not be tested, since there function was dependent upon successfully entering data in another screen. For instance, the Gain and Loss Management screens were not successfully tested since there was difficulty entering information in the Position Information forms. The developers did make some modifications so that information could eventually be saved in the Position tables, however, information is still not being saved on Personnel.                
               
As is to be expected in initial testing, all of the modules tested failed to operate as fully expected. This information has been relayed to the developers and modifications are currently underway.       
Number of Tests Conducted:
           
Number of Deficiencies Detected: 46
           
Number of Pass:
Percentage of Pass:
Number of Failures:
Percentage of Fail: 100
Modules Passed    
Modules Failed: All
Comments: (Discussion of progress as a result of testing, Analysis of the Pass/Fail Results, Impact of tests and discrepancies on system implementation):     
               
See the attached pages for a detailed description of the discrepancies found on each form.

Testing on Phase I of IHRIMS

Description of Testing and Results:

Initial testing consisted of general operation of the system. Logging into the IHRIMS system and moving from form to form using the menu options. Attempted to add test data in each screen to determine if information was being accepted by each of the forms and to determine if the information should have been accepted by the particular screen. For example, tested to ensure that the system would not allow the user to input new employee information anywhere the Gain Management screen. The tests to add new information to the tables and save the data all failed. Since data could not be added to the tables during initial testing, the majority of the anomalies noted below are format oriented.

General Note:
On all screens the position of the field that the cursor is on is very difficult to read, can the field that the cursor is on be highlighted as a different colour to enhance the visibility? (This was done on the Gain Management Screen)

Login screen

Type of Discrepancy
Solution   
Spelling error   
Change “Integrated” to Integrated
Time required to load the Beta model is extensive
This is due to the current set-up of downloading information from the CSC office, this should be corrected in the future    

Gains Management

Type of Discrepancy
Error Messages
Solution
Security Field
Requires an entry
This field should allow Null values   
Fix the Text labels next to the input fields
** The format for labeling fields should be consistent across all screens. Either use the label and box on all screens or remove it from all.   
The title of the fields are displayed on background boxes - the boxes should be fixed to match the length of the text   
The fields are not in sequential order when tabbing through the screen
           
The cursor skips a fields after the effective date, and if the user tabs backwards the cursor stops after the effective date and will not allow the user to continue tabbing backwards.   
No military Grades are included in the pull down list       
** The method for inputting grades should be consistent across all screens. On some screens this is an input field and on some     screens it’s a pull down field.   
Add an option     “O-” and “E-” to the grade pull down menu.       
Allow the user to enter values     from E-1-E-9 and O-1 - O-9
The Series field is required
       
This field should allow Null values (Military personnel do not have a series).
Once the cursor is placed in the bottom half of the screen it isn’t possible to move back to the top half of the screen
       
   
   
After entering Position Information, tried to add an employee through Gain Management. Received an error message
ORACLE error Unable to insert record
       
After the error message displayed - the cursor was moved to the effective date field. Tried varying the values entered in this date with no success.   
PP, Series and grade
           
These fields need to be displayed consistently among all forms.

Civilian Employee Information Management

Type of Discrepancy
Error Messages
Solution   
Cannot change the value in the pull-down field for minority status
Error message received “Cannot navigate out of the current block in enter query mode   
       
On Exit Receive an additional message
Message appears on exiting the query when hitting the exit     button
Hide this message behind the scenes so the user does not have to respond to the additional question
Cannot Save information on this screen
“FRM40735; PRE-INSERT trigger raised unhandled exception ORA-02289”
Error message received since information required by the tables was not entered yet. Need to be able to store information to the tables.   
Date on Station field is too small   
       
Need to expand the width of the field to include a full 8 character date (12/12/2012)
Error trying to enter information in the Minority Status and Rotation Date fields   
Cannot Navigate out of current block in enter query mode FRM 41047
       
After receiving the above error message, cannot use the tab key to move around the screen but can use the mouse to get into some fields
   
   
There is no check on the way dates are entered into the system
       
Can all date fields be formatted to ensure consistency in entering data?   
On prior system demonstrations there was a check to ensure consistency between the command and the component this was not working.   
       
   

Military Employee Information Management


Type of Discrepancy
Error Messages
Solution   
Cannot add Military Grades
   
The Grade field should be a 4 character field with the Civilian Grades listed (0-15) and the Military Grades as “E-*” or “O-*” *Military grades run from E-1-E-9 and O-1-O-9
Cannot change the value in the pull-down field for minority status
Error message received “Cannot navigate out of the current block in enter query mode   
       
In the “Keys” display box - The colours and font are very difficult to read
   
Increase the font size or change the background colours on the display field
Date of Birth - Needs to be entered as month/day/yr
       
Pre-format the field to a date field   
Menu Option fields - Explain the difference between the Block and Field options


Define the difference between the options Count Hits and Fetch Next Set



Training Budget


Type of Discrepancy
Error Messages
Solution   
Tuition Field isn’t formatted
       
Format the field to allow the user to enter a dollar amount without having to enter the commas and decimal places
The Tuition field should be expanded to allow for dollar amounts up to 5 digits plus a 2 decimal places
       
       
Expand the field to a width of 9.   

Position Information Management


Type of Discrepancy
Error Messages
Solution   
Can’t add Position titles to the screen
PRE_INSERT trigger raised unhandled exception ORA-02289
(*11/15/2012 5pm Able to add this information)
Move the location of the Edit button at the top of the screen   
       
The Edit function should be grouped with the block Locate, Cancel Add...
Office Symbol - the text description for the field should be repositioned so the full text can be seen
   
       
Command List in the pull down menu is incomplete
       
Add the full list of command descriptions to this pull down field. (A full listing is shown on the Civilian Employee Info, form)   
MPCN   
Required field
This should allow Null values   
Security Clearance
Required field
This should allow Null values   
CPCN   
Required field
This should allow Null values   
Career, Financial, and Position Valid Radio buttons don’t match the format of the screen
       
       
Change the font to match the font displayed on the remainder of the screen.
Position Field looks like a data entry field
   
This is supposed to be a system generated number - it should be shown as a background display only field
Cannot save information on the screen
“FRM40735; Pre-Insert trigger raised unhanded exception ORA-02289”
       
Military grades can’t be entered in the grade field
WHEN-VALIDATE ITEM triggers failed on field POSITION.GRADE
Expand the acceptable grade categories to include military grades E-1-E-9 and O-1-O-9
The grade field is valid only for single digits
           
   
Expand the acceptable grades to include 1-15
Component and Command mismatch, the system allows the user to enter a command that does not match the component
   
Add the Error message sequence that is shown on the Civilian Employee Information screen to all screens that have both the Component and the Command.   
Position Information Management (con’t.)

Type of Discrepancy
Error Messages
Solution   
Acquisition Skill field allows only one valid entry,     “Contracting” for all other selections an error message appears
WHEN-VALID-ITEM triggers failed on field
           
There are two position description boxes shown at the bottom of the screen with true false buttons following -    
       
The order on the True/False radio buttons should be the same beside each box. It currently displays as True/False next to one and False/True next to the other.   
Problem saving information on this form
       
Receive a message that the record has already been inserted - but when searching for the information cannot retrieve the record.
       
The Position Information Management and the Position Management Forms are the same
       
These should be two different forms
The Series field is shown as a three digit number
       
           

           
       
If there are only three digits in a series it is to be displayed with a leading zero.   
When trying to locate information on the screen the user hits the Locate button, after entering data the user must select the locate button again
       
Is it possible to allow the user to hit “enter” after typing an entry to begin locating the record?
After entering data on the screen and selecting some “False”     options on the radio buttons - we exited the screen reentered and pulled up the record. All of the radio buttons had gone back to “True” and information selected in the Command field was blank
   
       

No comments :

Post a Comment