The National Academies Press

Currently Skimming:

Pages 119-146

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.

From page 119... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-1 Appendix C: Portal Test Procedures This Appendix contains the test procedures used in the alpha testing of the Portal. The Appendix contains 15 different test cases, or sets of tests, to test the complete set of functional requirements for the system. Read the entire page →
From page 120... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-2 New ID Requirement Title Group Test Case(s) 1.3.2.2 Publish Status Change Content 3.1 1.3.2.3 Manage Content Approval Content 3.2 1.3.3 Manage Content Registration Content 3.1 1.3.3.1 Manage Registration Process Content 3.1 1.3.3.2 Validate and Store Content Content 3.1 1.3.3.3 Manage Content Upload Content 3.1 1.3.3.4 Manage Content Agreement Content 3.1 1.3.3.4.1 View Terms and Conditions Content 3.1 1.3.3.4.2 Print Terms and Conditions Content 3.1 1.3.3.4.3 Reject Terms and Conditions Content 3.1 1.3.3.5 Submit Content for Review Content 3.1 1.3.3.6 Manage Incomplete Content Submission Content 3.1 1.3.3.7 Manage Revised Content Content 3.1 1.3.4 Administer Content Review Content 3.2 1.3.4.1 Manage Pending Content Content 3.2 1.3.4.2 Manage Content Review Assignment Content 3.1 1.3.4.3 Review Content by Selection Criteria Content 3.2 1.3.4.4 Manage Content Committee Review Content 3.2 1.3.4.4.1 Edit Review Agenda Content 3.2 1.3.4.5 Provisional Acceptance Alert Content 3.2 1.3.5 Manage Content Quality Review Content 3.3 1.3.5.1 Reviewer Summary Page Content 3.3 1.3.5.2 View Assigned Content Content 3.3 1.3.5.3 Manage Review Scoring Content 3.3 1.3.5.4 Manage Incomplete Scoring Content 3.3 1.4 Manage Discovery Discovery 4.1, 4.2, 4.3, 4.4, 4.5 1.4.1 Manage Content Availability Discovery 4.1 1.4.2 Manage Free Text Search Discovery 4.1 1.4.3 Manage Keyword Search Discovery 4.2 1.4.4 Manage Most Viewed Search Discovery 4.3 1.4.5 Manage New Content Search Discovery 4.4 1.4.6 Manage Content Catalog Search Discovery 4.5 1.4.6.1 Sort Catalog Content Discovery 4.5 1.4.7 View Multimedia Formats Discovery 4.5 1.4.8 Print Multimedia Formats Discovery 4.5 1.5 Administer the System Administration 5.1 1.5.1 Create Lists Administration 5.1 Read the entire page →
From page 121... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-3 New ID Requirement Title Group Test Case(s) 1.5.1.1 Create Topic Type List Administration 5.1 1.5.1.2 Create Keyword Lists Administration 5.1 1.5.1.3 Create Content List Administration 5.1 1.5.1.4 Create a Reviewer List Administration 5.1 1.5.1.5 Create a Review Scoring List Administration 5.1 1.5.1.6 Create Supplementary Resources List Administration 5.1 1.5.1.7 Create Association between Lists Administration 5.1 1.5.1.8 Create a Lookup List Administration 5.1 1.5.2 Update List Format Administration 5.1 Test cases, and the associated test procedures, are divided by the overall portal function (e.g. Read the entire page →
From page 122... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-4 website) Test Case 1.2: Verify Role Assignment Capabilities Requirements Tested: • 1.1: Manage Access • 1.1.2: Manage Roles • 1.1.2.1: Assign User Roles • 1.1.2.2: Assign User to Multiple Roles • 1.1.3: Automate Role Grant Table C-3. Read the entire page →
From page 123... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-5 Step Type Procedure Requirement(s) Met P/F/NA Comments • Review Committee Member 6 Demonstration Verify the ability to assign two of the five user accounts specified in Step 2 as follows: • Content Administrator and Review Committee Member • System Administrator , Content Administrator , and Review Committee Member 1.1.2, 1.1.2.1, 1.1.2.2 7 Demonstration Verify the ability to modify a user's role by removing the designation of "Content Administrator" from the user account having this role specified in Step 6 1.1.2 Test Case 1.3: Verify Role Privilege Management Requirements Tested: • 1.1: Manage Access • 1.1.2.3: Manage Role Privileges • 1.1.2.3.1: Manage System Administrator Privileges • 1.1.2.3.2: Manage Content Administrator Privileges • 1.1.2.3.3: Manage Review Committee Member Privileges • 1.1.2.3.4: Manage Content Contributor Privileges • 1.1.2.3.5: Manage Content Reader Privileges Read the entire page →
From page 124... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-6 Table C-4. Test Case 1.3 Step Type Procedure Requirement(s) Read the entire page →
From page 125... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-7 Step Type Procedure Requirement(s) Met P/F/NA Comments 6. Read the entire page →
From page 126... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-8 • 1.1: Manage Access • 1.1.4: Manage Content Access • 1.1.5: Manage User Access • 1.1.5.1: Manage Reviewer List • 1.1.5.2: Manage Committee Member List Table C-5. Test Case 1.4 Step Type Procedure Requirement(s) Read the entire page →
From page 127... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-9 Step Type Procedure Requirement(s) Met P/F/NA Comments status 7 Demonstration Verify the ability of a Content Administrator to view all content items, including those that are unpublished 1.1.4 8 Demonstration Verify the ability of a Content Administrator to grant privileges to a specific reviewer to review one item; reviewer has only the roles of Content Contributor and Content Reader 1.1.5.1 9 Configuration Login to the portal as the user granted review privileges specified in Step 8. Read the entire page →
From page 128... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-10 Step Type Procedure Requirement(s) Met P/F/NA Comments Member assigned to the role in Step 5 12 Demonstration Verify that a Review Committee Member can view all portal content, whether it is published or unpublished 1.1.4 Manage Storage Tests This set of test cases test verifies that the requirements under requirement 1.2 of the System Requirements, "Manage Storage," are met. Read the entire page →
From page 129... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-11 Step Type Procedure Requirement(s) Met P/F/NA Comments error in one field, but completing all required fields. Read the entire page →
From page 130... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-12 Step Type Procedure Requirement(s) Met P/F/NA Comments portal as a Content Administrator 2 Configuration Upload two content items to the portal and set the status of one content item to be published 3 Demonstration Verify that the unpublished content item loaded in Step 2 does not appear in the content catalog and is listed in the content list as provisional content 1.2.3, 1.2.4 4 Demonstration Verify that the published content item loaded in Step 2 does appear in the content catalog 1.2.4 5 Demonstration Verify the ability of a Content Administrator to view both content items loaded to the portal in Step 2 1.2.3, 1.2.3.1, 1.2.4 6 Configuration Login to the portal as a Content Reader 7 Demonstration Verify that the Content Reader is able to view the published content item and unable to view the unpublished content item 1.2.3.1 Read the entire page →
From page 131... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-13 Manage Content Tests This set of test cases verifies that the requirements under requirement 1.3 of the System Requirements, "Manage Content," are met. Test Case 3.1: Verify Content Registration Process Requirements Met: • 1.3: Manage Content • 1.3.1: Manage Content Status • 1.3.1.1: Designate Status • 1.3.2: Manage Status Change • 1.3.2.1: Document Status Changes • 1.3.2.2.: Publish Status Changes • 1.3.3: Manage Content Registration Process • 1.3.3.1: Manage Registration Process • 1.3.3.2: Validate and Store Content • 1.3.3.3: Manage Content Upload • 1.3.3.4: Manage Content Agreement • 1.3.3.4.1: View Terms and Conditions • 1.3.3.4.2: Print Terms and Conditions • 1.3.3.5: Submit Content for Review • 1.3.3.6: Manage Incomplete Content Submission • 1.3.3.7: Manage Revised Content Table C-8. Read the entire page →
From page 132... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-14 Step Type Procedure Requirement(s) Met P/F/NA Comments mandatory fields. Read the entire page →
From page 133... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-15 Step Type Procedure Requirement(s) Met P/F/NA Comments verify that it is accepted 10 Demonstration Verify that the user can view the terms and conditions of the portal 1.3.3.4.1 11 Demonstration Verify that the user can print the terms and conditions of the portal 1.3.3.4.2 12 Demonstration Verify that the user can accept the terms and conditions of the portal, completing the review process 1.3.3.4, 1.3.3.5 13 Demonstration Verify that the content submitted is automatically granted a status of "Post Complete " 1.3.1, 1.3.1.1 14 Demonstration Verify that Content Administrator and Review Committee Members receive an alert that the status of the content has been changed in Step 13 1.3.2 15 Demonstration Verify that the status change of the content changed in Step 13 is documented 1.3.2.1 16 Demonstration Verify that the status of the content changed in Step 13 is published to the 1.3.2.2 Read the entire page →
From page 134... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-16 Step Type Procedure Requirement(s) Met P/F/NA Comments personalized web page of Content Administrator and Review Committee Members 17 Configuration Perform Steps 1, 2, 7, and 8 again 18 Demonstration Verify that the user can reject the terms and conditions of the portal and that the content registration process is terminated 1.3.3.4.3 19 Configuration Set the status of the content submitted in Step 16 to "Revision Requested" 20 Demonstration Verify the ability of the user to make changes to the content using a streamlined process and to resubmit content 1.3.3.7 Test Case 3.2: Verify Content Review Administration Requirements Tested: • 1.3: Manage Content • 1.3.2.3: Manage Content Approval • 1.3.4: Administer Content Review • 1.3.4.1: Manage Pending Content • 1.3.4.2: Manage Content Review Assignment • 1.3.4.3: Review Content by Selection Criteria • 1.3.4.4: Manage Content Committee Review • 1.3.4.5: Provisional Acceptance Alert • 1.3.4.4.1: Edit Review Agenda Read the entire page →
From page 135... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-17 Table C-9. Test Case 3.2 Step Type Procedure Requirement(s) Read the entire page →
From page 136... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-18 Step Type Procedure Requirement(s) Met P/F/NA Comments organized by status 8 Demonstration Verify the ability of the Content Administrator to edit, save, and submit a Review Committee Meeting agenda 1.3.4.4.1 9 Demonstration Verify the ability of a Content Administrator to change the status of any content item in the portal to "accepted," "provisionally accepted," or "rejected" 1.3.2.3 10 Configuration Login to the portal as a Review Committee Member 11 Demonstration Verify the ability of the Review Committee Member to view a summary page of the review process 1.3.4 12 Demonstration Verify the ability of the Review Committee Member to view a list of pending content 1.3.4.1 13 Demonstration Verify the ability of the Review Committee Member to review a list of content that has been assigned for review 1.3.4.2 14 Demonstration Verify the ability 1.3.4.3 Read the entire page →
From page 137... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-19 Step Type Procedure Requirement(s) Met P/F/NA Comments of the Review Committee Member to view the entire content list, organized by selection criteria 15 Demonstration Verify the ability of the Review Committee Member to view a list of content to be discussed at the next meeting of the review committee, organized by status 1.3.4.4 16 Demonstration Verify the ability of the Review Committee Member to view the agenda of the next Review Committee Meeting 1.3.4.4.1 17 Configuration Provisionally accept content with specific changes that the content contributor must make 18 Configuration Login to the Portal as the Content Contributor whose content was provisionally accepted in step 17 19 Demonstration Verify that an alert is received stating required revisions for content to be published Read the entire page →
From page 138... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-20 Test Case 3.3: Verify Quality Review Processes Requirements Tested: • 1.3: Manage Content • 1.3.1.1: Designate Status • 1.3.5: Manage Content Quality Review • 1.3.5.1: Reviewer Summary Page • 1.3.5.2: View Assigned Content • 1.3.5.3: Manage Review Scoring • 1.3.5.4: Manage Incomplete Scoring Table C-10. Test Case 3.3 Step Type Procedure Requirement(s) Read the entire page →
From page 139... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-21 Step Type Procedure Requirement(s) Met P/F/NA Comments assigned, open the Review Scoring form and partially complete the form 6 Demonstration Verify the ability of the Reviewer to save, exit, and reenter the Review Scoring form prior to completion 1.3.5.4 7 Demonstration Complete and submit the Review Scoring form, verifying that the status of the item is changed to review complete 1.3.1.1 Manage Discovery Tests This set of test cases verifies that the requirements of under requirement 1.4 of the System Requirements, "Manage Discovery," are met. Read the entire page →
From page 140... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-22 Step Type Procedure Requirement(s) Met P/F/NA Comments 2 Configuration Populate the portal with at least two content items set to a status of "unpublished" and record at least two distinct search terms for each content item 3 Configuration Login to the portal as a user with content reader/Content Contributor credentials only 4 Demonstration For each published content item loaded in step 1, use each search term identified to search for each content item and verify that each item can be located in the portal 1.4.2 5 Demonstration For each unpublished content item loaded in step 2, use each search terms identified to search for each content item and verify that these content items cannot be located 1.4.1 Test Case 4.2: Verify Keyword Search Requirements Tested: • 1.4: Manage Discovery Read the entire page →
From page 141... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-23 • 1.4.1: Manage Content Availability • 1.4.3: Manage Keyword Search Table C-12. Test Case 4.2 Step Type Procedure Requirement(s) Read the entire page →
From page 142... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-24 Step Type Procedure Requirement(s) Met P/F/NA Comments navigation functionality and verify that these content items cannot be located Test Case 4.3: Verify Most Viewed Search Requirements Tested: • 1.4: Manage Discovery • 1.4.4: Manage Most Viewed Search Table C-13. Read the entire page →
From page 143... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-25 • 1.4.5: Manage New Content Search Table C-14. Test Case 4.4 Step Type Procedure Requirement(s) Read the entire page →
From page 144... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-26 in the portal, and verify that each item loaded into the portal is listed in the catalog 3 Demonstration Sort the content catalog by each column in the catalog 1.4.6.1 4 Demonstration Verify the ability to open and view each content item listed in the content catalog 1.4.7 5 Demonstration Verify the ability to print each content item which is not an audio or video file 1.4.8 Administer the System This set of test cases verifies that the requirements under requirement 1.5 of the System Requirements, "Administer the System," are met. Test Case 5.1: Verify Administration Requirements Tested: • 1.5: Administer the System • 1.5.1: Create Lists • 1.5.1.1: Create Topic Type List • 1.5.1.2: Create Keyword Lists • 1.5.1.3: Create Content List • 1.5.1.4: Create a Reviewer List • 1.5.1.5: Create a Review Scoring List • 1.5.1.6: Create Supplementary Resources List • 1.5.1.7: Create Association Between Lists • 1.5.1.8: Create a Lookup List • 1.5.2: Update List Format Table C-16. Read the entire page →
From page 145... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-27 Step Type Procedure Requirement(s) Met P/F/NA Comments List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1.1, 1.5.2 3 Demonstration Create a Keyword List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.2, 1.5.2 4 Demonstration Create a Content List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.3, 1.5.2 5 Demonstration Create a Reviewer List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.4, 1.5.2 6 Demonstration Create a Review Scoring List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.5, 1.5.2 7 Demonstration Create a Supplementary Resources List as specified in the 5.2.2.1.5.1, 5.2.2.1.5.1.6, 5.2.2.1.5.2 Read the entire page →
From page 146... ... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-28 Step Type Procedure Requirement(s) Met P/F/NA Comments System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 8 Demonstration Create a set of Association lists as specified in the System Requirements, and verify the ability to edit these lists, add a new field, and delete the new field 5.2.2.1.5.1, 5.2.2.1.5.1.7, 5.2.2.1.5.2 9 Demonstration Create a Lookup List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.4, 1.5.2 Read the entire page →

From page 119...

... May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-1 Appendix C: Portal Test Procedures This Appendix contains the test procedures used in the alpha testing of the Portal. The Appendix contains 15 different test cases, or sets of tests, to test the complete set of functional requirements for the system.