Developing an ITS Technology Web Portal for Transit System Leaders (2016)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-1 Appendix C: Portal Test Procedures This Appendix contains the test procedures used in the alpha testing of the Portal. The Appendix contains 15 different test cases, or sets of tests, to test the complete set of functional requirements for the system. Table C-1 below shows which test cases are used to test each requirement. Table C-1. Test Case Summary New ID Requirement Title Group Test Case(s) 1.1 Manage Access Access 1.1, 1.2, 1.3, 1.4 1.1.1 Manage Portal Login Access 1.1 1.1.2 Manage Roles Access 1.2 1.1.2.1 Assign User Role Access 1.2 1.1.2.2 Assign User to Multiple Roles Access 1.2 1.1.2.3 Manage Role Privileges Access 1.3 1.1.2.3.1 Manage System Administrator Privileges Access 1.3 1.1.2.3.2 Manage Content Administrator Privileges Access 1.3 1.1.2.3.3 Manage Review Committee Member Privileges Access 1.3 1.1.2.3.4 Manage Content Contributor Privileges Access 1.3 1.1.2.3.5 Manage Content Reader Privileges Access 1.3 1.1.3 Automate Role Grant Access 1.2 1.1.4 Manage Content Access Access 1.4 1.1.5 Manage User Access Access 1.4 1.1.5.1 Manage Reviewer List Access 1.4 1.1.5.2 Manage Committee Member List Access 1.4 1.2 Manage Storage Storage 2.1, 2.2 1.2.1 Populate List Storage 2.1 1.2.2 Validate List Entry Storage 2.1 1.2.3 Manage Provisional Content Storage 2.1, 2.2 1.2.3.1 Restrict Access to Provisional Content Storage 2.2 1.2.4 Manage Content Catalog Storage 2.2 1.3 Manage Content Content 3.1, 3.2 1.3.1 Manage Content Status Content 3.1 1.3.1.1 Designate Status Content 3.1 1.3.2 Manage Status Change Content 3.1 1.3.2.1 Document Status Change Content 3.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-2 New ID Requirement Title Group Test Case(s) 1.3.2.2 Publish Status Change Content 3.1 1.3.2.3 Manage Content Approval Content 3.2 1.3.3 Manage Content Registration Content 3.1 1.3.3.1 Manage Registration Process Content 3.1 1.3.3.2 Validate and Store Content Content 3.1 1.3.3.3 Manage Content Upload Content 3.1 1.3.3.4 Manage Content Agreement Content 3.1 1.3.3.4.1 View Terms and Conditions Content 3.1 1.3.3.4.2 Print Terms and Conditions Content 3.1 1.3.3.4.3 Reject Terms and Conditions Content 3.1 1.3.3.5 Submit Content for Review Content 3.1 1.3.3.6 Manage Incomplete Content Submission Content 3.1 1.3.3.7 Manage Revised Content Content 3.1 1.3.4 Administer Content Review Content 3.2 1.3.4.1 Manage Pending Content Content 3.2 1.3.4.2 Manage Content Review Assignment Content 3.1 1.3.4.3 Review Content by Selection Criteria Content 3.2 1.3.4.4 Manage Content Committee Review Content 3.2 1.3.4.4.1 Edit Review Agenda Content 3.2 1.3.4.5 Provisional Acceptance Alert Content 3.2 1.3.5 Manage Content Quality Review Content 3.3 1.3.5.1 Reviewer Summary Page Content 3.3 1.3.5.2 View Assigned Content Content 3.3 1.3.5.3 Manage Review Scoring Content 3.3 1.3.5.4 Manage Incomplete Scoring Content 3.3 1.4 Manage Discovery Discovery 4.1, 4.2, 4.3, 4.4, 4.5 1.4.1 Manage Content Availability Discovery 4.1 1.4.2 Manage Free Text Search Discovery 4.1 1.4.3 Manage Keyword Search Discovery 4.2 1.4.4 Manage Most Viewed Search Discovery 4.3 1.4.5 Manage New Content Search Discovery 4.4 1.4.6 Manage Content Catalog Search Discovery 4.5 1.4.6.1 Sort Catalog Content Discovery 4.5 1.4.7 View Multimedia Formats Discovery 4.5 1.4.8 Print Multimedia Formats Discovery 4.5 1.5 Administer the System Administration 5.1 1.5.1 Create Lists Administration 5.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-3 New ID Requirement Title Group Test Case(s) 1.5.1.1 Create Topic Type List Administration 5.1 1.5.1.2 Create Keyword Lists Administration 5.1 1.5.1.3 Create Content List Administration 5.1 1.5.1.4 Create a Reviewer List Administration 5.1 1.5.1.5 Create a Review Scoring List Administration 5.1 1.5.1.6 Create Supplementary Resources List Administration 5.1 1.5.1.7 Create Association between Lists Administration 5.1 1.5.1.8 Create a Lookup List Administration 5.1 1.5.2 Update List Format Administration 5.1 Test cases, and the associated test procedures, are divided by the overall portal function (e.g. Manage Access, Manage Storage, Manage Content, Manage Discovery, Administer the System) Manage Access Testing This set of test cases verifies that the requirements under Requirement 1.1 of the System Requirements, “Manage Access,” are met. Test Case 1.1: Verify Portal Login Requirements Tested: • 1.1: Manage Access • 1.1.1: Manage Portal Login Table C-2. Test Case 1.1 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Locate the portal within the APTA website, or emulate this capability 2 Demonstration Verify the ability to access the Portal after first logging into the APTA website (or emulated APTA website) 1.1.1 3 Demonstration Verify that the portal cannot be accessed without first logging in to the APTA website (or emulated APTA 1.1.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-4 website) Test Case 1.2: Verify Role Assignment Capabilities Requirements Tested: • 1.1: Manage Access • 1.1.2: Manage Roles • 1.1.2.1: Assign User Roles • 1.1.2.2: Assign User to Multiple Roles • 1.1.3: Automate Role Grant Table C-3. Test Case 1.2 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Ensure that one user exists with System Administrator Capabilities 2 Configuration Create five user accounts that have access to the portal 3 Configuration Login to the portal with the Role of System Administrator 4 Demonstration Verify that all user accounts with access to the portal are automatically assigned the roles of Content Contributor and Content Reader 1.1.3 5 Demonstration Verify the ability to assign three of the five user accounts specified in Step 2 as follows: • System Administrator • Content Administrator 1.1.2, 1.1.2.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-5 Step Type Procedure Requirement(s) Met P/F/NA Comments • Review Committee Member 6 Demonstration Verify the ability to assign two of the five user accounts specified in Step 2 as follows: • Content Administrator and Review Committee Member • System Administrator , Content Administrator , and Review Committee Member 1.1.2, 1.1.2.1, 1.1.2.2 7 Demonstration Verify the ability to modify a user’s role by removing the designation of “Content Administrator” from the user account having this role specified in Step 6 1.1.2 Test Case 1.3: Verify Role Privilege Management Requirements Tested: • 1.1: Manage Access • 1.1.2.3: Manage Role Privileges • 1.1.2.3.1: Manage System Administrator Privileges • 1.1.2.3.2: Manage Content Administrator Privileges • 1.1.2.3.3: Manage Review Committee Member Privileges • 1.1.2.3.4: Manage Content Contributor Privileges • 1.1.2.3.5: Manage Content Reader Privileges

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-6 Table C-4. Test Case 1.3 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the portal as a System Administrator 2 Demonstration Verify the ability of a System Administrator to Create, Update, and Delete roles, by creating a role entitled “Test,” setting privileges for this role, and deleting this role 1.1.2.3, 1.1.2.3.1 3 Demonstration Assign to the Content Administrator role the following privileges: 1. The ability to view all content, regardless of status 2. The ability to change the status of content 3. The ability to assign content reviewers to a specific post and provide access to that content 4. The ability to edit the list of content reviewers 5. The ability to edit the list of review committee members 1.1.2.3, 1.1.2.3.2

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-7 Step Type Procedure Requirement(s) Met P/F/NA Comments 6. The ability to edit the content privileges of review committee members 4 Demonstration Assign the Review Committee Member role the following privileges: • The ability to view all content, regardless of status 1.1.2.3, 1.1.2.3.3 5 Demonstration Assign the Content Contributor role the following privileges: • The ability to submit content 1.1.2.3, 1.1.2.3.4 6 Demonstration Assign the Content Reader role the following privileges: • The ability to view content that has a status of “published” • The ability to search for content 1.1.2.3, 1.1.2.3.5 Test Case 1.4: Verify User and Content Access Requirements Tested:

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-8 • 1.1: Manage Access • 1.1.4: Manage Content Access • 1.1.5: Manage User Access • 1.1.5.1: Manage Reviewer List • 1.1.5.2: Manage Committee Member List Table C-5. Test Case 1.4 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the portal as a System Administrator 2 Demonstration Verify the ability of the System Administrator to edit and update the Reviewer List and the Review Committee Member list 1.1.5, 1.1.5.1, 1.1.5.1.2 3 Configuration Login to the portal as a Content Administrator 4 Demonstration Verify the ability of the Content Administrator to edit and update the Reviewer List and to assign at least one user to this role 1.1.5.1, 5 Demonstration Verify the ability of the Content Administrator to edit and update the Reviewer Committee Member list and to assign at least one User to this role 1.1.5.1.2 6 Configuration Load two content items to the portal, with an unpublished

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-9 Step Type Procedure Requirement(s) Met P/F/NA Comments status 7 Demonstration Verify the ability of a Content Administrator to view all content items, including those that are unpublished 1.1.4 8 Demonstration Verify the ability of a Content Administrator to grant privileges to a specific reviewer to review one item; reviewer has only the roles of Content Contributor and Content Reader 1.1.5.1 9 Configuration Login to the portal as the user granted review privileges specified in Step 8. 10 Demonstration Verify the ability of the assigned reviewer designated in Step 8 to view content that was assigned for review and any published content. Verify that the assigned reviewer cannot view unpublished content that was not assigned. 1.1.4 11 Configuration Login to the portal as a Review Committee

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-10 Step Type Procedure Requirement(s) Met P/F/NA Comments Member assigned to the role in Step 5 12 Demonstration Verify that a Review Committee Member can view all portal content, whether it is published or unpublished 1.1.4 Manage Storage Tests This set of test cases test verifies that the requirements under requirement 1.2 of the System Requirements, “Manage Storage,” are met. Test Case 2.1: Verify Content Upload Process Requirements Tested: • 1.2: Manage Storage • 1.2.1: Populate List • 1.2.2: Validate List Entry • 1.2.3: Manage Provisional Content Table C-6. Test Case 2.1 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the portal as a Content Administrator 2 Demonstration Upload a content item, filling out the upload form without making any errors in syntax and completing all required fields 1.2.2 3 Demonstration Attempt to upload a content item, filling out the upload form making a syntax 1.2.2

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-11 Step Type Procedure Requirement(s) Met P/F/NA Comments error in one field, but completing all required fields. Verify that the submission was rejected 4 Demonstration Attempt to upload a content item, filling out the upload form without making syntax errors but not completing all required fields. Verify that the submission was rejected 1.2.2 5 Demonstration Verify that the information entered to the content upload process during Step 2 appears in the appropriate content list 1.2.1 4 Demonstration Verify that the content loaded in Step 2 is stored in the portal with a status of provisional 1.2.3 Test Case 2.2: Verify Provisional Content Access and Content Catalog Requirements Tested: • 1.2: Manage Storage • 1.2.3: Manage Provisional Content • 1.2.3.1: Restrict Access to Provisional Content • 1.2.4: Manage Content Catalog Table C-7. Test Case 2.2 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-12 Step Type Procedure Requirement(s) Met P/F/NA Comments portal as a Content Administrator 2 Configuration Upload two content items to the portal and set the status of one content item to be published 3 Demonstration Verify that the unpublished content item loaded in Step 2 does not appear in the content catalog and is listed in the content list as provisional content 1.2.3, 1.2.4 4 Demonstration Verify that the published content item loaded in Step 2 does appear in the content catalog 1.2.4 5 Demonstration Verify the ability of a Content Administrator to view both content items loaded to the portal in Step 2 1.2.3, 1.2.3.1, 1.2.4 6 Configuration Login to the portal as a Content Reader 7 Demonstration Verify that the Content Reader is able to view the published content item and unable to view the unpublished content item 1.2.3.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-13 Manage Content Tests This set of test cases verifies that the requirements under requirement 1.3 of the System Requirements, “Manage Content,” are met. Test Case 3.1: Verify Content Registration Process Requirements Met: • 1.3: Manage Content • 1.3.1: Manage Content Status • 1.3.1.1: Designate Status • 1.3.2: Manage Status Change • 1.3.2.1: Document Status Changes • 1.3.2.2.: Publish Status Changes • 1.3.3: Manage Content Registration Process • 1.3.3.1: Manage Registration Process • 1.3.3.2: Validate and Store Content • 1.3.3.3: Manage Content Upload • 1.3.3.4: Manage Content Agreement • 1.3.3.4.1: View Terms and Conditions • 1.3.3.4.2: Print Terms and Conditions • 1.3.3.5: Submit Content for Review • 1.3.3.6: Manage Incomplete Content Submission • 1.3.3.7: Manage Revised Content Table C-8. Test Case 3.1 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the portal as a user with Content Contributor and Content Administrator Privileges 2 Demonstration Enter the Content Registration Process for a new submission 1.3.3.1 3 Demonstration Complete the submission form, making errors in syntax and omitting 1.3.3.2

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-14 Step Type Procedure Requirement(s) Met P/F/NA Comments mandatory fields. Verify that the form is rejected, and the user is given the opportunity to make corrections 4 Demonstration Save the submission in its current state and exit the submission process 1.3.3.6 5 Demonstration Verify that the status of the content saved in Step 4 is “Post- Incomplete” 1.3.1, 1.3.1.1 6 Demonstration Verify that the user is able to resume the content registration process terminated in step 4, verifying that the submission form is completed as it was prior to exiting the process 1.3.3.6 7 Demonstration Complete the submission form, ensuring that there are no errors in syntax and that all mandatory fields are completed 1.3.3.2 8 Demonstration Upload content in a format not supported by the portal, and verify that it is rejected 1.3.3.3 9 Demonstration Upload content in a format supported by the portal, and 1.3.3.3

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-15 Step Type Procedure Requirement(s) Met P/F/NA Comments verify that it is accepted 10 Demonstration Verify that the user can view the terms and conditions of the portal 1.3.3.4.1 11 Demonstration Verify that the user can print the terms and conditions of the portal 1.3.3.4.2 12 Demonstration Verify that the user can accept the terms and conditions of the portal, completing the review process 1.3.3.4, 1.3.3.5 13 Demonstration Verify that the content submitted is automatically granted a status of “Post Complete ” 1.3.1, 1.3.1.1 14 Demonstration Verify that Content Administrator and Review Committee Members receive an alert that the status of the content has been changed in Step 13 1.3.2 15 Demonstration Verify that the status change of the content changed in Step 13 is documented 1.3.2.1 16 Demonstration Verify that the status of the content changed in Step 13 is published to the 1.3.2.2

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-16 Step Type Procedure Requirement(s) Met P/F/NA Comments personalized web page of Content Administrator and Review Committee Members 17 Configuration Perform Steps 1, 2, 7, and 8 again 18 Demonstration Verify that the user can reject the terms and conditions of the portal and that the content registration process is terminated 1.3.3.4.3 19 Configuration Set the status of the content submitted in Step 16 to “Revision Requested” 20 Demonstration Verify the ability of the user to make changes to the content using a streamlined process and to resubmit content 1.3.3.7 Test Case 3.2: Verify Content Review Administration Requirements Tested: • 1.3: Manage Content • 1.3.2.3: Manage Content Approval • 1.3.4: Administer Content Review • 1.3.4.1: Manage Pending Content • 1.3.4.2: Manage Content Review Assignment • 1.3.4.3: Review Content by Selection Criteria • 1.3.4.4: Manage Content Committee Review • 1.3.4.5: Provisional Acceptance Alert • 1.3.4.4.1: Edit Review Agenda

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-17 Table C-9. Test Case 3.2 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Load multiple content items into the portal with each possible content status being covered 2 Configuration Login to the portal as a Content Administrator 3 Demonstration Verify the ability of the Content Administrator to view a summary page of the review process 1.3.4 4 Demonstration Verify the ability of the Content Administrator to view a list of pending content 1.3.4.1 5 Demonstration Verify the ability of the Content Administrator to review a list of content that has been assigned for review 1.3.4.2 6 Demonstration Verify the ability of the Content Administrator to view the entire content list, organized by selection criteria 1.3.4.3 7 Demonstration Verify the ability of the Content Administrator to view a list of content to be discussed at the next meeting of the review committee, 1.3.4.4

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-18 Step Type Procedure Requirement(s) Met P/F/NA Comments organized by status 8 Demonstration Verify the ability of the Content Administrator to edit, save, and submit a Review Committee Meeting agenda 1.3.4.4.1 9 Demonstration Verify the ability of a Content Administrator to change the status of any content item in the portal to “accepted,” “provisionally accepted,” or “rejected” 1.3.2.3 10 Configuration Login to the portal as a Review Committee Member 11 Demonstration Verify the ability of the Review Committee Member to view a summary page of the review process 1.3.4 12 Demonstration Verify the ability of the Review Committee Member to view a list of pending content 1.3.4.1 13 Demonstration Verify the ability of the Review Committee Member to review a list of content that has been assigned for review 1.3.4.2 14 Demonstration Verify the ability 1.3.4.3

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-19 Step Type Procedure Requirement(s) Met P/F/NA Comments of the Review Committee Member to view the entire content list, organized by selection criteria 15 Demonstration Verify the ability of the Review Committee Member to view a list of content to be discussed at the next meeting of the review committee, organized by status 1.3.4.4 16 Demonstration Verify the ability of the Review Committee Member to view the agenda of the next Review Committee Meeting 1.3.4.4.1 17 Configuration Provisionally accept content with specific changes that the content contributor must make 18 Configuration Login to the Portal as the Content Contributor whose content was provisionally accepted in step 17 19 Demonstration Verify that an alert is received stating required revisions for content to be published

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-20 Test Case 3.3: Verify Quality Review Processes Requirements Tested: • 1.3: Manage Content • 1.3.1.1: Designate Status • 1.3.5: Manage Content Quality Review • 1.3.5.1: Reviewer Summary Page • 1.3.5.2: View Assigned Content • 1.3.5.3: Manage Review Scoring • 1.3.5.4: Manage Incomplete Scoring Table C-10. Test Case 3.3 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Load multiple content items into the portal and assign them for review to a user who has only the role of a Content Contributor and Content Reader. At least one content item shall have already been reviewed 2 Configuration Login to the portal as the user designated in Step 1 3 Demonstration Verify the ability of the user to view a Reviewer Summary Page showing pending, incomplete, and complete reviews 1.3.5.1 4 Demonstration Verify the ability of the Reviewer to view content that has been assigned for review 1.3.5.2 5 Demonstration For a content item that has been 1.3.5.3

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-21 Step Type Procedure Requirement(s) Met P/F/NA Comments assigned, open the Review Scoring form and partially complete the form 6 Demonstration Verify the ability of the Reviewer to save, exit, and re- enter the Review Scoring form prior to completion 1.3.5.4 7 Demonstration Complete and submit the Review Scoring form, verifying that the status of the item is changed to review complete 1.3.1.1 Manage Discovery Tests This set of test cases verifies that the requirements of under requirement 1.4 of the System Requirements, “Manage Discovery,” are met. Test Case 4.1: Verify Free Text Search Requirements Tested: • 1.4: Manage Discovery • 1.4.1: Manage Content Availability • 1.4.2: Manage Free Text Search Table C-11. Test Case 4.1 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Populate the portal with multiple content items set to a status of “published” and record at least two distinct search terms for each content item

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-22 Step Type Procedure Requirement(s) Met P/F/NA Comments 2 Configuration Populate the portal with at least two content items set to a status of “unpublished” and record at least two distinct search terms for each content item 3 Configuration Login to the portal as a user with content reader/Content Contributor credentials only 4 Demonstration For each published content item loaded in step 1, use each search term identified to search for each content item and verify that each item can be located in the portal 1.4.2 5 Demonstration For each unpublished content item loaded in step 2, use each search terms identified to search for each content item and verify that these content items cannot be located 1.4.1 Test Case 4.2: Verify Keyword Search Requirements Tested: • 1.4: Manage Discovery

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-23 • 1.4.1: Manage Content Availability • 1.4.3: Manage Keyword Search Table C-12. Test Case 4.2 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Populate the portal with multiple content items set to a status of “published” and record the keywords assigned to each content item 2 Configuration Populate the portal with at least two content items set to a status of “unpublished” and record the keywords assigned to each content item 3 Configuration Login to the portal as a user with content reader/Content Contributor credentials only 4 Demonstration For each published content item in Step 1, use the portal’s keyword navigation functionality to verify that the content item can be located in the portal 1.4.3 5 Demonstration For each unpublished content item loaded in step 2, use the portal’s keyword 1.4.1

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-24 Step Type Procedure Requirement(s) Met P/F/NA Comments navigation functionality and verify that these content items cannot be located Test Case 4.3: Verify Most Viewed Search Requirements Tested: • 1.4: Manage Discovery • 1.4.4: Manage Most Viewed Search Table C-13. Test Case 4.3 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Load multiple content items into the portal, each set to a status of “published” 2 Configuration View each content item from Step 1 multiple times, with each content item being visited a different number of times. Record the number of times each content item is viewed 3 Demonstration Use the Most Viewed Search functionality, and verify that the content items loaded in Step 1 appear in the order of visits set in Step 2 1.4.4 Test Case 4.4: Verify New Content Search Requirements Tested: • 1.4: Manage Discovery

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-25 • 1.4.5: Manage New Content Search Table C-14. Test Case 4.4 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Load multiple content items into the portal, each set to a status of “published.” Record the order that content is loaded 2 Demonstration Use the New Content Search functionality, and verify that the order of content is the same as the order in which content was loaded to the portal 1.4.5 Test Case 4.5: Verify Content Catalog and Content Viewing Capabilities Requirements Tested: • 1.4: Manage Discovery • 1.4.6: Manage Content Catalog Search • 1.4.6.1: Sort Content Catalog • 1.4.7: View Multimedia Formats • 1.4.8: Print Multimedia Formats Table C-15. Test Case 4.5 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Load at least one content item for each type of content supported by the portal, and set the status of each content item to “publish” 2 Demonstration View the catalog of all content items 1.4.6

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-26 in the portal, and verify that each item loaded into the portal is listed in the catalog 3 Demonstration Sort the content catalog by each column in the catalog 1.4.6.1 4 Demonstration Verify the ability to open and view each content item listed in the content catalog 1.4.7 5 Demonstration Verify the ability to print each content item which is not an audio or video file 1.4.8 Administer the System This set of test cases verifies that the requirements under requirement 1.5 of the System Requirements, “Administer the System,” are met. Test Case 5.1: Verify Administration Requirements Tested: • 1.5: Administer the System • 1.5.1: Create Lists • 1.5.1.1: Create Topic Type List • 1.5.1.2: Create Keyword Lists • 1.5.1.3: Create Content List • 1.5.1.4: Create a Reviewer List • 1.5.1.5: Create a Review Scoring List • 1.5.1.6: Create Supplementary Resources List • 1.5.1.7: Create Association Between Lists • 1.5.1.8: Create a Lookup List • 1.5.2: Update List Format Table C-16. Test Case 5.1 Step Type Procedure Requirement(s) Met P/F/NA Comments 1 Configuration Login to the portal as a System Administrator 2 Demonstration Create a Topic Type 1.5.1,

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-27 Step Type Procedure Requirement(s) Met P/F/NA Comments List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1.1, 1.5.2 3 Demonstration Create a Keyword List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.2, 1.5.2 4 Demonstration Create a Content List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.3, 1.5.2 5 Demonstration Create a Reviewer List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.4, 1.5.2 6 Demonstration Create a Review Scoring List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.5, 1.5.2 7 Demonstration Create a Supplementary Resources List as specified in the 5.2.2.1.5.1, 5.2.2.1.5.1.6, 5.2.2.1.5.2

May 2016 TCRP_G-13 FINAL REPORT APPENDIX C C-28 Step Type Procedure Requirement(s) Met P/F/NA Comments System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 8 Demonstration Create a set of Association lists as specified in the System Requirements, and verify the ability to edit these lists, add a new field, and delete the new field 5.2.2.1.5.1, 5.2.2.1.5.1.7, 5.2.2.1.5.2 9 Demonstration Create a Lookup List as specified in the System Requirements, and verify the ability to edit this list, add a new field, and delete the new field 1.5.1, 1.5.1.4, 1.5.2