220.127.116.11.2 - The repository shall have a process for testing and evaluating the effect of changes to the repository's critical processes.
SP tests and evaluates changes to its critical processes in isolated development environments to ensure that changes will not disrupt normal operations. In addition to automated tests and checks performed by software, SP staff manually evaluate changes by examining samples of the relevant content. Staff evaluate changes for their effect on the integrity of information, the speed and efficiency of the system, and the accessibility and usability of disseminated information. The repository uses a code versioning system to record changes to software. Moving software from development to production is an automated process. Testing and evaluation continues in the production environment, and the repository uses JIRA for logging and reporting problems (see 18.104.22.168.1 for more information about JIRA).
Solicited and unsolicited feedback from users is another source of information about system behaviour. SP has a large and diverse Designated Community, and they regularly report malfunctions and glitches to repository staff.
Please see the Risk Analysis and Management Strategies document for additional information about software failure. The repository has a Backup Plan that describes policies and procedures used by SP and the University of Toronto Libraries' Information Technology Services department to provide reliable backup copies of the repository's data, databases, and applications.
Digital Preservation Policy Librarian
There is always a risk of software failure in complex information systems. SP uses widely accepted, industry-standard procedures for testing and evaluating software changes, but small errors or conflicts sometimes escape testing. Software failure could force SP to suspend certain operations until the affected systems can be thoroughly analyzed, repaired, and tested.
SP will monitor changes to critical processes and procedures for compliance with the Mandatory Responsibilities described in OAIS. In addition, the repository will examine new editions of the OAIS Reference Model for changes.