V11 SP8
Loading...

Advanced Archive - OnePass for Windows File System

Table of Contents

Incremental backups

An incremental backup contains only data that is new or has changed since the last backup, regardless of the type. On average, incremental backups consume less media and use less resources than full backups. 

The illustration below clarifies the nature of full and incremental backups. For simplicity, assume there is a file system that contains six files as represented in the figure.

Backup #1 is a full backup and therefore writes all the data, changed and unchanged, to the backup media. Backups #2 through #n-1 are incrementals and only back up those files that have changed since the time of the last backup, regardless of the type. For example, files A, B, and E changed after the full backup and were therefore backed up in Backup #2. Backup #4 backed up files A and D because both files were modified sometime after Backup #3 occurred. File F did not change; hence, it was not backed up in any of the incremental backups, but it was included in both full backups, which, by definition, back up everything.

Important: Incremental backups that run subsequently after a synthetic full backup, takes a long time to complete. The backup job has to validate the stubs against issues, such as offline attributes and reparse data.

Follow the steps below to perform an incremental backup:

  1. From the CommCell Browser, navigate to <Client> | File System | defaultBackupSet.
  2. Right click the <Subclient> and click Backup.
  3. Select Incremental as backup type and Immediate to run the job immediately.
  4. Click OK.

    You can track the progress of the job from the Job Controller.  When the backup has completed, the Job Controller displays Completed.

Synthetic Full Backups

A synthetic full backup is a synthesized backup, created from the most recent full backup and subsequent incremental and/or differential backups. The resulting synthetic full backup is identical to a full backup for the subclient.

Unlike full, incremental, and differential backups, a synthetic full backup does not actually transfer data from a client computer to the backup media. Therefore, they do not use any resources on the client computer.

Synthetic full backups are media-based; they read backup data from one media and simultaneously write (restore) the result to the new active media within the same media group. As a result, synthetic full backups require that at least two media drives for the same storage policy be available at the time the job is started. Synthetic full backups cannot be performed on subclients where the storage policy is associated with a stand-alone drive.

Running Synthetic Full Backups

Synthetic full backups can either be started manually or scheduled to occur at regular intervals.

  1. From the CommCell Browser, navigate to <Client> | File System | defaultBackupSet.
  1. Right click the <Subclient> and click Backup.
  2. From the Backup Options window, select Synthetic Full for Backup Type.
  3. Select Immediate for Job Initiation.
  4. Click OK.

    You can track the progress of the backup job from the Job Controller. When the backup has completed, the Job Controller displays Completed.

Running an Incremental Backup before or after a Synthetic Full Backup

An incremental backup can be run either before or after a synthetic full backup.

  • Running an incremental backup before the synthetic full ensures that any new or recently changed data is included in the synthetic full.
  • Running an incremental backup after the synthetic full ensures that any new or recently changed data since the backup that occurred prior to the synthetic full, but was not included in the synthetic full, is backed up by the incremental.

The sections below describe the steps to run an incremental backup before or after a synthetic full backup:

  1. From the CommCell Browser, navigate to <Client> | File System | defaultBackupSet.
  1. Right click the <Subclient> and click Backup.
  2. From the Backup Options window, select Synthetic Full for Backup Type.
  3. Select Run Incremental Backup and then select Before Synthetic Full or After Synthetic Full options.
  4. Select Immediate for Job Initiation.
  5. Click OK.

    You can track the progress of the backup job from the Job Controller. When the backup has completed, the Job Controller displays Completed.

Verifying Synthetic Full Backups

This option ensures that files that have not been backed up by incremental jobs since the last full backup are backed up by the next incremental.

For example, if you perform the conventional full backup only once for a given subclient and then perform incremental (or differential) backups and periodic synthetic full backups. After the conventional full backup, a file is added to the subclient and the file has a time stamp older than the time of full backup. In this case, the file will never be backed up. Eventually, such files might be pruned and no backup of such  files will be available.

The illustration explains the need to verify synthetic full backups.

In order to overcome this problem, periodically verify the synthetic full backups job.

  1. From the CommCell Browser, navigate to <Client> | File System | defaultBackupSet.
  1. Right click the <Subclient> and click Backup.
  2. From the Backup Options dialog box, select Synthetic Full.
  3. Click Advanced.
  4. In the Advanced Backup Options dialog box, click the Data tab.
  5. Select Verify Synthetic Full. Click OK to continue.
  6. Click OK.

Preventing Deleted Stubs From Increasing the Size Of Synthetic Full Backups

If you have two or more copies of the archived data and you want to back up only the copy that resides on the disk then select the Check for deleted stubs check box. Selecting the Check for deleted stubs option reduces the size of the synthetic full backup. If your CommCell environment uses capacity licenses, the reduced size of the synthetic full backup frees up the space for capacity license consumption.

Procedure

  1. From the CommCell Console, expand Client Computers > File System.
  2. Right-click the subclient and then click Backup.
  3. In the Backup Options dialog box, select the following:
    1. Synthetic Full as the backup type.
    2. Under Job Initiation, select Immediately.
    3. Click Advanced.
    4. In the Advanced Backup Options dialog box, select the Check for deleted stubs check box, and click OK.
  4. Click OK.

Example

A user archives 5 GB of data. Later, the user recalls the 5 GB of archived data. The user then performs an incremental back up. The incremental back up picks up the recalled files and archives them again. When the user performs a synthetic full back up, a total of 10 GB data is backed up. However, if Check for deleted stubs option is selected before running the synthetic full backup, only the latest copy of the data on the disk (5 GB of recalled data) is backed up.

As a result, the usage of capacity license is less due to smaller size backups.

Accelerated Synthetic Full Backups (DASH Full)

When a storage policy copy is deduplicated, synthetic full backups can be created in an accelerated mode to significantly reduce the copy duration. This is done by identifying and transferring the data signatures (instead of the data itself) to the target wherever possible.

To enable DASH full on a storage policy copy, see Modifying a Storage Policy Copy Deduplication Settings.

Verify Dropped and Dangling Stubs during a Synthetic Full Backup

  1. Create the SYNTHFULL_DROPPED_FILES_AND_DANGLING_STUBS_REPORT additional setting on the MediaAgent computer and set the value to 1. For more information on creating the additional setting, see Add or Modify an Additional Setting.
  2. Whenever you run a synthetic full backup, two .csv files are created in the following location:
    • <IndexCache>/CvIdxReports/<commcellid>/<backupsetguid>/<jobid_of_synthful>/DroppedFilesList.csv
    • <IndexCache>/CvIdxReports/<commcellid>/<backupsetguid>/<jobid_of_synthful>/DanglingStubsList.csv

    The DanglingStubs.csv file contains the list of stubs that do nt have a source file. The DroppedFilesList.csv file contains the list of files that are dropped from the backup cycle.

    You can review the items in the .csv files and verify if the number of missing or deleted items are accurate. By default, the files are deleted after 30 days.

Backing Up Files That Meet the Archiving Rules

By default while running a backup, files and folders defined as the subclient content are backed up. However, you can also define the files to be backed up based on the archiving rules. It means that only files and folders that meet the archiving rules will be backed up.

Use the following steps to configure rule based backups:

  1. From the CommCell Console, navigate to Client Computers | File System | <backupSet>.
  2. In the right pane, right-click the Subclient and point to Properties.
  3. Select the Content tab and select Only backup files that qualify for archiving checkbox and click OK on the Warning dialog box.

  4. Right-click the Subclient and click Backup.
  5. Select Incremental as backup type and Immediate to run the job immediately.
  6. Click OK.
  7. Once the job is complete, view the details of the job from the backup history. Right-click the Subclient and select Backup History.
  8. Click OK.
  9. Right-click the job and select View backup items.

    Note that the files that satisfied the archiving rules have been backed up.

    If this option is unchecked, the next backup job will run as an incremental backup but will backup all the files.

Scheduling an Archive Job

  1. From the CommCell Console, navigate to Client Computers | File System | Backupset.

    Right-click the Subclient and click Backup.

  2. Click Schedule to schedule the backup job for a specific time.

    Click Configure to set the schedule for the backup job. The Schedule Details dialog displays.

  3. Select the appropriate scheduling options.  For example:
    • Click Weekly.
    • Check the days you want the run the archive job.
    • Change the Start Time to 9:00 PM
    • Click OK to close the Schedule Details dialog
    • Click OK to close the Backup Options dialog

    The backup job will execute as per the schedule.

Long Term Data Retention

Once the backed up data has been archived it can be transferred and retained for long term on cost effective media also by using the following:

Cloud Storage

  • Cloud Storage enables you to configure and use online storage devices — cloud storage devices — as storage targets.
  • It reduces the need to maintain hardware resources such as tape or disk storage devices at onsite locations.
  • It also provides the ability to easily increase your storage capacity as and when it is required.
  • It also provides centralized data access, better failover capabilities and reduces the day-to-day storage administration tasks.

For more details, see Cloud Storage.

Auxiliary Copy

  • An auxiliary copy operation allows you to create secondary copies of data associated with data protection operations, independent of the original copy.
  • The auxiliary copy operation can be useful for creating additional standby copies of data.
  • The primary and secondary copies use different media and often use different libraries, depending on the configuration.
  • In case the primary copy become inoperative, you can promote a synchronous copy to become the primary copy. This allows you to continue data protection and data recovery operations without interruptions.

For details, see Auxiliary Copy.

Managing Jobs

Jobs can be managed in a number of ways. The following sections provide information on the different job management options available.

Restarting Jobs

Jobs that fail to complete successfully are automatically restarted based on the job restartability configuration set in the Control Panel. This configuration can be changed at any time; however, changes to this configuration will affect all jobs run in the entire CommCell.

It is also possible to override the default CommServe configuration for individual jobs by configuring retry settings when initiating the job. This configuration, however, will apply only to the specific job.

Backup jobs for this Agent are resumed from the point-of-failure.

Configure Job Restartability at the CommServe Level

  1. From the CommCell Console ribbon, click the Home tab, and then click Control Panel.
  2. In the Data section, click Job Management.

    The Job Management dialog box is displayed.

  3. On the Job Restarts tab, select the job information.
    • In the Job Type box, select the job that you want set the restart capability for (for example, for DB2 backup jobs, select DB2 Data Protection).
    • Select the Restartable check box.
    • Optional: to change the maximum number of times that the Job Manager tries to restart a job, in the Max Restarts box, select the number of times.
    • Optional: to change the time interval between attempts for the Job Manager to restart the job, in the Restart Interval (Mins) box, select the number of minutes.
  4. Click OK.

Configure Job Restartability for an Individual Job

  1. From the Backup Options dialog box, click Advanced, then select the Job Retry tab and specify the following as desired:
    • Total Running Time - The maximum elapsed time, in hours and minutes, from the time that the job is created.
    • Number of Retries - The number of times that Job Manager will attempt to restart the job.
    • Kill Running Jobs When Total Running Time Expires - Option to kill the job when the specified Total Running Time has elapsed, even if its state is "Running".
  2. Click OK.

Controlling Jobs

The following controls are available for running jobs in the Job Controller window:

Suspend

Temporarily stops a job. A suspended job is not terminated; it can be restarted at a later time.

Resume

Resumes a job and returns the status to Waiting, Pending, Queued, or Running. The status depends on the availability of resources, the state of the Operation Windows, or the Activity Control setting.

Kill

Terminates a job.

Suspending a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Suspend.
  2. The job status may change to Suspend Pending for a few moments while the operation completes. The job status then changes to Suspended.

Resuming a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Resume.
  2. As the Job Manager attempts to restart the job, the job status changes to Waiting, Pending, or Running.

Killing a Job

  1. From the Job Controller of the CommCell Console, right-click the job and select Kill.
  2. Click Yes when the confirmation prompt appears if you are sure you want to kill the job. The job status may change to Kill Pending for a few moments while the operation completes. Once completed, the job status will change to Killed and it will be removed from the Job Controller window after five minutes.

Additional Options

The following table describes the available additional options to further refine your backup operations:

Option Description Related Topics
Startup Options The Startup Options are used by the Job Manager to set priority for resource allocation. This is useful to give higher priority to certain jobs. You can set the priority as follows:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and click Startup tab.
  4. Select the Change Priority checkbox.
  5. Enter a priority number - 0 is the highest priority and 999 is the lowest priority.
  6. Select the Start up in suspended State check box to start the job in a suspended state.
  7. Click OK.
Refer to Job Priority and Priority Precedence.
Alerts This option enables users or user groups to get automatic notification on the status of the data protection job. Follow the steps given below to set up the criteria to raise notifications/alerts:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Alert tab.
  4. Click Add Alert.
  5. From the Add Alert Wizard dialog box, select the required threshold and notification criteria and click Next.
  6. Select the required notification types and click Next.
  7. Select the recipients and click Next.
  8. Click Finish.
  9. Click OK.
Refer to Alerts and Notifications.
Command Line Backups Command Line Interface enables you to perform backups or restore from the command line. The commands can be executed from the command line or can be integrated into scripts.

You can also generate command line scripts for specific operations from the CommCell Browser using the Save As Script option.

Refer to Command Line Interface.
Data Path Options Data Protection operations use a default Library, MediaAgent, Drive Pool, and Drive as the Data Path. You can use this option to change the data path if the default data path is not available. Follow the steps given below to change the default data path:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Data Path tab.
  4. Select the MediaAgent and Library.
  5. Select the Drive Pool and Drive for tape library.
  6. Click OK.
Refer Change Data Path.
Start New Media The Start New Media option enables you to start the data protection operation on a new media. This feature provides control over where the data physically resides.Use the following steps to start the data protection operation on a new media:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Media tab.
  4. Select the Start New Media check box.
  5. Click OK.
Refer to Start New Media.
Mark Media Full This option marks the media as full, two minutes after the successful completion of the data protection job. This option prevents another job from writing to this media. Follow the steps given below:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select Media tab.
  4. Select the Mark Media Full on Success check box.
  5. Click OK.
Refer to Export Media.
Allow Other Schedules To Use Media Set The Allow Other Schedules to use Media Set option allows jobs that are part of the schedule or schedule policy and using the specific storage policy to start a new media. It also prevents other jobs from writing to the same set of media.
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Media tab.
  4. Select the Allow Other Schedules To Use Media Set check box.
  5. Click OK.
Refer to Creating an Exportable Media Set.
Reserve Resources Before Scan Media is reserved for a job when the job is ready to write data. You can use this option to reserve the media during the initial phase of the job. Follow the steps given below to reserve media:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Media tab.
  4. Select the Reserve Resources Before Scan check box.
  5. Click OK.
 
Extended Data Retention This option allows you to extend the expiration date of a specific job. This will override the default retention set at the corresponding storage policy copy. Follow the steps given below to extend the expiration date:
  1. From the CommCell Browser, navigate to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the Subclient in the right pane and click Backup.
  3. Click Advanced and select the Media tab.
  4. Select one of the following options:
    • Infinite - Select this option to extend the expiration date by infinite number of days
    • Number of day - Select this option to specify the number of days to extend the expiration date and then enter the number of days.
  5. Click OK.
Refer to Extended Retention Rules.
Vault Tracker The Vault Tracker Feature allows you to manage media that is removed from a library and stored in offsite locations. To access and select the Vault Tracker options.
  1. From the CommCell Browser, expand to Client Computers | <Client> | File System | Backup Set.
  2. Right-click the subclient in the right pane, and then click Backup.
  3. Click Advanced, and select the Vault Tracking tab.
  4. Select the required options.
  5. Click OK.
Refer to Vault Tracker.
CommCell Readiness Report The CommCell Readiness Report provides you with vital information such as connectivity and readiness of the Client, MediaAgent, and CommServe. It is useful to run this report before performing a backup or a recovery operation. Follow the steps given below to generate the report:
  1. On the CommCell Console menu bar, select the Reports tab.
  2. Click Readiness.

    The Report Selection dialog box appears.

  3. If necessary, select Reports | CommServe | CommCell Readiness in the left pane.
  4. Select the Computers tab, and then click Modify below the Computers list.
  5. In the dialog box that appears, clear Include All Client Computers and All Client Groups.
  6. Select the appropriate client from the Exclude list, and then click Include >.
  7. Click OK.
  8. Select the MediaAgent tab, and then clear Include All MediaAgents.
  9. Select the appropriate MediaAgent from the Exclude list, and then click Include >.
  10. Click Run.

    The report appears in your default Web browser.

Refer to CommCell Readiness Report.
Backup Job Summary Report The Backup Job Summary Report provides you with information about all of the backup jobs that are run in last 24 hours for a specific subclient. You can get information such as status, time, data size, and so on for each backup job. It is useful to run this report after performing the backup. Follow the steps given below to generate the report:
  1. On the CommCell Console menu bar, select the Reports tab.
  2. Click Summary.

    The Report Selection dialog box appears.

  3. If necessary, select Reports | Jobs | Job Summary in the left pane.
  4. On the General tab, select Data Management.
  5. Select the Computers tab.
  6. Select Subclient, and then select the Edit sub tab.
  7. Navigate to Client Computers | <Client> | File System | Backup Set | <Subclient>.
  8. Click Run.

    The report appears in your default Web browser.

Refer to Backup Job Summary Report.