V11 SP8
Loading...

Cloud Storage - Advanced

Table of Contents

Setting Up Cloud Storage Using a Proxy

In this setup, the client computers are connected to the cloud library through the MediaAgent computer. During a backup operation, the MediaAgent sends the client data to the cloud storage through a proxy computer.

Use the following steps to configure cloud storage using proxy computer. Once configured the cloud storage library operates like a regular disk library:

  1. On the CommCell Console ribbon, click the Storage tab, and then click Expert Storage Configuration.
  2. In the Available MediaAgents list, select the MediaAgents whose devices you want to detect or display.
  3. Click Add to move the MediaAgents to Selected MediaAgents list, and then click OK.
  4. Click the Shared Disk Device tab.
  5. In the Device Name, by default the system generated Cloud Storage device name is displayed.
    • From the Type list, select the server type of Cloud Storage server.
    • In the Gateway box, select the MediaAgent to be used for controlling the library.
    • Provide the Access Information.

      The access information for Cloud Storage devices varies for each server type, and your screen might be different from the one displayed here.

  6. Click the Advanced tab.
  7. Select Proxy Server check box.
  8. In the Proxy Address box, type IP address or host name of the proxy computer.
  9. In the Port box, specify the port number to connect to proxy computer.
  10. In the User Name box, specify the user account information of the proxy computer
  11. In the Password box, specify the password for the specified user account.
  12. In the Verify Password box, re-type the password for confirmation.
  13. Click OK.

Adding a New MediaAgent to an Existing Cloud Device

You can add a new MediaAgent to control the cloud storage library. You can add more MediaAgents for GridStor settings or restore purposes. In a Cloud Storage setup, you can add a MediaAgent from a geographically different area than the one from which the backup is run, and restore the data to that MediaAgent.

Use the following steps to add a new MediaAgent to an existing cloud device:

  1. From the CommCell Browser, expand to Storage Resources | Libraries | <Library>.
  2. Right-click the mount path that you want to share with another MediaAgent, and click Share Mount Path.
  3. Select the mount path and click Share.
  4. From the Share Mount Path dialog box, perform the following:
    1. Select the MediaAgent you want to share and assign Access.
    2. Click OK.
  5. Click Ok to confirm your selection.

Adding an Additional Mount Path

You can add an additional mount path to an existing cloud library from the CommCell Console or from the command line Interface. For more information on adding additional mount path from the command line, see Adding a Mount Path to the Cloud Library.

To add a mount path from the CommCell Console, complete the following steps:

  1. From the CommCell Browser, expand Storage Resources > Libraries.
  2. Right-click the appropriate library, and then click Add Mount Path.
  3. The Add Mount Path dialog box appears.

  4. On the General tab, enter the following information:
    • Type: Select the type of cloud storage server.
    • MediaAgent: Select the MediaAgent you want to use.
    • Access information: Enter the credentials to access the cloud storage library.

      • You can acquire the access credentials from your cloud storage vendor.

        The access information for cloud storage devices varies for each server type. For a list of server types and their access information, see Add Cloud Storage MediaAgent

      • The credentials must not contain blank spaces or other special characters.
      • For another vendor that supports Amazon S3 such as Scality, you must select Amazon S3 from Type, and then, under Access Information, enter the credentials of that vendor.
      • When you create a cloud library, if you select a cloud storage server that is used for an existing cloud library from Type, the following occur:
        • If you enter the same credentials in Access Information, then the cloud device of the existing cloud library gets associated with this new cloud library.
        • If you select a different MediaAgent from MediaAgent, then the MediaAgent that you select is added as a new controller for the existing cloud device.

  5. If the MediaAgent accesses the cloud library via proxy, click Advanced tab, select Proxy Server check box and then enter the proxy server access information.
  6. Click OK.

    The new mount path appears in the CommCell Browser under Storage Resources > Libraries > library and also under Storage Resources > MediaAgents > MediaAgent > library.

Configuring Space Allocation Policy for Cloud Storage

You can configure the mount path allocation policy defining the space allocation parameters and writer assignments.

Use the following procedure to configure space allocation for a cloud storage:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Cloud Storage Library>.
  2. Right-click the Cloud Storage mount path and then click Properties.
  3. Click the Allocation Policy tab.
  4. In the Space Allocation section, establish one of the following options:
    • If you prefer no space restrictions, select the No Restriction option.
    • To specify the maximum space that can be used by the mount path select the Do not consume more than specified GB option and specify the space limit.
  5. Click OK.

Modifying the Timeouts for Cloud Storage

You can configure the timeout parameter that determines how long a job waits for a status response after an operation is requested.

Use the following procedure to modify the Timeouts for cloud storage:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries.
  2. Right-click the <Library> and then click Properties.
  3. In the Mount and Unmount box, type or select the timeout periods.
  4. Click OK.

Viewing or Modifying the Device Alias Name for Cloud Storage

Use the following procedure to modify the device alias name of the cloud storage device:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Cloud Storage Library>.
  2. Right-click the Cloud Storage mount path and then click Properties.
  3. In the Device section, view or modify the Device Alias Name.
  4. Click OK.

Configuring Multiple MediaAgents for a Cloud Storage Device

For steps to configure multiple MediaAgents for a cloud storage device, see Adding a New MediaAgent to an Existing Cloud Device.

Deconfiguring Multiple MediaAgents for a Cloud Storage Device

Use the following procedure to deconfigure multiple MediaAgents for a cloud storage device:

  1. From the CommCell Browser, expand to Storage Resources | Libraries | <Library>.
  2. Right-click the mount path from which you want to deconfigure a MediaAgent, and click Share Mount Path.
  3. Select the MediaAgent that you want to deconfigure, click Delete and then click OK.

Configuring Micro Pruning on Cloud Storage

For cloud storage configured with deduplication, by default, data will be pruned from storage, as soon as a backup job meets the retention rules, without sealing the corresponding DDB (deduplication database).

However, if necessary, you can configure pruning to occur only when all the backup jobs in a DDB meets the retention rules and the DDB is sealed.

Note: If there are multiple MediaAgents configured to write to a cloud storage, the system auto selects a preferred MediaAgent to prune the data from the cloud storage. You can set another MediaAgent as the preferred MediaAgent by using the QS_SetDeviceControllerProps qscript.

Procedure

  1. From the CommCell Browser, expand Storage Resources > Libraries >Cloud Storage Library.
  2. Right-click the appropriate cloud storage mount path and then click Properties.
  3. Click the Allocation Policy tab, select the Enable Micro Pruning check box.

    Note: This option will not be available for cloud storage products that do not support micro pruning. See Micro Pruning support for a list.

  4. Click OK.

Related Tasks

Pruning Deduplication Database Backup Jobs of Sealed DDB

Configuring Files as Read-Only

You can configure the library to create archive/backup files as read-only files to achieve WORM functionality on cloud storage. This enables the corresponding read-only lock mechanism on the cloud storage and saves the archive/backup files as read-only files. The expiration date for the read-only lock is set to match the data retention time (backup or archiver retention days, whichever is higher) established in the storage policy copies. These files cannot be modified or deleted by any user or application until the specified retention date. Once the retention expires, the system deletes the files as a part of Data Aging.

This feature is supported for cloud vendors (like Hitachi and Caringo storage) who support retention at object level. (See Cloud Storage - Frequently Asked Questions for vendors who support bucket level WORM policy.)

This option affects only the files that are subsequently created by data protection and auxiliary copy operations to this library. Permission to files that are already available in this library are not affected.

  1. From the CommCell Browser, expand to Storage Resources > Libraries.
  2. Right-click the appropriate library, and then click Properties.
  3. Select the Mark Archive files as Read-Only check box.
  4. Click OK.

Managing a Cloud Storage Device

Modify the Cloud Device Name

Use the following procedure to modify the device name of an already configured cloud storage device:

  1. On the CommCell Console ribbon, click the Storage tab, and then click Expert Storage Configuration.
  2. In the Available MediaAgents list, select the MediaAgents whose devices you want to detect or display.
  3. Click Add to move the MediaAgents to Selected MediaAgents list, and then click OK.
  4. Click the Shared Disk Device tab.
  5. Right-click the <Cloud Storage Device>, and then click Properties.
  6. In the Device Name box, type the name of the device.
  7. Click OK.

Modify the Access Information

Use the following procedure to modify the access information of an already configured cloud storage device:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Cloud Storage Library>.
  2. Right-click the Cloud Storage mount path and then click Properties.
  3. Click the Sharing tab.
  4. Highlight the MediaAgent for which you wish to modify the access information from the Controllers list, and then click the Edit button.

    The access information for Cloud Storage devices vary for each server type and may vary from the description provided below..

    For Caringo CAStor, you can add multiple service host provider names separated by a comma for load balancing. This helps in case if one of the service provider goes down, the other service host provider can be used.

  5. In the Access Key ID box type the access key ID.
  6. In the Secret Access Key box, type the key.
  7. In the Verify Secret Access Key box, retype the key for verification.
  8. In the Bucket box, type the bucket name.
  9. From the Storage Class list, select the appropriate storage class for your account.
  10. Click OK.

Modify the Proxy Server Details

Use the following procedure to modify the device name of an already configured cloud storage device:

  1. On the CommCell Console ribbon, click the Storage tab, and then click Expert Storage Configuration.
  2. In the Available MediaAgents list, select the MediaAgents whose devices you want to detect or display.
  3. Click Add to move the MediaAgents to Selected MediaAgents list, and then click OK.
  4. Click the Shared Disk Device tab.
  5. Right-click the <Cloud Storage Device>, and then click Properties.
  1. In the Proxy Address box, type IP address or host name of the proxy computer.
  2. In the Port box, specify the port number to connect to proxy computer.
  3. In the User Name box, type the user account information of the proxy computer
  4. In the Password box, type the password for the specified user account.
  5. In the Verify Password box, re-type the password for confirmation.
  6. Click OK.

Enabling or Disabling a Cloud Library

Use the following procedure to enable/disable a library:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries.
  2. Right-click the <Library>, and then click Properties.
  3. By default, the Enable Library check box is selected.

    Click to clear the Enable Library check box to disable the library.

  4. Click OK.

Enabling or Disabling a Mount Path

Use the following procedure to enable/disable a mount path:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Cloud Storage Library>.
  2. Right-click the Cloud Storage mount path, and then click Properties.
  3. By default, the Enable Mount Path check box is selected.

    Click to clear the Enable Mount Path check box to disable the library.

  4. Click OK.

Validating the Mount Path

You can validate a mount path to calculate the throughputs of a mount path and to check the read and write operations. You can determine the read and write throughputs based on a sample block size, number of writer/ thread, file size and the file count. During the validation process, the system writes data temporarily on the mount path and reads data from the mount path.

Validating a mount path is useful when you want to determine the read and write throughputs.

Note: Amazon Glacier and Oracle Cloud Storage Archive Service are not supported for device validation.

Before You Begin

  • Ensure that your MediaAgent is upgraded to V11.
  • The default percentage of random or sequential read and write operations during the validation of cloud mount path is 50%. You can configure the percentage of random read and write operations using the nCloudValidationRandomReadPercentage additional setting. For more information, see Configuring the Percentage of Random Operations for Mount Path Validation.

Procedure

  1. From the CommCell Browser, expand to Storage Resources > Libraries > Cloud Library.
  2. Right-click the appropriate mount path, and then click Validate Mount Path.
  3. In the Validate Mount Path dialog box, select the MediaAgent.  The default values for File Size(GB), Number of Writer/Thread, File block size(KB), and File Count are pre-populated.

    To change the default values, select a value from the drop down list, or type a value.

  4. Click OK.

    You can track the progress of the job from the Job Controller. On successful validation of the mount path, you can view the throughput details in a pop-up window.

Configuring the Percentage of Random Read Operations for Mount Path Validation

The default percentage of random or sequential read operations during the validation of cloud mount path is 50%. You can configure the percentage of random read operations using the nCloudValidationRandomReadPercentage additional setting. When the value is set to 100, the operations are pure random and not sequential. When the value is set to 0, the operations are pure sequential and not random.

Procedure

Retiring a Mount Path

Use the following steps to retire or for phasing out a mount path from a cloud library:

  • When you select Disable mount path for write operations, the mount path will not be used for subsequent write operations. You can however perform read operations on the data available in the mount path.
  • Depending on the retention criteria set for the storage policy copy that was used to write the data, the data in the mount path will be pruned when data aging operation is performed. To prevent pruning, the device controller needs to be set to read only.

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Library>.
  2. Right-click the <MountPath> that you no longer want to use, and then click Properties.
  3. Click the Allocation Policy tab.
  4. Click the Disable mount path for write option.
  5. Click OK to save the changes.

Viewing the Contents of a Mount Path

You can view the contents of a specific mount path. This feature can be used to view a list of backup operations residing in the mount path. All of the details that are associated with the backup operations that are available in the media are displayed. This includes the following:

  • The Job ID and the status associated with the backup operation
  • Names of the client, agent, instance/backup set and subclient
  • Whether the backup operation is Full, Incremental, Differential or Synthetic full
  • The archive file type
  • The day and time in which the archive file associated with the backup operation was created.
  1. From the CommCell Browser, expand to Storage Resources | Libraries | <Library>.
  2. Right-click the appropriate mount path, and then click View Contents.

    The Data on Media dialog box displays the details of jobs available in the media.

Viewing the Mount Path Offline Reason

The status of the mount path indicates whether the mount path is online or offline, and if offline, the reason for the offline status.

Use the following procedure to view the offline reason for a mount path:

  1. From the CommCell Browser, navigate to Storage Resources | Libraries | <Cloud Storage Library>.
  2. Right-click the Cloud Storage mount path and then click Properties.
  3. Information on the mount path offline reason is displayed in the Offline Reason box.

Deleting the Contents of a Mount Path

The delete contents option can be used to logically delete the contents of a mount path. This operation deletes the data from the CommServe database. This operation does not make the disk space in the mount path available. A Data Aging operation must be run afterwards to make the disk space available. 

This option can be used to make media available in order to complete an important data protection job when there is no free space available in the library. The Delete Contents operation is recorded in the Audit Trail.

Use Extreme caution when you use this option. Once the contents of the mount path are deleted, they are not available for data recovery operations.

  1. From the CommCell Browser, expand to Storage Resources | Libraries | <Library>.
  2. Right-click the appropriate mount path, and then click Delete Contents.

    A warning message appears.

  3. Do either of the following:
    • Click Yes in the Warning prompt to continue.
    • Click No to stop the operation.
  4. In the Enter Confirmation text dialog box, type erase and reuse media.
  5. Click OK.

Hiding Libraries

You can hide libraries and prevent it from being displayed in the CommCell Console. When hidden the library will not be displayed under the Storage Resources node. In addition, the library will not be available for selection during other operations such as storage policy creation, data path selection, etc. This option is useful for hiding libraries that are waiting for data to be aged-off after being disabled for write. (The library can be deleted once all the data is aged. You can determine if a library contains valid data by running the Storage Information Report.)

  1. From the CommCell Browser, expand Storage Resources | Libraries.
  2. Right-click the appropriate library, click Properties and then select the Hide Library check box.

    The library will be hidden in the CommCell Browser.

Viewing Hidden Libraries

  1. From the ribbon in the CommCell Console, click the Storage tab, and then click Media Management.
  2. Click the Service Configuration tab.
  3. Navigate to the Show hidden libraries option and set the value to 1.

    Tip: Press F5 to refresh the CommCell Browser if the library continues to be visible.

    The hidden libraries will be visible in the CommCell Browser.

License Administration

Required Licenses

The following license is required for each MediaAgent that uses cloud storage libraries for data protection operations. This license is consumed when a cloud storage device is configured in the CommCell.

Component License Type License Consumption
Cloud Storage Cloud Storage 1 license per MediaAgent

Converting Evaluation Licenses to Permanent Licenses

For information on how to convert an evaluation license to a permanent license, see Converting Evaluation Licenses to Permanent for Specific Clients.

Using Capacity-Based Licensing

License Usage by Capacity is a licensing mechanism that allows you to obtain licenses based on the amount of data you back up. It provides the following features:

  • Flexibility of usage on all agents, rather than being tied to number of server, agents, etc.
  • Allows you to purchase licenses based on your data protection needs

Both Core and Enterprise license types are available. Refer to License Usage by Capacity for comprehensive information on utilizing this method.

Releasing a License

If you no longer require a license on a computer, such as cases where the computer is being retired, you can release the license and use it later for another computer. Backup data from the retired computer can still be restored after the license is released provided the data is not aged.

  1. From the CommCell Browser, right-click the name of the client from which you want to release a license, click All Tasks, and then click Release License for Client.
  2. Click OK to continue releasing the license
  3. Click Yes to confirm you want to release the license or No to abort.

Related Reports

The Library and Drive Report can be used to review the following information.

  • Name of the Cloud Storage server.
  • Amount of data uploaded to the cloud library.
  • Amount of data downloaded from the cloud library.

Use the following steps to generate Library and Drive Report :

  1. On the CommCell Console toolbar, click the Reports button. The Report Selection dialog box appears.
  2. From the Reports pane, select Library and Drive, and then click Run.

    The Library and Drive report appears in your default Web browser.