Data Multiplexing

Topics | How To | Related Topics


Overview

How Data Multiplexing Works

Configure for Data Multiplexing

Determining the Multiplexing Factor

Perform a Multiplexed Data Protection Operation

Impact of Data Multiplexing on Data Recovery Operations

Best Practices

License Requirement

Support Information - Storage Policy Copy


Overview

In a typical storage policy configuration, many clients/subclients can point to the same storage policy. Each storage policy copy has one or more streams related to the number of drives in a drive pool. On a particular stream, only one subclient can perform a data protection operation at any one time. The limit for the number of data protection operations that can go to any one stream is one. Therefore, only one data protection operation can be sent to a media/drive at any one time.

This limitation has its disadvantages. Backing up one client/subclient to a single piece of media does not fully utilize the drive's throughput, as the backing up of client data can be much slower than actual speeds of the tape.

In a large enterprise with many clients, many data protection operations may need to be performed within a fixed backup window. This may lead to high hardware requirement costs if the drive or media used for those data protection operations is being under utilized.

To optimally use the high speed tape drives available today, data from several clients/subclients can be multiplexed and written to media.

Chunk Size of Data That is Multiplexed

Multiplexed data chunk sizes are determined by the type of data that is being multiplexed; file system data and database data. 

Multiplexed data is aged when all jobs (multiplexed) on a single chunk have met the defined retention rules of their associated storage policy copy.


How Data Multiplexing Works

During a data protection operation, agent data is transferred to media over a data pipeline. This data is transferred by data movers that read agent data then write the data to the media.

During data multiplexing, many such data movers must read and write data to the same piece of media. To achieve this, these data movers are comprised of two components, data receivers and data writers. During data multiplexing, one data receiver per backup stream reads the data coming through the data pipeline. One data writer per media receives data from multiple data receivers then writes data to the media.

In the sample image that follows, Subclient_A and Subclient_B are being backed up at the same time and their data is being multiplexed. Multiple data receivers read the data and then one data writer writes the data to a single piece of media.


Configuring for Data Multiplexing

To configure your subclients to use this feature, data multiplexing must be enabled from the Media tab of the Copy Properties dialog box of the primary copy.

For example, if three subclients of this storage policy are to be backed up in a multiplexed manner, then the multiplexing factor would be set to three.


Determining the Multiplexing Factor

The multiplexing factor should be determined by analyzing your network configuration and by examining your needs for maximizing disk throughput to decrease the total amount of time it takes to protect your data. The multiplexing factor is determined by the following:

The following examples will help you determine the multiplexing factor. Keep in mind that these are only hypothetical examples.

  1. Let's analyze a network configuration that involves three clients, without and with multiplexing.
  2. What happens when a fourth client is added to the example and the multiplexing factor is set to four.
  3. A fifth client is added, and the multiplexing factor is set to five, is this over-multiplexing?
  4. If you have over-multiplexed, either set the multiplexing factor lower and multiplex less clients, or add some gigabit Ethernet switches to your network.
  5. In another example, client disk speeds are fast and they become slower after multiplexing.

Note that the maximum multiplexing factor that can be set from the CommCell Console is 10 and the system displays a warning message when the multiplexing factor is set to 5 or above.


Perform a Multiplexed Data Protection Operation

Once the multiplexing factor is set on the primary copy of the storage policy whose subclients are to be backed up, all data protection operations of the storage policy can run at the same time, to the same piece of media.

In the sample image that follows, Job IDs 142, 140, and 141 are all backing up to Lib_Drive1.

Perform Data Multiplexing Using a Magnetic Library

Data Multiplexing can be performed on a magnetic library by setting the maximum number of streams on the magnetic storage policy to a value equal to the number of data protection operations that are to be performed simultaneously. For more information on setting the number of data streams, see Storage Policy Copy Properties.

De-Multiplexing Multiplexed Data

De-multiplexing segregates/de-multiplexes the data for selected clients/subclients from the larger list of clients. The software does not require de-multiplexing; however, if you want to de-multiplex the data that you have multiplexed, you can create a subclient-based storage policy copy for each subclient within the original storage policy copy, and then perform an auxiliary copy operation on that copy.

Be sure to adhere to Best Practices when using the data multiplexing feature.


Multiplexing and Data Streams

Data Multiplexing is performed differently based on whether or not you are performing multiple stream data protection operations.

Data Multiplexing With Single Stream Data Protection Operations

In the following example, J1, J2, J3,and J4 have been run as single stream data protection operations. There are two drives available, D1, and D2.

If there is no data multiplexing:

J1 will use D1, J2 will use D2. J3,and J4 will go into a waiting state until J1 and J2 have completed.

If data multiplexing was used with a multiplexing factor of two:

J1 and J2 will use D1. J3 and J4 will use D2.

Data Multiplexing With Multiple Stream Data Protection Operations

The following examples illustrate data multiplexing with data protection operations that use multiple streams.

Data Multiplexing with File System Multiple Stream Data Protection Operations

In the following example, there are two jobs, J1 and J2. Each job was run with three streams. There are two drives, D1 and D2.

If there is no data multiplexing:

J1 has three streams, and each stream uses D1, but they run one after another.

J2 also has three streams, and each stream uses D2, and they also run one after another.

If there is data multiplexing with a multiplexing factor of three:

The three streams of J1 can run concurrently to D1.

The three streams of J2 can run concurrently to D2.

Data Multiplexing with Database Multi Streaming

In the following example, a three stream database data protection operation is performed with a multiplexing factor of three. J1, J2, and J3 are database data protection operations, and each used three streams. There are three drives available, D1, D2, and D3.

If there is no data multiplexing:

D1 - J1

D2 - J1

D3 - J1

The second and third job (J2 and J3) must wait for the necessary resources.

If there is data multiplexing with a multiplexing factor of three.

The first job (J1) uses three drives, D1, D2, and D3:

D1 - J1

D2 - J1

D3 - J1

The second and third job (J2 and J3) are multiplexed and use the same drives as J1:

D1 - J1, J2, J3

D2 - J1, J2, J3

D3 - J1, J2, J3

Therefore, J1, J2, and J3 use D1, D2, and D3 in parallel.


Impact of Data Multiplexing on Data Recovery Operations

The following data recovery operations can be performed on multiplexed data without significant degradation of performance:


Best Practices

It is recommended that you keep the following in mind when performing data multiplexing:


License Requirement

This feature requires a Feature License to be available in the CommServe.

Review general license requirements included in License Administration. Also, View All Licenses provides step-by-step instructions on how to view the license information.


Back to Top