Optimized Incremental Scans Using Qumulo Native Change File Tracking APIs

Qumulo REST APIs provide capabilities for optimized scan and backup performance.

Qumulo REST APIs

Qumulo REST APIs provide the following capabilities for optimized scan and backup performance:

  • An incremental scan operation creates snapshots and performs change file tracking.

  • A Change File Tracking operation determines which files changed between the previous and current backup snapshots. This requires inbound access to TCP 8000 on the Qumulo devices.

  • The scan and backup operations read data from the snapshots, to shift load from production data shares. To offload production data shares, two snapshots are created and retained: one for the current backup operation and the other for the previous backup operation.

Performance Metrics for Regular and Qumulo Operations

File count: 100 million

File size: Mixed file size

The following tables compare performance metrics between regular scans and Qumulo scans of CIFS share and NFS export snapshots, of new files and modified files.

CIFS

Backup type

Items

Regular scan time

Qumulo CFT scan time

Full

Not applicable

02:31:00

02:39:00

Incremental

1 million, modified files

00:58:00

00:30:00

Incremental

1 million, new files under a new folder

01:20:00

00:03:40

NFS

Backup type

Items

Regular scan time

Qumulo CFT scan time

Full

Not applicable

05:04:00

03:07:00

Incremental

1 million, modified files

07:02:00

00:37:00

Incremental

1 million, new files under 1000 new folders

07:13:00

00:15:00

Loading...