Idea ID: 1638649

Backup a single file system with multiple streams

Status: Accepted

Brief description:

While file systems continue to grow and the underlaying disk subsystems become faster the backups of large file systems are still one of the major concerns for traditional backup environments. The Data Protector Disk Agent should support multiple streams on a single file system that can be configured similar to device concurrency to drastically speed up the backup and the restore operation.

Picture1.png

Existing Enhancement Requests:

QCCR2A62413: Support multiple disk agents per volume

Benefit:

Reduce the complexitiy of subdividing file systems manually into smaller pieces. Optimize for backup and restore performance using multiple streams even on large file systems with millions of files and folders.

Tags:

Parents
  • Hi Shishir, Hi antaln,

    Thanks for your questions. I had to think about this for a few days.

     is right, having a multi-thread only implementation for backing up data has benefits. It would allow us to maintain the single object for each drive or mount point that can be directly presented in the GUI for restore and taken into consideration for Object Copy and Consolidation. The biggest disadvantage is that it does not cover the restore part where a multi-thread operation does not offer any advantage. Usually the backup media is sequential.

    Only a multi-stream solution offers benefits on backup and restore since Data Protector can restore from multiplexed media or multiple drives at the same time. Having multiple sub-objects would also allow Object Copy and Consolidation to scale with the number objects. In any case this must be transparent to the user. The individual parts of the multi-stream backup object must mapped into a single logical object (e.g. use the same description of each sub-object).

    Regards,
    Sebastian Koehler

Comment
  • Hi Shishir, Hi antaln,

    Thanks for your questions. I had to think about this for a few days.

     is right, having a multi-thread only implementation for backing up data has benefits. It would allow us to maintain the single object for each drive or mount point that can be directly presented in the GUI for restore and taken into consideration for Object Copy and Consolidation. The biggest disadvantage is that it does not cover the restore part where a multi-thread operation does not offer any advantage. Usually the backup media is sequential.

    Only a multi-stream solution offers benefits on backup and restore since Data Protector can restore from multiplexed media or multiple drives at the same time. Having multiple sub-objects would also allow Object Copy and Consolidation to scale with the number objects. In any case this must be transparent to the user. The individual parts of the multi-stream backup object must mapped into a single logical object (e.g. use the same description of each sub-object).

    Regards,
    Sebastian Koehler

Children
No Data