Idea ID: 1638649

Backup a single file system with multiple streams

Status: Accepted

Brief description:

While file systems continue to grow and the underlaying disk subsystems become faster the backups of large file systems are still one of the major concerns for traditional backup environments. The Data Protector Disk Agent should support multiple streams on a single file system that can be configured similar to device concurrency to drastically speed up the backup and the restore operation.

Picture1.png

Existing Enhancement Requests:

QCCR2A62413: Support multiple disk agents per volume

Benefit:

Reduce the complexitiy of subdividing file systems manually into smaller pieces. Optimize for backup and restore performance using multiple streams even on large file systems with millions of files and folders.

Tags:

Parents
  • will Block-Based-Backup do more than a single, sequential read?  If not, you're really not addressing the problem.  Yes, skipping the OS filesystem layer will yield a performance improvement, but not of the magnitude needed.  A block-based, single-stream, sequential read of an object measured in dozens of TB is still untenable.  Whether block-based or filesystem-based, the agent needs intelligence added to analyze the object to be backed up and dynamically execute a divide-and-conquer strategy.  I've been preaching this for more than a decade.  Thanks.

Comment
  • will Block-Based-Backup do more than a single, sequential read?  If not, you're really not addressing the problem.  Yes, skipping the OS filesystem layer will yield a performance improvement, but not of the magnitude needed.  A block-based, single-stream, sequential read of an object measured in dozens of TB is still untenable.  Whether block-based or filesystem-based, the agent needs intelligence added to analyze the object to be backed up and dynamically execute a divide-and-conquer strategy.  I've been preaching this for more than a decade.  Thanks.

Children
No Data