HDFS Sync

Download, configure, and deploy

Ingest data from one HDFS cluster to another

The HDFS to HDFS Sync Application Template continuously ingests files as blocks from one Hadoop cluster to another, retaining one-to-one file traceability.

Features of the enterprise-grade application template include these advantages:

  • The application scales linearly with the number of block readers.
  • The application is fault-tolerant and can withstand node and cluster outages without data loss.
  • Highly performant, the application can perform as fast as network bandwidth allows.
  • Configuration is simple: users need only provide source and destination HDFS paths.
  • Dramatic reduction in time-to-market and cost of operations.

 

Download the application template and launch it to ingest data from one Hadoop cluster to another. Follow the tutorial videos or walkthrough document to launch and run the template.

Get Started

Import, configure, and launch application template