NAME¶gfpcopy - copy Gfarm files in parallel
gfpcopy [-nqvdpPU] [-X regexp] [-S source-domainname] [-h source-hostfile] [-D destination-domainname] [-H destination-hostfile] [-j num-of-processes] [-J num-of-processes] [-M limit-byte] [-z minimum-byte] [-Z maximum-byte] [-w way-of-scheduling] [-W kilobytes-for-threshold] [-s KB/s-to-simulate] [-F num-for-readahead] [-b bufsize] [-f] [-e] [-k] source-path destination-path
DESCRIPTION¶gfpcopy copies files in parallel.
When the source-path parameter is a directory, files under the directory will be copied recursively.
When the destination-path does not exist, the directory is created. When the destination-path exists, a directry of the same name as the source-path is created under the destination-path.
A set of source/destination hosts can be specified by a domain name and/or a hostlist file. When both a domain name and a hostlist file are specified, a set of hosts is determined by both conditions. When a set of source hosts is specified, only files stored on the source hosts are cppied. When a set of source hosts are specified, only files stored on the set of source hosts are copied. A set of hosts can be specified by a domain name and/or a host file. When both a domain name and a host file are specified, a set of hosts is determined by both conditions.
gfpcopy can also read the directory and get information of the entries in parallel.
SOURCE PATH¶source-path must be following format. Files on HPSS cannot be copied.
DESTINATION PATH¶destination-path must be following format.
GFPCOPY OPTIONS¶These are the options only for gfpcopy.
The default value is 64KiB (64 * 1024).
Without -f option, existing destination files will be overwritten when that they are older than the corresponding source files in the modification time.
COMMON OPTIONS¶gfpcopy has the same options with gfprep. (see man gfprep)
EXAMPLES¶To copy files under the directory recursively.
$ cd /mnt/gfarm2fs $ gfpcopy dir /tmp/dir
To copy a file.
$ cd /mnt/gfarm2fs $ gfpcopy file /tmp/dir
NOTES¶If the gfmd and gfpcopy are far apart, the gfpcopy operation is slow. Specifying a large value by -j or -J options may be effective in such a case.
SEE ALSO¶gfprep(1), gfreg(1), gfexport(1), gfarm2.conf(5)
|27 Aug 2015||Gfarm|