table of contents
GFPCOPY(1) | Gfarm | GFPCOPY(1) |
NAME¶
gfpcopy - copy Gfarm files in parallelSYNOPSIS¶
gfpcopy [-nqvdpPU] [-X regexp] [-S source-domainname] [-h source-hostfile] [-D destination-domainname] [-H destination-hostfile] [-j num-of-processes] [-J num-of-processes] [-M limit-byte] [-z minimum-byte] [-Z maximum-byte] [-w way-of-scheduling] [-W kilobytes-for-threshold] [-s KB/s-to-simulate] [-F num-for-readahead] [-b bufsize] [-f] [-e] [-k] source-path destination-path
DESCRIPTION¶
gfpcopy copies files in parallel.When the source-path parameter is a directory, files under the directory will be copied recursively.
When the destination-path does not exist, the directory is created. When the destination-path exists, a directry of the same name as the source-path is created under the destination-path.
A set of source/destination hosts can be specified by a domain name and/or a hostlist file. When both a domain name and a hostlist file are specified, a set of hosts is determined by both conditions. When a set of source hosts is specified, only files stored on the source hosts are cppied. When a set of source hosts are specified, only files stored on the set of source hosts are copied. A set of hosts can be specified by a domain name and/or a host file. When both a domain name and a host file are specified, a set of hosts is determined by both conditions.
gfpcopy can also read the directory and get information of the entries in parallel.
SOURCE PATH¶
source-path must be following format. Files on HPSS cannot be copied.gfarm:...
file:...
ANY
DESTINATION PATH¶
destination-path must be following format.gfarm:...
file:...
hpss:...
ANY
GFPCOPY OPTIONS¶
These are the options only for gfpcopy.-b bufsize
The default value is 64KiB (64 * 1024).
-f
Without -f option, existing destination files will be overwritten when that they are older than the corresponding source files in the modification time.
-e
-k
COMMON OPTIONS¶
gfpcopy has the same options with gfprep. (see man gfprep)EXAMPLES¶
To copy files under the directory recursively.$ gfpcopy gfarm:///dir file:///tmp/dir
$ gfpcopy file:///tmp/dir gfarm:///dir
$ gfpcopy gfarm:///dir1 gfarm:///dir2
$ gfpcopy gfarm:///dir hpss:///tmp/dir
$ cd /mnt/gfarm2fs $ gfpcopy dir /tmp/dir
To copy a file.
$ gfpcopy gfarm:///dir/file file:///dir
$ cd /mnt/gfarm2fs $ gfpcopy file /tmp/dir
NOTES¶
If the gfmd and gfpcopy are far apart, the gfpcopy operation is slow. Specifying a large value by -j or -J options may be effective in such a case.SEE ALSO¶
gfprep(1), gfreg(1), gfexport(1), gfarm2.conf(5)27 Aug 2015 | Gfarm |