.TH "wavefront_master" 1 "" "CCTools 8.0.0 DEVELOPMENT" "Cooperative Computing Tools" .SH NAME .LP \fBwavefront_master\fP - executes Wavefront workflow in parallel on distributed systems .SH SYNOPSIS .LP \FC\fBwavefront [options] \fP\FT .SH DESCRIPTION .LP \fBwavefront_master\fP computes a two dimensional recurrence relation. You provide a function F (\fB\fP) that accepts the left (x), right (y), and diagonal (d) values and initial values (\fB\fP) for the edges of the matrix. The output matrix, whose size is determined by \fB\fP and \fB\fP, will be stored in a file specified by \fB\fP. .PP \fBwavefront_master\fP uses the Work Queue system to distribute tasks among processors. After starting \fBwavefront_master\fP, you must start a number of \fBwork_queue_worker(1)\fP processes on remote machines. The workers will then connect back to the master process and begin executing tasks. .SH OPTIONS .LP .LP .TP .B \ -h, --help . Show this help screen .TP .B \ -v, --version . Show version string .TP \fB-d\fP, \fB-\-debug\fP=\fI\fP . Enable debugging for this subsystem. (Try -d all to start.) .TP \fB-N\fP, \fB-\-project-name\fP=\fI\fP . Set the project name to .TP \fB-o\fP, \fB-\-debug-file\fP=\fI\fP . Write debugging output to this file. By default, debugging is sent to stderr (":stderr"). You may specify logs to be sent to stdout (":stdout") instead. .TP \fB-p\fP, \fB-\-port\fP=\fI\fP . Port number for queue master to listen on. .TP \fB-P\fP, \fB-\-priority\fP=\fI\fP . Priority. Higher the value, higher the priority. .TP \fB-Z\fP, \fB-\-port-file\fP=\fI\fP . Select port at random and write it to this file. (default is disabled) .TP .BI \ --work-queue-preferred-connection \ . Indicate preferred connection. Chose one of by_ip or by_hostname. (default is by_ip) .SH EXIT STATUS .LP On success, returns zero. On failure, returns non-zero. .SH EXAMPLES .LP Suppose you have a program named \FCfunction\FT that you want to use in the Wavefont workflow computation. The program \FCfunction\FT, when invoked as \FCfunction a b c\FT, should do some computations on files \FCa\FT, \FCb\FT and \FCc\FT and produce some output on the standard output. .PP Before running \fBwavefront_master\fP, you need to create a file, say \FCinput.data\FT, that lists initial values of the matrix (values on the left and bottom edges), one per line: .fam C .nf .nh .IP "" 8 0 0 value.0.0 0 1 value.0.1 ... 0 n value.0.n 1 0 value.1.0 2 0 value.2.0 ... n 0 value.n.0 .fi .hy .fam .P To run a Wavefront workflow sequentially, start a single \fBwork_queue_worker(1)\fP process in the background. Then, invoke \fBwavefront_master\fP. The following example computes a 10 by 10 Wavefront matrix: .fam C .nf .nh .IP "" 8 % work_queue_worker localhost 9123 & % wavefront_master function 10 10 input.data output.data .fi .hy .fam .P The framework will carry out the computations in the order of dependencies, and print the results one by one (note that the first two columns are X and Y indices in the resulting matrix) in the specified output file. Below is an example of what the output file - \FCoutput.data\FT would look like: .fam C .nf .nh .IP "" 8 1 1 value.1.1 1 2 value.1.2 1 3 value.1.3 ... .fi .hy .fam .P To speed up the process, run more \fBwork_queue_worker(1)\fP processes on other machines, or use \fBcondor_submit_workers(1)\fP or \fBsge_submit_workers(1)\fP to start hundreds of workers in your local batch system. .PP The following is an example of adding more workers to execute a Wavefront workflow. Suppose your \fBwavefront_master\fP is running on a machine named barney.nd.edu. If you have access to login to other machines, you could simply start worker processes on each one, like this: .fam C .nf .nh .IP "" 8 % work_queue_worker barney.nd.edu 9123 .fi .hy .fam .P If you have access to a batch system like Condor, you can submit multiple workers at once: .fam C .nf .nh .IP "" 8 % condor_submit_workers barney.nd.edu 9123 10 Submitting job(s).......... Logging submit event(s).......... 10 job(s) submitted to cluster 298. .fi .hy .fam .P .SH COPYRIGHT .LP The Cooperative Computing Tools are Copyright (C) 2005-2019 The University of Notre Dame. This software is distributed under the GNU General Public License. See the file COPYING for details. .SH SEE ALSO .LP .IP \(bu 4 The Cooperative Computing Tools (\fB"http://ccl.cse.nd.edu/software/manuals"\fP) .IP \(bu 4 Wavefront User Manual (\fB"http://ccl.cse.nd.edu/software/manuals/wavefront.html"\fP) .IP \(bu 4 Work Queue User Manual (\fB"http://ccl.cse.nd.edu/software/manuals/workqueue.html"\fP) .IP \(bu 4 \fBwork_queue_worker(1)\fP .IP \(bu 4 \fBcondor_submit_workers(1)\fP .IP \(bu 4 \fBsge_submit_workers(1)\fP