NAME¶
batcher - Article batching for InterNetNews
SYNOPSIS¶
batcher [
-rv] [
-a articles] [
-A
total-articles] [
-b size] [
-B total-size]
[
-i string] [
-N batches] [
-p
process] [
-s separator]
host [
input]
DESCRIPTION¶
batcher reads a list of files and prepares news batches for the specified
host. It is generally used to prepare UUCP feeds, but the resulting batches
can be used by any application that uses
rnews(8) to inject the
articles. It is normally invoked by a script run out of cron that uses
shlock to lock the host, followed by
ctlinnd to flush the batch
file. See
send-uucp(8) for a front-end for
batcher.
batcher reads the file
input, or standard input if no file is
given. If
input is a relative file name, it is assumed to be in
pathoutgoing as set in
inn.conf. Blank lines and lines starting
with a number sign ("#") are ignored. All other lines in the input
should consist of one or two fields separated by a single space. The first
field is the storage API token of an article. The second field, if present,
specifies the size of the article in bytes.
By default, batches are written to standard output (which isn't very useful if
more than one batch is output), but see the
-p option.
OPTIONS¶
- -a articles
- This flag limits the number of articles included in each batch. The
default is no limit. A new batch will be started when either the total
bytes or the number of articles written exceeds the specified limits.
- -A total-articles
- Limits the total number of articles written for all batches. As soon as
the total number of articles written to batches reaches or exceeds
total-articles, all additional articles in the input will be
deferred. The default is no limit.
- -b size
- This flag sets the size limit for each batch; as soon as at least this
much data has been written out, a new batch will be started. The default
size is 60 KB. Using "-b 0" will allow unlimited batch
sizes.
- -B total-size
- Limits the total number of bytes written for all batches. As soon as the
total bytes written to batches reaches or exceeds total-size, all
additional articles in the input will be deferred. The default is no
limit.
- -i string
- A batch starts with an identifying line to specify the unpacking method to
be used on the receiving end. When this flag is used, string,
followed by a newline, will be output at the start of each batch. The
default is to have no initial string (under the assumption that either the
processor specified with the -p flag or some other later process
will add the appropriate line).
- -N batches
- Limits the total number of batches written. As soon as the number of
batches written reaches or exceeds batches, all additional articles
in the input will be deferred. The default is no limit.
- -p process
- By default, batches are written to standard output, which is not useful
when more than one output batch is created. If this option is given, each
batch will instead be fed via a pipe to the shell command process.
The process argument must be an sprintf(3) format string,
which may have a single %s parameter that will be replaced with the host
name.
A common value is:
( echo '#! gunbatch' ; exec gzip -c ) | uux - -r -z %s!rnews
which generates gzip-compressed batches and feeds them to uux.
- -r
- By default, batcher reports errors to pathlog/errlog. To
suppress this redirection and report errors to standard error, use the
-r flag.
- -s separator
- Each article in a batch starts with a separator line that indicates the
size of the article. separator must be an sprintf(3) string,
which may have a single %ld in the string that will be replaced with the
size of the article. If the separator is not empty, a newline will also be
appended to it when it is added to the beginning of each article.
The default separator is:
#! rnews %ld
and this should rarely be changed.
- -v
- Upon exit, batcher reports statistics via syslog. With this flag,
the statistics will also be printed to standard output.
EXIT STATUS¶
If the input is exhausted and all batches are created successfully,
batcher will exit with a zero status.
If any of the limits specified with
-A,
-B, or
-N flags are
reached, or if there is an error in writing a batch,
batcher will try
to spool the remaining input by copying it to a file as follows:
- •
- If there was no input filename, the remaining input will be copied to
pathoutgoing/ host.
- •
- If an input filename was given, the remaining input will be copied to a
temporary file named by appending ".bch" to the end of
input (and qualified by adding pathoutgoing if input
was not a fully qualified path). If this happens successfully,
batcher will then try to rename this temporary file to input
(thus replacing input with a copy of itself with all of lines for
the successfully batched articles removed).
Upon receipt of an interrupt or termination signal,
batcher will finish
batching the current article, close the batch, and then rewrite the batch file
as described above.
HISTORY¶
Written by Rich $alz <rsalz@uunet.uu.net> for InterNetNews. Rewritten by
Russ Allbery <rra@stanford.edu> in POD.
$Id: batcher.pod 8774 2009-11-15 09:23:27Z iulius $
SEE ALSO¶
ctlinnd(8),
inn.conf(5),
newsfeeds(5),
rnews(8),
send-uucp(8),
shlock(1).