.\" Automatically generated by Pod::Man 4.14 (Pod::Simple 3.40) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" Set up some character translations and predefined strings. \*(-- will .\" give an unbreakable dash, \*(PI will give pi, \*(L" will give a left .\" double quote, and \*(R" will give a right double quote. \*(C+ will .\" give a nicer C++. Capital omega is used to do unbreakable dashes and .\" therefore won't be available. \*(C` and \*(C' expand to `' in nroff, .\" nothing in troff, for use with C<>. .tr \(*W- .ds C+ C\v'-.1v'\h'-1p'\s-2+\h'-1p'+\s0\v'.1v'\h'-1p' .ie n \{\ . ds -- \(*W- . ds PI pi . if (\n(.H=4u)&(1m=24u) .ds -- \(*W\h'-12u'\(*W\h'-12u'-\" diablo 10 pitch . if (\n(.H=4u)&(1m=20u) .ds -- \(*W\h'-12u'\(*W\h'-8u'-\" diablo 12 pitch . ds L" "" . ds R" "" . ds C` "" . ds C' "" 'br\} .el\{\ . ds -- \|\(em\| . ds PI \(*p . ds L" `` . ds R" '' . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is >0, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{\ . if \nF \{\ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{\ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" .\" Accent mark definitions (@(#)ms.acc 1.5 88/02/08 SMI; from UCB 4.2). .\" Fear. Run. Save yourself. No user-serviceable parts. . \" fudge factors for nroff and troff .if n \{\ . ds #H 0 . ds #V .8m . ds #F .3m . ds #[ \f1 . ds #] \fP .\} .if t \{\ . ds #H ((1u-(\\\\n(.fu%2u))*.13m) . ds #V .6m . ds #F 0 . ds #[ \& . ds #] \& .\} . \" simple accents for nroff and troff .if n \{\ . ds ' \& . ds ` \& . ds ^ \& . ds , \& . ds ~ ~ . ds / .\} .if t \{\ . ds ' \\k:\h'-(\\n(.wu*8/10-\*(#H)'\'\h"|\\n:u" . ds ` \\k:\h'-(\\n(.wu*8/10-\*(#H)'\`\h'|\\n:u' . ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'^\h'|\\n:u' . ds , \\k:\h'-(\\n(.wu*8/10)',\h'|\\n:u' . ds ~ \\k:\h'-(\\n(.wu-\*(#H-.1m)'~\h'|\\n:u' . ds / \\k:\h'-(\\n(.wu*8/10-\*(#H)'\z\(sl\h'|\\n:u' .\} . \" troff and (daisy-wheel) nroff accents .ds : \\k:\h'-(\\n(.wu*8/10-\*(#H+.1m+\*(#F)'\v'-\*(#V'\z.\h'.2m+\*(#F'.\h'|\\n:u'\v'\*(#V' .ds 8 \h'\*(#H'\(*b\h'-\*(#H' .ds o \\k:\h'-(\\n(.wu+\w'\(de'u-\*(#H)/2u'\v'-.3n'\*(#[\z\(de\v'.3n'\h'|\\n:u'\*(#] .ds d- \h'\*(#H'\(pd\h'-\w'~'u'\v'-.25m'\f2\(hy\fP\v'.25m'\h'-\*(#H' .ds D- D\\k:\h'-\w'D'u'\v'-.11m'\z\(hy\v'.11m'\h'|\\n:u' .ds th \*(#[\v'.3m'\s+1I\s-1\v'-.3m'\h'-(\w'I'u*2/3)'\s-1o\s+1\*(#] .ds Th \*(#[\s+2I\s-2\h'-\w'I'u*3/5'\v'-.3m'o\v'.3m'\*(#] .ds ae a\h'-(\w'a'u*4/10)'e .ds Ae A\h'-(\w'A'u*4/10)'E . \" corrections for vroff .if v .ds ~ \\k:\h'-(\\n(.wu*9/10-\*(#H)'\s-2\u~\d\s+2\h'|\\n:u' .if v .ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'\v'-.4m'^\v'.4m'\h'|\\n:u' . \" for low resolution devices (crt and lpr) .if \n(.H>23 .if \n(.V>19 \ \{\ . ds : e . ds 8 ss . ds o a . ds d- d\h'-1'\(ga . ds D- D\h'-1'\(hy . ds th \o'bp' . ds Th \o'LP' . ds ae ae . ds Ae AE .\} .rm #[ #] #H #V #F C .\" ======================================================================== .\" .IX Title "PUBLIC-INBOX-XCPDB 1" .TH PUBLIC-INBOX-XCPDB 1 "1993-10-02" "public-inbox.git" "public-inbox user manual" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH "NAME" public\-inbox\-xcpdb \- upgrade Xapian DB formats .SH "SYNOPSIS" .IX Header "SYNOPSIS" public-inbox-xcpdb [\s-1OPTIONS\s0] \s-1INBOX_DIR\s0 .PP public-inbox-xcpdb [\s-1OPTIONS\s0] \-\-all .SH "DESCRIPTION" .IX Header "DESCRIPTION" public-inbox-xcpdb is similar to \fBcopydatabase\fR\|(1) for upgrading to the latest database format supported by Xapian (e.g. \*(L"glass\*(R" or \*(L"honey\*(R"), but is designed to tolerate and accept parallel Xapian database modifications from \&\fBpublic\-inbox\-watch\fR\|(1), \fBpublic\-inbox\-mda\fR\|(1), \&\fBpublic\-inbox\-learn\fR\|(1), and \fBpublic\-inbox\-index\fR\|(1). .PP This command is rarely used, as Xapian \s-1DB\s0 formats rarely change. .SH "OPTIONS" .IX Header "OPTIONS" .IP "\-\-all" 4 .IX Item "--all" Copy all inboxes configured in ~/.public\-inbox/config. This is an alternative to specifying individual inboxes directories on the command-line. .IP "\-c" 4 .IX Item "-c" .PD 0 .IP "\-\-compact" 4 .IX Item "--compact" .PD In addition to performing the copy operation, run \fBxapian\-compact\fR\|(1) on each Xapian shard after copying but before finalizing it. Compared to the cost of copying a Xapian database, compacting a Xapian database takes only around 5% of the time required to copy. .Sp Compared to \fBpublic\-inbox\-compact\fR\|(1), use of this option is preferable for gigantic inboxes where the coarse-grained lock currently required for \fBpublic\-inbox\-compact\fR\|(1) can cause the compaction to take hours at-a-time. .IP "\-R N" 4 .IX Item "-R N" .PD 0 .IP "\-\-reshard=N" 4 .IX Item "--reshard=N" .PD Reshard the Xapian database on a v2 inbox to \f(CW\*(C`N\*(C'\fR shards . Since \fBxapian\-compact\fR\|(1) is not suitable for merging, users can rely on this switch to reshard the existing Xapian database(s) to any positive value of \f(CW\*(C`N\*(C'\fR. .Sp This is useful in case the Xapian \s-1DB\s0 was created with too few or too many shards given the capabilities of the current hardware. .IP "\-\-blocksize" 4 .IX Item "--blocksize" .PD 0 .IP "\-\-no\-full" 4 .IX Item "--no-full" .IP "\-\-fuller" 4 .IX Item "--fuller" .PD These options are passed directly to \fBxapian\-compact\fR\|(1) when used with \f(CW\*(C`\-\-compact\*(C'\fR. .IP "\-\-no\-fsync" 4 .IX Item "--no-fsync" Disable \fBfsync\fR\|(2) and \fBfdatasync\fR\|(2). See \*(L"\-\-no\-fsync\*(R" in \fBpublic\-inbox\-index\fR\|(1) for caveats. .Sp Available in public-inbox 1.6.0+. .IP "\-\-sequential\-shard" 4 .IX Item "--sequential-shard" Copy each shard sequentially, ignoring \f(CW\*(C`\-\-jobs\*(C'\fR. This also affects indexing done at the end of a run. .IP "\-\-batch\-size=BYTES" 4 .IX Item "--batch-size=BYTES" .PD 0 .IP "\-\-max\-size=BYTES" 4 .IX Item "--max-size=BYTES" .PD See \fBpublic\-inbox\-index\fR\|(1) for a description of these options. .Sp These indexing options indexing at the end of a run. \&\f(CW\*(C`public\-inbox\-xcpdb\*(C'\fR may run in parallel with with \&\fBpublic\-inbox\-index\fR\|(1), and \f(CW\*(C`public\-inbox\-xcpdb\*(C'\fR needs to reindex changes made to the old Xapian DBs by \&\fBpublic\-inbox\-index\fR\|(1) while it was running. .SH "ENVIRONMENT" .IX Header "ENVIRONMENT" .IP "\s-1PI_CONFIG\s0" 8 .IX Item "PI_CONFIG" The default config file, normally \*(L"~/.public\-inbox/config\*(R". See \fBpublic\-inbox\-config\fR\|(5) .IP "\s-1XAPIAN_FLUSH_THRESHOLD\s0" 8 .IX Item "XAPIAN_FLUSH_THRESHOLD" The number of documents to update before committing changes to disk. This environment is handled directly by Xapian, refer to Xapian \s-1API\s0 documentation for more details. .Sp Default: 10000 .SH "UPGRADING" .IX Header "UPGRADING" This tool is intended for admins upgrading Xapian search databases used by public-inbox, \s-1NOT\s0 users upgrading public-inbox itself. .PP In particular, it \s-1DOES NOT\s0 upgrade the schema used by the \&\s-1PSGI\s0 search interface (see \fBpublic\-inbox\-index\fR\|(1)). .SH "LIMITATIONS" .IX Header "LIMITATIONS" Do not use \fBpublic\-inbox\-purge\fR\|(1) or \fBpublic\-inbox\-edit\fR\|(1) while this is running; old (purged or edited data) may show up. .PP Normal invocations \fBpublic\-inbox\-index\fR\|(1) can safely run while this is running, too. However, reindexing via the \&\*(L"\-\-reindex\*(R" in \fBpublic\-inbox\-index\fR\|(1) switch will be a waste of computing resources. .SH "CONTACT" .IX Header "CONTACT" Feedback welcome via plain-text mail to .PP The mail archives are hosted at and .SH "COPYRIGHT" .IX Header "COPYRIGHT" Copyright 2019\-2021 all contributors .PP License: \s-1AGPL\-3.0+\s0 .SH "SEE ALSO" .IX Header "SEE ALSO" \&\fBcopydatabase\fR\|(1), \fBxapian\-compact\fR\|(1), \fBpublic\-inbox\-index\fR\|(1)