.\" Automatically generated by Pod::Man 2.28 (Pod::Simple 3.28) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" Set up some character translations and predefined strings. \*(-- will .\" give an unbreakable dash, \*(PI will give pi, \*(L" will give a left .\" double quote, and \*(R" will give a right double quote. \*(C+ will .\" give a nicer C++. Capital omega is used to do unbreakable dashes and .\" therefore won't be available. \*(C` and \*(C' expand to `' in nroff, .\" nothing in troff, for use with C<>. .tr \(*W- .ds C+ C\v'-.1v'\h'-1p'\s-2+\h'-1p'+\s0\v'.1v'\h'-1p' .ie n \{\ . ds -- \(*W- . ds PI pi . if (\n(.H=4u)&(1m=24u) .ds -- \(*W\h'-12u'\(*W\h'-12u'-\" diablo 10 pitch . if (\n(.H=4u)&(1m=20u) .ds -- \(*W\h'-12u'\(*W\h'-8u'-\" diablo 12 pitch . ds L" "" . ds R" "" . ds C` "" . ds C' "" 'br\} .el\{\ . ds -- \|\(em\| . ds PI \(*p . ds L" `` . ds R" '' . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is turned on, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{ . if \nF \{ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" .\" Accent mark definitions (@(#)ms.acc 1.5 88/02/08 SMI; from UCB 4.2). .\" Fear. Run. Save yourself. No user-serviceable parts. . \" fudge factors for nroff and troff .if n \{\ . ds #H 0 . ds #V .8m . ds #F .3m . ds #[ \f1 . ds #] \fP .\} .if t \{\ . ds #H ((1u-(\\\\n(.fu%2u))*.13m) . ds #V .6m . ds #F 0 . ds #[ \& . ds #] \& .\} . \" simple accents for nroff and troff .if n \{\ . ds ' \& . ds ` \& . ds ^ \& . ds , \& . ds ~ ~ . ds / .\} .if t \{\ . ds ' \\k:\h'-(\\n(.wu*8/10-\*(#H)'\'\h"|\\n:u" . ds ` \\k:\h'-(\\n(.wu*8/10-\*(#H)'\`\h'|\\n:u' . ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'^\h'|\\n:u' . ds , \\k:\h'-(\\n(.wu*8/10)',\h'|\\n:u' . ds ~ \\k:\h'-(\\n(.wu-\*(#H-.1m)'~\h'|\\n:u' . ds / \\k:\h'-(\\n(.wu*8/10-\*(#H)'\z\(sl\h'|\\n:u' .\} . \" troff and (daisy-wheel) nroff accents .ds : \\k:\h'-(\\n(.wu*8/10-\*(#H+.1m+\*(#F)'\v'-\*(#V'\z.\h'.2m+\*(#F'.\h'|\\n:u'\v'\*(#V' .ds 8 \h'\*(#H'\(*b\h'-\*(#H' .ds o \\k:\h'-(\\n(.wu+\w'\(de'u-\*(#H)/2u'\v'-.3n'\*(#[\z\(de\v'.3n'\h'|\\n:u'\*(#] .ds d- \h'\*(#H'\(pd\h'-\w'~'u'\v'-.25m'\f2\(hy\fP\v'.25m'\h'-\*(#H' .ds D- D\\k:\h'-\w'D'u'\v'-.11m'\z\(hy\v'.11m'\h'|\\n:u' .ds th \*(#[\v'.3m'\s+1I\s-1\v'-.3m'\h'-(\w'I'u*2/3)'\s-1o\s+1\*(#] .ds Th \*(#[\s+2I\s-2\h'-\w'I'u*3/5'\v'-.3m'o\v'.3m'\*(#] .ds ae a\h'-(\w'a'u*4/10)'e .ds Ae A\h'-(\w'A'u*4/10)'E . \" corrections for vroff .if v .ds ~ \\k:\h'-(\\n(.wu*9/10-\*(#H)'\s-2\u~\d\s+2\h'|\\n:u' .if v .ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'\v'-.4m'^\v'.4m'\h'|\\n:u' . \" for low resolution devices (crt and lpr) .if \n(.H>23 .if \n(.V>19 \ \{\ . ds : e . ds 8 ss . ds o a . ds d- d\h'-1'\(ga . ds D- D\h'-1'\(hy . ds th \o'bp' . ds Th \o'LP' . ds ae ae . ds Ae AE .\} .rm #[ #] #H #V #F C .\" ======================================================================== .\" .IX Title "XML_SPLIT 1p" .TH XML_SPLIT 1p "2012-05-17" "perl v5.20.1" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH "NAME" .Vb 1 \& xml_split \- cut a big XML file into smaller chunks .Ve .SH "DESCRIPTION" .IX Header "DESCRIPTION" \&\f(CW\*(C`xml_split\*(C'\fR takes a (presumably big) \s-1XML\s0 file and split it in several smaller files. The memory used is the memory needed for the biggest chunk (ie memory is reused for each new chunk). .PP It can split at a given level in the tree (the default, splits children of the root), or on a condition (using the subset of XPath understood by XML::Twig, so \f(CW\*(C`section\*(C'\fR or \f(CW\*(C`/doc/section\*(C'\fR). .PP Each generated file is replaced by a processing instruction that will allow \&\f(CW\*(C`xml_merge\*(C'\fR to rebuild the original document. The processing instruction format is \f(CW\*(C` ?>\*(C'\fR .PP File names are \-.xml, with \-00.xml holding the main document. .SH "OPTIONS" .IX Header "OPTIONS" .IP "\-l " 4 .IX Item "-l " level to cut at: 1 generates a file for each child of the root, 2 for each grand child .Sp defaults to 1 .IP "\-c " 4 .IX Item "-c " generate a file for each element that passes the condition .Sp xml_split \-c
will put each \f(CW\*(C`section\*(C'\fR element in its own file (nested sections are handled too) .Sp Note that at the moment this option is a lot slower than using \f(CW\*(C`\-l\*(C'\fR .IP "\-s " 4 .IX Item "-s " generates files of (approximately) . The content of each file is enclosed in a new element (\f(CW\*(C`xml_split::root\*(C'\fR), so it's well-formed \s-1XML.\s0 The size can be given in bytes, Kb, Mb or Gb. .IP "\-g " 4 .IX Item "-g " groups elements in a single file. The content of each file is enclosed in a new element (\f(CW\*(C`xml_split::root\*(C'\fR), so it's well-formed \s-1XML.\s0 .IP "\-b " 4 .IX Item "-b " base name for the output, files will be named \-<.ext> .Sp is a sequence number, see below \f(CW\*(C`\-\-nb_digits\*(C'\fR is an extension, see below \f(CW\*(C`\-\-extension\*(C'\fR .Sp defaults to the original file name (if available) or \f(CW\*(C`out\*(C'\fR (if input comes from the standard input) .IP "\-n " 4 .IX Item "-n " number of digits in the sequence number for each file .Sp if more digits than are needed, then they are used: if \f(CW\*(C`\-\-nb_digits 2\*(C'\fR is used and 112 files are generated they will be named \f(CW\*(C`\-01.xml\*(C'\fR to \f(CW\*(C`\-112.xml\*(C'\fR .Sp defaults to 2 .IP "\-e " 4 .IX Item "-e " extension to use for generated files .Sp defaults to the original file extension or \f(CW\*(C`.xml\*(C'\fR .IP "\-i" 4 .IX Item "-i" use XInclude elements instead of Processing Instructions to mark where sub files need to be included .IP "\-v" 4 .IX Item "-v" verbose output .Sp Note that this option can slow down processing considerably (by an order of magnitude) when generating lots of small documents .IP "\-V" 4 .IX Item "-V" outputs version and exit .IP "\-h" 4 .IX Item "-h" short help .IP "\-m" 4 .IX Item "-m" man (requires pod2text to be in the path) .SH "EXAMPLES" .IX Header "EXAMPLES" .Vb 4 \& xml_split foo.xml # split at level 1 \& xml_split \-l 2 foo.xml # split at level 2 \& xml_split \-c section foo.xml # a file is generated for each section element \& # nested sections are split properly .Ve .SH "SEE ALSO" .IX Header "SEE ALSO" XML::Twig, xml_merge .SH "TODO" .IX Header "TODO" .IP "optimize the code" 4 .IX Item "optimize the code" any idea welcome! I have already implemented most of what I thought would improve performances. .IP "provide other methods that PIs to keep merge information" 4 .IX Item "provide other methods that PIs to keep merge information" XInclude is a good candidate (alpha support added in 0.04). .Sp using entities, which would seem the natural way to do it, doesn't work, as they make it impossible to have both the main document and the sub docs to be well-formed if the sub docs include sub-sub docs (you can't have entity declarations in an entity) .SH "AUTHOR" .IX Header "AUTHOR" Michel Rodriguez .SH "LICENSE" .IX Header "LICENSE" This tool is free software; you can redistribute it and/or modify it under the same terms as Perl itself.