.\" Automatically generated by Pod::Man 4.14 (Pod::Simple 3.40) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" Set up some character translations and predefined strings. \*(-- will .\" give an unbreakable dash, \*(PI will give pi, \*(L" will give a left .\" double quote, and \*(R" will give a right double quote. \*(C+ will .\" give a nicer C++. Capital omega is used to do unbreakable dashes and .\" therefore won't be available. \*(C` and \*(C' expand to `' in nroff, .\" nothing in troff, for use with C<>. .tr \(*W- .ds C+ C\v'-.1v'\h'-1p'\s-2+\h'-1p'+\s0\v'.1v'\h'-1p' .ie n \{\ . ds -- \(*W- . ds PI pi . if (\n(.H=4u)&(1m=24u) .ds -- \(*W\h'-12u'\(*W\h'-12u'-\" diablo 10 pitch . if (\n(.H=4u)&(1m=20u) .ds -- \(*W\h'-12u'\(*W\h'-8u'-\" diablo 12 pitch . ds L" "" . ds R" "" . ds C` "" . ds C' "" 'br\} .el\{\ . ds -- \|\(em\| . ds PI \(*p . ds L" `` . ds R" '' . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is >0, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{\ . if \nF \{\ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{\ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" ======================================================================== .\" .IX Title "MediaWiki::DumpFile::Benchmarks 3pm" .TH MediaWiki::DumpFile::Benchmarks 3pm "2021-01-09" "perl v5.32.0" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH "NAME" MediaWiki::DumpFile::Benchmarks \- Documentation on parsing speeds .SH "ENVIRONMENT" .IX Header "ENVIRONMENT" The tests were conducted on Debian/squeeze using the vendor supplied Perl version 5.10.1. All modules were installed from \s-1CPAN\s0 and not from the Debian package archives. .PP The host hardware is a 4 core Intel i7 at 2.8ghz with 16 GiB of \s-1RAM\s0 and disks that can read at 100 MiB/sec. .SH "SOFTWARE" .IX Header "SOFTWARE" The benchmark software is included in the MediaWiki::DumpFile distribution tarball in the speed_test/ directory. .PP The tested version of MediaWiki::DumpFile is version 0.2.0 .PP Parse::MediaWikiDump version 1.0.6 is included for comparison against the original implementation. .SH "RESULTS" .IX Header "RESULTS" All times are expressed in seconds. See the \s-1SPEED\s0 section of the MediaWiki::DumpFile documentation for an explanation of the various parsing modes. .SS "With XML::CompactTree::XS" .IX Subsection "With XML::CompactTree::XS" \fIEnglish Wikipedia\fR .IX Subsection "English Wikipedia" .PP .Vb 10 \& markup_density: 0.171869387735729 \& size: 25247483017 \& tests: \& \- MiB/sec: 35.0121798854383 \& name: suite//MediaWiki\-DumpFile\-FastPages.t \& percentage: 100 \& runtimes: \& system: 25.04 \& total: 687.7 \& user: 662.66 \& \- MiB/sec: 30.0620222578669 \& name: suite//MediaWiki\-DumpFile\-Pages_fastmode.t \& percentage: 116 \& runtimes: \& system: 26.52 \& total: 800.94 \& user: 774.42 \& \- MiB/sec: 23.3355715754023 \& name: suite//MediaWiki\-DumpFile\-Compat_fastmode.t \& percentage: 150 \& runtimes: \& system: 28.1 \& total: 1031.81 \& user: 1003.71 \& \- MiB/sec: 9.00969754502099 \& name: suite//MediaWiki\-DumpFile\-Pages.t \& percentage: 388 \& runtimes: \& system: 31.56 \& total: 2672.44 \& user: 2640.88 \& \- MiB/sec: 7.83820750529512 \& name: suite//MediaWiki\-DumpFile\-Compat.t \& percentage: 446 \& runtimes: \& system: 31.28 \& total: 3071.86 \& user: 3040.58 \& \- MiB/sec: 5.19432459350304 \& name: suite//Parse\-MediaWikiDump.t \& percentage: 674 \& runtimes: \& system: 23.22 \& total: 4635.42 \& user: 4612.2 .Ve .PP \fISimple English Wikipedia\fR .IX Subsection "Simple English Wikipedia" .PP .Vb 10 \& markup_density: 0.202659609191331 \& size: 227681797 \& tests: \& \- MiB/sec: 27.9092907599128 \& name: suite//MediaWiki\-DumpFile\-FastPages.t \& percentage: 100 \& runtimes: \& system: 0.17 \& total: 7.78 \& user: 7.61 \& \- MiB/sec: 26.19231388566 \& name: suite//MediaWiki\-DumpFile\-Pages_fastmode.t \& percentage: 106 \& runtimes: \& system: 0.15 \& total: 8.29 \& user: 8.14 \& \- MiB/sec: 19.632394404351 \& name: suite//MediaWiki\-DumpFile\-Compat_fastmode.t \& percentage: 142 \& runtimes: \& system: 0.19 \& total: 11.06 \& user: 10.87 \& \- MiB/sec: 7.20180040172874 \& name: suite//MediaWiki\-DumpFile\-Pages.t \& percentage: 387 \& runtimes: \& system: 0.27 \& total: 30.15 \& user: 29.88 \& \- MiB/sec: 6.39382456160546 \& name: suite//MediaWiki\-DumpFile\-Compat.t \& percentage: 436 \& runtimes: \& system: 0.26 \& total: 33.96 \& user: 33.7 \& \- MiB/sec: 4.14457495919301 \& name: suite//Parse\-MediaWikiDump.t \& percentage: 673 \& runtimes: \& system: 0.12 \& total: 52.39 \& user: 52.27 .Ve .PP \fIChuvash Wikipedia\fR .IX Subsection "Chuvash Wikipedia" .PP .Vb 10 \& markup_density: 0.18934898819024 \& size: 39436366 \& tests: \& \- MiB/sec: 25.7598968401347 \& name: suite//MediaWiki\-DumpFile\-FastPages.t \& percentage: 100 \& runtimes: \& system: 0.03 \& total: 1.46 \& user: 1.43 \& \- MiB/sec: 22.6562948112028 \& name: suite//MediaWiki\-DumpFile\-Pages_fastmode.t \& percentage: 113 \& runtimes: \& system: 0.06 \& total: 1.66 \& user: 1.6 \& \- MiB/sec: 17.9949518596156 \& name: suite//MediaWiki\-DumpFile\-Compat_fastmode.t \& percentage: 143 \& runtimes: \& system: 0.04 \& total: 2.09 \& user: 2.05 \& \- MiB/sec: 7.46219233861045 \& name: suite//MediaWiki\-DumpFile\-Pages.t \& percentage: 345 \& runtimes: \& system: 0.04 \& total: 5.04 \& user: 5 \& \- MiB/sec: 6.45102047797542 \& name: suite//MediaWiki\-DumpFile\-Compat.t \& percentage: 399 \& runtimes: \& system: 0.05 \& total: 5.83 \& user: 5.78 \& \- MiB/sec: 4.15574026371234 \& name: suite//Parse\-MediaWikiDump.t \& percentage: 619 \& runtimes: \& system: 0.02 \& total: 9.05 \& user: 9.03 .Ve .SS "With out XML::CompactTree::XS" .IX Subsection "With out XML::CompactTree::XS" \fISimple English Wikipedia\fR .IX Subsection "Simple English Wikipedia" .PP .Vb 10 \& markup_density: 0.202659609191331 \& size: 227681797 \& tests: \& \- MiB/sec: 30.0740002925376 \& name: suite//MediaWiki\-DumpFile\-FastPages.t \& percentage: 100 \& runtimes: \& system: 0.18 \& total: 7.22 \& user: 7.04 \& \- MiB/sec: 24.3697286321124 \& name: suite//MediaWiki\-DumpFile\-Pages_fastmode.t \& percentage: 123 \& runtimes: \& system: 0.23 \& total: 8.91 \& user: 8.68 \& \- MiB/sec: 20.2550636298621 \& name: suite//MediaWiki\-DumpFile\-Compat_fastmode.t \& percentage: 148 \& runtimes: \& system: 0.19 \& total: 10.72 \& user: 10.53 \& \- MiB/sec: 4.21456292919491 \& name: suite//Parse\-MediaWikiDump.t \& percentage: 713 \& runtimes: \& system: 0.12 \& total: 51.52 \& user: 51.4 \& \- MiB/sec: 4.06770854462573 \& name: suite//MediaWiki\-DumpFile\-Pages.t \& percentage: 739 \& runtimes: \& system: 0.24 \& total: 53.38 \& user: 53.14 \& \- MiB/sec: 3.79871032386497 \& name: suite//MediaWiki\-DumpFile\-Compat.t \& percentage: 791 \& runtimes: \& system: 0.28 \& total: 57.16 \& user: 56.88 .Ve .PP \fIChuvash Wikipedia\fR .IX Subsection "Chuvash Wikipedia" .PP .Vb 10 \& markup_density: 0.18934898819024 \& size: 39436366 \& tests: \& \- MiB/sec: 25.5846594466644 \& name: suite//MediaWiki\-DumpFile\-FastPages.t \& percentage: 100 \& runtimes: \& system: 0.04 \& total: 1.47 \& user: 1.43 \& \- MiB/sec: 20.4399181448895 \& name: suite//MediaWiki\-DumpFile\-Pages_fastmode.t \& percentage: 125 \& runtimes: \& system: 0.04 \& total: 1.84 \& user: 1.8 \& \- MiB/sec: 14.5210229291879 \& name: suite//MediaWiki\-DumpFile\-Compat_fastmode.t \& percentage: 176 \& runtimes: \& system: 0.03 \& total: 2.59 \& user: 2.56 \& \- MiB/sec: 4.11481940772393 \& name: suite//Parse\-MediaWikiDump.t \& percentage: 621 \& runtimes: \& system: 0.03 \& total: 9.14 \& user: 9.11 \& \- MiB/sec: 3.87726282336048 \& name: suite//MediaWiki\-DumpFile\-Pages.t \& percentage: 659 \& runtimes: \& system: 0.03 \& total: 9.7 \& user: 9.67 \& \- MiB/sec: 3.53140369827199 \& name: suite//MediaWiki\-DumpFile\-Compat.t \& percentage: 724 \& runtimes: \& system: 0.06 \& total: 10.65 \& user: 10.59 .Ve