.\" Automatically generated by Pod::Man 2.28 (Pod::Simple 3.28) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" Set up some character translations and predefined strings. \*(-- will .\" give an unbreakable dash, \*(PI will give pi, \*(L" will give a left .\" double quote, and \*(R" will give a right double quote. \*(C+ will .\" give a nicer C++. Capital omega is used to do unbreakable dashes and .\" therefore won't be available. \*(C` and \*(C' expand to `' in nroff, .\" nothing in troff, for use with C<>. .tr \(*W- .ds C+ C\v'-.1v'\h'-1p'\s-2+\h'-1p'+\s0\v'.1v'\h'-1p' .ie n \{\ . ds -- \(*W- . ds PI pi . if (\n(.H=4u)&(1m=24u) .ds -- \(*W\h'-12u'\(*W\h'-12u'-\" diablo 10 pitch . if (\n(.H=4u)&(1m=20u) .ds -- \(*W\h'-12u'\(*W\h'-8u'-\" diablo 12 pitch . ds L" "" . ds R" "" . ds C` "" . ds C' "" 'br\} .el\{\ . ds -- \|\(em\| . ds PI \(*p . ds L" `` . ds R" '' . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is turned on, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{ . if \nF \{ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" .\" Accent mark definitions (@(#)ms.acc 1.5 88/02/08 SMI; from UCB 4.2). .\" Fear. Run. Save yourself. No user-serviceable parts. . \" fudge factors for nroff and troff .if n \{\ . ds #H 0 . ds #V .8m . ds #F .3m . ds #[ \f1 . ds #] \fP .\} .if t \{\ . ds #H ((1u-(\\\\n(.fu%2u))*.13m) . ds #V .6m . ds #F 0 . ds #[ \& . ds #] \& .\} . \" simple accents for nroff and troff .if n \{\ . ds ' \& . ds ` \& . ds ^ \& . ds , \& . ds ~ ~ . ds / .\} .if t \{\ . ds ' \\k:\h'-(\\n(.wu*8/10-\*(#H)'\'\h"|\\n:u" . ds ` \\k:\h'-(\\n(.wu*8/10-\*(#H)'\`\h'|\\n:u' . ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'^\h'|\\n:u' . ds , \\k:\h'-(\\n(.wu*8/10)',\h'|\\n:u' . ds ~ \\k:\h'-(\\n(.wu-\*(#H-.1m)'~\h'|\\n:u' . ds / \\k:\h'-(\\n(.wu*8/10-\*(#H)'\z\(sl\h'|\\n:u' .\} . \" troff and (daisy-wheel) nroff accents .ds : \\k:\h'-(\\n(.wu*8/10-\*(#H+.1m+\*(#F)'\v'-\*(#V'\z.\h'.2m+\*(#F'.\h'|\\n:u'\v'\*(#V' .ds 8 \h'\*(#H'\(*b\h'-\*(#H' .ds o \\k:\h'-(\\n(.wu+\w'\(de'u-\*(#H)/2u'\v'-.3n'\*(#[\z\(de\v'.3n'\h'|\\n:u'\*(#] .ds d- \h'\*(#H'\(pd\h'-\w'~'u'\v'-.25m'\f2\(hy\fP\v'.25m'\h'-\*(#H' .ds D- D\\k:\h'-\w'D'u'\v'-.11m'\z\(hy\v'.11m'\h'|\\n:u' .ds th \*(#[\v'.3m'\s+1I\s-1\v'-.3m'\h'-(\w'I'u*2/3)'\s-1o\s+1\*(#] .ds Th \*(#[\s+2I\s-2\h'-\w'I'u*3/5'\v'-.3m'o\v'.3m'\*(#] .ds ae a\h'-(\w'a'u*4/10)'e .ds Ae A\h'-(\w'A'u*4/10)'E . \" corrections for vroff .if v .ds ~ \\k:\h'-(\\n(.wu*9/10-\*(#H)'\s-2\u~\d\s+2\h'|\\n:u' .if v .ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'\v'-.4m'^\v'.4m'\h'|\\n:u' . \" for low resolution devices (crt and lpr) .if \n(.H>23 .if \n(.V>19 \ \{\ . ds : e . ds 8 ss . ds o a . ds d- d\h'-1'\(ga . ds D- D\h'-1'\(hy . ds th \o'bp' . ds Th \o'LP' . ds ae ae . ds Ae AE .\} .rm #[ #] #H #V #F C .\" ======================================================================== .\" .IX Title "TABMERGE 1p" .TH TABMERGE 1p "2015-04-21" "perl v5.20.2" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH "NAME" tabmerge \- unify delimited files on common fields .SH "SYNOPSIS" .IX Header "SYNOPSIS" .Vb 1 \& tabmerge [action] [options] file1 file2 [...] .Ve .PP Actions: .PP .Vb 4 \& \-\-min Take only fields present in all files [DEFAULT] \& \-\-max Take all fields present \& \-f|\-\-fields=f1[,f2] Take only the fields mentioned in the \& comma\-separated list .Ve .PP Options: .PP .Vb 8 \& \-l|\-\-list List available fields \& \-\-fs=x Use "x" as the field separator \& (default is tab "\et") \& \-\-rs=x Use "x" as the record separator \& (default is newline "\en") \& \-s|\-\-sort=f1[,f2] Sort data ASCII\-betically on field(s) \& \-\-stdout Print data in original delimited format \& (i.e., not in a table format) \& \& \-\-help Show brief help and quit \& \-\-man Show full documentation .Ve .SH "DESCRIPTION" .IX Header "DESCRIPTION" This program merges the fields \*(-- not the rows \*(-- of delimited text files. That is, if several files are almost but not quite entirely unlike each other in their structure (in their field names, numbers or orders), this script allows you to easily unify the files into one file with all the same fields. The output can be based on fields as determined by the three \*(L"action\*(R" flags. .PP For the following examples, consider three files that contain the following fields: .PP .Vb 7 \& +\-\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ \& | File | Fields | \& +\-\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ \& | merge1.tab | name, type, position | \& | merge2.tab | name, type, position, lod_score | \& | merge3.tab | name, position | \& +\-\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ .Ve .PP To list all available fields in the files and the number of times they are present: .PP .Vb 9 \& $ tabmerge \-\-list merge* \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ \& | Field | No. Times Present | \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ \& | lod_score | 1 | \& | name | 3 | \& | position | 3 | \& | type | 2 | \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-\-+ .Ve .PP To merge the files on the minimum overlapping fields: .PP .Vb 10 \& $ tabmerge merge* \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+ \& | name | position | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+ \& | RM104 | 2.30 | \& | RM105 | 4.5 | \& | TX5509 | 10.4 | \& | UU189 | 19.0 | \& | Xpsm122 | 3.3 | \& | Xpsr9556 | 4.5 | \& | DRTL | 2.30 | \& | ALTX | 4.5 | \& | DWRF | 10.4 | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+ .Ve .PP To merge the files and include all the fields: .PP .Vb 10 \& $ tabmerge \-\-max merge* \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ \& | lod_score | name | position | type | \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ \& | | RM104 | 2.30 | RFLP | \& | | RM105 | 4.5 | RFLP | \& | | TX5509 | 10.4 | AFLP | \& | 2.4 | UU189 | 19.0 | SSR | \& | 1.2 | Xpsm122 | 3.3 | Marker | \& | 1.2 | Xpsr9556 | 4.5 | Marker | \& | | DRTL | 2.30 | | \& | | ALTX | 4.5 | | \& | | DWRF | 10.4 | | \& +\-\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ .Ve .PP To merge and extract just the \*(L"name\*(R" and \*(L"type\*(R" fields: .PP .Vb 10 \& $ tabmerge \-f name,type merge* \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ \& | name | type | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ \& | RM104 | RFLP | \& | RM105 | RFLP | \& | TX5509 | AFLP | \& | UU189 | SSR | \& | Xpsm122 | Marker | \& | Xpsr9556 | Marker | \& | DRTL | | \& | ALTX | | \& | DWRF | | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-+ .Ve .PP To merge the files on just the \*(L"name\*(R" and \*(L"lod_score\*(R" fields and sort on the name: .PP .Vb 10 \& $ tabmerge \-f name,lod_score \-s name merge* \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-+ \& | name | lod_score | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-+ \& | ALTX | | \& | DRTL | | \& | DWRF | | \& | RM104 | | \& | RM105 | | \& | TX5509 | | \& | UU189 | 2.4 | \& | Xpsm122 | 1.2 | \& | Xpsr9556 | 1.2 | \& +\-\-\-\-\-\-\-\-\-\-+\-\-\-\-\-\-\-\-\-\-\-+ .Ve .PP To do the same but mimic the original tab-delimited input: .PP .Vb 11 \& $ tabmerge \-f name,lod_score \-s name \-\-stdout merge* \& name lod_score \& ALTX \& DRTL \& DWRF \& RM104 \& RM105 \& TX5509 \& UU189 2.4 \& Xpsm122 1.2 \& Xpsr9556 1.2 .Ve .PP Why would you want to do this? Suppose you have several delimited text files with nearly the same structure and want to create just one file from them, but the fields may be in a different order in each file and/or some files may contain more or fewer fields than others. (As far-fetched as it may seem, it happens to the author more than he'd like.) .SH "SEE ALSO" .IX Header "SEE ALSO" .IP "\(bu" 4 Text::RecordParser .IP "\(bu" 4 Text::TabularDisplay .SH "AUTHOR" .IX Header "AUTHOR" Ken Youens-Clark . .SH "LICENSE AND COPYRIGHT" .IX Header "LICENSE AND COPYRIGHT" Copyright (C) 2006\-10 Ken Youens-Clark. All rights reserved. .PP This program is free software; you can redistribute it and/or modify it under the terms of the \s-1GNU\s0 General Public License as published by the Free Software Foundation; version 2. .PP This program is distributed in the hope that it will be useful, but \&\s-1WITHOUT ANY WARRANTY\s0; without even the implied warranty of \&\s-1MERCHANTABILITY\s0 or \s-1FITNESS FOR A PARTICULAR PURPOSE. \s0 See the \s-1GNU\s0 General Public License for more details.