Name¶
SVN::Notify::Filter - Create output filters for SVN::Notify
Synopsis¶
package SVN::Notify::Filter::Textile;
use Text::Textile ();
sub log_message {
my ($notifier, $lines) = @_;
return $lines unless $notify->content_type eq 'text/html';
return [ Text::Textile->new->process( join $/, @$lines ) ];
}
Description¶
This document covers the output filtering capabilities of SVN::Notify. Output
filters are simply subroutines that modify content before SVN::Notify outputs
it. The idea is to provide a simple interface for anyone to use to change the
format of the messages that SVN::Notify creates. Filters are loaded by the
"filter" parameter to "new()" or by the
"--filter" option to the "svnnotify" command-line program.
A Quick Example¶
The most common use for an output filter is to modify the format of log commit
messages. Say that your developers write their commit messages in Markdown
format, and you'd like it to be reformatted as HTML in the messages sent by
SVN::Notify::HTML. To do so, just create a Perl module and put it somewhere in
the Perl path. Something like this:
package SVN::Notify::Filter::Markdown;
use strict;
use Text::Markdown ();
sub log_message {
my ($notifier, $lines) = @_;
return $lines unless $notify->content_type eq 'text/html';
return [ Text::Markdown->new->markdown( join $/, @$lines ) ];
}
Put this code in a file named
SVN/Notify/Filter/Markdown.pm somewhere in
your Perl's path. The way that SVN::Notify filters work is that you simply
define a subroutine named for what you want to filter. The subroutine's first
argument will always be the SVN::Notify object that's generating the
notification message, and the second argument will always be the content to be
filtered.
In this example, we wanted to filter the commit log message, so we just defined
a subroutine named "log_message()" and, if the message will be HTML,
passed the lines of the commit message to Text::Markdown to format, returning
a new array reference. And that's all there is to writing SVN::Notify filters:
Define a subroutine, process the second argument, and return a data structure
in the same format as that argument (usually an array reference).
Now, to use this filter, just use the "--filter" option:
svnnotify -p "$1" -r "$2" --handler HTML --filter Markdown
SVN::Notify will assume that a filter option without "::" is in the
SVN::Notify::Filter name space, and will load it accordingly. If you instead
created your filter in some other name space, say
"My::Filter::Markdown", then you'd specify the full package name in
the "--filter" option:
svnnotify -p "$1" -r "$2" --handler HTML --filter My::Filter::Markdown
And that's it! The filter modifies the contents of the log message before
SVN::Notify::HTML spits it out.
The Details¶
Writing SVN::Notify filters is easy. The name of each subroutine in a filter
module determines what content it filters. The filter subroutines take two
arguments: the SVN::Notify object that's creating the notification message,
and the content to be filtered. They should return the filtered content in the
same data structure as that in which it was passed. This makes it easy to
change the output of SVN::Notify without the hassle of subclassing or sending
patches to the maintainer.
The names of the filter subroutines and the types of their content arguments and
return values are as follows, in the order in which they execute:
Sub Name | Second Argument
-------------+---------------------------------------------------------------
pre_prepare | undef
recipients | Array reference of email addresses.
from | String with sender address.
subject | String with the subject line.
post_prepare | undef
pre_execute | undef
headers | Array reference of individual email headers lines.
start_html | An array of lines starting an SVN::Notify::HTML document.
css | An array of lines of CSS. Used only by SVN::Notify::HTML.
start_body | Array reference of lines at the start of the message body.
metadata | Array reference of lines of the metadata part of the message.
log_message | Array reference of lines of log message.
file_lists | Array reference of lines of file names. The first line will
| be the type of change for the list, the next a simple line of
| dashes, and each of the rest of the lines a file name.
diff | A file handle reference to the diff.
end_body | Array reference of lines at the end of the message body.
post_execute | undef
Note that the data passed to the filters by SVN::Notify subclasses
(SVN::Notify::HTML and SVN::Notify::HTML::ColorDiff) may be in a slightly
different format than documented here. Consult the documentation for the
relevant methods in those classes for details.
There are four special filter subroutines that are called at the beginning and
at the end of the execution of the "prepare()" and
"execute()" methods, named "pre_prepare",
"post_prepare", "pre_execute", and
"post_execute". No data is passed to them and their return values
are ignored, but they are included to enable callbacks at the points at which
they execute. If, for example, you wanted to set the value of the
"to" attribute before SVN::Notify checks to make sure that there are
recipients to whom to send an email, you'd want to do so in a
"pre_prepare" filter.
The package name of the filter module can be anything you like; just pass it via
the "filter" parameter, e.g., "filter => [ 'My::Filter'
]" (or "--filter My::Filter" on the command-line). If, however,
it's in the "SVN::Notify::Filter" name space, you can just pass the
last bit as the filter name, for example "filter => [ 'NoSpam' ]"
(or "--filter NoSpam" on the command-line) for
"SVN::Notify::Filter::NoSpam".
The first argument to a filter subroutine is always the SVN::Notify object
that's generating the message to be delivered. This is so that you can access
its attributes for your own nefarious purposes in the filter, as in the first
example below.
But more importantly -- and more hackerously -- you can add attributes to the
SVN::Notify class from your filters. Just call
"SVN::Notify->register_attributes" to do so, as in the final
example below. below.
Examples¶
First, see the "Synopsis" for an example that converts
Textile-formatted log messages to HTML, and "A Quick Example" for a
filter that converts a Markdown-formatted log message to HTML. If you format
your log messages for Trac, just use the included SVN::Notify::Filter::Trac
filter. There is also SVN::Notify::Filter::Markdown on CPAN, and maybe other
filters as well.
But if you can't find anything that does what you want, here are some examples
to get you started writing your own filters:
- •
- Map committers to senders
Map committer user names to email addresses using a lookup table. The
"from" filter gets and returns a string representing the sender.
Note how this example makes use of the SVN::Notify object to get the
username of the committer:
package SVN::Notify::Filter::FromTable;
my %committers = (
'homer' => 'homer@simpson.com',
'bart' => 'bart@gmail.com',
'marge' => 'marge@urbanmamas.com',
);
sub from {
my ($notifier, $from) = @_;
return $committers{ $notifier->user } || $from;
}
- •
- Add a recipient
Easily done from the command-line using "--to", but hey, why not
just filter it?
package SVN::Notify::Filter::Cc;
sub recipients {
my ($notifier, $recip) = @_;
push @$recip, 'boss@example.com';
return $recip;
}
- •
- Clean up the subject
Need to keep the subject line clean? Just modify the string and return it:
package SVN::Notify::Filter::FromTable;
my $nasties = qr/\b(?:golly|shucks|darn)\b/i;
sub subject {
my ($notifier, $subject) = @_;
$subject =~ s/$nasties/[elided]/g;
return $subject;
}
- •
- Add an extra header
This emulates "add_header" to demonstrate header filtering. Maybe
you have a special header that tells your spam filtering service to skip
filtering for certain messages (not a good idea, but what the hell?):
package SVN::Notify::Filter::NoSpam;
sub headers {
my ($notifier, $headers) = @_;
push @$headers, 'X-NotSpam: true';
return $headers;
}
- •
- Uppercase meta data labels
Change the format of the commit meta data section of the message to
uppercase all of the headers, so that "Revision: 111" becomes
"REVISION: 111":
Note that this example also makes use of the "content_type()"
method of SVN::Notify to determine whether or not to actually do the
filtering. This prevents it from being applied to HTML messages, where it
likely wouldn't be able to do much.
package SVN::Notify::Filter::UpLabels;
sub metadata {
my ($notifier, $lines) = @_;
return $lines unless $notify->content_type eq 'text/plain';
s/([^:]+:)/uc $1/eg for @$lines;
return $lines;
}
- •
- Wrap your log message
Log message filtering will probably be quite common, generally to reformat
it (see, for example, the included SVN::Notify::Filter::Trac filter, as
well as SVN::Notify::Filter::Markdown on CPAN). If the Markdown and
Textile examples above are more than you need, here's a simple filter that
reformats the log message so that paragraphs are wrapped.
package SVN::Notify::Filter::WrapMessage;
use Text::Wrap ();
sub log_message {
my ($notifier, $lines) = @_;
return [ Text::Wrap::wrap( '', '', @$lines ) ];
}
- •
- Remove leading "trunk/" from file names
Just to demonstrate how to filter file lists:
package SVN::Notify::Filter::StripTrunk;
sub file_lists {
my ($notifier, $lines) = @_;
s{^(\s*)trunk/}{$1} for @$lines;
return $lines;
}
- •
- Remove leading "trunk/" from file names in a diff
This one is a little more complicated because diff filters need to return a
file handle. SVN::Notify tries to be as efficient with resources as it
can, so it reads each line of the diff from the file handle one-at-a-time,
processing and outputting each in turn so as to avoid loading the entire
diff into memory. To retain this pattern, the best approach is to tie the
file handle to a class that does the filtering one line at a time. The
requisite "tie" class needs only three methods:
"TIEHANDLE" "READLINE", and "CLOSE". In this
example, I've defined them in a different name space than the filter
subroutine, so as to simplify SVN::Notify's loading of filters and to keep
thing neatly packaged. Note that this filter is applied before
SVN::Notify::HTML outputs its diff, so you can modify things before they
get marked up by, say, SVN::Notify::HTML::ColorDiff.
package My::IO::TrunkStripper;
sub TIEHANDLE {
my ($class, $fh) = @_;
bless { fh => $fh }, $class;
}
sub READLINE {
my $fh = shift->{fh};
defined( my $line = <$fh> ) or return;
$line =~ s{^((?:-{3}|[+]{3})\s+)trunk/}{$1};
return $line;
}
sub CLOSE {
close shift->{fh} or die $! ? "Error closing diff pipe: $!"
: "Exit status $? from diff pipe";
}
package SVN::Notify::Filter::StripTrunkDiff;
use Symbol ();
sub diff {
my ($notifier, $fh) = @_;
my $filter = Symbol::gensym;
tie *{ $filter }, 'My::IO::TrunkStripper', $fh;
return $filter;
}
However, if you don't mind loading the entire diff into memory (because you
just know that all of your commits are small [you know that's not
true, right?]), you can simplify things by using a data structure and an
existing IO module to do the same thing:
package SVN::Notify::Filter::StripTrunkDiff;
use IO::ScalarArray;
sub diff {
my ($notifier, $fh) = @_;
my @lines;
while (<$fh>) {
s{^((?:-{3}|[+]{3})\s+)trunk/}{$1};
push @lines, $_;
}
return IO::ScalarArray->new(\@lines);
}
But do beware of this approach if you're likely to commit changes that would
generate very larges diffs!
- •
- Filter based on parameter
You can also add attributes (and therefor command-line options) to
SVN::Notify in your filter in order to alter its behavior. This is
precisely what the included SVN::Notify::Filter::Trac module does: it adds
a new attribute, "trac_url()", so that it can create the proper
Trac links in your commit messages. See the documentation for
register_attributes() for details on its arguments mapping
attribute names to Getopt::Long rules.
Note that this example also makes use of the "content_type()"
method of SVN::Notify to determine whether or not to actually do the
filtering. This prevents it from inadvertently converting the log file to
HTML in plain text messages, such as those sent by default by SVN::Notify,
or the plain text part sent by SVN::Notify::Alternative.
package SVN::Notify::Filter::Trac;
SVN::Notify->register_attributes( trac_url => 'trac-url=s' );
sub log_message {
my ($notify, $lines) = @_;
return $lines unless $notify->content_type eq 'text/html';
my $trac = Text::Trac->new( trac_url => $notify->trac_url );
return [ $trac->parse( join $/, @{ $lines } ) ];
}
Contributing Filters¶
I created the filtering feature of SVN::Notify in the hopes that all those folks
who want new features for SVN::Notify will stop asking me for them and instead
start writing them themselves. I should have thought to do it a long time ago,
because, in truth, about half the features of SVN::Notify could have been
implemented as filters (maybe more than half).
So by all means write your filters for SVN::Notify. If you've think you've got a
really good one, or a filter that others will find useful, please
do
not send it to me. A better option is to package it up and put it
on the CPAN. Go ahead! Take an example from this document, if you want, put it
in a module, write a few tests, and upload the distribution. Model your
distribution on SVN::Notify::Filter::Markdown, which is already separately
distributed on CPAN. Let's create a mini-ecosystem of SVN::Notify filters, all
available via CPAN. That way, lots of people can take advantage of them, new
"features" can be added on a regular basis, and I don't have to keep
adding cruft to SVN::Notify itself!
See Also¶
- SVN::Notify
- The class that makes this stuff all work.
- SVN::Notify::HTML
- The SVN::Notify class that likely will be most often used
when filtering messages. Check its documentation for variations on filter
handling from SVN::Notify.
- SVN::Notify::Filter::Trac
- Filters log messages to convert them from Trac wiki format
to HTML. Also demonstrates the ability to add attributes to SVN::Notify
(and options to svnnotify for added functionality of the
filter.
- SVN::Notify::Filter::Markdown
- A separate CPAN distribution that filters log messages to
convert them from Markdown format to HTML. Check it out to get an idea how
to create your own filter distributions on CPAN.
Author¶
David E. Wheeler <david@kineticode.com>
Copyright and License¶
Copyright (c) 2008 Kineticode, Inc. Some Rights Reserved.
This module is free software; you can redistribute it and/or modify it under the
same terms as Perl itself.