Scroll to navigation

deltadb_query(1) Cooperative Computing Tools deltadb_query(1)

NAME

deltadb_query - query historical data stored by the catalog server.

SYNOPSIS

deltadb_query --db [source_directory] --from [starttime] --to [endtime] [--filter [expr]] [--where [expr]] [--output [expr]]

DESCRIPTION

deltadb_query is a tool that examines and displays historical data of the catalog server. (If given the -H option, the catalog server will record historical data in a format known as DeltaDB, hence the name of this tool.) The results can be displayed as a stream of time-ordered updates or as summaries of properties across all records over time. This is useful for reporting, for example, the total resources and clients served by a large collection of servers over the course of a year.

A paper entitled DeltaDB describes the operation of the tools in detail (see reference below).

ARGUMENTS

 --db path
Query this database directory.
 --file path
Query the data stream in this file.
 --from time
(required) The starting date and time of the query in an absolute time like "YYYY-MM-DD HH:MM:SS" or "YYYY-MM-DD" or a relative time like 5s, 5m, 5h, 5d to indicate five seconds, minutes, hours, or days ago, respectively.
 --to time
The ending time of the query, in the same format as the --from option. If omitted, the current time is assumed.
 --every interval
The intervals at which output should be produced, like 5s, 5m, 5h, 5d to indicate five seconds, minutes, hours, or days ago, respectively.
 --epoch
Causes the output to be expressed in integer Unix epoch time, instead of a formatted time.
 --filter expr
(multiple) If given, only records matching this expression will be processed. Use --filter to apply expressions that do not change over time, such as the name or type of a record.
 --where expr
(multiple) If given, only records matching this expression will be displayed. Use --where to apply expressions that may change over time, such as load average or storage space consumed.
 --output expr
(multiple) Display this expression on the output.

EXAMPLES

To show 1 week worth of history starting on 15 April 2013: 

% deltadb_query --db /data/catalog.history --from 2013-04-15 --to 2015-04-22

To show all history after 1 March 2013:

% deltadb_query --db /data/catalog.history --from 2013-03-01

To show the names of fred's servers where load5 exceeds 2.0:

% deltadb_query --db /data/catalog.history --from 2013-03-01 --filter 'owner=="fred"' --where 'load5>2.0' --output name --output load5

To show the average load of all servers owned by fred at one hour intervals:

% deltadb_query --db /data/catalog.history --from 2013-03-01 --filter 'owner=="fred"' --output 'AVERAGE(load5)' --every 1h

The raw event output of a query can be saved to a file, and then queried using the --file option, which can accelerate operations on reduced data. For example:

% deltadb_query --db /data/catalog.history --from 2014-01-01 --to 2015-01-01 --filter 'type=="wq_master"' > wq.data
% deltadb_query --file wq.data --from 2014-01-01 --output 'COUNT(name)' --output 'MAX(tasks_running)'

COPYRIGHT

The Cooperative Computing Tools are Copyright (C) 2003-2004 Douglas Thain and Copyright (C) 2005-2015 The University of Notre Dame. This software is distributed under the GNU General Public License. See the file COPYING for details.

SEE ALSO

CCTools 7.0.9 FINAL