summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Database (SQL) class for functionality common across all processorsAntanas Uršulis2013-07-291-0/+1
| | | | Currently uses MySQLdb. Schema included.
* Introduce processors and PortageProcessor.Antanas Uršulis2013-07-291-0/+1
| | | | | | | | | | | | A processor is initialised with a database and storage provider. It should implement the process(request, source) method, where request is a protobuf Submission message. process() should analyse the received files, perform any required transformations and should usually store the files and create appropriate database entries. Processors are multiplexed through the 'provider' variable in the protobuf Submission message. This allows to process/analyse various types of logs differently.
* Port simple_client to urllib2, so that we can set Content-TypeAntanas Uršulis2013-07-291-2/+3
|
* Send only filename, not full pathAntanas Uršulis2013-07-181-2/+2
|
* Group logs by source hostname and add multiple-file submissionsAntanas Uršulis2013-07-051-6/+9
|
* Simple file submission client, based on urllib and protobufAntanas Uršulis2013-07-031-0/+19