summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* squash! Avoid reprocessing webstats files.task-32747Karsten Loesing2020-01-09
| | | | | | | - Use the default options CREATE, TRUNCATE_EXISTING, and WRITE for overwriting the state file rather than just CREATE. The effect was that we kept lines from before, which is not a big issue, but also not what we wanted.
* squash! Avoid reprocessing webstats files.Karsten Loesing2020-01-09
| | | | | - Avoid duplicating code from WebServerAccessLogPersistence for calculating storage paths.
* Avoid reprocessing webstats files.Karsten Loesing2019-12-13
| | | | | | | | | | | | | | | | | | Web servers typically provide us with the last 14 days of request logs. We shouldn't process the whole 14 days over and over. Instead we should only process new logs files and any other log files containing log lines from newly written dates. In some cases web servers stop serving a given virtual host or stop acting as web server at all. However, in these cases we're left with 14 days of logs per virtual host. Ideally, these logs would get cleaned up, but until that's the case, we should at least not reprocess these files over and over. In order to avoid reprocessing webstats files, we need a new state file with log dates contained in given input files. We use that state file to determine which of the previously processed webstats files to re-process, so that we can write complete daily logs.
* Add some real tests for the webstats module.Karsten Loesing2019-12-12
| | | | | Temporary commit: requires update to metrics-base commit 264e498 as soon as that's merged to master.
* Remove dependency on metrics-lib's log package (4/4).task-32605Karsten Loesing2019-11-25
| | | | - Remove package-internal abstract class.
* Remove dependency on metrics-lib's log package (3/4).Karsten Loesing2019-11-25
| | | | | - Remove package-internal interfaces InternalLogDescriptor and InternalWebServerAccessLog.
* Remove dependency on metrics-lib's log package (2/4).Karsten Loesing2019-11-25
| | | | - Remove unused code.
* Remove dependency on metrics-lib's log package (1/4).Karsten Loesing2019-11-25
| | | | | | - Copy types from metrics-lib to this code base. - Update package and import statements. - Copy remaining parts of metrics-lib's FileType.
* Remove dependency on DescriptorIndexCollector.Karsten Loesing2019-11-22
|
* Remove dependency on metrics-lib's internal package.Karsten Loesing2019-11-22
| | | | | | | | | | | The only functionality contained in metrics-lib's internal package is file (de-)compression, which in turn uses a third-party library that we're using anyway. This is a weak reason for depending on our own library for this functionality. Removing this dependency will make it easier to make changes to our library in the future. The new FileType class is based on a copy of the same enum type in metrics-lib without @since tags and without methods that we don't use.
* Stop checking and reloading configuration file.Karsten Loesing2019-11-22
| | | | | | Removes a deprecation warning and simplifies code. Implements #32554.
* Remove String[][] as configuration value type.Karsten Loesing2019-11-21
|
* Remove final modifier from private method.Karsten Loesing2019-11-20
|
* Make inner class static.Karsten Loesing2019-11-20
|
* Tweak DownloaderTest a bit.Karsten Loesing2019-11-20
|
* Fix logging bug.Karsten Loesing2019-11-20
|
* Fix two JavaDocs issues with package-info.java.Karsten Loesing2019-11-20
|
* Use StandardCharsets.US_ASCII instead of "US-ASCII".Karsten Loesing2019-11-20
|
* Fix minor JavaDoc issue.Karsten Loesing2019-11-20
|
* Bump version to 1.13.1-dev.Karsten Loesing2019-11-11
|
* Prepare for 1.13.1 release.collector-1.13.1Karsten Loesing2019-11-11
|
* Bump version to 1.13.0-dev.Karsten Loesing2019-11-09
|
* Prepare for 1.13.0 release.collector-1.13.0Karsten Loesing2019-11-09
|
* Tweak BridgeDB metrics file names.Karsten Loesing2019-11-09
| | | | | | | | | | | | We were using the same path for BridgeDB metrics in out/ and recent/, and file names didn't contain the "-bridgedb-metrics" suffix that we intended to add. We're now using paths generated by BridgedbMetricsPersistence. Also update create-tarballs.sh to create BridgeDB metrics tarballs. Still part of #19332.
* Extend index.json by additional file meta data.Karsten Loesing2019-11-09
| | | | Implements #31204.
* Bump version to 1.12.0-dev.Karsten Loesing2019-10-18
|
* Prepare for 1.12.0 release.collector-1.12.0Karsten Loesing2019-10-18
|
* Update to latest metrics-base.Karsten Loesing2019-10-18
|
* Add new BridgedbMetrics module.Karsten Loesing2019-10-18
| | | | Implements part of #19332.
* Tweak URL-based unit tests.Karsten Loesing2019-09-27
| | | | | | | Turns out that one of the tests that we disabled earlier was only slow, because creating a URL instance to https://something.dummy.org/ triggered an actual DNS resolve. There's absolutely no need to do this, so we can as well use localhost in all our test URLs.
* Create utility class for downloading from HTTP serversKarsten Loesing2019-09-27
| | | | | | | Also skip two tests in ConfigurationTest that together take 53 seconds which has the effect that we don't run tests very often. Implements #31599.
* Use metrics-base ant task to fetch metrics-lib.Karsten Loesing2019-09-27
| | | | Implements part of #31649.
* Bump version to 1.11.1-dev.Karsten Loesing2019-09-19
|
* Prepare for 1.11.1 release.collector-1.11.1Karsten Loesing2019-09-19
|
* Fix bridge pool assignments sync and log statement.Karsten Loesing2019-09-19
|
* Update create-tarballs.sh script and PROTOCOL.Karsten Loesing2019-09-19
| | | | | | These changes still belong to archiving bridge pool assignments. But they're not important enough for putting out a new release at this point.
* Bump version to 1.11.0-dev.Karsten Loesing2019-09-19
|
* Prepare for 1.11.0 release.collector-1.11.0Karsten Loesing2019-09-19
|
* Tone down a warning about outdated assignments.Karsten Loesing2019-09-19
|
* Archive bridge pool assignments again.Karsten Loesing2019-09-19
| | | | Implements #31558.
* Upgrade to latest metrics-base.Karsten Loesing2019-09-19
|
* Bump version to 1.10.0-dev.Karsten Loesing2019-09-12
|
* Prepare for 1.10.0 release.collector-1.10.0Karsten Loesing2019-09-12
|
* Also update metrics-lib version for GitLab's CI.Karsten Loesing2019-09-12
|
* Archive snowflake statistics.Karsten Loesing2019-09-11
| | | | Implements #29461.
* Adds GitLab CI for tests and checksIain R. Learmonth2019-09-05
| | | | | | Configuration is held in the .gitlab-ci.yml file. Fixes: #31399
* Remove Cobertura from the build process.Karsten Loesing2019-08-14
|
* Use Ivy for resolving external dependencies.task-31326Karsten Loesing2019-08-06
| | | | | | Includes an upgrade to the latest metrics-base commit 256e619. Implements part of #31326.
* Add source name to locally imported bandwidth files.Karsten Loesing2019-07-30
| | | | Implements #30219.
* Revert all Debian buster library upgrades.Karsten Loesing2019-07-28
| | | | | | | | Turns out that updating all dependencies, including those in metrics-web and exonerator using servlets and JSPs, is much harder than expected. We decided to revert all these changes for now, so that we can merge patches again. We're going to investigate alternatives like Ant + Ivy, Maven, or Gradle in the near future.
generated by cgit v1.2.1 (git 2.18.0) at 2024-02-02 11:31:36 +0000