summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Avoid superfluous indexing runs.task-20251iwakeh2018-03-26
| | | | | | | | | | | | | This entails: * removal of updateindex scheduling-related properties and code * turn CreateIndexJson into a regular Java class, which doesn't extend CollectorMain anymore. * call index processing functionality after each CollecTorMain run * add a simple lock mechanism (to CreateIndexJson) in order to prevent concurrent writes to any of the index.json* files * adapt all tests accordingly Implements task-20251.
* Describe 'contrib' path contents.iwakeh2018-03-26
|
* Add 'contrib' directory to index.json.task-25624iwakeh2018-03-20
|
* Corrected description of vote descriptor path.iwakeh2018-03-20
| | | | Implements task-20287.
* Include webstats in create-tarballs.sh.Karsten Loesing2018-03-19
|
* Bump version to 1.5.1-dev.Karsten Loesing2018-03-19
|
* Prepare for 1.5.1 release.Karsten Loesing2018-03-19
|
* Avoid calling bytesFor() unnecessarily.Karsten Loesing2018-03-17
| | | | Found while looking into #25522.
* Add lines according to their count.task-25522iwakeh2018-03-07
| | | | Making the test from the previous commit pass and fixing task-25522.
* Add a failing test.iwakeh2018-03-07
| | | | Making a static method easier accessible for tests.
* Add bastet to directory authorities to download votes for.Karsten Loesing2018-03-07
| | | | | | | | | We did download bastet's votes in the past after reading the consensus. But there could have been situations when there was no consensus that we did not explicitly ask for bastet's vote. Found per chance while setting up a CollecTor instance with a webstats module.
* Describe file protocol for Tor web server logs.task-20234iwakeh2018-02-26
| | | | Part of task-20234.
* Bump version to 1.5.0-dev.Karsten Loesing2018-02-26
|
* Prepare for 1.5.0 release.Karsten Loesing2018-02-26
|
* Circumvent Collection (integer) size limit.iwakeh2018-02-26
| | | | | | | | Clean log lines immediately when they are read and also make use of sanitized log's high redundancy immediately, i.e., continue with maps of <LocalDate, <Map<String, Long>>. Rename method(s) to reflect what they do.
* Reduce memory footprint and wall time.iwakeh2018-02-20
| | | | | | | | | | | | | Adapt to latest changes of metrics-lib (task-25329) and make use of the high redundancy of logs (e.g. a 3G file might only contain 350 different lines). This avoids OOM and array out of bounds exceptions for large files (>2G) and gives a speed-up of roughly 50%. (The earlier 66min are down to 34min for meronense&weschniakowii files plus two larger files.) There is a BATCH constant, which could be tuned for processing speed. It is logged for each webstats module run. Currently, it is set to 100k. This was more or less arbitrarily chosen and used for all the tests. A test run using 500k didn't show significant differences.
* Adapt CollecTor to latest metrics-lib master branch.iwakeh2018-02-20
|
* Add hasContent method to make even more use of DescriptorBuilder.iwakeh2018-02-20
|
* Make logging statements comply to Metrics' standards.iwakeh2018-02-20
| | | | Also edit here and there for more readability and less lines.
* Use DescriptorBuilder more often.iwakeh2018-02-20
| | | | Add convenience constructor accepting the first string as argument.
* Add a finalized state to DescriptorBuilder.iwakeh2018-02-20
| | | | | | To avoid possible inconsistencies DescriptorBuilder is finalized after the first call to 'toString' and cannot be altered anymore. Any attempt to add more leads to an IllegalStateException.
* Use Java8 idiom for toString method.iwakeh2018-02-20
|
* Make DescriptorBuilder also accept DescriptorBuilders.iwakeh2018-02-20
| | | | This might facilitate easier processing of descriptors.
* Rename SanitizedBridgeDescriptorBuilder to DescriptorBuilder.iwakeh2018-02-20
| | | | | | | | | | | The class doesn't 'know' about descriptor sanitization, it is only a sort of container for writing descriptors. It could be actually moved to some util package and used in other parsing steps, too. Also rename test helper classes to avoid naming conflicts. Remove 'descriptor' from variable names. Make DescriptorBuilder public. Adapt other classes as well as tests.
* Separate parsing and sanitizing steps for bridge descriptors.Karsten Loesing2018-02-20
| | | | First step towards implementing #20549.
* Avoid repeated validation of clean and validated log lines.iwakeh2018-02-05
|
* Optimize parallel processing and use static imports for readability.iwakeh2018-02-05
|
* Parallelize two more processing steps.iwakeh2018-02-05
|
* Use enum Method from metrics-lib.iwakeh2018-02-05
|
* Add webstats module with sync and local import functionality.iwakeh2018-01-31
| | | | Implements task-22428.
* Update copyright to 2018.Karsten Loesing2018-01-09
|
* Update metrics-base.Karsten Loesing2017-12-15
|
* Exclude lastModifiedMillis in index.json.Karsten Loesing2017-12-14
| | | | Fixes #24621.
* Bump version to 1.4.1-dev.Karsten Loesing2017-10-26
|
* Prepare for 1.4.1 release.Karsten Loesing2017-10-25
|
* Add change log entries for the two #23981 changes.Karsten Loesing2017-10-25
|
* Update metrics-base.Karsten Loesing2017-10-25
|
* Retain "bridge-distribution-request" lines.Karsten Loesing2017-10-25
|
* Handle bridge descriptors with unusual line order.Karsten Loesing2017-10-25
| | | | | | | | | Typically, the "published" line appears before the "fingerprint" line. However, an alternative Tor implementation orders these two lines differently, which is valid due to the spec. We need to handle this case by accepting lines in either order. Fixes #23981.
* Add test that will fail #23981.Karsten Loesing2017-10-25
|
* Bump version to 1.4.0-dev.Karsten Loesing2017-10-17
|
* Prepare for 1.4.0 release.Karsten Loesing2017-10-09
|
* Add the build revision to index.json files.iwakeh2017-10-09
| | | | Implements the final part of task-21414 for CollecTor.
* Added overview page for javadoc.task-21139iwakeh2017-09-20
|
* Add changelog entries.iwakeh2017-09-20
|
* Adapt and add tests for OnionPerf sync-runs.iwakeh2017-09-20
|
* Enable OnionPerf 'Sync' runs.iwakeh2017-09-20
|
* Make OnionPerf adhere to the standard CollecTorMain.iwakeh2017-09-20
| | | | | | | | This includes adding property 'OnionPerfSources' and renaming some markers properly. In addition, all camel-case occurrences of 'OnionPerf' have a capitalized 'P' now. Part of task-21759.
* Tweak the change log a bit.Karsten Loesing2017-09-19
|
* Un-prettify directory listings.Karsten Loesing2017-09-19
| | | | | With #22836 being deployed, Tor Metrics parses our index.json and provides its own directory listings. Time to stop prettifying ours.
generated by cgit v1.2.1 (git 2.18.0) at 2024-02-02 11:27:47 +0000