BenchmarksΒΆ
All the log parsers have been evaluated on loghub log samples. We report parsing accuracy as the percentage of accurately parsed log messages. Note that accuracy values above 0.9 are marked in bold, and the best accuracy results achieved are marked with *.
Tools | HDFS | Hadoop | Spark | Zookeeper | OpenStack | BGL | HPC | Thunderbird |
---|---|---|---|---|---|---|---|---|
SLCT | 0.545 | 0.423 | 0.685 | 0.726 | 0.867 | 0.573 | 0.839 | 0.882 |
AEL | 0.998 | 0.538 | 0.905 | 0.921 | 0.758 | 0.957 | 0.903 | 0.941 |
IPLoM | 1* | 0.954 | 0.920 | 0.962 | 0.871 | 0.939 | 0.824 | 0.663 |
LKE | 1* | 0.670 | 0.634 | 0.438 | 0.787 | 0.128 | 0.574 | 0.813 |
LFA | 0.885 | 0.900 | 0.994 | 0.839 | 0.200 | 0.854 | 0.817 | 0.649 |
LogSig | 0.850 | 0.633 | 0.544 | 0.738 | 0.866 | 0.227 | 0.354 | 0.694 |
SHISO | 0.998 | 0.867 | 0.906 | 0.660 | 0.722 | 0.711 | 0.325 | 0.576 |
LogCluster | 0.546 | 0.563 | 0.799 | 0.732 | 0.696 | 0.835 | 0.788 | 0.599 |
LenMa | 0.998 | 0.885 | 0.884 | 0.841 | 0.743 | 0.690 | 0.830 | 0.943 |
LogMine | 0.851 | 0.870 | 0.576 | 0.688 | 0.743 | 0.723 | 0.784 | 0.919 |
Spell | 1* | 0.778 | 0.905 | 0.964 | 0.764 | 0.787 | 0.654 | 0.844 |
Drain | 0.998 | 0.948 | 0.920 | 0.967 | 0.733 | 0.963 | 0.887 | 0.955 |
MoLFI | 0.998 | 0.957 | 0.418 | 0.839 | 0.213 | 0.960 | 0.824 | 0.646 |
Tools | Windows | Linux | Mac | Android | HealthApp | Apache | OpenSSH | Proxifier |
SLCT | 0.697 | 0.297 | 0.558 | 0.882 | 0.331 | 0.731 | 0.521 | 0.518 |
AEL | 0.690 | 0.673 | 0.764 | 0.682 | 0.568 | 1* | 0.538 | 0.518 |
IPLoM | 0.567 | 0.672 | 0.673 | 0.712 | 0.822 | 1* | 0.802 | 0.515 |
LKE | 0.990 | 0.519 | 0.369 | 0.909 | 0.592 | 1* | 0.426 | 0.495 |
LFA | 0.588 | 0.279 | 0.599 | 0.616 | 0.549 | 1* | 0.501 | 0.026 |
LogSig | 0.689 | 0.169 | 0.478 | 0.548 | 0.235 | 0.582 | 0.373 | 0.967 |
SHISO | 0.701 | 0.672 | 0.595 | 0.585 | 0.397 | 1* | 0.619 | 0.517 |
LogCluster | 0.713 | 0.629 | 0.604 | 0.798 | 0.531 | 0.709 | 0.426 | 0.951 |
LenMa | 0.566 | 0.701 | 0.698 | 0.880 | 0.174 | 1* | 0.925 | 0.508 |
LogMine | 0.993 | 0.612 | 0.872 | 0.504 | 0.684 | 1* | 0.431 | 0.517 |
Spell | 0.989 | 0.605 | 0.757 | 0.919 | 0.639 | 1* | 0.554 | 0.527 |
Drain | 0.997 | 0.690 | 0.787 | 0.911 | 0.780 | 1* | 0.788 | 0.527 |
MoLFI | 0.406 | 0.284 | 0.636 | 0.788 | 0.440 | 1* | 0.50 | 0.013 |