Papers

A list of papers about log parsing

  1. [ICSE’19] Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, Michael R. Lyu. Tools and Benchmarks for Automated Log Parsing, International Conference on Software Engineering (ICSE), 2019.
  2. [TDSC’18] Pinjia He, Jieming Zhu, Shilin He, Jian Li, Michael R. Lyu. Towards Automated Log Parsing for Large-Scale Log Data Analysis, IEEE Transactions on Dependable and Secure Computing (TDSC), 2018.
  3. [TKDE’18] Min Du, Feifei Li. Spell: Online Streaming Parsing of Large Unstructured System Logs, IEEE Transactions on Knowledge and Data Engineering (TKDE), 2018.
  4. [ICPC’18] Salma Messaoudi, Annibale Panichella, Domenico Bianculli, Lionel Briand, Raimondas Sasnauskas. A Search-based Approach for Accurate Identification of Log Message Formats, IEEE/ACM International Conference on Program Comprehension (ICPC), 2018.
  5. [SIGMOD’18] Yihan Gao, Silu Huang, Aditya Parameswaran. Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets, International Conference on Management of Data (SIGMOD), 2018.
  6. [MASCOTS’18] Nicolas Aussel, Yohan Petetin, Sophie Chabridon. Improving Performances of Log Mining for Anomaly Prediction Through NLP-Based Log Parsing, International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS), 2018.
  7. [ICICS’18] Zhiyuan Zhao, Chenxu Wang, Wei Rao. Slop: Towards an Efficient and Universal Streaming Log Parser, International Conference on Information and Communications Security (ICICS), 2018.
  8. [ICWS’17] Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R. Lyu. Drain: An Online Log Parsing Approach with Fixed Depth Tree, IEEE International Conference on Web Services (ICWS), 2017.
  9. [Benelearn’17] Stefan Thaler, Vlado Menkovski, Milan Petkovic. Towards Unsupervised Signature Extraction of Forensic Logs, The Twenty-Sixth Benelux Conference on Machine Learning (Benelearn), 2017.
  10. [ISDFS’17] Stefan Thaler, Vlado Menkonvski, Milan Petkovic. Towards A Neural Language Model for Signature Extraction From Forensic Logs, International Symposium on Digital Forensic and Security (ISDFS), 2017.
  11. [DSN’16] Pinjia He, Jieming Zhu, Shilin He, Jian Li, Michael R. Lyu. An Evaluation Study on Log Parsing and Its Use in Log Mining, IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2016.
  12. [ICDM’16] Min Du, Feifei Li. Spell: Streaming Parsing of System Event Logs, IEEE International Conference on Data Mining (ICDM), 2016.
  13. [KDD’16] Animesh Nandi, Atri Mandal, Shubham Atreja, Gargi B. Dasgupta, Subhrajit Bhattacharya. Anomaly Detection Using Program Control Flow Graph Mining from Execution Logs, ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2016.
  14. [MILCOM’16] Risto Vaarandi, Markus Kont, Mauno Pihelgas. Event Log Analysis with the LogCluster Tool. IEEE Military Communications Conference (MILCOM), 2016.
  15. [arXiv’16] Keiichi Shima. Length Matters: Clustering System Log Messages using Length of Words, arXiv:1611.03213 (arXiv), 2016.
  16. [CIKM’16] Hossein Hamooni, Biplob Debnath, Jianwu Xu, Hui Zhang, Guofei Jiang, Abdullah Mueen. LogMine: Fast Pattern Recognition for Log Analytics, ACM International Conference on Information and Knowledge Management (CIKM), 2016.
  17. [IDDPSW’16] Yining Zhao, Haili Xiao. Extracting Log Patterns from System Logs in LARGE, IEEE International Parallel and Distributed Processing Symposium Workshops (IDPSW), 2016.
  18. [MILCOM’15] Jing Ya, Tingwen Liu, Haoliang Zhang, Jinqiao Shi, Li Guo. An Automatic Approach to Extract the Formats of. Network and Security Log Messages, IEEE Military Communications Conference (MILCOM), 2015.
  19. [CNSM’15] Risto Vaarandi, Mauno Pihelgas. LogCluster - A Data Clustering and Pattern Mining Algorithm for Event Logs, International Conference on Network and Service Management (CNSM), 2015.
  20. [CNSM’15] Tatsuaki Kimura, Akio Watanabe, Tsuyoshi Toyono, Keisuke Ishibashi. Proactive Failure Detection Learning Generation Patterns of Large-Scale Network Logs, International Conference on Network and Service Management (CNSM), 2015.
  21. [WISTP’15] David Jaeger, Amir Azodi, Feng Cheng, Christoph Meinel. Normalizing Security Events with a Hierarchical Knowledge Base, The 9th Workshop on Information Security Theory and Practice, 2015.
  22. [WHL’14] Xia Ning, Geoff Jiang, Haifeng Chen, Kenji Yoshihira. HLAer:a System for Heterogeneous Log Analysis, SDM Workshop on Heterogeneous Learning (WHL), 2014.
  23. [MSR’14] Ghazaleh Khodabandelou, Charlotte Hug, Rebecca Deneckere, Camille Salinesi. Unsupervised Discovery of Intentional Process Models from Event Logs, International Working Conference on Mining Software Repositories (MSR), 2014.
  24. [CFI’14] Satoru Kobayashi, Kensuke Fukuda, Hiroshi Esaki. Towards an NLP-based log template generation algorithm for system log analysis,International Conference on Future Internet Technologies (CFI), 2014.
  25. [2014] Basanta Joshi, Manoj ghimire. A Data Streaming Algorithm for Signature Generation and Clustering of Log Messages, Logpoint Technical Report, 2014.
  26. [BigMine’13] Farhana Zulkernine, Patrick Martin, Wendy Powley, Sima Soltani, Serge Mankovskii, Mark Addleman. CAPRI: A Tool for Mining Complex Line Patterns in Large Log Data, International Workshop on Big Data, Streams and Heterogeneous Source Mining: Algorithms, Systems, Programming Models and Applications (BigMine), 2013.
  27. [TKDE’12] Adetokunbo Makanju, A. Nur Zincir-Heywood, Evangelos E. Milios. A Lightweight Algorithm for Message Type Extraction in System Application Logs, IEEE Transactions on Knowledge and Data Engineering (TKDE), 2012.
  28. [CIKM’11] Liang Tang, Tao Li, Chang-Shing Perng. LogSig: Generating System Events from Raw Textual Logs, ACM International Conference on Information and Knowledge Management (CIKM), 2011.
  29. [Euro-Par’11] Ana Gainaru, Franck Cappello, Stefan Trausan-Matu, Bill Kramer. Event Log Mining Tool for Large Scale HPC Systems, InEuropean Conference on Parallel Processing (Euro-Par), 2011.
  30. [SIGOPS’10] Kathleen Fisher, David Walker, Kenny Q. Zhu. Incremental Learning of System Log Formats, ACM SIGOPS Operating Systems Review (SIGOPS), 2010.
  31. [MSR’10] Meiyappan Nagappan, Mladen A. Vouk. Abstracting Log Lines to Log Event Types for Mining Software System Logs, International Working Conference on Mining Software Repositories (MSR), 2010.
  32. [ICDM’10] Liang Tang, Tao Li. LogTree: A Framework for Generating System Events from Raw Textual Logs, InData Mining (ICDM), 2010.
  33. [KDD’09] Adetokunbo Makanju, A. Nur Zincir-Heywood, Evangelos E. Milios. Clustering Event Logs Using Iterative Partitioning, ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2009.
  34. [ICDM’09] Qiang Fu, Jian-Guang Lou, Yi Wang, Jiang Li. Execution Anomaly Detection in Distributed Systems through Unstructured Log Analysis, IEEE International Conference on Data Mining (ICDM), 2009.
  35. [SOSP’09] Wei Xu, Ling Huang, Armando Fox, David Patterson, Michael Jordan. Mining Console Logs for Large-Scale System Problem Detection, ACM SIGOPS Symposium on Operating Systems Principles (SOSP), 2009.
  36. [ISSRE’09] Meiyappan Nagappan, Kesheng Wu, Mladen A. Vouk. Efficiently Extracting Operational Profiles from Execution Logs Using Suffix Arrays, InSoftware Reliability Engineering (ISSRE), 2009.
  37. [JSME’08] Zhen Ming Jiang, Ahmed E. Hassan, Gilbert Hamann, Parminder Flora. AAn Automated Approach for Abstracting Execution Logs to Execution Events, Journal of Software Maintenance and Evolution: Research and Practice (JSME), 2008.
  38. [QSIC’08] Zhen Ming Jiang, Ahmed E. Hassan, Parminder Flora, Gilbert Hamann. Abstracting Execution Logs to Execution Events for Enterprise Applications, International Conference on on Quality Software (QSIC), 2018.
  39. [NOMS’08] Risto Vaarandi. Mining Event Logs with SLCT and LogHound, Network Operations and Management Symposium (NOMS), 2008.
  40. [INTELLCOMM’04] Risto Vaarandi. A Breadth-First Algorithm for Mining Frequent Patterns from Event Logs, Intelligence in Communication Systems (INTELLCOMM), 2004.
  41. [IPOM’03] Risto Vaarandi. A Data Clustering Algorithm for Mining Patterns from Event Logs, IEEE Workshop on IP Operations & Management (IPOM), 2003.