logai.applications package

Subpackages

Submodules

logai.applications.application_interfaces module

class logai.applications.application_interfaces.WorkFlowConfig(data_loader_config: object | None = None, open_set_data_loader_config: object | None = None, preprocessor_config: object | None = None, log_parser_config: object | None = None, log_vectorizer_config: object | None = None, partitioner_config: object | None = None, open_set_partitioner_config: object | None = None, categorical_encoder_config: object | None = None, feature_extractor_config: object | None = None, anomaly_detection_config: object | None = None, nn_anomaly_detection_config: object | None = None, clustering_config: object | None = None, workflow_config: object | None = None)

Bases: Config

config class for end to end workflow.

Parameters:

  • data_loader_config – A config object for data loader.

  • open_set_data_loader_config – A config object for data loader for opensource public log datasets.

  • preprocessor_config – A config object for log preprocessor.

  • log_parser_config – A config object for log parser.

  • log_vectorizer_config – A config object for log vectorizer.

  • partitioner_config – A config object for log partitioner.

  • open_set_partitioner_config – A config object for log partitioner for opensource public log datasets.

  • categorical_encoder_config – A config object for categorical encoder of log data.

  • feature_extractor_config – A config object for log feature extractor.

  • anomaly_detection_config – A config object for log anomaly detector.

  • nn_anomaly_detection_config – A config object for neural anomaly detector.

  • clustering_config – A config object for log clustering algorithm.

anomaly_detection_config: object
categorical_encoder_config: object
clustering_config: object
data_loader_config: object
feature_extractor_config: object
classmethod from_dict(config_dict)

Loads a config from a config dict.

Parameters:

config_dict – The config parameters in a dict.

log_parser_config: object
log_vectorizer_config: object
nn_anomaly_detection_config: object
open_set_data_loader_config: object
open_set_partitioner_config: object
partitioner_config: object
preprocessor_config: object
workflow_config: object

logai.applications.auto_log_summarization module

class logai.applications.auto_log_summarization.AutoLogSummarization(config: WorkFlowConfig)

Bases: object

The unified framework for log parsing analysis. How to use, the design of this analysis app should follow the general workflow of automated log parsing. The workflow should be able to control solely by WorkFlowConfig.

Parameters:

config – The configuration that controls the behavior this app.

property attributes
execute()

Execute auto log parsing analysis. Store the results and index for searching.

find_log_pattern(logline: str, return_para_list: bool = True)

Find the log pattern for a given logline, return all dynamic parameters in this log pattern if needed.

get_parameter_list(log_pattern)

For a given log pattern, return the dynamic parameters.

Parameters:

log_pattern – The input log pattern.

Returns:

The parameter list with Values, valuecounts and position.

property log_patterns
property parsing_results
recognize_parameter_entity(para_list)

Placeholder for log parameter entity recognization

summarize_numeric_paramters(paras: list)

Placeholder for numeric parameter summarization

logai.applications.log_anomaly_detection module

class logai.applications.log_anomaly_detection.LogAnomalyDetection(config: WorkFlowConfig)

Bases: object

This is a workflow for log anomaly detection.

property anomaly_labels
property anomaly_results
property attributes
property counter_df
evaluation()
property event_group
execute()
property feature_df
property log_templates
property loglines
property results
property timestamps

logai.applications.log_clustering module

class logai.applications.log_clustering.LogClustering(config)

Bases: object

Clustering Application class defines log clustering workflow. It includes which algorithm to use.

property attributes
property clusters
property event_index
execute()
property logline_with_clusters
property loglines
property timestamps

Module contents