logai package

Subpackages

• logai.algorithms package
  • Subpackages
    • logai.algorithms.anomaly_detection_algo package
      • Submodules
      • logai.algorithms.anomaly_detection_algo.anomaly_detector_het module
      • logai.algorithms.anomaly_detection_algo.dbl module
      • logai.algorithms.anomaly_detection_algo.distribution_divergence module
      • logai.algorithms.anomaly_detection_algo.ets module
      • logai.algorithms.anomaly_detection_algo.forecast_nn module
      • logai.algorithms.anomaly_detection_algo.isolation_forest module
      • logai.algorithms.anomaly_detection_algo.local_outlier_factor module
      • logai.algorithms.anomaly_detection_algo.logbert module
      • logai.algorithms.anomaly_detection_algo.one_class_svm module
      • Module contents
    • logai.algorithms.categorical_encoding_algo package
      • Submodules
      • logai.algorithms.categorical_encoding_algo.label_encoding module
      • logai.algorithms.categorical_encoding_algo.one_hot_encoding module
      • logai.algorithms.categorical_encoding_algo.ordinal_encoding module
      • Module contents
    • logai.algorithms.clustering_algo package
      • Submodules
      • logai.algorithms.clustering_algo.birch module
      • logai.algorithms.clustering_algo.dbscan module
      • logai.algorithms.clustering_algo.kmeans module
      • Module contents
    • logai.algorithms.nn_model package
      • Subpackages
      • Submodules
      • logai.algorithms.nn_model.transformers module
      • Module contents
    • logai.algorithms.parsing_algo package
      • Submodules
      • logai.algorithms.parsing_algo.ael module
      • logai.algorithms.parsing_algo.drain module
      • logai.algorithms.parsing_algo.iplom module
      • Module contents
    • logai.algorithms.vectorization_algo package
      • Submodules
      • logai.algorithms.vectorization_algo.fasttext module
      • logai.algorithms.vectorization_algo.forecast_nn module
      • logai.algorithms.vectorization_algo.logbert module
      • logai.algorithms.vectorization_algo.semantic module
      • logai.algorithms.vectorization_algo.sequential module
      • logai.algorithms.vectorization_algo.tfidf module
      • logai.algorithms.vectorization_algo.word2vec module
      • Module contents
  • Submodules
  • logai.algorithms.algo_interfaces module
    • AnomalyDetectionAlgo
      • AnomalyDetectionAlgo.fit()
      • AnomalyDetectionAlgo.predict()
    • CategoricalEncodingAlgo
      • CategoricalEncodingAlgo.fit_transform()
    • ClusteringAlgo
      • ClusteringAlgo.fit()
      • ClusteringAlgo.predict()
    • FeatureExtractionAlgo
      • FeatureExtractionAlgo.extract()
    • NNAnomalyDetectionAlgo
      • NNAnomalyDetectionAlgo.fit()
      • NNAnomalyDetectionAlgo.predict()
    • ParsingAlgo
      • ParsingAlgo.fit()
      • ParsingAlgo.parse()
    • VectorizationAlgo
      • VectorizationAlgo.fit()
      • VectorizationAlgo.transform()
  • logai.algorithms.factory module
    • AlgorithmFactory
      • AlgorithmFactory.get_algorithm()
      • AlgorithmFactory.get_algorithm_class()
      • AlgorithmFactory.get_config()
      • AlgorithmFactory.get_config_class()
      • AlgorithmFactory.instance
      • AlgorithmFactory.register()
      • AlgorithmFactory.unregister()
  • Module contents
• logai.analysis package
  • Submodules
  • logai.analysis.anomaly_detector module
    • AnomalyDetectionConfig
      • AnomalyDetectionConfig.algo_name
      • AnomalyDetectionConfig.algo_params
      • AnomalyDetectionConfig.custom_params
      • AnomalyDetectionConfig.from_dict()
    • AnomalyDetector
      • AnomalyDetector.fit()
      • AnomalyDetector.predict()
  • logai.analysis.clustering module
    • Clustering
      • Clustering.fit()
      • Clustering.predict()
    • ClusteringConfig
      • ClusteringConfig.algo_name
      • ClusteringConfig.algo_params
      • ClusteringConfig.custom_params
      • ClusteringConfig.from_dict()
  • logai.analysis.nn_anomaly_detector module
    • NNAnomalyDetector
      • NNAnomalyDetector.fit()
      • NNAnomalyDetector.predict()
  • Module contents
• logai.applications package
  • Subpackages
    • logai.applications.openset package
      • Subpackages
      • Module contents
  • Submodules
  • logai.applications.application_interfaces module
    • WorkFlowConfig
      • WorkFlowConfig.anomaly_detection_config
      • WorkFlowConfig.categorical_encoder_config
      • WorkFlowConfig.clustering_config
      • WorkFlowConfig.data_loader_config
      • WorkFlowConfig.feature_extractor_config
      • WorkFlowConfig.from_dict()
      • WorkFlowConfig.log_parser_config
      • WorkFlowConfig.log_vectorizer_config
      • WorkFlowConfig.nn_anomaly_detection_config
      • WorkFlowConfig.open_set_data_loader_config
      • WorkFlowConfig.open_set_partitioner_config
      • WorkFlowConfig.partitioner_config
      • WorkFlowConfig.preprocessor_config
      • WorkFlowConfig.workflow_config
  • logai.applications.auto_log_summarization module
    • AutoLogSummarization
      • AutoLogSummarization.attributes
      • AutoLogSummarization.execute()
      • AutoLogSummarization.find_log_pattern()
      • AutoLogSummarization.get_parameter_list()
      • AutoLogSummarization.log_patterns
      • AutoLogSummarization.parsing_results
      • AutoLogSummarization.recognize_parameter_entity()
      • AutoLogSummarization.summarize_numeric_paramters()
  • logai.applications.log_anomaly_detection module
    • LogAnomalyDetection
      • LogAnomalyDetection.anomaly_labels
      • LogAnomalyDetection.anomaly_results
      • LogAnomalyDetection.attributes
      • LogAnomalyDetection.counter_df
      • LogAnomalyDetection.evaluation()
      • LogAnomalyDetection.event_group
      • LogAnomalyDetection.execute()
      • LogAnomalyDetection.feature_df
      • LogAnomalyDetection.log_templates
      • LogAnomalyDetection.loglines
      • LogAnomalyDetection.results
      • LogAnomalyDetection.timestamps
  • logai.applications.log_clustering module
    • LogClustering
      • LogClustering.attributes
      • LogClustering.clusters
      • LogClustering.event_index
      • LogClustering.execute()
      • LogClustering.logline_with_clusters
      • LogClustering.loglines
      • LogClustering.timestamps
  • Module contents
• logai.dataloader package
  • Submodules
  • logai.dataloader.data_loader module
    • DataLoaderConfig
      • DataLoaderConfig.datetime_format
      • DataLoaderConfig.dimensions
      • DataLoaderConfig.filepath
      • DataLoaderConfig.infer_datetime
      • DataLoaderConfig.log_type
      • DataLoaderConfig.open_dataset
      • DataLoaderConfig.reader_args
    • DefaultDataLoader
    • FileDataLoader
      • FileDataLoader.load_data()
  • logai.dataloader.data_loader_utils module
    • generate_logformat_regex()
    • load_data()
    • log_to_dataframe()
  • logai.dataloader.data_model module
    • LogRecordObject
      • LogRecordObject.attributes
      • LogRecordObject.body
      • LogRecordObject.dropna()
      • LogRecordObject.filter_by_index()
      • LogRecordObject.from_dataframe()
      • LogRecordObject.labels
      • LogRecordObject.load_from_csv()
      • LogRecordObject.resource
      • LogRecordObject.save_to_csv()
      • LogRecordObject.select_by_index()
      • LogRecordObject.severity_number
      • LogRecordObject.severity_text
      • LogRecordObject.span_id
      • LogRecordObject.timestamp
      • LogRecordObject.to_dataframe()
      • LogRecordObject.trace_id
  • logai.dataloader.openset_data_loader module
    • OpenSetDataLoader
      • OpenSetDataLoader.dl_config
      • OpenSetDataLoader.load_data()
    • OpenSetDataLoaderConfig
      • OpenSetDataLoaderConfig.dataset_name
      • OpenSetDataLoaderConfig.filepath
    • get_config()
  • Module contents
• logai.information_extraction package
  • Submodules
  • logai.information_extraction.categorical_encoder module
    • CategoricalEncoder
      • CategoricalEncoder.fit_transform()
    • CategoricalEncoderConfig
      • CategoricalEncoderConfig.from_dict()
      • CategoricalEncoderConfig.name
      • CategoricalEncoderConfig.params
  • logai.information_extraction.feature_extractor module
    • FeatureExtractor
      • FeatureExtractor.convert_to_counter_vector()
      • FeatureExtractor.convert_to_feature_vector()
      • FeatureExtractor.convert_to_sequence()
    • FeatureExtractorConfig
      • FeatureExtractorConfig.group_by_category
      • FeatureExtractorConfig.group_by_time
      • FeatureExtractorConfig.max_feature_len
      • FeatureExtractorConfig.sliding_window
      • FeatureExtractorConfig.steps
  • logai.information_extraction.log_parser module
    • LogParser
      • LogParser.fit()
      • LogParser.fit_parse()
      • LogParser.get_parameter_list()
      • LogParser.load()
      • LogParser.parse()
      • LogParser.save()
    • LogParserConfig
      • LogParserConfig.custom_config
      • LogParserConfig.from_dict()
      • LogParserConfig.parsing_algo_params
      • LogParserConfig.parsing_algorithm
  • logai.information_extraction.log_vectorizer module
    • LogVectorizer
      • LogVectorizer.fit()
      • LogVectorizer.transform()
    • VectorizerConfig
      • VectorizerConfig.algo_name
      • VectorizerConfig.algo_param
      • VectorizerConfig.custom_param
      • VectorizerConfig.from_dict()
  • Module contents
• logai.preprocess package
  • Submodules
  • logai.preprocess.bgl_preprocessor module
    • BGLPreprocessor
  • logai.preprocess.hdfs_preprocessor module
    • HDFSPreprocessor
  • logai.preprocess.openset_partitioner module
    • OpenSetPartitioner
      • OpenSetPartitioner.generate_session_window()
      • OpenSetPartitioner.generate_sliding_window()
      • OpenSetPartitioner.partition()
    • OpenSetPartitionerConfig
      • OpenSetPartitionerConfig.logsequence_delim
      • OpenSetPartitionerConfig.session_window
      • OpenSetPartitionerConfig.sliding_window
  • logai.preprocess.openset_preprocessor module
    • OpenSetPreprocessor
      • OpenSetPreprocessor.clean_log()
  • logai.preprocess.partitioner module
    • Partitioner
      • Partitioner.group_counter()
      • Partitioner.group_sliding_window()
      • Partitioner.sliding_window()
    • PartitionerConfig
      • PartitionerConfig.exclude_last_window
      • PartitionerConfig.exclude_smaller_windows
      • PartitionerConfig.group_by_category
      • PartitionerConfig.group_by_time
      • PartitionerConfig.sep_token
      • PartitionerConfig.sliding_window
    • concat_logs()
  • logai.preprocess.preprocessor module
    • Preprocessor
      • Preprocessor.clean_log()
      • Preprocessor.group_log_index()
      • Preprocessor.identify_timestamps()
    • PreprocessorConfig
      • PreprocessorConfig.custom_delimiters_regex
      • PreprocessorConfig.custom_replace_list
  • logai.preprocess.thunderbird_preprocessor module
    • ThunderbirdPreprocessor
  • Module contents
• logai.utils package
  • Submodules
  • logai.utils.constants module
    • Field
      • Field.ATTRIBUTES
      • Field.BODY
      • Field.LABELS
      • Field.RESOURCE
      • Field.SPAN_ID
      • Field.TIMESTAMP
  • logai.utils.dataset_utils module
    • split_train_dev_test_for_anomaly_detection()
  • logai.utils.evaluate module
    • get_accuracy_precision_recall()
  • logai.utils.file_utils module
    • file_exists()
    • read_file()
  • logai.utils.functions module
    • get_parameter_list()
    • pad()
    • pd_to_timeseries()
  • logai.utils.tokenize module
    • replace_delimeters()
    • tokenize()
  • Module contents

Submodules

logai.config_interfaces module

class logai.config_interfaces.Config

Bases: ABC

as_dict()

classmethod from_dict(config_dict)

Loads a config from a config dict.

Parameters:

config_dict – The config parameters in a dict.

Module contents