logai.utils package
Submodules
logai.utils.constants module
logai.utils.dataset_utils module
logai.utils.evaluate module
logai.utils.file_utils module
logai.utils.functions module
logai.utils.tokenize module
Module that includes common tokenization functions to be applied by pandas dataframes.
- logai.utils.tokenize.replace_delimeters(logline, delimeter_regex)
Remove customer delimeters.
- logai.utils.tokenize.tokenize(logline, config)
Common tokenization of logline and using space to separate tokens.