:autogenerated:

gt4sd.frameworks.granular.tokenizer.tokenizer module
====================================================

.. currentmodule:: gt4sd.frameworks.granular.tokenizer.tokenizer

.. automodule:: gt4sd.frameworks.granular.tokenizer.tokenizer
    :members: BIG_SMI_REGEX_PATTERN, BasicSelfiesTokenizer, BasicSmilesTokenizer, BasicTokenizer, BigSmilesTokenizer, GenericTokenizer, SMI_REGEX_PATTERN, SelfiesTokenizer, SmilesTokenizer, TOKENIZER_FACTORY, Tokenizer, load_vocab, selfies_alphabet
    :undoc-members:
    :show-inheritance:
    :member-order: bysource

    Summary
    -------

    Classes:

    .. autosummary::
        :nosignatures:

        BasicSelfiesTokenizer
        BasicSmilesTokenizer
        BasicTokenizer
        BigSmilesTokenizer
        GenericTokenizer
        SelfiesTokenizer
        SmilesTokenizer
        Tokenizer

    Functions:

    .. autosummary::
        :nosignatures:

        load_vocab
        selfies_alphabet








    Reference
    ---------