o ȳgL@sJddlmZmZdefddZdedefddZdedeefdd Zd S) )AnyListreturncCs*z ddl}W|Stytdw)NrzCould not import anthropic python package. This is needed in order to accurately tokenize the text for anthropic models. Please install it with `pip install anthropic`.) anthropic ImportError Anthropic)rrc/var/www/html/chatdoc2/venv/lib/python3.10/site-packages/langchain_community/utilities/anthropic.py_get_anthropic_clients  r textcCst}|j|dS)z-Get the number of tokens in a string of text.)r )r count_tokens)r clientrrr get_num_tokens_anthropics rcCst}|}||}|jS)z'Get the token ids for a string of text.)r get_tokenizerencodeids)r r tokenizer encoded_textrrr get_token_ids_anthropics rN)typingrrr strintrrrrrr s