o ȳg:: @sdZddlZddlmZmZddlmZmZmZddl m Z ddl m Z ddl mZddlmZmZid d d d d d dd dddddddddddddddddd dd dd dd ddid dd!d"d#d$d%d"d&d$d'd(d)d(d*d+d,d-d.d+d/d-d0d1d2d1d3d4d5d6d7d8d9d4id:d6d;d4dd?d d@d>dAd>dBdCdDdCdEdCdFddGddHddId>dJd>dKd>dLd>idMd>dNd>dOddPddQddRdSdTdSdUdSdVdCdWdCdXdCdYdCdZdCd[dCd\d$d]d^d_d$id`d$dadbdcd$ddd"ded"dfdgdhd$didgdjdgdkdgdldgdmdndodndpd$dqd^drdgdsd$idtd$dud"dvd"dwdgdxd$dydgdzdgd{dgd|dnd}dnd~ddddd^dd^ddgddgddidddddddd(dd"dd"dd"dddd+dddd(ddddddddddddgd$ddgdgddd(dSdZGdddeZ dejddedededefddZ dejddededededef ddZGddde ZdS)z(Callback Handler that prints to std out.N)Enumauto)AnyDictList)warn_deprecated)BaseCallbackHandler) AIMessage)ChatGeneration LLMResulto1gQ?z o1-2024-12-17z o1-cachedgQ~?zo1-2024-12-17-cachedz o1-completiongQ?zo1-2024-12-17-completionzo3-minig/nR?zo3-mini-2025-01-31zo3-mini-cachedg/nB?zo3-mini-2025-01-31-cachedzo3-mini-completiong/nr?zo3-mini-2025-01-31-completionz o1-previewzo1-preview-cachedzo1-preview-2024-09-12zo1-preview-2024-09-12-cachedzo1-preview-completionz o1-preview-2024-09-12-completionzo1-minig~jth?zo1-mini-cachedg~jtX?zo1-mini-2024-09-12zo1-mini-2024-09-12-cachedzo1-mini-completiong~jt?zo1-mini-2024-09-12-completionz gpt-4o-miniga2U0*#?zgpt-4o-mini-cachedga2U0*?zgpt-4o-mini-2024-07-18zgpt-4o-mini-2024-07-18-cachedzgpt-4o-mini-completionga2U0*C?z!gpt-4o-mini-2024-07-18-completiongpt-4og{Gzd?z gpt-4o-cachedg{GzT?gpt-4o-2024-05-13g{Gzt?zgpt-4o-2024-08-06zgpt-4o-2024-08-06-cachedzgpt-4o-2024-11-20zgpt-4o-2024-11-20-cachedzgpt-4o-completiong{Gz?zgpt-4o-2024-05-13-completionzgpt-4o-2024-08-06-completionzgpt-4o-2024-11-20-completiongpt-4gQ?z gpt-4-0314z gpt-4-0613z gpt-4-32kzgpt-4-32k-0314zgpt-4-32k-0613zgpt-4-vision-previewzgpt-4-1106-previewzgpt-4-0125-previewzgpt-4-turbo-previewz gpt-4-turbozgpt-4-turbo-2024-04-09zgpt-4-completionzgpt-4-0314-completionzgpt-4-0613-completionzgpt-4-32k-completiongQ?zgpt-4-32k-0314-completionzgpt-4-32k-0613-completionzgpt-4-vision-preview-completionzgpt-4-1106-preview-completionzgpt-4-0125-preview-completionzgpt-4-turbo-preview-completionzgpt-4-turbo-completionz!gpt-4-turbo-2024-04-09-completionz gpt-3.5-turbozgpt-3.5-turbo-0125gMb@?zgpt-3.5-turbo-0301zgpt-3.5-turbo-0613zgpt-3.5-turbo-1106gMbP?zgpt-3.5-turbo-instructzgpt-3.5-turbo-16kzgpt-3.5-turbo-16k-0613zgpt-3.5-turbo-completiongMb`?zgpt-3.5-turbo-0125-completionzgpt-3.5-turbo-0301-completionzgpt-3.5-turbo-0613-completionzgpt-3.5-turbo-1106-completionz!gpt-3.5-turbo-instruct-completionzgpt-3.5-turbo-16k-completiongMbp?z!gpt-3.5-turbo-16k-0613-completionz gpt-35-turbozgpt-35-turbo-0125zgpt-35-turbo-0301zgpt-35-turbo-0613zgpt-35-turbo-instructzgpt-35-turbo-16kzgpt-35-turbo-16k-0613zgpt-35-turbo-completionzgpt-35-turbo-0125-completionzgpt-35-turbo-0301-completionzgpt-35-turbo-0613-completionz gpt-35-turbo-instruct-completionzgpt-35-turbo-16k-completionz gpt-35-turbo-16k-0613-completionz text-ada-001g-C6:?adaztext-babbage-001babbageztext-curie-001curieztext-davinci-003g{Gz?ztext-davinci-002zcode-davinci-002zbabbage-002-finetunedg-C6Z?zdavinci-002-finetunedzgpt-3.5-turbo-0613-finetunedzgpt-3.5-turbo-1106-finetunedzgpt-3.5-turbo-0125-finetunedz gpt-4o-mini-2024-07-18-finetunedga2U0*3?z'gpt-4o-mini-2024-07-18-finetuned-cachedz babbage-002-finetuned-completionz davinci-002-finetuned-completionz'gpt-3.5-turbo-0613-finetuned-completiong~jtx?z'gpt-3.5-turbo-1106-finetuned-completionz'gpt-3.5-turbo-0125-finetuned-completionz+gpt-4o-mini-2024-07-18-finetuned-completionga2U0*S?zbabbage-002-azure-finetunedzdavinci-002-azure-finetunedga2U0*c?)z!gpt-35-turbo-0613-azure-finetunedz&babbage-002-azure-finetuned-completionz&davinci-002-azure-finetuned-completionz,gpt-35-turbo-0613-azure-finetuned-completionzada-finetuned-legacyzbabbage-finetuned-legacyzcurie-finetuned-legacyzdavinci-finetuned-legacyc@s"eZdZdZeZeZeZdS) TokenTypezToken type enum.N)__name__ __module__ __qualname____doc__rPROMPT PROMPT_CACHED COMPLETIONrre/var/www/html/chatdoc2/venv/lib/python3.10/site-packages/langchain_community/callbacks/openai_info.pyrs  rF token_type model_name is_completionrreturncCs|r tddddtj}|}d|vr|ddd}d|vr*|d dd }d |vr7|d d d }|tjkr\|dsX|dsX|dsX|dsXd|vr\d|vr\|dS|tjkrt|dsk|drt|dst|dS|S)a Standardize the model name to a format that can be used in the OpenAI API. Args: model_name: Model name to standardize. is_completion: Whether the model is used for completion or not. Defaults to False. Deprecated in favor of ``token_type``. token_type: Token type. Defaults to ``TokenType.PROMPT``. Returns: Standardized model name. 0.3.13zis_completion is deprecated. Use token_type instead. Example: from langchain_community.callbacks.openai_info import TokenType standardize_model_name('gpt-4o', token_type=TokenType.COMPLETION) 1.0sincemessageremovalz.ft-rz-azure-finetunedz:ft-:z-finetuned-legacyzft:z -finetunedrzgpt-3.5zgpt-35zo1- finetunedlegacyz -completionr r rz-cached)rrrlowersplit startswithr)rr rrrrstandardize_model_namesD   r/ num_tokenscCsZ|r tddddtj}t||d}|tvr%td|ddtt||d S) a Get the cost in USD for a given model and number of tokens. Args: model_name: Name of the model num_tokens: Number of tokens. is_completion: Whether the model is used for completion or not. Defaults to False. Deprecated in favor of ``token_type``. token_type: Token type. Defaults to ``TokenType.PROMPT``. Returns: Cost in USD. r"zis_completion is deprecated. Use token_type instead. Example: from langchain_community.callbacks.openai_info import TokenType get_openai_token_cost_for_model('gpt-4o', 10, token_type=TokenType.COMPLETION) r#r$rzUnknown model: z=. Please provide a valid OpenAI model name.Known models are: z, i)rrrr/MODEL_COST_PER_1K_TOKENS ValueErrorjoinkeys)rr0r rrrrget_openai_token_cost_for_models   r5cseZdZUdZdZeed<dZeed<dZeed<dZ eed<dZ eed<dZ eed<d Z e ed <d#fd d Zd efddZed efddZdeeefdeeded d fddZdeded d fddZdeded d fddZd$ddZd ed dfd!d"ZZS)%OpenAICallbackHandlerz)Callback Handler that tracks OpenAI info.r total_tokens prompt_tokensprompt_tokens_cachedcompletion_tokensreasoning_tokenssuccessful_requestsg total_costr!Ncstt|_dS)N)super__init__ threadingLock_lockself __class__rrr?s zOpenAICallbackHandler.__init__cCs<d|jd|jd|jd|jd|jd|jd|jS)Nz Tokens Used: z Prompt Tokens: z Prompt Tokens Cached: z Completion Tokens: z Reasoning Tokens: z Successful Requests: z Total Cost (USD): $)r7r8r9r:r;r<r=rCrrr__repr__!s zOpenAICallbackHandler.__repr__cCdS)z;Whether to call verbose callbacks even if verbose is False.TrrCrrralways_verbose,sz$OpenAICallbackHandler.always_verbose serializedpromptskwargscKrH)zPrint out the prompts.Nr)rDrJrKrLrrr on_llm_start1sz"OpenAICallbackHandler.on_llm_starttokencKrH)zPrint out the token.Nr)rDrNrLrrron_llm_new_token7z&OpenAICallbackHandler.on_llm_new_tokenresponsecKsz |jdd}Wn tyd}Ynwt|tr=z|j}t|tr*|j}|j}nd}d}Wnty<d}d}Ynwd}d}d}d}|rd|di} |d} |d} |pXi d} rct | } n|j durkd} n t |j dd} d| d ivr|d d}d | d ivr|d d }nC|j durdSd |j vr|j |j d 7_ WddS1swYdS|j d } | dd} | dd} t |j dd} | tvr| |}t| |tjd}t| |tjd}||}t| | tjd}nd}d}|j @|j||7_|j| dd7_|j| 7_|j|7_|j| 7_|j|7_|j d 7_ WddS1sDwYdS)zCollect token usage.rNr7 output_tokens input_tokensr cache_readinput_token_details reasoningoutput_token_details token_usager)r:r8r) generations IndexError isinstancer r&r usage_metadataresponse_metadataAttributeErrorgetr/ llm_outputrBr<r1r5rrrrr=r7r8r9r:r;)rDrQrL generationr&r]r^r9r;rYr:r8response_model_nameruncached_prompt_tokensuncached_prompt_costcached_prompt_cost prompt_costcompletion_costrrr on_llm_end;s                $z OpenAICallbackHandler.on_llm_endcC|S)z&Return a copy of the callback handler.rrCrrr__copy__rPzOpenAICallbackHandler.__copy__memocCrj)z+Return a deep copy of the callback handler.r)rDrlrrr __deepcopy__rPz"OpenAICallbackHandler.__deepcopy__)r!N)r!r6)rrrrr7int__annotations__r8r9r:r;r<r=floatr?strrGpropertyboolrIrrrrMrOr rirkrm __classcell__rrrErr6s4            Wr6)F)rr@enumrrtypingrrrlangchain_core._apirlangchain_core.callbacksrlangchain_core.messagesr langchain_core.outputsr r r1rrrqrsr/rnrpr5r6rrrrsz        "#$%'(*+,-./02345789:;<=>?@ABDEFGHIJKLMNOSTUVWXYZ^_`abcdeghijklmopqrstuwxyz{|}~       : (