o ȳg@sldZddlZddlmZmZmZmZddlZddlZddl m Z ddl m Z m Z mZdZGddde ZdS) zWUtil that calls Metaphor Search API. In order to set this up, follow instructions at: N)AnyDictListOptionalget_from_dict_or_env) BaseModel ConfigDictmodel_validatorzhttps://api.metaphor.systemsc@seZdZUdZeed<dZeed<eddZ       d ded ed e e ed e e ed e ed e ede ede ede e de e fddZeddededefddZ       d ded ed e e ed e e ed e ed e ede ede ede e de efddZ       d ded ed e e ed e e ed e ed e ede ede ede e de efddZde ede efddZdS)!MetaphorSearchAPIWrapperz Wrapper for Metaphor Search API.metaphor_api_key kforbid)extraNquery num_resultsinclude_domainsexclude_domainsstart_crawl_dateend_crawl_datestart_published_dateend_published_dateuse_autopromptreturnc  CsPd|ji} ||||||||| d } tjtd| | d} | | } | dS)N X-Api-Key numResultsrincludeDomainsexcludeDomainsstartCrawlDate endCrawlDatestartPublishedDateendPublishedDate useAutoprompt/search)headersjsonresults)r requestspostMETAPHOR_API_URLraise_for_statusr')selfrrrrrrrrrr&paramsresponsesearch_resultsr1i/var/www/html/chatdoc2/venv/lib/python3.10/site-packages/langchain_community/utilities/metaphor_search.py_metaphor_search_resultss&  z1MetaphorSearchAPIWrapper._metaphor_search_resultsbefore)modevaluescCst|dd}||d<|S)z9Validate that api key and endpoint exists in environment.r METAPHOR_API_KEYr)clsr6r r1r1r2validate_environment>s z-MetaphorSearchAPIWrapper.validate_environmentc Cs&|j||||||||| d } || S)aLRun query through Metaphor Search and return metadata. Args: query: The query to search for. num_results: The number of results to return. include_domains: A list of domains to include in the search. Only one of include_domains and exclude_domains should be defined. exclude_domains: A list of domains to exclude from the search. Only one of include_domains and exclude_domains should be defined. start_crawl_date: If specified, only pages we crawled after start_crawl_date will be returned. end_crawl_date: If specified, only pages we crawled before end_crawl_date will be returned. start_published_date: If specified, only pages published after start_published_date will be returned. end_published_date: If specified, only pages published before end_published_date will be returned. use_autoprompt: If true, we turn your query into a more Metaphor-friendly query. Adds latency. Returns: A list of dictionaries with the following keys: title - The title of the page url - The url author - Author of the content, if applicable. Otherwise, None. published_date - Estimated date published in YYYY-MM-DD format. Otherwise, None. )rrrrrrrr)r3_clean_results) r-rrrrrrrrrraw_search_resultsr1r1r2r(Is! z MetaphorSearchAPIWrapper.resultsc sJdtf f dd } | IdH} t| } | dS)z8Get results from the Metaphor Search API asynchronously.rc sdji} d }t4IdHU}|jtd||d4IdH/}|jdkrM|IdH}|WdIdHWdIdHStd|jd|j1IdHs_wYWdIdHdS1IdHsuwYdS)Nrrr%)r'r&zError z: ) r aiohttp ClientSessionr*r+statustext Exceptionreason)r&r.sessionresdata rrrrrrr-rrrr1r2fetchs2    .z5MetaphorSearchAPIWrapper.results_async..fetchNr()strr'loadsr:) r-rrrrrrrrrrGresults_json_str results_jsonr1rFr2 results_asyncws $  z&MetaphorSearchAPIWrapper.results_asyncr;c CsFg}|D]}||dd|dd|dd|ddd q|S) Ntitlez Unknown Titleurlz Unknown URLauthorzUnknown Author publishedDatez Unknown Date)rMrNrOpublished_date)appendget)r-r;cleaned_resultsresultr1r1r2r:s    z'MetaphorSearchAPIWrapper._clean_results)NNNNNNN)__name__ __module__ __qualname____doc__rH__annotations__rintr model_configrrbooldictr3r classmethodrrr9r(rLr:r1r1r1r2r s       #      2     *r )rYr'typingrrrrr=r)langchain_core.utilsrpydanticrr r r+r r1r1r1r2s