o +i @sdZddlmZmZddlmZddlmZddlm Z zddl m Z m Z m Z mZWney=ZzdZeeedZ[wwGd d d e ZdS) zAnthropic prompt caching middleware. Requires: - langchain: For agent middleware framework - langchain-anthropic: For ChatAnthropic model (already a dependency) ) AwaitableCallable)Literal)warn) ChatAnthropic)AgentMiddlewareModelCallResult ModelRequest ModelResponsezAnthropicPromptCachingMiddleware requires 'langchain' to be installed. This middleware is designed for use with LangChain agents. Install it with: pip install langchainNc @seZdZdZ    ddeddedd ed ed d d f ddZded efddZ dede ege fd e fddZ dede egee fd e fddZd S) AnthropicPromptCachingMiddlewarea?Prompt Caching Middleware. Optimizes API usage by caching conversation prefixes for Anthropic models. Requires both 'langchain' and 'langchain-anthropic' packages to be installed. Learn more about Anthropic prompt caching [here](https://docs.claude.com/en/docs/build-with-claude/prompt-caching). ephemeral5mrrtypettl)r 1hmin_messages_to_cacheunsupported_model_behavior)ignorerraisereturnNcCs||_||_||_||_dS)aInitialize the middleware with cache control settings. Args: type: The type of cache to use, only "ephemeral" is supported. ttl: The time to live for the cache, only "5m" and "1h" are supported. min_messages_to_cache: The minimum number of messages until the cache is used, default is 0. unsupported_model_behavior: The behavior to take when an unsupported model is used. "ignore" will ignore the unsupported model and continue without caching. "warn" will warn the user and continue without caching. "raise" will raise an error and stop the agent. N)rrrr)selfrrrrrj/var/www/html/psymed-ai/venv/lib/python3.10/site-packages/langchain_anthropic/middleware/prompt_caching.py__init__)s z)AnthropicPromptCachingMiddleware.__init__requestcCspt|jts$dt|j}|jdkrt||jdkr"t|dddS|jr.t|j dnt|j }||j kS)a.Check if caching should be applied to the request. Args: request: The model request to check. Returns: True if caching should be applied, False otherwise. Raises: ValueError: If model is unsupported and behavior is set to "raise". zeAnthropicPromptCachingMiddleware caching middleware only supports Anthropic models, not instances of rr) stacklevelF) isinstancemodelrrr ValueErrorr system_promptlenmessagesr)rrmsgmessages_countrrr_should_apply_cachingCs     z6AnthropicPromptCachingMiddleware._should_apply_cachinghandlercCsB||s ||S|j}i|d|j|jdi}||j|dS)a Modify the model request to add cache control blocks. Args: request: The model request to potentially modify. handler: The handler to execute the model request. Returns: The model response from the handler. cache_controlrrmodel_settingsr&r+rroverriderrr'r+new_model_settingsrrrwrap_model_callas z0AnthropicPromptCachingMiddleware.wrap_model_callcsP||s ||IdHS|j}i|d|j|jdi}||j|dIdHS)a#Modify the model request to add cache control blocks (async version). Args: request: The model request to potentially modify. handler: The async handler to execute the model request. Returns: The model response from the handler. Nr(r)r*r,r.rrrawrap_model_callys z1AnthropicPromptCachingMiddleware.awrap_model_call)r r rr)__name__ __module__ __qualname____doc__rintrr boolr&rr rr0rr1rrrrr s@    r )r5collections.abcrrtypingrwarningsrlangchain_anthropic.chat_modelsr!langchain.agents.middleware.typesrrr r ImportErrorer$r rrrrs