o +i@sdZddlmZddlmZddlmZmZmZddlm Z ddl m Z ddl m Z mZmZmZmZmZddlmZdd lmZmZzdd lmZmZmZmZmZmZWneymdd l mZmZmZmZmZmZYnwdd l!m"Z"dd lm#Z#eeeed fZ$ee%e&d fZ'GdddeZ(e%e&ee)e&e*fe(e)e&e"fffZ+ eGdddeZ,GdddeZ-GdddeZ.ee(e.e)e&e*fe)e&e"ffZ/GdddeZ0e0Z1Gddde0Z2GdddeZ3Gddde-Z4Gddde-Z5Gd d!d!eZ6Gd"d#d#eZ7e7Z8Gd$d%d%e&e Z9Gd&d'd'eZ:e#d(Z;Gd)d*d*ed+d,Zd1d2Z?Gd3d4d4eZ@Gd5d6d6e@ZAGd7d8d8e&e ZBGd9d:d:ed+d,ZCGd;d<dd>eZEGd?d@d@eEZFGdAdBdBeEZGGdCdDdDe ZHGdEdFdFeZIGdGdHdHed+d,ZJGdIdJdJed+d,ZKGdKdLdLeIZLGdMdNdNeIZMGdOdPdPeZNGdQdRdReNZOeGdSdTdTeZPGdUdVdVed+d,ZQGdWdXdXeZRGdYdZdZeRZSGd[d\d\ed+d,ZTGd]d^d^eZUe4VGd_d`d`eZWGdadbdbeZXGdcdddded+d,ZYGdedfdfed+d,ZZGdgdhdheZ[GdidjdjeZ\GdkdldleZ]GdmdndneZ^GdodpdpeZ_GdqdrdreZ`Gdsdtdte&e ZaGdudvdved+d,ZbGdwdxdxed+d,ZcGdydzdzed+d,ZdGd{d|d|ed+d,ZeGd}d~d~eZfGddded+d,ZgGdddeZhGddde4ZiGdddeZjGdddeZkGdddeZld S)zSchemas for the LangSmith API.) annotations)Iterator)datetime timedeltatimezone)Decimal)Enum)Any NamedTupleOptionalProtocolUnionruntime_checkable)UUID) NotRequired TypedDict) BaseModelField PrivateAttr StrictBool StrictFloat StrictInt)Path)LiteralNc@"eZdZUdZded<ded<dS) AttachmentaAnnotated type that will be stored as an attachment if used. Examples: ```python from langsmith import traceable from langsmith.schemas import Attachment @traceable def my_function(bar: int, my_val: Attachment): # my_val will be stored as an attachment # bar will be stored as inputs return bar ``` str mime_typeUnion[bytes, Path]dataN__name__ __module__ __qualname____doc____annotations__r&r&N/var/www/html/psymed-ai/venv/lib/python3.10/site-packages/langsmith/schemas.pyr0s  rc@s2eZdZdZddddZddd d ZdddZdS) BinaryIOLikez$Protocol for binary IO-like objects.sizeintreturnbytescCdS)zRead function.Nr&)selfr*r&r&r'readPzBinaryIOLike.readroffsetwhencecCr.)zSeek function.Nr&)r/r2r3r&r&r'seekTr1zBinaryIOLike.seekcCr.)zGet value function.Nr&r/r&r&r'getvalueXr1zBinaryIOLike.getvalueN)r))r*r+r,r-)r)r2r+r3r+r,r+)r,r-)r!r"r#r$r0r4r6r&r&r&r'r(Ls   r(c@s^eZdZUdZded<eddZded<eddZded<eddZded <Gd d d Z dS) ExampleBasezExample base model.r dataset_idNdefaultOptional[dict[str, Any]]inputsoutputsmetadatac@seZdZdZdZdZdS)zExampleBase.Config#Configuration class for the schema.TN)r!r"r#r$frozenarbitrary_types_allowedr&r&r&r'ConfigesrB) r!r"r#r$r%rr<r=r>rBr&r&r&r'r7]s r7c@seZdZUded<ded<dS)_AttachmentDictrrrrN)r!r"r#r%r&r&r&r'rCls  rCcseZdZUdZded<edddZded<ed d Zd ed <ed d Zd ed <ed d Z d ed<d Z ded<d Z ded<dZ ded<d Z ded<d Zded<fddZZS) ExampleCreatez Example upload with attachments.Optional[UUID]idcC ttjSNrnowrutcr&r&r&r'z zExampleCreate.default_factoryr created_atNr9r;r<r=r>Optional[Union[str, list[str]]]splitz$Optional[dict[str, _AttachmentLike]] attachmentsFbooluse_source_run_ioOptional[list[str]]use_source_run_attachments source_run_idc tjdi|dSzInitialize from dict.Nr&super__init__r/r __class__r&r'r]zExampleCreate.__init__)r!r"r#r$r%rrPr<r=r>rRrSrUrWrXr] __classcell__r&r&r_r'rDvs      rDc@eZdZUdZded<dS)ExampleUpsertWithAttachmentsz Example create with attachments.rr8Nr r&r&r&r'rd  rdc@s*eZdZUdZded<ded<ded<dS) AttachmentInfozInfo for an attachment.r presigned_urlr(reader Optional[str]rNr r&r&r&r'rfs  rfcseZdZUdZded<edddZded<eed d Zded <ed d Z d ed<d Z ded<ed d Z ded< e d d Z ded<e d d Zded< d d!fdd Zed"ddZddZZS)#ExamplezExample model.rrFcCstjdtjdS)Nr)tz)r fromtimestamprrKr&r&r&r'rLszExample.rNrrPz$00000000-0000-0000-0000-000000000000r9r8NOptional[datetime] modified_atrErXz#Optional[dict[str, AttachmentInfo]]rSri _host_url _tenant_idkwargsr r,Nonec s"tjdi|||_||_dS)Initialize a Dataset object.Nr&)r\r]rorp)r/rorprqr_r&r'r]s zExample.__init__cCsL|jr$d|jd|j}|jr|jdt|j|S|j|SdS)URL of this run within the app. /datasets/z/e//o/N)ror8rFrpr)r/pathr&r&r'urls z Example.urlcC$|jd|jd|jd|jdS)5Return a string representation of the RunBase object.(id=z , dataset_id=z, link=''))r`rFr8rxr5r&r&r'__repr__$zExample.__repr__)NN)rorirprErqr r,rrr,ri)r!r"r#r$r%rrPrr8rnrXrSrrorpr]propertyrxr}rbr&r&r_r'rjs&    rjc@rc) ExampleSearchzExample returned via search.rrFNr r&r&r&r'rrerc@s:eZdZUdZeeddZded<eeddZ ded<d S) AttachmentsOperationsz%Operations to perform on attachments.z,Mapping of old attachment names to new names)rO descriptionzdict[str, str]renamez List of attachment names to keep list[str]retainN) r!r"r#r$rdictrr%listrr&r&r&r'rs rcseZdZUdZded<dZded<eddZded <eddZded <eddZ ded <dZ d ed <dZ ded<dZ ded<GdddZ fddZZS) ExampleUpdatez Example update with attachments.rrFNrEr8r9r;r<r=r>rQrRzOptional[Attachments]rSzOptional[AttachmentsOperations]attachments_operationsc@eZdZdZdZdS)zExampleUpdate.Configr?TNr!r"r#r$r@r&r&r&r'rBrBc rYrZr[r^r_r&r'r]razExampleUpdate.__init__)r!r"r#r$r%r8rr<r=r>rRrSrrBr]rbr&r&r_r'rs     rc@seZdZdZdZdZdZdS)DataTypezEnum for dataset data types.kvllmchatN)r!r"r#r$rrrr&r&r&r'rs rc@s@eZdZUdZded<dZded<dZded<Gd d d ZdS) DatasetBasezDataset base model.rnameNrirzOptional[DataType] data_typec@r)zDatasetBase.Configr?TNrr&r&r&r'rBrrB)r!r"r#r$r%rrrBr&r&r&r'rs   r)remove_system_messagesconvert_to_openai_messageconvert_to_openai_toolremove_extra_fieldsextract_tools_from_runc@r)DatasetTransformationz#Schema for dataset transformations.rrwz%Union[DatasetTransformationType, str]transformation_typeNr r&r&r&r'r s  rF)totalcseZdZUdZded<ded<eddZded <dZd ed <dZd ed <dZ ded <dZ ded<dZ ded<dZ ded<dZ ded<eddZded<eddZded<eddZded<   d!d"fdd Zed#dd ZZS)$DatasetzDataset ORM model.rrFrrPNr9rmrn Optional[int] example_count session_countlast_session_start_timer; inputs_schemaoutputs_schemaz%Optional[list[DatasetTransformation]]transformationsr>rirorErp _public_pathrqr r,rrc sTd|vr |d|d<d|vr|d|d<tjdi|||_||_||_dS)rsinputs_schema_definitionroutputs_schema_definitionrNr&)popr\r]rorpr)r/rorprrqr_r&r'r]$s zDataset.__init__cCsV|jr)|jr|j|jS|jr |jdt|jd|jS|jd|jSdS)rtrvruN)rorrprrFr5r&r&r'rx7sz Dataset.url)NNN) rorirprErrirqr r,rrr)r!r"r#r$r%rrnrrrrrrr>rrorprr]rrxrbr&r&r_r'rs*        rc@s&eZdZUdZdZded<ded<dS)DatasetVersionz%Class representing a dataset version.NrVtagsras_of)r!r"r#r$rr%r&r&r&r'rCs   rcCsdiiS)Nr>r&r&r&r&r'_default_extraJsrc@s&eZdZUdZded< ded< ded< ded< d Zd ed < eed Zd ed< d Z ded< d Z d ed< d Z ded< ee d Z ded< d Zd ed< d Zded< d Zded< d Zded< ee d Zded< ed+d d!Zed,d"d#Zed-d%d&Zd'd(ZGd)d*d*Zd S).RunBasea3Base Run schema. A Run is a span representing a single unit of work or operation within your LLM app. This could be a single call to an LLM or chain, to a prompt formatting call, to a runnable lambda invocation. If you are familiar with OpenTelemetry, you can think of a run as a span. rrFrrr start_timerun_typeNrmend_timerNOptional[dict]extrarierror serializedOptional[list[dict]]eventsrr<r=rEreference_example_id parent_run_idrVrz-Union[Attachments, dict[str, AttachmentInfo]]rSr,dict[str, Any]cCs|jduri|_|jdiSzRetrieve the metadata (if any).Nr>)r setdefaultr5r&r&r'r>s zRunBase.metadatacCs |jdS)z"Retrieve the revision ID (if any). revision_id)r>getr5r&r&r'rs zRunBase.revision_idOptional[float]cCs|jdurdS|j|jS)zLatency in seconds.N)rr total_secondsr5r&r&r'latencys zRunBase.latencycCry)rzr{z, name='z ', run_type='r|)r`rFrrr5r&r&r'r}r~zRunBase.__repr__c@r)zRunBase.Configr?TN)r!r"r#r$rAr&r&r&r'rBrrBr,r)r,rE)r,r)r!r"r#r$r%rrrrrrrrr<r=rrrrSrr>rrr}rBr&r&r&r'rNsT            rcseZdZUdZdZded< dZded< dZded< dZd ed < dZ d ed < dZ ded < dZ d ed< dZ ded< dZ ded< dZded< dZded< dZded< dZded< dZded< dZded< dZded< dZded< dZded< dZded< d ed!< ed"d#Zd$ed%< dZd&ed'< edd#Zd ed(<dEdFfd-d. ZedGd/d0ZedHd2d3Z edHd4d5Z!edId7d8Z"edId9d:Z#edJdd?Z%edKdAdBZ&edKdCdDZ'Z(S)LRunz$Run schema when loading from the DB.NrE session_idOptional[list[UUID]] child_run_idszOptional[list[Run]] child_runsr;feedback_statsriapp_path manifest_idstatusr prompt_tokenscompletion_tokens total_tokenszOptional[dict[str, int]]prompt_token_detailscompletion_token_detailsrmfirst_token_timeOptional[Decimal] total_cost prompt_costcompletion_costzOptional[dict[str, Decimal]]prompt_cost_detailscompletion_cost_detailsparent_run_idsrtrace_idr9r dotted_orderOptional[bool] in_datasetrorqr r,rrc s~|dsd|di|}|ddpi}tjdi|d|i||_|js;|js=|j |j |_dSdSdS)Initialize a Run object.rrFr<Nr&) rrr\r]rorstriprr isoformatrF)r/rorqr<r_r&r'r]s z Run.__init__cCs |jr|jr|j|jSdS)rtN)rorr5r&r&r'rxs zRun.url int | NonecC|jS)zAlias for prompt_tokens.)rr5r&r&r' input_tokenszRun.input_tokenscCr)zAlias for completion_tokens.)rr5r&r&r' output_tokensrzRun.output_tokensDecimal | NonecCr)zAlias for prompt_cost.)rr5r&r&r' input_cost rzRun.input_costcCr)zAlias for completion_cost.)rr5r&r&r' output_costrzRun.output_costdict[str, int] | NonecCr)zAlias for prompt_token_details.)rr5r&r&r'input_token_detailsrzRun.input_token_detailscCr)zAlias for output_token_details.)rr5r&r&r'output_token_detailsrzRun.output_token_detailsdict[str, Decimal] | NonecCr)zAlias for prompt_cost_details.)rr5r&r&r'input_cost_detailsrzRun.input_cost_detailscCr)z"Alias for completion_cost_details.)rr5r&r&r'output_cost_details$rzRun.output_cost_detailsrHrorirqr r,rrr)r,r)r,r)r,r)r,r))r!r"r#r$rr%rrrrrrrrrrrrrrrrrrrrrrror]rrxrrrrrrrrrbr&r&r_r'rs                             rc@s,eZdZdZdZdZdZdZdZdZ dZ d S) RunTypeEnumz5(Deprecated) Enum for run types. Use string directly.toolchainr retriever embeddingpromptparserN) r!r"r#r$rrrrrrrr&r&r&r'r*src@seZdZUdZded<ded<ded<ded <ded <d ed <ded <ded<ded<ded<ded<ded<ded<ded<ded<ded<ded<ded<ded<ded<ded<d ed!<ded"<d#ed$<d%S)& RunLikeDictz&Run-like dictionary, for type-hinting.rrrrrrrr<r=rmrrrirrrErrrrrVrinputs_s3_urlsoutputs_s3_urlsrFr session_namerinput_attachmentsoutput_attachmentsrrr AttachmentsrSNr r&r&r&r'r6s4  rc@s,eZdZUdZdZded< dZded<dS)RunWithAnnotationQueueInfoz&Run schema with annotation queue info.Nrmlast_reviewed_timeadded_at)r!r"r#r$rr%rr&r&r&r'rSs   rc@sJeZdZUdZded< eedZded< dZded < dZ d ed <dS) FeedbackSourceBasezBase class for feedback sources. This represents whether feedback is submitted from the API, model, human labeler, etc. rtyperNr;r>NzOptional[Union[UUID, str]]user_idri user_name) r!r"r#r$r%rrr>rrr&r&r&r'r\s   rc@eZdZUdZdZded<dS)APIFeedbackSourcezAPI feedback source.apizLiteral['api']rNr!r"r#r$rr%r&r&r&r'rm rc@r)ModelFeedbackSourcezModel feedback source.modelzLiteral['model']rNrr&r&r&r'r srr c@seZdZdZdZ dZdS)FeedbackSourceTypezFeedback source type.rr N)r!r"r#r$APIMODELr&r&r&r'r ys r c@seZdZUdZded< dZded< dZded< ded < ded < d ed < dZd ed< dZded< dZ ded< dZ ded< dZ ded< dZ ded< dZ ded< dZded< dZded< GdddZdS) FeedbackBasezFeedback schema.rrFNrmrPrnrErun_idrrkey SCORE_TYPEscore VALUE_TYPEvaluericommentzUnion[str, dict, None] correctionOptional[FeedbackSourceBase]feedback_sourcercomparative_experiment_idfeedback_group_idrrc@r)zFeedbackBase.Configr?TNrr&r&r&r'rBrrB)r!r"r#r$r%rPrnrrrrrrrrrrBr&r&r&r'rsB            rc@$eZdZUdZded< ded<dS)FeedbackCategoryz+Specific value and label pair for feedback.floatrrilabelNr r&r&r&r'r rc@s8eZdZUdZded< ded< ded< ded<d S) FeedbackConfigz:Represents _how_ a feedback value ought to be interpreted.z0Literal['continuous', 'categorical', 'freeform']rrminmaxz Optional[list[FeedbackCategory]] categoriesNr r&r&r&r'r s r c@s6eZdZUdZded< dZded< dZded<dS) FeedbackCreatez"Schema used for creating feedback.rrNzOptional[FeedbackConfig]feedback_configrr)r!r"r#r$r%r%rr&r&r&r'r$s  r$c@s:eZdZUdZded<ded< ded< dZded <dS) FeedbackzSchema for getting feedback.rrFrrPrnNrr)r!r"r#r$r%rr&r&r&r'r&s  r&cseZdZUdZded< edddZded< d Zd ed < d Zd ed < d Z d ed< d Z ded< ded< ded< e d dZ d ed<d$d%fdd Z ed&ddZed'dd Zed(d"d#ZZS)) TracerSessionzbTracerSession schema for the API. Sessions are also referred to as "Projects" in the UI. rrFcCrGrHrIr&r&r&r'rLrMzTracerSession.rNrrNrmrrirrr;r tenant_idrEreference_dataset_idr9rorqr r,rrc s>tjdi|||_|jjdur|jjtjd|_dSdS)rN)tzinfor&)r\r]rorr*replacerrK)r/rorqr_r&r'r]s  zTracerSession.__init__cCs$|jr|jd|jd|jSdS)rtrv /projects/p/N)ror(rFr5r&r&r'rxszTracerSession.urlrcC"|jdus d|jvr iS|jdSrrr5r&r&r'r> zTracerSession.metadatarcCs"|jdus d|jvr gS|jdS)zRetrieve the tags (if any).Nrr.r5r&r&r'rr/zTracerSession.tagsrHrrr)r,r)r!r"r#r$r%rrrrrrrror]rrxr>rrbr&r&r_r'r's4       r'c@seZdZUdZded< ded< ded< ded< ded< ded < d ed < d ed < d ed< ded< ded< ded< ded< ded< ded< ded<dS)TracerSessionResultzqA project, hydrated with additional information. Sessions are also referred to as "Projects" in the UI. r run_countOptional[timedelta] latency_p50 latency_p99rrrrmlast_run_start_timer;rsession_feedback_statsOptional[list[dict[str, Any]]] run_facetsrrrrfirst_token_p50first_token_p99r error_rateNr r&r&r&r'r0sD r0c@s4eZdZUdZded< ded< ed ddZd S) BaseMessageLikez7A protocol representing objects similar to BaseMessage.rcontentzdict[Any, Any]additional_kwargsr,cCr.)z,Type of the Message, used for serialization.Nr&r5r&r&r'r@szBaseMessageLike.typeNr,r)r!r"r#r$r%rrr&r&r&r'r<7s r<c@s.eZdZUdZded< ded< ded<dS)DatasetShareSchemaz*Represents the schema for a dataset share.rr8 share_tokenrrxNr r&r&r&r'r@E r@c@sleZdZUdZded< ded< dZded< ed d d Zd ed < edd d Zd ed< ded<dS)AnnotationQueuezRepresents an annotation queue.rrFrrNrircCrGrHrIr&r&r&r'rLYrMzAnnotationQueue.rNrrPcCrGrHrIr&r&r&r'rL[rM updated_atr() r!r"r#r$r%rrrPrDr&r&r&r'rCPs  rCc@seZdZUdZdZded<dS)AnnotationQueueWithDetailsz,Represents an annotation queue with details.Nrirubric_instructions)r!r"r#r$rFr%r&r&r&r'rEas  rEc@sLeZdZUdZded< ded< ded< ded< ded< d ed <d S) BatchIngestConfigz"Configuration for batch ingestion.rTuse_multipart_endpointr+scale_up_qsize_triggerscale_up_nthreads_limitscale_down_nempty_trigger size_limitrsize_limit_bytesNr r&r&r&r'rGhs rGc@sHeZdZUdZdZded< dZded< dZded < dZd ed <dS) LangSmithInfoz'Information about the LangSmith server.rrversionNrmlicense_expiration_timezOptional[BatchIngestConfig]batch_ingest_configr;instance_flags) r!r"r#r$rOr%rPrQrRr&r&r&r'rNys    rNc@s<eZdZUdZded< ded< ded< dZded <dS) LangSmithSettingsz"Settings for the LangSmith tenant.rrF display_namerrPNri tenant_handle)r!r"r#r$r%rUr&r&r&r'rSs rSc@.eZdZUdZded< ded< ded<dS) FeedbackIngestTokenz2Represents the schema for a feedback ingest token.rrFrrxr expires_atNr r&r&r&r'rWrBrWc@rV) RunEventzRun event schema.rrzUnion[datetime, str]timer;rqNr r&r&r&r'rYrBrYc@.eZdZUdZded< ded< ded<dS)TimeDeltaInputzTimedelta input schema.r+dayshoursminutesNr r&r&r&r'r\rBr\c@r[)DatasetDiffInfoz;Represents the difference information between two datasets.z list[UUID]examples_modifiedexamples_addedexamples_removedNr r&r&r&r'r`rBr`c@seZdZUdZded< dZded< dZded< ded< d ed < d ed < ded < dZd ed< dZded< dZ d ed< e dddZ dS)ComparativeExperimentzRepresents a comparative experiment. This information summarizes evaluation results comparing two or more models on a given dataset. rrFNrirrr(rrPrnr)r;rrexperiments_inforr,rcCr-rr.r5r&r&r'r>r/zComparativeExperiment.metadatar) r!r"r#r$r%rrrrerrr>r&r&r&r'rds0      rdc@sBeZdZUdZded< ded< ded< ded< ded <d S) PromptCommitz$Represents a Prompt with a manifest.rownerrepo commit_hashrmanifestz list[dict]examplesNr r&r&r&r'rfs rfc@seZdZUdZded< ded< ded< dZded < dZded < dZded < dZd ed < dZ ded< dZ ded< e e dZ ded< dZded< dZded< dZd ed<dS)ListedPromptCommitz;Represents a listed prompt commit with associated metadata.rrFrrgrhNrErrepo_id parent_idririrmrPrDrNrexample_run_idsrr num_downloads num_viewsparent_commit_hash)r!r"r#r$r%rrmrnrirPrDrrrorprqrrr&r&r&r'rls8          rlc@s eZdZUdZded< dZded< dZded< ded< ded < d ed < d ed < d ed< d ed< ded< dZded< dZded< ded< ded< ded< ded< ded< dZ ded< dZ ded< ded< dZ ded< dZ ded<dS) Promptz"Represents a Prompt with metadata.r repo_handleNrirreadmerFr(rrPrDrT is_public is_archivedrroriginal_repo_idupstream_repo_idrg full_namer+ num_likesrprqrliked_by_auth_userlast_commit_hash num_commitsoriginal_repo_full_nameupstream_repo_full_name) r!r"r#r$r%rrurxryr|r}rrr&r&r&r'rss\         rsc@r)ListPromptsResponsez A list of prompts with metadata.z list[Prompt]reposr+rNr r&r&r&r'rOrrc@s&eZdZdZdZ dZ dZ dZdS)PromptSortFieldz$Enum for sorting fields for prompts.rprqrDr{N)r!r"r#r$rprqrDr{r&r&r&r'rXsrc@r[)InputTokenDetailsz~Breakdown of input token counts. Does *not* need to sum to full input token count. Does *not* need to have all keys. r+audiocache_creation cache_readNr r&r&r&r're rc@$eZdZUdZded< ded<dS)OutputTokenDetailszBreakdown of output token counts. Does *not* need to sum to full output token count. Does *not* need to have all keys. r+r reasoningNr r&r&r&r'rz rc@r[)InputCostDetailszvBreakdown of input token costs. Does *not* need to sum to full input cost. Does *not* need to have all keys. rrrrNr r&r&r&r'rrrc@r)OutputCostDetailszxBreakdown of output token costs. Does *not* need to sum to full output cost. Does *not* need to have all keys. rrrNr r&r&r&r'rrrc@teZdZUdZded< ded< ded< ded< ded < d ed < d ed < d ed < ded< ded<dS) UsageMetadatazUsage metadata for a message, such as token counts. This is a standard representation of token usage that is consistent across models. r+rrrzNotRequired[InputTokenDetails]rzNotRequired[OutputTokenDetails]rzNotRequired[float]rrrzNotRequired[InputCostDetails]rzNotRequired[OutputCostDetails]rNr r&r&r&r'rs, rc@r)ExtractedUsageMetadatazUsage metadata dictionary extracted from a run. Should be the same as UsageMetadata, but does not require all keys to be present. r+rrrrrrrrrrrrrrrNr r&r&r&r'rs, rc@r)UpsertExamplesResponsezCResponse object returned from the upsert_examples_multipart method.r+countr example_idsNr r&r&r&r'rrrc@s$eZdZUdZeedZded<dS)ExampleWithRunszExample with runs.rNz list[Run]runsN)r!r"r#r$rrrr%r&r&r&r'rs rc@seZdZUdZded< ded< ded< ded< ded< ded < d ed < d ed < ded< ded< ded< ded< ded< ded<dS)ExperimentRunStatsz!Run statistics for an experiment.rr1r2r3r4rrrrmr5r7r8rrrrr9r:rr;Nr r&r&r&r'rs< rc@rV) ExperimentResultszResults container for experiment data with stats and examples. Breaking change in v0.4.32: The 'stats' field has been split into 'feedback_stats' and 'run_stats'. rrr run_statszIterator[ExampleWithRuns]examples_with_runsNr r&r&r&r'r s  rc@sfeZdZUdZded<ded<ded<dZded <ded <ded <ded <edddZdddZdS)InsightsReportzHAn Insights Report created by the Insights Agent over a tracing project.z UUID | strrFrrrNz str | Noner project_idhost_urlr(r,cCs.|jdt|jdt|jdt|jS)z1URL to view this Insights Report in LangSmith UI.rvr,z?tab=4&clusterJobId=)rrr(rrFr5r&r&r'link9s.zInsightsReport.linkcCsd|jd|jdS)Nz InsightsReport('z'))rrr5r&r&r' _repr_html_>szInsightsReport._repr_html_r?) r!r"r#r$r%rrrrr&r&r&r'r.s   r)mr$ __future__rcollections.abcrrrrdecimalrenumrtypingr r r r r ruuidrtyping_extensionsrr pydantic.v1rrrrrr ImportErrorpydanticpathlibrrrrrrrtupler-rr(r7rC_AttachmentLikerDExampleUploadWithAttachmentsrdrfrjrrrExampleUpdateWithAttachmentsrrDatasetTransformationTyperrrrrrrrrrrr r rrr r$r&r'r0r<r@rCrErGrNupdate_forward_refsrSrWrYr\r`rdrfrlrsrrrrrrrrrrrrrr&r&r&r's      $ $ &*   0Z   *   6(        $+1  " !