ijddlZddlZddlZddlmZddlZddlZddlm Z ddl m Z m Z m Z ddlmZddlmZddlmZddlmZdd lmZd d lmZd d lmZmZgd Zej<eZ de!de"fdZ#de"de!fdZ$dejJde&e"fdZ'dejJde&e!fdZ(dejJde&efdZ)iejTdde'fejVdde'fejXdde'fejZdde)fejBdde)fej\dde)fej^dde)fej`dde)fejbd de)fejdd de)fejfd!de)fejhd!de)fejDd"de)fejjd"de)fejld"de)fejnd#d$e)fejpd%d&e(fejrd%d&e(fejtd'd&e(fejvd'd&e(fejxd(d)e)fejzd*d+e(fej|d*d+e(fejbd d,e)fej~d d,e)fejd d,e)fi ZAde"fd-ZB dDd.ZCdEd/ZDdFd0ZEd1ZFd2ZGdGd3ZHdGd4ZIdHd5ZJ dId6ZKdGd7ZLdJd8ZMdKd9ZNd:ZOdLd;ZPd<ZQd=ZR dMd>ZSdMd?ZTdNd@ZUdAZVdBZW dNdCZXy)ON)Any) struct_pb2)HistogramProtoSummarySummaryMetadata) TensorProto)TensorShapeProto) layout_pb2)PrCurvePluginData)TextPluginData)make_np)_prepare_videoconvert_to_HWC) half_to_int int_to_halfhparamsscalar histogram_raw histogrammake_histogramimage image_boxes draw_boxes make_imagevideo make_videoaudiocustom_scalarstext tensor_proto pr_curve_rawpr_curve compute_curvemeshfreturnc`tjd|}tjd|dS)aACasts a half-precision float value into an integer. Converts a half precision floating point value, such as `torch.half` or `torch.bfloat16`, into an integer value which can be written into the half_val field of a TensorProto for storage. To undo the effects of this conversion, use int_to_half(). r&irstructpackunpack)r&bufs Y/var/www/html/engine/venv/lib/python3.12/site-packages/torch/utils/tensorboard/summary.pyrr6s* ++c1 C ==c "1 %%r)c`tjd|}tjd|dS)zCasts an integer value to a half-precision float. Converts an integer value obtained from half_to_int back into a floating point value. r)r&rr*)r)r.s r/rrCs* ++c1 C ==c "1 %%r0tcv|jjDcgc] }t|c}Scc}wN)flattentolistr)r2xs r/_tensor_to_half_valr8Ms)$%IIK$6$6$8 9qKN 99 9s6cdtj|jjSr4)torch view_as_realr5r6r2s r/_tensor_to_complex_valr=Ps%   a ( ( * 1 1 33r0c>|jjSr4)r5r6r<s r/_tensor_to_listr?Ss 99;   r0DT_HALFhalf_val DT_BFLOAT16DT_FLOAT float_val DT_DOUBLE double_valDT_INT8int_valDT_UINT8DT_INT16DT_INT32DT_INT64 int64_val DT_COMPLEX32 scomplex_val DT_COMPLEX64DT_BOOLbool_val DT_COMPLEX128 dcomplex_val uint32_valct|tjs|jn|}|jtj k(rdSdS)Nr ) isinstancenpndarraynumpydtypeuint8)tensor converteds r/_calc_scale_factorr`us6&0&D &I288+144r0c ddlm} m} | j} | j |} ||||f\} }}}| j | |f| |f||f||f| |fg|||r|}| j |\}}}}||z ||z }}tjd|z}| j| ||z d|zz f| |z|fg|| j| |z||z |z f||| |S)Nr) ImageDraw ImageFont)widthfillg?)re)refont) PILrbrc load_defaultDrawlinegetbboxrYceil rectangler )rxminyminxmaxymax display_strcolor color_text thicknessrbrcrgdrawleftrighttopbottom text_bottom_left_top_right_bottom text_width text_heightmargins r/_draw_single_boxrzs/)  ! ! #D >>% D"&dD!9T5#vII tVnufos|dC[Q   '+||K'@$tVW"(5.'D.K  +, {[01v:=> "K0    F]K+5> ?   Lr0c j ddl}ddlm}m}m}m}m}m} ddlm } m } m } m } m }ddlm}m}m}t%t&s t(j+dt-dt%|t&s t(j+dt-d|xsi}t%|t&s t-d|j/D]@\}vs&t%|t0rt3fd |Dr0t-d d d g}|}j/D],\}| t%|t4t6fr||j8_|vr|Dcgc]}t=j@| c}}nd}|jC||jAd|t%|tDr||j8_#|vr|Dcgc]}t=j@|c}}nd}|jC||jAd|1t%|tHr||j8_%|vr|Dcgc]}t=j@|c}}nd}|jC||jAd|t%||jLrLtO|d}||j8_|jC||jAd$tQd||| }tStSjT| |jW}tYtYj@||g}|Dcgc]}|||}}|||}||| }tStSjT| |jW}tYtYj@| |g}|| jAd !}||| "}tStSjT| |jW}tYtYj@| |g}|||fScc}wcc}wcc}wcc}w)#a2Output three `Summary` protocol buffers needed by hparams plugin. `Experiment` keeps the metadata of an experiment, such as the name of the hyperparameters and the name of the metrics. `SessionStartInfo` keeps key-value pairs of the hyperparameters `SessionEndInfo` describes status of the experiment e.g. STATUS_SUCCESS Args: hparam_dict: A dictionary that contains names of the hyperparameters and their values. metric_dict: A dictionary that contains names of the metrics and their values. hparam_domain_discrete: (Optional[Dict[str, List[Any]]]) A dictionary that contains names of the hyperparameters and all discrete values they can hold Returns: The `Summary` protobufs for Experiment, SessionStartInfo and SessionEndInfo rN)DataType Experiment HParamInfo MetricInfo MetricNameStatus)EXPERIMENT_TAGPLUGIN_DATA_VERSION PLUGIN_NAMESESSION_END_INFO_TAGSESSION_START_INFO_TAG)HParamsPluginDataSessionEndInfoSessionStartInfoz>parameter: hparam_dict should be a dictionary, nothing logged.z>parameter: metric_dict should be a dictionary, nothing logged.zIparameter: hparam_domain_discrete should be a dictionary, nothing logged.c3NK|]}t|tywr4)rXtype).0d hparam_dictks r/ zhparams..s!Fqz!T+a.%9:Fs"%z"parameter: hparam_domain_discrete[z/] should be a list of same type as hparam_dict[z].) number_value)valuesDATA_TYPE_FLOAT64)namerdomain_discrete) string_valueDATA_TYPE_STRING) bool_valueDATA_TYPE_BOOL)rrz=value should be one of int, float, str, bool, or torch.Tensor)session_start_infoversion plugin_namecontent plugin_data)tagmetadatavaluer)r) hparam_infos metric_infos) experimentrSTATUS_SUCCESS)status)session_end_infor)-r:#tensorboard.plugins.hparams.api_pb2rrrrrr$tensorboard.plugins.hparams.metadatarrrrr+tensorboard.plugins.hparams.plugin_data_pb2rrrrXdictloggerwarning TypeErroritemslistallintfloatrrr ListValueValueappendstrrboolrTensorr ValueErrorr PluginDataSerializeToStringr)r metric_dicthparam_domain_discreter:rrrrrrrrrrrrrrvhpsssirrrsmdrmtsexpseis` ` r/rrs( k4 (WX L   k4 (WX L  49r ,d 3 W  ',,.1 [ a&FAFF4QC7fghfiikl   C  C!!#P 1 9  a#u &*+CKKN '**?I?S?S"8!:#((a8@#' JJ!(;<$3    a *+CKKN '**","6"6"8!:#((a8##' JJ!(:;$3    a ()CKKN %**","6"6"8!:#((A6##' JJ!(89$3    a & 1 A*+CKKN ' JJzqx~~>Q/RS T  K  ]P d 3@STG #..#W-F-F-H  C +ACPQ RC7B C!::!, - CC C #C 8C38KLG #..#W-F-F-H  C >CHI JC  -= > ?C>QRG #..#W-F-F-H  C +?#NO PC S=]..L Ds*R! :R& R+ +R0ct|j}|jdk7r&td|jd|jdt |}|rct |gd}|rt |gd}tjd }t| }ttj||| g Sttj||g S)aOutput a `Summary` protocol buffer containing a single scalar value. The generated Summary has a Tensor.proto containing the input Tensor. Args: name: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: A real numeric Tensor containing a single value. collections: Optional list of graph collections keys. The new summary op is added to these collections. Defaults to `[GraphKeys.SUMMARIES]`. new_style: Whether to use new style (tensor field) or old style (simple_value field). New style could lead to faster data loading. Returns: A scalar `Tensor` of type `string`. Which contains a `Summary` protobuf. Raises: ValueError: If tensor has the wrong shape or type. rzNTensor should contain one element (0 dimensions). Was given size: z and z dimensions.rC)rDr\rE)rFr\scalarsrrrr^rr)r simple_value) rsqueezendimAssertionErrorsizerrrrrr) rr^ collections new_styledouble_precisionrr!rrs r/rrms"V_ $ $ &F {{a #[[Mv{{m<IJ J6]F"fXZH &6(+NL&00YG +6 '   gmm6JKLLr0c|j|jzdk\r td|jtvret|j\}}}t d id|dt |jDcgc]}t j|c}|||i}nt|d|jtjd }t| }ttj||| g Scc}w)aOutputs a `Summary` protocol buffer containing the full tensor. The generated Summary has a Tensor.proto containing the input Tensor. Args: tag: A name for the generated node. Will also serve as the series name in TensorBoard. tensor: Tensor to be converted to protobuf Returns: A tensor protobuf in a `Summary` protobuf. Raises: ValueError: If tensor is too big to be converted to protobuf, or tensor data type is not supported lzAtensor is bigger than protocol buffer's hard limit of 2GB in sizer\ tensor_shaperdimz has unsupported tensor dtype r^rrrrr^r) numelitemsizerr\_TENSOR_TYPE_MAPrr shapeDimrrrr) rr^r\ field_name conversion_fnr7r!rrs r/r!r!s||~'G4 O  ||''+;FLL+I(z="   0?E||L!)--15L!M&1   C5 >v||nMNN",,BK k 2C '--C#lST UUMs2Dc jt|||||||}ttj||gS)aOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. min: A float or int min value max: A float or int max value num: Int number of values sum: Float or int sum of all values sum_squares: Float or int sum of squares for all values bucket_limits: A numeric `Tensor` with upper value per bucket bucket_counts: A numeric `Tensor` with number of values per bucket Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. minmaxnumsum sum_squares bucket_limitbucketrhistor)rrr) rrrrrr bucket_limits bucket_countshists r/rrs>*     " D '--D=> ??r0ct|}t|jt||}t t j ||gS)adOutput a `Summary` protocol buffer with a histogram. The generated [`Summary`](https://www.tensorflow.org/code/tensorflow/core/framework/summary.proto) has one summary value containing a histogram for `values`. This op reports an `InvalidArgument` error if any value is not finite. Args: name: A name for the generated node. Will also serve as a series name in TensorBoard. values: A real numeric `Tensor`. Any shape. Values to use to build the histogram. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rr)rrastyperrr)rrbinsmax_binsrs r/rrs="V_F &--.h ?D '--D=> ??r0c 8|jdk(r td|jd}tj||\}}t |}|||kDr||z}||z}|dk7rtj |d||z ggdd}|jd|jd}tj|jd zf|j}|dd||dd|d|d<|}tjtj|d} tj| d| dd z gd \} } t| } t| d z} ~ | dkDr|| d z | ntjdg|d| g}|| | d z}|jdk(s|jdk(r td |j|} t!|j#|j%t ||j| |j'|j' S)zDConvert values into a histogram proto using logic from histogram.cc.rzThe input has no element.)rNconstant) pad_widthmodeconstant_values)axisr ry)sidez1The histogram is empty, please file a bug report.r)rrreshaperYrlenpadremptyr\cumsumgreater searchsortedr concatenatedotrrrr6) rrrcountslimitsnum_bins subsamplingsubsampling_remainder new_limits cum_countsstartendsum_sqs r/rrs {{a455 ^^B F\\&t4NFF6{H8 3(* (; 6 A %VV{-BBCD ! F K044"4=XXv{{Q0&,,?  "[1 3B 22::fa01JaB!1C-D7SJE3 JE c(Q,C$)19uqy3"..1#vds|AT2U EC!G $F {{a6;;!+LMM ZZ F  JJL JJL K JJL]]_}} r0cFt|}t||}t|}|jtj }||zj ddjtj}t||}ttj||gS)aJOutput a `Summary` protocol buffer with images. The summary has up to `max_images` summary values containing images. The images are built from `tensor` which must be 3-D with shape `[height, width, channels]` and where `channels` can be: * 1: `tensor` is interpreted as Grayscale. * 3: `tensor` is interpreted as RGB. * 4: `tensor` is interpreted as RGBA. The `name` in the outputted Summary.Value protobufs is generated based on the name, with a suffix depending on the max_outputs setting: * If `max_outputs` is 1, the summary value tag is '*name*/image'. * If `max_outputs` is greater than 1, the summary value tags are generated sequentially as '*name*/image/0', '*name*/image/1', etc. Args: tag: A name for the generated node. Will also serve as a series name in TensorBoard. tensor: A 3-D `uint8` or `float32` `Tensor` of shape `[height, width, channels]` where `channels` is 1, 3, or 4. 'tensor' can either have values in [0, 1] (float32) or [0, 255] (uint8). The image() function will scale the image values to [0, 255] by applying a scale factor of either 1 (uint8) or 255 (float32). Out-of-range values will be clipped. Returns: A scalar `Tensor` of type `string`. The serialized `Summary` protocol buffer. rrW)rescalerrr) rrr`rrYfloat32clipr]rrr)rr^r dataformats scale_factorrs r/rr4s6V_F FK 0F%f-L ]]2:: &F|# ) )!S 1 8 8 BF vw /E '--Cu=> ??r0cXt|}t||}t|}|jtjt |z}t |jddjtj|||}ttj||gS)z/Output a `Summary` protocol buffer with images.rrW)rroislabelsrr) rrrrYrr`rrr]rr)r tensor_image tensor_boxesrr r$rs r/rrZs<(L!,  ??r0c |jd}t|}|D]/}t|||df||df||df||df|dn||d}1|S)Nrr rfRed)rsrt)rranger) disp_imageboxesr$ num_boxeslist_gtr)s r/rrlsy AIIG   %  !Q$K !Q$K !Q$K !Q$K &F1I    r0cddlm}|j\}}}t||z}t||z} |j |} |t | ||} |j j} | j| |f| } ddl } | j} | j| d| j}| jtj||||S)z=Convert a numpy representation of an image to Image protobuf.r)ImageN)r$PNG)formatheightrd colorspaceencoded_image_string)rhr0rr fromarrayr ResamplingLANCZOSresizeioBytesIOsavegetvaluecloser)r^rr#r$r0r4rdchannel scaled_height scaled_widthr ANTIALIASr;output image_strings r/rr}s#\\FE7()Muw'L OOF #E 5$v6  ((I LL, 6 BE ZZ\F JJveJ$??$L LLN ==)  r0cBt|}t|}t|}|jtj }||zj ddjtj}t||}ttj||gS)NrrWrr) rrr`rrYrrr]rrr)rr^fpsr!rs r/rrs| V_F F #F%f-L ]]2:: &F|# ) )!S 1 8 8 BF vs #E '--Cu=> ??r0cz ddl} ddlm}ddl}|j \}}}}|j t||} |jd5} | j} | j| d d | jd| j} tj|||| cdddS#t$rtdYywxYw#t$rtddYywxYw#t$r; | j| d d n"#t$r| j| d YnwxYwYwxYw#1swYyxYw)Nrzadd_video needs package moviepy)editorz6moviepy is installed, but can't import moviepy.editor.z2Some packages could be missing [imageio, requests])rGz.gif)suffixF)verboser)rK progress_bar)rKr3)moviepy ImportErrorprintrItempfilerImageSequenceCliprNamedTemporaryFiler write_gifrseekreadrr0) r^rGrMmpyrP_thwcrr&filename tensor_strings r/rrsE),,KB1a  f3 7D  $ $F $ 3 q66 8 NN8U4N @ q  }}A!-   %  /0  D @   " 8 8xUK 8x7 8 8   svB5C D1C*29D15C  C C'&C'* D.4D D. D(%D.'D((D.+D1-D..D11D:cHt|}|j}t|jdkDrt d|j dd}|j dk7r td|tjtjjzjd}ddl }ddl }|j}|j|d5}|j!d|j#d|j%||j'|j(ddd|j+}|j-t/j0|d|j2d|d } t/t/j4|| g S#1swYrxYw) Nr z4warning: audio amplitude out of range, auto clipped.rz%input tensor should be 1 dimensional.zr?rAudiorr) rr^r_arrayr;rgfio wave_write audio_stringrs r/rrsI FOE MMOE 5z~~! DE 2q! zzQDEE RXXbhh'++ + 3 3E :E  **,C 3 +"" ,uzz* + <<>LIIK MMkk"o)  E '--Cu=> ??!++s AFF!c 2g}|jD]\}}g}|jD]\}}|d}|ddk(rqt|dk7r tdtjtjj |d|d|dg}tj || } n-tj| } tj || } |j| |jtj|| tj| }tjd} t| } td|jgt} t!t!j"d| | gS)Nr rMarginr(zlen(tags) != 3rf)rlowerupper)series)titlerr)rx multiline)rxchart)categoryrrr DT_STRINGr\ string_valrcustom_scalars__config__rr)rr rr MarginChartContentSeriesChartMultilineChartContentrCategoryLayoutrrrrr rr)layout categoriesrrcharts chart_namechart_metadatatagsmgccrzmlccrrr^s r/rrsJ F1*+'') ! &J!!$Da H,t9>()9::!44#55<<"&q'aQ=#((z$G!77DA"((zTJ MM% # !$ *--AVDE)F,   3F!,,9IJK k 2C ,,./%'F  MM8RU V  r0c @tjdtdj}t|}t d|j dgt t jd g  }ttj|d z||gS)Nr r)rrrr|utf_8)encodingr rrr}z /text_summaryrr) rrr rrencoder rrr)rr rrr^s r/r r s!,,N1$=$O$O$QK k 2C KKK12%+;+?+?Q+G*HI F }}!6VTU r0c |dkDrd}tj||||||f} td|j} t j d| } t | } t d| jdjttj| jd tj| jd  g  } ttj|| | gS)Nrrnum_thresholds pr_curvesrrrCrrr rr\rDrrr)rYstackr rrrrrr6r rrrr)rtpfptnfn precisionrecallrweightsrmpr_curve_plugin_datarrr^s r/r"r"(s 88RRY7 8D,.",,)=K k 2C ,,r"))+%!$$$**Q-8 $$$**Q-8   F '--C#fMN OOr0c t|d}t||||}td|j}t j d|}t |}t d|jd jttj|jd tj|jd  g  } ttj||| gS)Nr)rrrrrrrrCrrr rrrr)rr$r rrrrrr6r rrrr) rr$ predictionsrrrmrrrr^s r/r#r#Fs-N  NG D-.",,)=K k 2C ,,r"))+%!$$$**Q-8 $$$**Q-8   F '--C#fMN OOr0cd}|d}tjtj||dz z}|jtj}d|dz f}tj |||||z\}} tj |||d|z |z\} } tj |dddddd} tj | dddddd} | d| z } | d| z }| tj|| | zz }| tj|| |zz }tj| | | |||fS)NgHz>g?r r)rr*rr) rYint32floorrfloat64rr maximumr)r$rrr_MINIMUM_COUNTbucket_indices float_labelshistogram_range tp_buckets_ fp_bucketsrrrrrrs r/r$r$esLNXXbhh{nq6H'IJKN==,L.1,-OLL w& MJLL |#w. MJ :dd# $TrT *B :dd# $TrT *B AB ABRZZR88I "**^R"W5 5F 88RRY7 88r0c ddl}ddlm}|j|}|j |||||j ||} t d|jdjttj|j dtj|j dtj|j d g  }tj|j|||| } | S) aCreate a tensor summary with summary metadata. Args: name: Uniquely identifiable name of the summary op. Could be replaced by combination of name and type to make it unique even outside of this summary. display_name: Will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. tensor: Tensor to display in summary. content_type: Type of content inside the Tensor. components: Bitmask representing present parts (vertices, colors, etc.) that belong to the summary. json_config: A string, JSON-serialized dictionary of ThreeJS classes configuration. Returns: Tensor summary with metadata. rNr) json_configrCrrr rfrrr)r:tensorboard.plugins.meshr as_tensorcreate_summary_metadatarrrr6r rrrget_instance_name) r display_name descriptionr^rc componentsrr:rtensor_metadatatensor_summarys r/_get_tensor_summaryrs.1 U__V $F66  7O..$++-%!$$&,,q/: $$&,,q/: $$&,,q/:    F ]]  & &t\ : N r0c<d}|tj|d}|S)z5Parse and returns JSON string from python dictionary.z{}T) sort_keys)jsondumps) config_dictrs r/_get_json_configrs#Kjj= r0c zddlm}ddlm}t |} g} ||j f||j f||jfg} | D cgc] } | d |  } } |j| D cgc]\} } |  c} } }| D]%\} } | jt|||| | || 't| Scc} wcc} } w)a'Output a merged `Summary` protocol buffer with a mesh/point cloud. Args: tag: A name for this summary operation. vertices: Tensor of shape `[dim_1, ..., dim_n, 3]` representing the 3D coordinates of vertices. faces: Tensor of shape `[dim_1, ..., dim_n, 3]` containing indices of vertices within each triangle. colors: Tensor of shape `[dim_1, ..., dim_n, 3]` containing colors for each vertex. display_name: If set, will be used as the display name in TensorBoard. Defaults to `name`. description: A longform readable description of the summary data. Markdown is supported. config_dict: Dictionary with ThreeJS classes names and configuration. Returns: Merged summary for mesh/point cloud representation. rr)MeshPluginDatar) rr(tensorboard.plugins.mesh.plugin_data_pb2rrVERTEXFACECOLORget_components_bitmaskrrr)rverticescolorsfacesrrrrrr summariestensorsr^rcrs r/r%r%s,2G";/KI >(() ##$ %%& G%,E&vay/DvEGE004;<06<<J!(          ##%Frs   ' <F8JC 2 0   8 $ &5 &S &&3&5&:5<<:DI:4ell4tE{4 u|| S   JJJ(;< MMIz+>? NN]J0CD MMJ _=   KK*k?;   MMK?  LL; o> JJI7 KK*i9 KK*i9 KK*i9 KK*i9 II I7 KK*i9 LL:y/:  KK*k?;!" OOnn6LM#$ KK..2HI OOnn6LM LL>>3IJ JJJ8 8NO MMO^5KL KK*lO< LL:|_= NNZ?5<5#5 (VEP+M\%VP@D@.5p#@NKO@$"6 @% P@B&R&IMP<P>"9J<~OS6$r0