i=6TUddlZddlmZddlmZddlZddlmcmZ ddl mcmcm Z ddl mcmcm cmZddlmcmcm cmZddlmcmcm cmcmZddlmcmcmZddlmcmcmcmZddlmcmcmZddlmcmcmcmZddlmcmcmcmZ ddl!Zddl"mcm#Z$ddlmZddl%m&Z&m'Z'ddl(m)Z)m*Z*ddl+m,Z,ddl-m.Z.gd Z/e*ej`e)ejbejde jdejfe jfejhe jhejje jjejle jlejne jnejpe jpejre jrejte jtejve jvejxe jxejze jzej|e j|iZ?e@eefeAd <ie*ej`e)ejbejejejejejejejfejfejhejhejjejjejlejlejnejnejpejpejejejrejrejtejtejejejejejejiejejejejejejejejejjjejdejdejdejejejejejeje jeje jeje jeje jeje jeje jeje jeje jeje jeje jejejejfejejhejejjejejejejejejejejejejejejejejdejdejdejhejhejjejjiZee@eefeAd <ejhejhejjejjejdejdejjjejde jeje jeje jeje jeje jeje jeje jeje jeje jeje jejiZfe@eefeAd <ejvejvejdejdejdejdejjjejdej|ej|ejejejxejxejzejze jejejtejtejrejri Zhe@eefeAd <ejhZjekeeAd<e$jejj"je$jejj"je$jejj"je$jejj"je$jejj"je$jejj"jiZse@eetzefeAd<eje&eje&eje&eje'iZye@eefeAd<ejde jj"jdiZ{e@eefeAd<ejde jj"j(jdiZ|e@eefeAd<dekefdZ}de@eeffdZ~de@eeffdZde@eeffdZde@eeffdZ d+dede@eefdzdedefdZ d,dede@eefdzdefdZde@eeffdZde@eeffd Zde@eeffd!Zde@eeffd"Zdekefd#Zdekefd$Zde@eetzeffd%Zd&eetzdefd'Zd(ejjdedzfd)Zd(ejjdefd*Zy)-N)Callable)Any)nn)+default_fixed_qparams_range_0to1_fake_quant.default_fixed_qparams_range_neg1to1_fake_quant) DeQuantStub QuantStub)get_combined_dict)type_before_parametrizations).DEFAULT_REFERENCE_STATIC_QUANT_MODULE_MAPPINGS$DEFAULT_STATIC_QUANT_MODULE_MAPPINGSDEFAULT_QAT_MODULE_MAPPINGS%DEFAULT_DYNAMIC_QUANT_MODULE_MAPPINGS,DEFAULT_FLOAT_TO_QUANTIZED_OPERATOR_MAPPINGS"DEFAULT_MODULE_TO_ACT_POST_PROCESS+DEFAULT_STATIC_SPARSE_QUANT_MODULE_MAPPINGS,DEFAULT_DYNAMIC_SPARSE_QUANT_MODULE_MAPPINGSno_observer_set(get_default_static_quant_module_mappings2get_default_static_quant_reference_module_mappings*get_embedding_static_quant_module_mappings/get_default_static_sparse_quant_module_mappingsget_static_quant_module_classget_dynamic_quant_module_classget_default_qat_module_mappings!get_embedding_qat_module_mappings)get_default_dynamic_quant_module_mappings0get_default_dynamic_sparse_quant_module_mappings$get_default_qconfig_propagation_list&get_default_compare_output_module_list0get_default_float_to_quantized_operator_mappingsget_quantized_operatorr r rr_INCLUDE_QCONFIG_PROPAGATE_LISTrrrrreturncntjjtjjh}|S)z8These modules cannot have observers inserted by default.)r quantizableLSTMMultiheadAttention) no_observerss e/var/www/html/engine/venv/lib/python3.12/site-packages/torch/ao/quantization/quantization_mappings.pyrrs&NN'')J)JKL c4tjtS)z8Get module mapping for post training static quantization)copydeepcopyr r+r*rrs === >>r+c4tjtS)zBGet reference module mapping for post training static quantization)r-r.r r/r+r*rrs ==G HHr+ctjt}tj|t j<tj |t j <|S)z7Get module mapping, including mapping for embedding QAT)r-r.r nnq EmbeddingBagnnqat Embeddingmappings r*rrs>mm@AG"%"2"2GE  "}}GEOO Nr+c4tjtS)z?Get module mapping for post training static sparse quantization)r-r.rr/r+r*rrs ==D EEr+float_module_classadditional_static_quant_mapping is_referencec|i}t|rtnt|}|j|d}|t dt |dzt j|S)zen Get the statically quantized module class corresponding to the floating point module class NFloating point module class 5 does not have a corresponding quantized module class)r r r getAssertionErrorstrr-r.)r9r:r; all_mappingsstatic_quant_module_classs r*rrs}'.*,'$  7 1' L !- 0 01CT J (*3/A+B*C DE F   ==2 33r+ additional_dynamic_quant_mappingc|i}tt|}|j|d}|tdt |dzt j |S)zfn Get the dynamically quantized module class corresponding to the floating point module class Nr=r>)r rr?r@rAr-r.)r9rDrBdynamic_quant_module_classs r*rrsu(/+-($-/OL".!1!12Dd!K!)*3/A+B*C DE F   ==3 44r+c4tjtS)z:Get default module mapping for quantization aware training)r-r.rr/r+r*rrs ==4 55r+ctjt}tj|t j<tj |t j <|S)zGet module mapping for quantization aware training This is includes default values in addition to enabling qat for embeddings. )r-r.rr4r3rr5r6s r*rr!s> mm78G$11GBOO!OOGBLL Nr+ctS)z9Get module mapping for post training dynamic quantization)rr/r+r*rr,s 00r+ctS)z@Get module mapping for post training dynamic sparse quantization)rr/r+r*rr1s 77r+cttjttjzttjzt z}t j|S)z_Get the default list of module types that we'll attach qconfig attribute to in prepare )setr keysrrr#r-r.)#QCONFIG_PROPAGATE_MODULE_CLASS_LISTs r*rr6se 0 5 5 78 )..0 1 2 388: ; < * *( ==< ==r+cttjttjzttjzttj zttj zttj zt z}tj|S)zSGet list of module class types that we will record output in numeric suite ) rLr valuesrrrMr#r-r.).NUMERIC_SUITE_COMPARE_MODEL_OUTPUT_MODULE_LISTs r*r r Cs 0 7 7 9: )002 3 4 3::< = > 2779 : ; )..0 1  2 388: ;  < *  *3 ==G HHr+c4tjtSN)r-r.rr/r+r*r!r!Ss ==E FFr+float_opcdtj|}|tdt|d|S)z>Get the quantized operator corresponding to the float operatorz Operator z) does not have corresponding quantized op)rr?r@rA)rT quantized_ops r*r"r"Zs>?CCHMLH &O P   r+modulec@tjt|dS)zGet the special activation post process for `module`, this has higher priority than the activation post process in `qconfig` e.g. input: torch.nn.Sigmoid output: default_affine_fixed_qparam_fake_quant N)rr?r rWs r*_get_special_act_post_processrZds! . 1 1$V,d r+c@|jxrt|tvSrS)trainingtyperrYs r*_has_special_act_post_processr^ps ?? QtF|/QQQr+)NFrS)r-collections.abcrtypingrtorch torch.ao.nnaorao_nntorch.ao.nn.intrinsic intrinsicnnitorch.ao.nn.intrinsic.qatqatnniqattorch.ao.nn.intrinsic.quantized quantizednniq'torch.ao.nn.intrinsic.quantized.dynamicdynamicnniqdtorch.ao.nn.qatr4torch.ao.nn.qat.dynamicnnqatdtorch.ao.nn.quantizedr2torch.ao.nn.quantized.dynamicnnqdtorch.ao.nn.quantized.reference referencennqrtorch.ao.nn.sparsetorch.nn.functional functionalF#torch.ao.quantization.fake_quantizerrtorch.ao.quantization.stubsrr torch.ao.quantization.utilsr torch.nn.utils.parametrizer __all__Quantize DeQuantizeLinearConv1dConv2dConv3dConvTranspose1dConvTranspose2dConvTranspose3dr5r3GRUCellLSTMCellRNNCellr'r dict__annotations__ BatchNorm2d BatchNorm3dDropoutELU GroupNorm HardswishInstanceNorm1dInstanceNorm2dInstanceNorm3d LayerNorm LeakyReLUmoduleslinearNonDynamicallyQuantizableLinearReLU6PReLUFloatFunctional QFunctionalBNReLU2dBNReLU3d ConvReLU1d ConvReLU2d ConvReLU3d ConvAdd2d ConvAddReLU2d LinearReLULinearLeakyReLU LinearTanhConvBn1dConvBn2dConvBn3d ConvBnReLU1d ConvBnReLU2d ConvBnReLU3d LinearBn1dr rGRUr Sequentialr#rLeluops hardswish instance_norm layer_norm leaky_reludropoutrrA HardsigmoidSigmoidSoftmaxTanhrsparserrrrrrrboolrrrrrrrr r!r"ModulerZr^r/r+r*rs  $ ##**..777((##,,..?9C 8s||IIt{{IIt{{IIt{{IIt{{,,,,,,LL$..OOT&&JJ KKJJ GGTYYG.Xs]0C&5= s||5=5=NNCOO5=NNCOO 5= JJ 5= IIszz 5=IIszz5=IIszz5=++5=++5=++5=FFCGG5=LL#--5=OOS%%5=LL#--5= LL#--!5="s))#5=$s))%5=&s))'5=(LL#--)5=*LL#--+5=,JJ55szz-5=.IIszz/5=0HHcii15=2HHcii35=675=:LL$--;5=<LL$--=5=>NNDOO?5=@NNDOOA5=BNNDOOC5=DMM4>>E5=Ft))G5=HNNDOOI5=J--NNDOO OOSZZ OOSZZ OOSZZ    t t t szz LL#** LL#** LL#**i5=$d8S=&95rIIu||IIu||IIu||JJ55u||LL&//LL&//LL&//f))f))f))NNF%%NNF%%NNF%%NNF%%4T(C-0(JJ IIt{{ MM4;;JJ55t{{GGTYYFFDHHKKJJ NNE$$OOS%%LL#-->%tHcM':0MM2XEE599   " "KK$$..OOUYY((66LL%))%%00LL%))%%00IIuyy""** P,d8c>83K.LNN?JJ;JJ;GG ; @"D8);$<IIu||%%,,D+T(C--@ IIu||%%--44E,d8S=.A S ?$x}2E? ID314# 3F1 8$x}:M8 >c(m > IH I G$ sNH;GX^ %((// ho R%((//RdRr+