i9 ddlmZddlZddlmZmZddlmZddlm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZmZdd lmZerddlm Z m!Z!ede"e#e$edfZ%ede"e#e$edfe&e'eefe(eZ)Gdde*Z+Gddeee%e)fZ,Gdde,e%e)fZ-Gdde,e%e)fZ.Gdde.e%e)fZ/Gdde/e%e)fZ0y)) annotationsN)ABCabstractmethod) literal_eval)cached_property)sha256)getenv)Path) gettempdir)Lock)AnyGeneric TYPE_CHECKINGTypeVar) assert_neveroverrideSelf)FileLock)FutureThreadPoolExecutorKey.ValueceZdZdZy) CacheErrorzJ Exception raised for errors encountered during cache operations. N)__name__ __module__ __qualname____doc__O/var/www/html/engine/venv/lib/python3.12/site-packages/torch/_inductor/cache.pyrrsr rc4eZdZdZeddZeddZy)Cachezi Abstract base class for cache implementations. Provides the interface for cache operations. cyz Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present, else None. Nr)selfkeys r!getz Cache.get*r cy)  Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Nrr&r'values r!insertz Cache.insert4r)r Nr&rr'rreturnz Value | Noner&rr'rr-rr0bool)rrrrrr(r.rr r!r#r#$s/     r r#cLeZdZdZddZd dZd dZed dZed dZ y) InMemoryCachezL In-memory cache implementation using a dictionary and thread lock. c0i|_t|_y)z6 Initialize an empty in-memory cache. N)_cacher _lockr&s r!__init__zInMemoryCache.__init__Es)+ 6 r c|j5|jj|x} |cdddS dddy#1swYyxYwr%)r7r6r(r,s r!r(zInMemoryCache.getLsJZZ --:     sAAA c|j5||jvr dddy||j|< dddy#1swYyxYw)r+NFT)r7r6r,s r!r.zInMemoryCache.insertYsLZZ dkk!   %DKK     s ??Ac |}t|x}|S|jdD]}|j}|s |jdd\}}|j|j}} t |} t |} tj|} tj| } |j| | r|j| | k7st d | d|j| d| d|S#t$r}t d|d|d|d}~wwxYw#tt f$r}t d|d |d |d}~wwxYw#tt f$r}t d |d |d |d}~wwxYw#tj$r}t d|d |d |d}~wwxYw#tj$r}t d |d |d |d}~wwxYw)av Create an in-memory cache from an environment variable. Args: env_var (str): Name of the environment variable containing cache data. Returns: InMemoryCache: An instance populated from the environment variable. Raises: CacheError: If the environment variable is malformed or contains invalid data. N;,zMalformed kv_pair z from env_var z!, likely missing comma separator.zMalformed key_bytes_repr z in kv_pair z, encoding is invalid.zMalformed value_bytes_repr z, not un-pickle-able.zMultiple values for key z found, got z and .) r splitstrip ValueErrorrr SyntaxErrorpickleloadsUnpicklingErrorr.r() clsenv_varcacheenv_valkv_pairkey_bytes_reprvalue_bytes_reprerr key_bytes value_bytesr'r-s r! from_env_varzInMemoryCache.from_env_varisIg &G /L}}S)9 GmmoG 3:==a3H0 0$$& &&(-N  (8  *+;<  ll9-   [1LLe,599S>U3J .sg\%))C.ASSXY^Xaabco9 v a  ( >'Lmn  ,  //Ag[Xno  ,  12B1E\RYQ\\rs ))  //Ag[Xmn  ))  12B1E\RYQ\\qr swD5 D+ E E?#F- D(D##D(+E:E  EE<$E77E<?F*F%%F*-GGGcX|}|js|S t|d5}tj||_dddt|jtst d|d|S#1swY4xYw#tj $r}t d|d|d}~wwxYw)a= Create an in-memory cache from a file path. Args: fpath (Path): Path to the file containing pickled cache data. Returns: InMemoryCache: An instance populated from the file. Raises: CacheError: If the file is not a valid pickled dictionary. rbNz&Failed to create cache from file path z#, file contents are un-pickle-able.z-, file contents not pickled dict[Key, Value].) is_fileopenrEloadr6rGr isinstancedict)rHfpathrJfprOs r!from_file_pathzInMemoryCache.from_file_paths}}L eT" /b%{{2  /%,,-8?lm   / /%% 8?bc  s. BA5B5A>:BB)B$$B)Nr&rr0Noner/r1)rIstrr0r)rZr r0r) rrrrr9r(r. classmethodrRr\rr r!r4r4@sA"  KKZr r4cDeZdZdZ ddZ ddZy) AsyncCachezE Asynchronous cache implementation using ThreadPoolExecutor. c:|j|j|S)a Retrieve a value from the cache asynchronously. Args: key (Key): The key to look up. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[Value | None]: Future for the cached value or None. )submitr()r&r'executors r! get_asynczAsyncCache.get_asyncstxx--r c<|j|j||S)aO Insert a value into the cache asynchronously. Args: key (Key): The key to insert. value (Value): The value to associate with the key. executor (ThreadPoolExecutor): Executor for async execution. Returns: Future[bool]: Future for the result of insertion. )rdr.)r&r'r-res r! insert_asynczAsyncCache.insert_asyncst{{C77r N)r&rr'rrerr0zFuture[Value | None]) r&rr'rr-rrerr0z Future[bool])rrrrrfrhrr r!rbrbsY . . .(: .  . 8 8 8%* 86H 8  8r rbceZdZUdZdZded<d ddZeddZddZ dd Z e dd Z e dd Ze dd Zy) OnDiskCachea? On-disk cache implementation using files and file locks. Stores cache data in files on disk, with atomic operations and versioning. Supports custom cache directory names. Attributes: version (int): The version used for cache versioning. name (str): The name of the cache directory. rintversionNc|xsd|_y)z Initialize an on-disk cache instance. Args: name (str | None, optional): The name of the cache directory. If None, defaults to "on_disk_cache". on_disk_cacheN)name)r&ros r!r9zOnDiskCache.__init__s+O r cHttdz |jz S)z Get the base directory for the cache. Returns: Path: The base directory path for storing cache files. rJ)r r ror8s r!base_dirzOnDiskCache.base_dirsJL!G+dii77r c |jttj|j ddz S#t tj f$r}td|d|d}~wwxYw)a Get the file path for a given key. Args: key (Key): The key to convert to a file path. Returns: Path: The file path for the key. Raises: CacheError: If the key is not pickle-able. N zFailed to get fpath for key z, key is not pickle-able.) rqrrEdumps hexdigestAttributeError PicklingErrorrr)r&r'rOs r!_fpath_from_keyzOnDiskCache._fpath_from_keysl ==6&,,s*;#<#F#F#H"#MM M 4 45 .sg5NO  s;>A,A''A,cjtt|jdz |jddz dzS)z Get a file lock for a given file path. Args: fpath (Path): The file path. Returns: FileLock: The file lock for the path. locksNz.lock)rr_parentro)r&rZs r!_flock_from_fpathzOnDiskCache._flock_from_fpath*s1ELL72UZZ^CDwNOOr ctttjj j ddS)z Get the version prefix for the cache. Returns: bytes: The version prefix as bytes, derived from the cache version string. Nr{)rr_rjrlencodedigestr8s r!version_prefixzOnDiskCache.version_prefix9s3c+--.5578??A"1EEr c4|j|}|j|}|5|js dddyd}t|j}t |d5}|j ||jk(r|j }ddd||j dddy tj|}|cdddS#1swYFxYw#tj$r}td|d|d}~wwxYw#1swYyxYw)a Retrieve a value from the cache. Args: key (Key): The key to look up. Returns: Value | None: The cached value if present and version matches, else None. Raises: CacheError: If the value is corrupted or cannot be unpickled. Side Effects: Removes stale cache files if the version prefix does not match. NrTzFailed to get key z?, value is potentially corrupted (value is not un-pickle-able).) rxr}rUlenrrVreadunlinkrErFrGr) r&r'rZflockrQ prefix_lengthr[r-rOs r!r(zOnDiskCache.getBs$$S)&&u-  ==?  K 3 34MeT" ,b77=)T-@-@@"$'')K ,"   "  [1 1    , ,))  (/no '  sMD#D#/CD7C# DC D#D 6DD  DDc|j|}|j|}|jjdd |5}t |d5}|j |j tj||ddddddy#1swYxYw#1swYyxYw#tj$r}td|d|d|d}~wt$rYywxYw) a Insert a value into the cache. Args: key (Key): The key to insert. value (Value): The value to associate with the key. Returns: bool: True if the value was inserted, False if the key already exists. Raises: CacheError: If the value is not pickle-able. Side Effects: Creates the cache directory if it does not exist. T)parentsexist_okxbNzFailed to insert key z with value z, value is not pickle-able.F) rxr}r|mkdirrVwriterrEdumprwrFileExistsError)r&r'r-rZr_r[rOs r!r.zOnDiskCache.insertls$$S)&&u- 4$7  '!T%. '",,- E2& ' ' ' ' ' ## 'wl5)C^_   sTB+ B2BB B+B BB($B+(B++C >C C C )N)r&rroz str | Noner0r^r&rr0r )r&rr'rr0r )r&rrZr r0r)r&rr0bytesr/r1)rrrrrl__annotations__r9rrqrxr}propertyrrr(r.rr r!rjrjsvGS,88& PFF''Rr rjc6eZdZdZdfd ZeddZxZS)InductorOnDiskCachezt Inductor-specific on-disk cache implementation. Uses a custom base directory for Inductor cache files. c$t|dy)z Initialize an inductor on-disk cache instance. Sets the cache directory name to "inductor_on_disk_cache". inductor_on_disk_cacheN)superr9)r& __class__s r!r9zInductorOnDiskCache.__init__s 12r cFddlm}t|d|jS)z Get the base directory for the Inductor cache. Returns: Path: The base directory path for Inductor cache files. r)default_cache_dirrJ)%torch._inductor.runtime.runtime_utilsrr ro)r&rs r!rqzInductorOnDiskCache.base_dirs L%'$))<rs" #%77::*=eS#uS#X/c5c?E4S>4PS9U  Ce$ 8UE#u*%Up8sEz"8BQ*S%Z(Qh=+c5j1=r