暾jfdZddlmZddlZddlZddlZddlmZmZm Z m Z ddl Z ddl Z ddlZ ddlZddlZerddlmZddlmZddlmZmZdd lmZdd lmZej<j>j@ej<j>jBzej<j>jDzZ#ejHe%Z&e'e(e)fZ* d Z+ d Z, d Z- dZ. Gdde Z/ddZ0ddZ1dde-e,e.f ddZ2 d dZ3GddZ4GddejjZ6GddejjZ7GddejjZ8y#e$rdZY6wxYw)!zPImplements file-like objects for reading and writing to/from Azure Blob Storage.) annotationsN) TYPE_CHECKINGAny TypedDictcastT) TracebackType)IO)ReadableBufferWriteableBuffer)Self)TransportParamsazureii@c,eZdZUded<ded<ded<y) _AzureUristrscheme container_idblob_idN)__name__ __module__ __qualname____annotations__Z/home/spazio/kingdom_calls/work5/transenv/lib/python3.12/site-packages/smart_open/azure.pyrr>s K Lrrctjj|}|jtk(sJ|j }|j jd}|sd}|}n|}|}t||dS)zAParse an ``azure://`` URI into its container and blob components./z$root)rrr) smart_openutils safe_urlsplitrSCHEMEnetlocpathlstrip) uri_as_stringsrfirstsecondrrs r parse_urir*Dsk    ' ' 6B 99   IIE WW^^C F   lw OOrct|}tjjt|}t |d|d|fi|S)zIOpen an Azure Blob Storage URI using the given mode and transport params.rr)r*rr check_kwargsopen)urimodetransport_params parsed_urikwargss ropen_urir3VsB3J    * *41A BF  >*Jy,A4 R6 RRrc|s d}t||tjjk(r)t ||||tjj |S|tjj k(rt|||||S|tjjk(rt|||||Sd|d}t|)azOpen an Azure Blob Storage blob for reading or writing. Args: container_id: The name of the container this object resides in. blob_id: The name of the blob within the bucket. mode: The mode for opening the object. Must be either "rb", "wb", or "ab". client: The Azure Blob Storage client to use when working with azure-storage-blob. May be a BlobServiceClient, ContainerClient, or BlobClient. blob_kwargs: Additional parameters to pass to ``BlobClient.commit_block_list`` (for "wb") or ``BlobClient.upload_blob`` (for "ab"). For writing only. buffer_size: The buffer size to use when performing I/O. For reading only. min_part_size: The minimum part size for multipart uploads. For writing only. max_concurrency: The number of parallel connections with which to download. For reading only. Returns: A file-like object for reading from or writing to the blob. Raises: ValueError: If no client is provided. NotImplementedError: If the requested mode is not supported. z/you must specify the client to connect to Azure) buffer_sizeline_terminatormax_concurrency) blob_kwargs min_part_sizez$Azure Blob Storage support for mode z not implemented) ValueErrorr constants READ_BINARYReaderBINARY_NEWLINE WRITE_BINARYWriter APPEND_BINARY AppendWriterNotImplementedError) rrr/clientr8r5r9r7msgs rr-r-]sF ?o z##///   #&00??+    z##000lGV\ijj z##111 '6{R_   18H IC c ""rc|}t|dr|j|}t|dr,|j|k7rd|jd|}t|t|dr|j |}t d|S)z>TZZ '**40 #f+% rc|j|jk(ry|dk(r2|jj|j|j}n2|jj|j|j|}t j d|jt|tjjjr|j}n|j}td|S)Nr)offsetr7)rgr7lengthz$reading with a max concurrency of %dbytes)rUrVrT download_blobrWloggerdebug isinstancerstoragerMStorageStreamDownloaderreadallrdr)rXrYstreamrcs rraz_RawReader._download_blob_chunks :: '  2:ZZ--T^^UYUfUf-gFZZ--~~t7H7HQU.F  ;T=N=NO femm00HH I^^%F[[]FGV$$rN)rMrJrYintrZrrreturnNone)r^rrrsrrrfrYrrrsri)rrr__doc__r[r_rdrarrrrQrQs*( %rrQc^eZdZUdZded<dZded<eejje f ddZ ddZ e dd Zdd Zdd Zdd Zejj$fdd ZddZd d!dZd"d#dZd"d#dZd$dZd"d%dZd"d&dZd"d'dZd(dZ d)dZd*dZd*dZy)+r=aReads bytes from Azure Blob Storage. Implements the io.BufferedIOBase interface of the standard library. Args: container: The name of the container the blob resides in. blob: The name of the blob within the container. client: The Azure Blob Storage client. May be a BlobServiceClient, ContainerClient, or BlobClient. buffer_size: The buffer size to use when performing I/O. line_terminator: The line terminator to use when reading lines. max_concurrency: The number of parallel connections with which to download. Raises: azure.core.exceptions.ResourceNotFoundError: Raised when the blob to read from does not exist. rnameN$azure.storage.blob.BlobClient | NonerTc||_||_t||||_|j1d|d|}tj j j| |jjd|_ t|j|j||_ d|_ tjj!||_||_y#t$r d|_ YkwxYw)Nzblob z not found in rYr)_container_name _blob_namerOrTrcore exceptionsResourceNotFoundErrorget_blob_propertiesrUKeyErrorrQ _raw_readerrVr bytebuffer ByteBuffer _current_part_line_terminator)rXrLrMrDr5r6r7rEs rr[zReader.__init__s )%fi> :: $~i[9C**''==cB B 779&ADJ/9TZZQ`.a'22==kJ /  DJ s"CC-,C-cdtjd|jsd|_d|_yy)zFlush and close this stream. close: calledN)rkrlclosedrTrrXs rclosez Reader.closes) _%{{DJ#D rc|jduSz$Return True if the stream is closed.NrTrs rrz Reader.closedzzT!!rcy)z+Return True if the stream can be read from.Trrs rreadablezReader.readablercy)z2Return True; we support `seek` but not `truncate`.Trrs rseekablezReader.seekable!rrc"tj Unsupported.ioUnsupportedOperationrs rdetachz Reader.detach(%%%rc0tjd|||tjjvr+d|dtjj}t ||tjj k(r|}n<|tjjk(r|j|z}n|j|z}||jkDr`||jz t|jkr;|jj||jz ||_|jS|j}|J||_|j|tjd|j|jj|jS)a"Seek to the specified position. Args: offset: The offset in bytes. whence: Where the offset is from. Returns: The position after seeking. Raises: ValueError: If ``whence`` is not one of the accepted values. z seeking to offset: %r whence: %rzinvalid whence z, expected one of zcurrent_pos: %r)rkrlrr;WHENCE_CHOICESr: WHENCE_STARTWHENCE_CURRENTrVrUrbrrdrr_empty)rXrgwhencerE new_position raw_readers rr_z Reader.seek,sM  7H --<< <#F8+=j>R>R>a>a=deCS/ ! Z))66 6!L z++:: :>>F2L::.L $.. (\DNN-JcRVRdRdNe-e    # #L4>>$A B)DN>> !%% %%%% % &7   "~~rc|jS)z,Return the current position within the file.r]rs rtellz Reader.tellUs ~~rc"tjrrrXrYs rtruncatezReader.truncateYrrc|d}|j}|J|dk(ry|dkr2|j|_|j|j zSt |j |k\r|j|S|j|jk(r|jS|j||j|S)z6Read up to size bytes from the object and return them.rfrr)rrUrV_read_from_bufferrdrbr _fill_buffer)rXrYrs rrdz Reader.read]s <D%% %%% 19 !8!ZZDN))+joo.?? ? t!! "d *))$/ / >>TZZ '))+ + $%%d++rc&|j|S)zThis is the same as read().)rY)rdrs rread1z Reader.read1usyydy##rct|jd}|jt|}|sy||dt|t|S)zDRead up to len(b) bytes into b, and return the number of bytes read.BrN) memoryviewrrdrb)rXbmvdatas rreadintozReader.readintoysG ]   $yyR!;SY4yrc^|d}|dk7r d}t|tj}|j|jk(rt |j dk(s|j j|j}|j||xjt |z c_|j|jr |jS|j|j|jk(st |j dk(s|jS)zCRead up to and including the next newline. Returns the bytes read.rfz(limits other than -1 not implemented yetr) rCrBytesIOrVrUrbrreadlinerwriteendswithrgetvalue)rXlimitrEline line_parts rrzReader.readlines =E B;>TZZ/C8J8J4Kq4P**33D4I4IJI JJy ! NNc)n ,N!!$"7"78}}    >>TZZ/C8J8J4Kq4P}}rc|dk\r|nt|j}|jj|}|xjt|z c_|S)z:Remove at most size bytes from our buffer and return them.r)rbrrdrV)rXrYparts rrzReader._read_from_buffersGqytc$*<*<&=!!&&t, #d)# rc|j}|Jt||jj}t |j|kr|j |j k7rr|jjtd|}|dk(rtjdyt |j|kr|j |j k7rry)Nz IO[bytes]rz reached EOF while filling bufferT) rmaxr _chunk_sizerbrVrUfillrrkrl)rXrYr bytes_reads rrzReader._fill_buffers%% %%%4++778$$$%,4::1M++00k:1NOJQ ?@ $$$%,4::1M rc|S)z!Enter the reader context manager.rrs r __enter__zReader.__enter__ rc$|jy)z!Close the reader on context exit.N)rrXexc_typeexc_valexc_tbs r__exit__zReader.__exit__s  rcjd|jjd|jd|jdS)z8Return a short human-readable description of the reader.(, ) __class__rr|r}rs r__str__zReader.__str__54>>**+2d.B.B-ERGZZ[\\rch|jjd|jd|jdS)z3Return an unambiguous representation of the reader. (container=, blob=rrrs r__repr__zReader.__repr__6..))*+d6J6J5MWUYUdUdTgghiir)rLrrMrrD _AzureClientr5rrr6rir7rrrsrtrsrtrsboolrsz io.RawIOBasergrrrrrrsrrrsrrNrY int | Nonersrrru)rYrrsri)rr rsrr)rrrsrirv)rYrrrsz bool | Nonersr rztype[BaseException] | NonerzBaseException | NonerzTracebackType | Nonersrtrsr) rrrrwrrTDEFAULT_BUFFER_SIZErr;r>DEFAULT_MAX_CONCURRENCYr[rpropertyrrrrrr_rrrdrrrrrrrrrrrrr=r=s& I26E /6/!+!5!5!D!D6000 0  0  00 0<$""&/9.B.B.O.O'R&,0$4 ,&%   ]jrr=ceZdZUdZded<dZded<def ddZddZdd Z dd Z e dd Z dd Z dd Zej j"fddZdddZddZddZd dZddZd!dZ d"dZd#dZd#dZy)$r@zqWrites bytes to Azure Blob Storage. Implements the io.BufferedIOBase interface of the standard library. rryNrzrTc||_||_|xsi|_||_d|_d|_d|_tj|_ g|_ t||||_ yrS) r|r} _blob_kwargs_min_part_size _total_size _total_parts_bytes_uploadedrrr _block_listrOrTrXrLrMrDr8r9s rr[zWriter.__init__sf )'-2+ ZZ\?A%fi> rcyz>No-op flush; data is buffered until `close` or `_upload_part`.Nrrs rflushz Writer.flushrctjd||jsg|_d|_tjd|y)zDo not commit block list on abort. Uploaded (uncommitted) blocks will be garbage collected after 7 days. See also https://stackoverflow.com/a/69673084/5511061. z %s: terminating multipart uploadNz%s: terminated multipart upload)rkrlrrrTrs r terminatezWriter.terminates8  7>{{!D DJ 6=rctjd|js|j}|Jtjd| |jj dkDr|j |j|jfi|jg|_d|_tjd|yy#g|_d|_wxYw)z4Commit the buffered block list and close the stream.rNz%s: completing multipart uploadrz%s: completed multipart upload) rkrlrrTrr _upload_partcommit_block_listrr)rXrMs rrz Writer.closes _%{{::D# ## LL:D A "%%**,q0%%'&&&t'7'7M4;L;LM#% ! LL94 @$& ! s ACCc|jduSrrrs rrz Writer.closedrrcyz+Return True if the stream supports writing.Trrs rwritablezWriter.writable rrcyz #8}227;##$8$?$?$AB " 4#5#5#:#:>#JK  MM   ( (( ( ;   9    "   Q .ZZ(:(:(?(?(AB 2;;/rc|S)z!Enter the writer context manager.rrs rrzWriter.__enter__XrrcJ||jy|jy)z.Close or terminate the writer on context exit.Nrrrs rrzWriter.__exit__\   NN  JJLrcjd|jjd|jd|jdS)z8Return a short human-readable description of the writer.rrrrrs rrzWriter.__str__hrrc|jjd|jd|jd|jdS)z3Return an unambiguous representation of the writer.rrz, min_part_size=r)rrr|r}rrs rrzWriter.__repr__ls[..))*+d6J6J5MWUYUdUdTggwx|yLyLxOOPQ Qr rLrrMrrDrr8dict[str, Any] | Noner9rrrsrtrrrrrrrrr rsrrrrrrrrrwrrT_DEFAULT_MIN_PART_SIZEr[rrrrrrrrr;rr_rrrrrrrrrrrrr@r@s I26E /6.23 ??? ? + ?  ? ?(M > A ""/9.B.B.O.O&& + &0> , & %   ]Qrr@ceZdZUdZded<dZded<def ddZddZdd Z dd Z e dd Z dd Z dd Zej j"fddZdddZddZddZd dZddZd!dZ d"dZd#dZd#dZy)$rBzqAppend bytes to Azure Blob Storage. Implements the io.BufferedIOBase interface of the standard library. rryNrzrTc||_||_|xsi|_||_d|_t j |_t||||_ yrS) r|r}rrrrrrrOrTrs rr[zAppendWriter.__init__zsN )'-2+ZZ\%fi> rcyrrrs rrzAppendWriter.flushrrc^|js!tj|_d|_yy)z4AppendBlob cannot be aborted, so we do nothing here.N)rrrrrTrs rrzAppendWriter.terminates#{{!#D DJrc|js6 |jjdkDr|jd|_yy#d|_wxYw)zDNo action needed here, as the AppendBlob is automatically committed.rN)rrrrrTrs rrzAppendWriter.closesH{{ "%%**,q0%%'!  " s -A A c|jduSrrrs rrzAppendWriter.closedrrcyrrrs rrzAppendWriter.writablerrcyrrrs rrzAppendWriter.seekablerrc"tjrrrs rr_zAppendWriter.seekrrc"tjrrrs rrzAppendWriter.truncaterrc|jSr r rs rrzAppendWriter.tellr rc0d}tj|r rrs rrzAppendWriter.detachrrc\t|ts dtdt|}t|t t |}|j j||xj|z c_|j j|jk\r|j|S)z@Append `b` to the AppendBlob, buffering until ``min_part_size``.rrrrs rrzAppendWriter.writes!]+)-):'$q'MCC. Z]#   # F"    " " $(;(; ;     rc"|j}|J|jj}|jd|tj j jjdd|jtj|_y)NF)r blob_type overwriter) rTrr upload_blobrrnrMBlobType APPENDBLOBrrr)rXrMrs rrzAppendWriter._upload_partszz!!**, mm((11<<    ZZ\rc|S)z(Enter the append writer context manager.rrs rrzAppendWriter.__enter__rrcJ||jy|jy)z5Close or terminate the append writer on context exit.Nr*rs rrzAppendWriter.__exit__r+rcjd|jjd|jd|jdS)z?Return a short human-readable description of the append writer.rrrrrs rrzAppendWriter.__str__rrch|jjd|jd|jdS)z:Return an unambiguous representation of the append writer.rrrrrs rrzAppendWriter.__repr__rrr.rrrrrrrr0rrrr1rrrrBrBqs I26E /6.23 ??? ? + ?  ? ?"M """/9.B.B.O.O&& +  * , & %   ]jrrB)r&rrsr)r.rr/rr0r rsio.BufferedIOBase)rrrrr/rrDz_AzureClient | Noner8r/r5rrr9rrr7rrrsrJ)rDrrLrrMrrsrJ)9rw __future__rrrloggingtypingrrrrsmart_open.bytebufferrsmart_open.constantssmart_open.utilsazure.core.exceptionsrazure.storage.blob ImportError MISSING_DEPStypesrr _typeshedr r typing_extensionsr smart_open._typingr rnrMBlobServiceClientContainerClient BlobClientr getLoggerrrkri bytearrayrrr"r2rrrr*r3r-rOrQBufferedIOBaser=r@rBrrrr_sW" 66 #9&2  ,, --   , , - --   ' ' (   8 $ :. Y H%Q!D  P$S#')-*/27#7# 7# 7# 7# ' 7#  7#7#7#7#t6 66 6# 6(.%.%bfjR  fjRiQR  iQXxj2$$xjsLsE""E-,E-