ij ddlmZddlZddlZddlmZddlmZddl m Z ddl m Z m Z dZddZd d hZddd Zddd Zdd Zy)) annotationsN)makedirs)Path)settings)errorinfoArgosTranslatec:|jd}|dkDr|d|Sy)a.Gets the protocol of a URL string For example if url is "https://www.argosopentech.com" "https" is returned. If the protocol can't be determined None is returned Args: url: The URL to get the protocol of Returns: The string representation of the protocol or None :rN)find)urlprotocol_end_indexs c/home/spazio/kingdom_calls/work5/transenv/lib/python3.12/site-packages/argostranslate/networking.py get_protocolrs,#A&&'' httphttpsczt|tvrytd|d}||krg tjj |dt i}tjj|}|j}td||Sy#t$r}|dz }t|Yd}~nd}~wwxYw||kr.)a]Downloads data from an url and returns it Args: url: The url to download (http, https) retry_count: The number of retries to attempt if the initial download fails. If retry_count is 0 the download will only be attempted once. Returns: The downloaded data, None is returned if the download fails NzGet rz User-Agent)headerszGot ) rsupported_protocolsrurllibrequestRequest USER_AGENTurlopenread Exceptionr)r retry_countdownload_attempts_countreqresponsedataerrs rgetr%#sC 334u ![ 0 ..((%z2)C~~--c2H==?D 4u K   #q ( # #JJ  "[ 0sA%B B3B..B3cptj|t|D]}t||}||cSy)agDownloads data from a list of urls and returns it Args: urls: The urls to download (http, https) retry_count: The number of retries to attempt if the initial download fails. If retry_count is 0 the download will only be attempted once. Returns: The downloaded data, None is returned if the download fails N)randomsamplelenr%)urlsrr attempts rget_fromr,Bs>}}T3t9-c;'  N rcddlm}ddlm}t t j dz }t|dtdt |dz d z }|js= td |d |d d g }|j|td|S|S#t$r}tt|Yd}~yd}~wwxYw)zSDownloads Spacy multilingual model and saves it the cache directory for further user)load)downloadspacyT)exist_okz'Looking for cached Spacy xx_sent_ud_sm.sentermodelz Downloading Spacy xx_sent_ud_sm. xx_sent_ud_smparser)excludez(Spacy xx_sent_ud_sm successfully cached.N)r0r. spacy.clir/rr cache_dirrrexiststo_diskrrstr) spacy_loadspacy_download spacy_cache spacy_modelnlpes r cache_spacyrBTs(4x))G34K [4( 23{X-78K      3 4 ? +_xjAC KK $ ; <     #a&M s#;B!! C*CC)r r;returnz str | None))r r;rintrC bytes | None)r*z list[str]rrErCrF)rCz Path | None) __future__rr'urllib.requestrosrpathlibrargostranslaterargostranslate.utilsrrrrrr%r,rBrrrNs@" #,  $w'>$r