FEibSUdZddlZddlZddlZddlmZmZmZmZm Z m Z m Z m Z m Z ddlmZe rddlZddlmZddlmZddlmZddlmZdd lmZdd lmZmZm Z m!Z!dd l"m"Z"d d l#m$Z$m%Z%d dl&m'Z'm(Z(m)Z)e dZ*e dZ+iddddddddddddddddddddddddddddd d d!d!d"d"d#d$d%d&Z,ee-e-fe.d'<d(d)d*d+d,Z/ee-e0fe.d-<gdZ1e e-e.d.<dDd/egefd0e0d1efd2Z2d3e-d1e-fd4Z3d5e0d1e0fd6Z4d7e-d1e-fd8Z5d9e-d:e*d;e-d1e e-de7d?e-d@e7d;ee-d:e*d1e e-d q(L ! }Id1g>N>N=OPQ+I;fWq[M;-WXYZ 9% [M1ABC & sB+A2B&&B+geoc|j}|tvs|tvr|SttjttjzDcgc]&}t |dkDr|j |dr|(c}dd}d|d}|r|ddj|dz }|d t td z }|d t td z }|d z }t|cc}w)zValidate geo parameter against available countries and US states. Args: geo: Country or US state code Raises: InvalidParameterError: If geo code is invalid Returns: Validated geo code (uppercased) rNzInvalid geo code ''. Did you mean one of: , ?z Available: z% countries (US, CA, UK, DE, FR, ...) zor z US states (CA, NY, TX, FL, ...)zN See trendspyg.config.COUNTRIES and trendspyg.config.US_STATES for full list.) upperrrlistkeyslen startswithjoinr)rXcodesimilar error_msgs rV validate_georhss ))+C i3)+ !%Y^^%5 6inn>N9O O<c(Q,4??3q6#:<<>Q@G%SE,I-dii.@-ACC  ?3y>"22WXXI 3s9~&&FGGI ccI  **r?zInvalid hours value 'z'. Must be one of: zr 4 = Past 4 hours 24 = Past 24 hours (1 day) 48 = Past 48 hours (2 days) 168 = Past 168 hours (7 days))r)ri valid_hourss rVvalidate_hoursrms<#K   w&9+G* + categoryc|j}|tvr|StjDcgc](}|j|ddst |dk\s'|*c}dd}d|d}|r|ddj |dz }|d dj t tjz }t|cc}w) zValidate category parameter against available categories. Args: category: Category name Raises: InvalidParameterError: If category is invalid Returns: Validated category (lowercased) NrZzInvalid category 'r[r\r]r^z Available categories: )lowerr;rarcrbrdsortedr)rocatrfrgs rVvalidate_categoryrus~~H:)oo/fs3>>(2A,3OSVW_S`deSesfgihijG$XJb1I-dii.@-ACC  -diiz?P8Q.R-STTI  **gsC CCcsv_path output_format download_dirz pd.DataFramec.|dk(r|S ddl} |j|}|dk(r|S|j dd d}|d k(r\|d z} |j |d d tj|tdtjj||S|dk(r[|dz} |j|dtj|tdtjj||Std|#t$rtd|dwxYw#t$r}t d|d}~wwxYw#t$r}t d|d}~wwxYw#t$r tdt$r}t d|d}~wwxYw)aConvert downloaded CSV to requested output format. Args: csv_path: Path to the downloaded CSV file output_format: Desired output format download_dir: Directory for output files Returns: Path to converted file or DataFrame object Raises: ImportError: If required library is not installed DownloadError: If conversion fails rrNzpandas is required for 'z7' format. Install with: pip install trendspyg[analysis]zFailed to read CSV file: r .rrz.jsonrecordsrJ)orientindentz[OK] Converted to JSON: zFailed to convert to JSON: rz.parquetF)indexzK] Converted to Parquet: zIpyarrow is required for parquet format. Install with: pip install pyarrowzFailed to convert to Parquet: zUnsupported output format: )pandas ImportErrorread_csv Exceptionrrsplitto_jsonosremoverNpathbasename to_parquetr) rvrwrxpddfrT base_path json_path parquet_paths rV_convert_csv_to_formatrs& = R[[ "  # Q'*I'  C JJy1J = IIh  ,RWW-=-=i-H,IJ K  ) # :-  F MM,eM 4 IIh  /0@0@0N/OP Q  "=m_ M NN_  &}o6< <    =7s;<<=$ C"=aS AB B C 4  F"@ DE E FsTD D'AE(AE% D$' E0D>>E E"EE"%FFF active_onlysort_byheadlessc  t|}t|}t|}|2tjj tj d}tjj|}tj|dtdtj|D}t} |dddd} | jd| |rD| jd | jd | jd | jd | jd | jddgtdtd|td|dtd|td|td| tj | } d|} |dk7r| d|z } t&j)|j+d}|r| d|z } td| | j)| t-| d j/t1j2t4j6d!f|r& td"t-| d#j/t1j8t4j:d$f}|j=t?j@d%t-| d&j/t1j8t4j:d'f}| jCd(|t?j@d)| jEt4jFd*jItJjLt?j@d)|j+d-k7rtd.|d/td0t-| d j/t1j8t4j6d!f}|j=t?j@d)t-| d#j/t1j2t4j:d1f}| jCd(|td2d }d%}d3}t}||kr]t?j@|||z }td4tj|D}||z }|rtd5|d6d7n||kr]|s*td8tj|D}||z }|rtS|d9}tjj ||}tUjVjYd:}d;|d<|d=|d<|d> }tjj ||}tjZ||td?|td@|t]|||}|dAk(rtdBt_|dC|| jaStcdD|#t"$r} t%d| dd} ~ wwxYw#tNtPf$r!} td+td,Yd} ~ d} ~ wwxYw#tN$r} t%dE| dFd} ~ wtP$r} t%dG| dHd} ~ wtd$r} t%dI| dJd} ~ wtft$tbf$rth$r*} t%dKtk| jldL| dMd} ~ wwxYw#| jawxYw)NaK Download Google Trends data with configurable filters and output formats Args: geo: Country code (US, CA, UK, IN, JP, etc.) hours: Time period in hours (4, 24, 48, 168) category: Category filter (all, sports, entertainment, etc.) active_only: Show only active trends sort_by: Sort criteria (relevance, title, volume, recency) headless: Run browser in headless mode download_dir: Directory to save file output_format: Output format (csv, json, parquet, dataframe) Returns: Path to downloaded file (for csv/json/parquet) or DataFrame (for dataframe format), or None if failed Raises: InvalidParameterError: If any parameters are invalid BrowserError: If browser automation fails DownloadError: If file download fails N downloadsT)exist_okc3DK|]}|jds|yw.csvNendswith.0fs rV z-download_google_trends_csv..@sSq 6@RS  F)zdownload.default_directoryzdownload.prompt_for_downloadzdownload.directory_upgradezsafebrowsing.enabledprefsz--headless=newz --disable-gpuz --no-sandboxz--disable-dev-shm-usagez --log-level=3excludeSwitcheszenable-loggingz[INFO] Opening Google Trends...z Location: z Time: Past z hoursz Category: z Active only: z Sort: )optionsz Failed to start Chrome browser: z Please ensure: 1. Chrome browser is installed 2. ChromeDriver is compatible with your Chrome version 3. You have proper permissions ChromeDriver is auto-downloaded by Selenium, but you need Chrome browser installed.z'https://trends.google.com/trending?geo=r=z&hours=r&z&cat=z[INFO] Navigating to: z//button[contains(., 'Export')]z.[INFO] Enabling 'Active trends only' filter...rZz)button[aria-label*='select trend status']g?rqz;button[role='switch'][aria-label='Show active trends only']zarguments[0].click();rbodyzF[WARN] Could not toggle 'Active trends only' filter - using all trendszM Reason: UI element not found (Google may have changed their interface)r!z[INFO] Note: Sort by 'z:' only affects UI display (CSV exports in relevance order)z[INFO] Downloading CSV...zli[data-action="csv"]z#[INFO] Waiting for file download...gc3DK|]}|jds|ywrrrs rVrz-download_google_trends_csv..ZaqzzRXGYZrzNFO] File detected after z.1fsc3DK|]}|jds|ywrrrs rVrz-download_google_trends_csv..rrrz %Y%m%d-%H%M%Strends__h_rz[OK] Downloaded: z[OK] Location: r z![OK] Converted to DataFrame with z rowszNo new file detected after download attempt. Possible causes: - Download may have failed silently - File may have been downloaded to a different location - Network timeout during download Expected download directory: zPage load timeout: z Possible causes: - Slow internet connection - Google Trends website is down or slow - Network firewall blocking access Try again with a better connection or check https://trends.google.com/trendingzCould not find UI element: a Possible causes: - Google Trends changed their website design - Page did not load correctly Solutions: - Update trendspyg: pip install --upgrade trendspyg - Check GitHub issues: https://github.com/flack0x/trendspyg/issues - Report this issue if it persistszCould not click UI element: zq An element is blocking the click. This may be temporary. Try running again - this often resolves automatically.z"Unexpected error during download: z: z_ This is an unexpected error. Please report it at: https://github.com/flack0x/trendspyg/issues)7rhrmrurrrdgetcwdabspathmakedirssetlistdirradd_experimental_option add_argumentrNr Chromerrr;getrrruntilECpresence_of_element_locatedr XPATHelement_to_be_clickable CSS_SELECTORclickrQrRexecute_script find_elementTAG_NAME send_keysrESCAPErrr`rnowstrftimerenamerrbquitrrrrrOrP)rXrirorrrrxrwexisting_fileschrome_optionsrdriverrTurlcat_code active_buttontoggle export_button download_csv max_wait_timecheck_interval elapsed_time new_files current_filesdownloaded_file full_path timestampnew_namenew_pathresults rVdownload_google_trends_csvrsB s C 5 !E *Hww||BIIK= 77??<0LKK t,SBJJ|$<SSNYN&2(-&* $  E **7E:##$45##O4##N3##$=>0**+PQ +- cU #$ ugV ,- hZ ()  ./ M' #$  !!.9f7u= B; WUG$ $C>>(.."2B7  U8*% %C &se,- 3 fb!''  * *BHH6W+X Y   hFG -fa 8 > >..Al/mn! ##% 3'vq177..A~/A%%&=vF 1 ##BKK8BB4;;O 1  ==?k ) *7)3mn o )*%fb177  & &2S'T U   1 %VQ/55  * *BOO=T+U V  5|D 34  !e ]* JJ~ & N *L Z2::l+CZZM%6I3L3EQGH]*Z2::l+CZZM%6I "9oa0O \?CI! //@I QugRz9+TJHww||L(;H IIi * %hZ0 1 OH:. /,Hm\RF +9#f+eLMj  g 0 1=~ ? {  .qc2b b   l%&<= h^`egg h`  !!%] ]   "  )!-1 1   , *1#.E E  "< ?  0a1A1A0B"QCH: :     sW5(B Y D%X.EY D Y'Y5 X>X  XY$Y:YYY [ Y  [ ,Y;; [ Z [ 6%[[  [##[5c tjdtjd}|jdtdd|jdt gd d d |jd tt tjdd |jddd|jdttdd |jddd|jdtd|j}tdtdtdt|jj|j|j |j"|j$|j& |j(}td|rFt*j,j/|}td|d d!td"t1d#ytd$t1d%y)&Nz/Download Google Trends data with custom filtersa Examples: # Default (US, past 24 hours, all categories) %(prog)s # Canada, past 4 hours %(prog)s --geo CA --hours 4 # UK, past 7 days, Sports only, sorted by volume %(prog)s --geo UK --hours 168 --category sports --sort volume # India, active trends only %(prog)s --geo IN --active-only # Japan, Entertainment category, sorted by recency %(prog)s --geo JP --category entertainment --sort recency Available countries (geo codes): US, CA, UK, AU, IN, JP, DE, FR, BR, MX, ES, IT, RU, KR, and many more Available categories: all, sports, entertainment, business, politics, technology, health, science, games, shopping, food, travel, beauty, hobbies, climate, etc. ) descriptionformatter_classepilogz--geoUSz4Country code (US, CA, UK, IN, JP, etc.). Default: US)rOdefaulthelpz--hoursrkr=z>Time period: 4 (4h), 24 (24h), 48 (48h), 168 (7d). Default: 24)rOchoicesrrz --categoryr%zCategory filter. Default: allz --active-only store_truezShow only active trends)actionrz--sortr!z>Sort by: relevance, title, volume, recency. Default: relevancez --visiblez*Run browser in visible mode (not headless)z --output-dirz$Output directory for downloaded file)rOrzF======================================================================z%Google Trends Configurable Downloader)rXrirorrrrxz File size: ,z bytesz Done!rz Failed to downloadr)argparseArgumentParserRawDescriptionHelpFormatterrstrintr`r;rarE parse_argsrNrrXr_rirorsortvisible output_dirrrgetsizeexit)parserargsfilepathsizes rVmainrs  $ $E << F: c4RT  5Er\^  3Z__=N8OY^;=  57 sL+\^  LHJ SBD    D &M 12 &M) HHNN jj$$ \\!__H &Mwwx( D86*+ i Q $% Qrn__main__)rq)rr=r%Fr!TNr)rHN);__doc__rrQrtypingrrrrrrr r r seleniumr rrselenium.webdriver.common.byr selenium.webdriver.common.keysrselenium.webdriver.support.uirselenium.webdriver.supportrr!selenium.webdriver.chrome.optionsrselenium.common.exceptionsrrrrrconfigrr exceptionsrrr OutputFormat SortOptionr;r__annotations__rDrrErWrhrmrurboolrrrPrnrVrs  ZZZ+/7@5 )<= > ?  2 W h  y  _  F W hy F 5 W F  y!" #$) DcN2   d38nF d3iES(9TW8+c+c+>##4+++8HOHOHOHO 3  HOX"&"'} } }} }  }  }3-} } 3 $%}@L^ zFrn