Wi[# rddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZGddZdZd Zd ZGd d Zd Zddej,dej,fdZ dde e ej0efde e ej0efdededeej0eff dZGddZy)N)Iterable) csr_matrix) squareform)OptionalUnionTupleAnyc0eZdZdZdZdZdZdZdZy)MyLoggerc8tjd|_y)NBERTopic)logging getLoggerlogger)selfs [/home/sietch6/trending-topics-pipeline/venv/lib/python3.12/site-packages/bertopic/_utils.py__init__zMyLogger.__init__ s'' 3 ch|j||jd|j_y)NF) set_level _add_handlerr propagate)rlevels r configurezMyLogger.configures& u  % rc<|jj|yN)rinformessages rrz MyLogger.infos G9&rc@|jjd|y)Nz WARNING: )rwarningrs rr!zMyLogger.warnings iy12rcLgd}||vr|jj|yy)N)DEBUGINFOWARNINGERRORCRITICAL)rsetLevel)rrlevelss rrzMyLogger.set_levels%B F? KK  ' rcBtj}|jtjd|jj |t |jjdkDr*|jjdg|j_yy)Nz$%(asctime)s - %(name)s - %(message)sr)r StreamHandler setFormatter Formatterr addHandlerlenhandlers)rshs rrzMyLogger._add_handlersv  " " $ ))*PQR r" t{{## $q ($(KK$8$8$;#SJsC(>?PQ Q@ghh?sBc|ett|tjt|tgs t d|j dt|k7r t dyy)z/Check if the embeddings have the correct shape.NzOMake sure to input embeddings as a numpy array or scipy.sparse.csr.csr_matrix. rzMake sure that the embeddings are a numpy array with shape: (len(docs), vector_dim) where vector_dim is the dimensionality of the vector embeddings. )r=r8npndarrayr ValueErrorshaper0) embeddingsdocss rcheck_embeddings_shaperH3sfJz2::6 :z8Z[\no o"c$i/ 10 rcfd}|j#t|dt|jizy)aChecks if the model was fitted by verifying the presence of self.matches. Arguments: topic_model: BERTopic instance for which the check is performed. Returns: None Raises: ValueError: If the matches were not found. zlThis %(name)s instance is not fitted yet. Call 'fit' with appropriate arguments before using this estimator.Nname)topics_rDtyper3) topic_modelmsgs rcheck_is_fittedrOAs; yC"[(9(B(BCCDD#rc$eZdZdZddZdZdZy) NotInstalledzThis object is used to notify the user that additional dependencies need to be installed in order to use the string matching model. Nc||_||_d|jd}| ||z }||_y|d|jdz }||_y)NzIn order to use z you will need to install via; zpip install bertopic[z] )tooldeprN)rrSrT custom_msgrNs rrzNotInstalled.__init__Xs]   +MN  ! : C *488*E: :Crc,t|jrModuleNotFoundErrorrNrargskwargss r __getattr__zNotInstalled.__getattr__c!$((++rc,t|jrrWrYs r__call__zNotInstalled.__call__fr]rr)r3r4r5__doc__rr\r_r6rrrQrQSs ,,rrQc|j}t|dk(r|d}|||dz zdz k7rmtdt|dk(r=|d|k7s|d|k7r tdtj|dt |}ntdt |ztj|dkr td|S)a_Validate the distance matrix and convert it to a condensed distance matrix if necessary. A valid distance matrix is either a square matrix of shape (n_samples, n_samples) with zeros on the diagonal and non-negative values or condensed distance matrix of shape (n_samples * (n_samples - 1) / 2,) containing the upper triangular of the distance matrix. Arguments: X: Distance matrix to validate. n_samples: Number of samples in the dataset. Returns: X: Validated distance matrix. Raises: ValueError: If the distance matrix is not valid. r+rz;The condensed distance matrix must have shape (n*(n-1)/2,).zMThe distance matrix must be of shape (n, n) where n is the number of samples.zThe distance matrix must be either a 1-D condensed distance matrix of shape (n*(n-1)/2,) or a 2-D square distance matrix of shape (n, n).where n is the number of documents.Got a distance matrix of shape %sz/Distance matrix cannot contain negative values.)rEr0rDrB fill_diagonalrr<r=)X n_samplessns rvalidate_distance_matrixrhjs( A 1v{ aD i!m,q0 1Z[ [ Q1 aDI 1Q49#4lm m A qM 036a&  9   vva!e}JKK Hrdistsreturnc\j}tjddz D]{dzk(stfddzdD|z}t |||z }t j j||dz z||z|dz<}|S)aCheck if the consecutive elements in the distance array are the same. If so, a small noise is added to one of the elements to make sure that the array does not contain duplicates. Arguments: dists: distance array sorted in the increasing order. noise_max: the maximal magnitude of noise to be added. Returns: Unique distances sorted in the preserved increasing order. rr+c34K|]}|k7s |ywrr6).0driis r z'get_unique_distances..s$P1!uQx-Q$Ps Nrb)lowhigh)copyrangerEnextminrBrandomuniform)ri noise_maxdists_cpnext_unique_distcurr_max_noiseros` @rget_unique_distancesr}szz|H 5;;q>A% &y 8uQU| ##$Pa!eg$PRWXYRZ]fRfg !,.to_ndarrays eZ (==? " rzyNo c-TF-IDF matrix was found despite it is supposed to be used (`use_ctfidf` is True). Defaulting to semantic embeddings.FTzNo topic embeddings were found despite they are supposed to be used (`use_ctfidf` is False). Defaulting to c-TF-IDF representation.)rrBrCrr r!)r~rFrrrrrepr_ ctfidf_useds rselect_topic_representationrs.% J 67BJJ ZF  $ NN5 ",U;E!2D;E   NN9 "3D;E!+U;E .:e ; FFE; FFrc eZdZdZdedefdZy)MockPlotlyModulezBMock module that raises an error when plotly functions are called.rJrjcfd}|S)Nc"tdd)NzPlotly is required to use 'z('. Install it with uv pip install plotly) ImportError)rZr[rJs r mock_functionz3MockPlotlyModule.__getattr__..mock_functions ;D6Aijk krr6)rrJrs ` rr\zMockPlotlyModule.__getattr__s lrN)r3r4r5r`r<r r\r6rrrrsLrr)gHz>)NNTF)numpyrBpandasr9rcollections.abcr scipy.sparserscipy.spatial.distancertypingrrrr r r@rHrOrQrhrr}rCboolrrr6rrrs$#-..==<i E$,,.. bRXX2BF:> 1Gbjj*&< =>1Grzz:5671G1G 1G  2::t  1Ghr