WiO ^ddlZddlZddlZddlmZddlmZmZmZddl m Z Gdde Z y)N)tqdm)ListMappingAny) BaseEmbedderc eZdZdZdddifdej dededzdedzde ee ff fd Z dd e ed e d ejfd ZdZxZS) OpenAIBackendaJOpenAI Embedding Model. Arguments: client: A `openai.OpenAI` client. embedding_model: An OpenAI model. Default is For an overview of models see: https://platform.openai.com/docs/models/embeddings delay_in_seconds: If a `batch_size` is given, use this set the delay in seconds between batches. batch_size: The size of each batch. generator_kwargs: Kwargs passed to `openai.Embedding.create`. Can be used to define custom engines or deployment_ids. Examples: ```python import openai from bertopic.backend import OpenAIBackend client = openai.OpenAI(api_key="sk-...") openai_embedder = OpenAIBackend(client, "text-embedding-ada-002") ``` ztext-embedding-ada-002Nclientembedding_modeldelay_in_seconds batch_sizegenerator_kwargsc6t|||_||_||_||_||_|j jdr|jd|_y|j jds|j|j d<yy)Nmodelengine)super__init__r r r r rget)selfr r r r r __class__s d/home/sietch6/trending-topics-pipeline/venv/lib/python3.12/site-packages/bertopic/backend/_openai.pyrzOpenAIBackend.__init__"s  . 0$ 0  $ $W -#3#7#7#@D &&**84-1-A-AD ! !' *5 documentsverbosereturnc|Dcgc] }|dk(rdn| }}|jg}t|j|| D]}|jjj dd|i|j }|j|jDcgc]}|jc}|jsutj|jnU|jjj dd|i|j }|jDcgc]}|j}}tj|Scc}wcc}wcc}w)aEmbed a list of n documents/words into an n-dimensional matrix of embeddings. Arguments: documents: A list of documents or words to be embedded verbose: Controls the verbosity of the process Returns: Document/words embeddings with shape (n, m) with `n` documents/words that each have an embeddings size of `m`  )disableinput)r r_chunksr embeddingscreaterextenddata embeddingr timesleepnparray) rrrdocprepared_documentsr#batchresponsers rembedzOpenAIBackend.embed6s)DMMCSBYcC7MM ?? &Jdll+=>G T 684;;1188^u^H]H]^!! "F11;;"FG((JJt445  65t{{--44g;MgQUQfQfgH/7}}=!!++=J=xx ###N#G>sEE E c#~Ktdt||jD]}||||jzyw)Nr)rangelenr )rris rr"zOpenAIBackend._chunksVs<q#i.$//: 5AADOO 34 4 5s;=)F)__name__ __module__ __qualname____doc__openaiOpenAIstrfloatintrrrrboolr*ndarrayr1r" __classcell__)rs@rr r s6 8)-!%.0 B BB $, B $J B "#s(+ B($tCy$4$BJJ$@5rr ) r(r:numpyr*rtypingrrrbertopic.backendrr r!rrrEs( %%)O5LO5r