WiK FddlZddlmZddlmZddlmZGddeZy)N)tqdm)List) BaseEmbeddercReZdZdZfdZddeededejfdZ xZ S) SpacyBackendaSpacy embedding model. The Spacy embedding model used for generating document and word embeddings. Arguments: embedding_model: A spacy embedding model Examples: To create a Spacy backend, you need to create an nlp object and pass it through this backend: ```python import spacy from bertopic.backend import SpacyBackend nlp = spacy.load("en_core_web_md", exclude=['tagger', 'parser', 'ner', 'attribute_ruler', 'lemmatizer']) spacy_model = SpacyBackend(nlp) ``` To load in a transformer model use the following: ```python import spacy from thinc.api import set_gpu_allocator, require_gpu from bertopic.backend import SpacyBackend nlp = spacy.load("en_core_web_trf", exclude=['tagger', 'parser', 'ner', 'attribute_ruler', 'lemmatizer']) set_gpu_allocator("pytorch") require_gpu(0) spacy_model = SpacyBackend(nlp) ``` If you run into gpu/memory-issues, please use: ```python import spacy from bertopic.backend import SpacyBackend spacy.prefer_gpu() nlp = spacy.load("en_core_web_trf", exclude=['tagger', 'parser', 'ner', 'attribute_ruler', 'lemmatizer']) spacy_model = SpacyBackend(nlp) ``` crt|dtt|vr||_yt d)NspacyzPlease select a correct Spacy model by either using a string such as 'en_core_web_md' or create a nlp model using: `nlp = spacy.load('en_core_web_md'))super__init__strtypeembedding_model ValueError)selfr __class__s c/home/sietch6/trending-topics-pipeline/venv/lib/python3.12/site-packages/bertopic/backend/_spacy.pyr zSpacyBackend.__init__5s;  c$/0 0#2D S  documentsverbosereturncd}g}t|dd| D]}|j|xs|}|jr |j}n&|jj j dd}t|tjst|dr|j}|j|tj|S)aEmbed a list of n documents/words into an n-dimensional matrix of embeddings. Arguments: documents: A list of documents or words to be embedded verbose: Controls the verbosity of the process Returns: Document/words embeddings with shape (n, m) with `n` documents/words that each have an embeddings size of `m`  rT)positionleavedisableget)rr has_vectorvector_trf_datatensors isinstancenpndarrayhasattrrappendarray)rrrempty_document embeddingsdoc embeddings rembedzSpacyBackend.embed@s  ATw;O )C,,S-BNCI##%,, %KK0088r8s)W$<W$r