nlpatl.models.embeddings.transformers

class nlpatl.models.embeddings.transformers.Transformers(model_name_or_path, batch_size=16, padding=False, truncation=False, nn_fwk=None, name='transformers')[source]

Bases: nlpatl.models.embeddings.embeddings.Embeddings

A wrapper of transformers class.

Parameters

  • model_name_or_path (str) – transformers model name.

  • batch_size (int) – Batch size of data processing. Default is 16

  • padding (bool) – Inputs may not have same size. Set True to pad it. Default is False

  • truncation (bool) – Inputs may not have same size. Set True to truncate it. Default is False

  • nn_fwk (str) – Neual network framework. Either pt (for PyTorch) or tf (for TensorFlow)

  • name (str) – Name of this embeddings

>>> import nlpatl.models.embeddings as nme
>>> model = nme.Transformers()
convert(x)[source]
Parameters

x (np.ndarray) – Raw features

Returns

Vectors of features

Return type

np.ndarray