espnet2.lm.huggingface_pretrained_opt_lm.HuggingfaceOPTModel

source

class espnet2.lm.huggingface_pretrained_opt_lm.HuggingfaceOPTModel(vocab_size: int, opt_name: str)

Bases: AbsLM

Initializes internal Module state, shared by both nn.Module and ScriptModule.

batch_score(ys: Tensor, states: List[Any], xs: Tensor) → Tuple[Tensor, List[Any]]

Score new token batch.

• Parameters:
  • ys (torch.Tensor) – torch.int64 prefix tokens (n_batch, ylen).
  • states (List *[*Any ]) – Scorer states for prefix tokens.
  • xs (torch.Tensor) – The encoder feature that generates ys (n_batch, xlen, n_feat).
• Returns: Tuple of : batchfied scores for next token with shape of (n_batch, vocab_size) and next state list for ys.
• Return type: tuple[torch.Tensor, List[Any]]

forward(input: Tensor, hidden: None) → Tuple[Tensor, None]

Compute LM loss value from buffer sequences.

• Parameters:
  • input (torch.Tensor) – Input ids. (batch, len)
  • hidden (torch.Tensor) – Target ids. (batch, len)

reload_pretrained_parameters()

score(y: Tensor, state: Any, x: Tensor) → Tuple[Tensor, Any]

Score new token.

• Parameters:
  • y (torch.Tensor) – 1D torch.int64 prefix tokens.
  • state – Scorer state for prefix tokens
  • x (torch.Tensor) – encoder feature that generates ys.
• Returns: Tuple of : torch.float32 scores for next token (vocab_size) and next state for ys
• Return type: tuple[torch.Tensor, Any]