espnet2.universa.abs_universa.AbsUniversa

source

class espnet2.universa.abs_universa.AbsUniversa(*args: Any, **kwargs: Any)

Bases: Module, ABC

Universa abstract class.

Initialize internal Module state, shared by both nn.Module and ScriptModule.

abstractmethod forward(audio: Tensor, audio_lengths: Tensor, metrics: Dict[str, Tensor], ref_audio: Tensor, ref_audio_lengths: Tensor, ref_text: Tensor, ref_text_lengths: Tensor, **kwargs) → Tuple[Tensor, Dict[str, Tensor], Tensor]

Calculate outputs and return the loss tensor.

abstractmethod inference(audio: Tensor, audio_lengths: Tensor, **kwargs) → Dict[str, ndarray | Tensor]

Return predicted output as a dict.

property require_raw_audio

Return whether or not raw_audio is required.

property require_raw_text

Return whether or not raw_text is required.