espnet2.speechlm.dataloader.multimodal_loader.dialogue_loader.validate_and_process_messages

source

espnet2.speechlm.dataloader.multimodal_loader.dialogue_loader.validate_and_process_messages(messages: List[Any], key: str) → List[Tuple[str, str, str | Tuple[ndarray, int]]]

Validate and process dialogue messages.

• Parameters:
  • messages – List of message tuples (role, modality, content).
  • key – The example ID for error messages.
• Returns: List of validated tuples where each tuple is (role, modality, content). Content format depends on modality:
  • text: string
  • audio: (audio_array, sample_rate) where audio_array has shape

  [num_channels, num_samples]