Sakriani Sakti

Dual-support mechanism with visual saliency guidance and auxiliary acoustic loss for image-to-speech generation

Abstract Recent advances have made it possible to generate speech directly from images without relying on text as a bridge, which is particularly beneficial for unwritten languages. These methods leverage speech units as intermediate representations and jointly train image-to-uni...