| Unsupervised learning of spoken language with visual context D Harwath, A Torralba, J Glass Advances in Neural Information Processing Systems 29, 2016 | 266 | 2016 |
| Jointly discovering visual objects and spoken words from raw sensory input D Harwath, A Recasens, D Surís, G Chuang, A Torralba, J Glass Proceedings of the European conference on computer vision (ECCV), 649-665, 2018 | 202 | 2018 |
| Deep multimodal semantic embeddings for speech and images D Harwath, J Glass 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU …, 2015 | 154 | 2015 |
| A summary of the 2012 JHU CLSP workshop on zero resource speech technologies and models of early language acquisition A Jansen, E Dupoux, S Goldwater, M Johnson, S Khudanpur, K Church, ... 2013 IEEE International Conference on Acoustics, Speech and Signal …, 2013 | 109 | 2013 |
| Avlnet: Learning audio-visual language representations from instructional videos A Rouditchenko, A Boggust, D Harwath, B Chen, D Joshi, S Thomas, ... arXiv preprint arXiv:2006.09199, 2020 | 107 | 2020 |
| Learning word-like units from joint audio-visual analysis D Harwath, JR Glass arXiv preprint arXiv:1701.07481, 2017 | 106 | 2017 |
| Learning hierarchical discrete linguistic units from visually-grounded speech D Harwath, WN Hsu, J Glass arXiv preprint arXiv:1911.09602, 2019 | 83 | 2019 |
| Vision as an interlingua: Learning multilingual semantic embeddings of untranscribed speech D Harwath, G Chuang, J Glass 2018 IEEE International Conference on Acoustics, Speech and Signal …, 2018 | 57 | 2018 |
| Everything at once-multi-modal fusion transformer for video retrieval N Shvetsova, B Chen, A Rouditchenko, S Thomas, B Kingsbury, RS Feris, ... Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2022 | 53 | 2022 |
| Multimodal clustering networks for self-supervised learning from unlabeled videos B Chen, A Rouditchenko, K Duarte, H Kuehne, S Thomas, A Boggust, ... Proceedings of the IEEE/CVF International Conference on Computer Vision …, 2021 | 49 | 2021 |
| Text-free image-to-speech synthesis using learned segmental units WN Hsu, D Harwath, C Song, J Glass arXiv preprint arXiv:2012.15454, 2020 | 44 | 2020 |
| Towards visually grounded sub-word speech unit discovery D Harwath, J Glass ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and …, 2019 | 38 | 2019 |
| Spoken moments: Learning joint audio-visual representations from video descriptions M Monfort, SY Jin, A Liu, D Harwath, R Feris, J Glass, A Oliva Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern …, 2021 | 34 | 2021 |
| Look, Listen, and Decode: Multimodal Speech Recognition with Images F Sun, D Harwath, J Glass IEEE Workshop on Spoken Language Technology, 2016 | 32 | 2016 |
| Zero resource spoken audio corpus analysis DF Harwath, TJ Hazen, JR Glass 2013 IEEE International Conference on Acoustics, Speech and Signal …, 2013 | 31 | 2013 |
| Learning modality-invariant representations for speech and images K Leidal, D Harwath, J Glass 2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU …, 2017 | 30 | 2017 |
| Transfer learning from audio-visual grounding to speech recognition WN Hsu, D Harwath, J Glass arXiv preprint arXiv:1907.04355, 2019 | 28 | 2019 |
| Trilingual semantic embeddings of visually grounded speech with self-attention mechanisms Y Ohishi, A Kimura, T Kawanishi, K Kashino, D Harwath, J Glass ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and …, 2020 | 25 | 2020 |
| Mae-ast: Masked autoencoding audio spectrogram transformer A Baade, P Peng, D Harwath arXiv preprint arXiv:2203.16691, 2022 | 23 | 2022 |
| Topic identification based extrinsic evaluation of summarization techniques applied to conversational speech D Harwath, TJ Hazen 2012 IEEE International Conference on Acoustics, Speech and Signal …, 2012 | 23 | 2012 |
James GlassMIT Computer Science and Artificial Intelligence LaboratoryVerified email at mit.edu
