Publications

*: equal contributions · : intern (co-)supervised by me

Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLM
Eliya Nachmani*, Alon Levkovitch*, Roy Hirsch, Julian Salazar, Chulayuth Asawaroengchai, Soroosh Mariooryad, Ehud Rivlin, RJ Skerry-Ryan, Michelle Tadmor Ramanovich
ICLR 2024 (to appear) samples · dataset (spoken LLaMA-Questions) · Google Research blog

Zero-Shot End-to-End Spoken Language Understanding via Cross-Modal Selective Self-Training
Jianfeng He, Julian Salazar, Kaisheng Yao, Haoqi Li, Jinglun Cai
EACL 2024 long paper code · datasets (MiniPS2SLURP, VoxPopuli2SLUE)

2022

Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation
Zejiang Hou, Julian Salazar, George Polovets
Transactions of the Association for Computational Linguistics (TACL), Vol. 10 (2022) code · EMNLP 2022 talk

2021

Align-Refine: Non-Autoregressive Speech Recognition via Iterative Realignment
Ethan A. Chi, Julian Salazar, Katrin Kirchhoff
NAACL 2021 short paper code in progress · talk

2020

Masked Language Model Scoring
Julian Salazar, Davis Liang, Toan Q. Nguyen, Katrin Kirchhoff
ACL 2020 long paper code · talk · also at DeepLo 2019

Unsupervised Bitext Mining and Translation via Self-Trained Contextual Embeddings
Phillip Keung, Julian Salazar, Yichao Lu, Noah A. Smith
Transactions of the Association for Computational Linguistics (TACL), Vol. 8 (2020) NAACL 2021 talk

BERTphone: Phonetically-Aware Encoder Representations for Utterance-Level Speaker and Language Recognition
Shaoshi Ling, Julian Salazar, Yuzong Liu, Katrin Kirchhoff
Speaker Odyssey 2020 [best paper runner-up] code

Don’t Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings
Phillip Keung, Yichao Lu, Julian Salazar, Vikas Bhardwaj
EMNLP 2020 short paper [oral] talk

Deep Contextualized Acoustic Representations for Semi-Supervised Speech Recognition
Shaoshi Ling, Yuzong Liu, Julian Salazar, Katrin Kirchhoff
ICASSP 2020 [oral] code · talk

Attentional Speech Recognition Models Misbehave on Out-of-Domain Utterances
Phillip Keung, Wei Niu, Yichao Lu, Julian Salazar, Vikas Bhardwaj
arXiv (Feb. 2020) data

2019

*: indicates equal contribution

Self-Attention Networks for Connectionist Temporal Classification in Speech Recognition
Julian Salazar, Katrin Kirchhoff, Zhiheng Huang
ICASSP 2019 poster · slides for AWS AI in Practice

Transformers without Tears: Improving the Normalization of Self-Attention
Toan Q. Nguyen*, Julian Salazar*
IWSLT 2019 [oral] code · slides · WNGT 2020 talk

2018 and earlier

^: the Hardy-Littlewood rule

Invariant Representation Learning for Robust Deep Networks
Julian Salazar*, Davis Liang*, Zhiheng Huang, Zachary C. Lipton
Workshop on Integration of Deep Learning Theories at NeurIPS 2018 poster

Crepant Resolutions of Weierstrass Models with Torsion
Julian Salazar
Harvard University undergraduate thesis, Mar. 2017 (high honors) supervisors: Mboyo Esole, Noam Elkies · examiner: Joe Harris

Conway’s Subprime Fibonacci Sequences
Richard K. Guy^, Tanya Khovanova^, Julian Salazar^
Mathematics Magazine, Vol. 87, No. 5 (Dec. 2014) code · presented at MathFest 2012

Explorations

The Representability Hierarchy and Hilbert’s 13th Problem
Explicates the relationship between classical superpositions of algebraic functions and the viewpoint from algebraic geometry. Supervised by Benson Farb at the 2016 UChicago REU.

Persistent Homology and the Topology of Motor Cortical Activity
With Emma West. Introduces topological data analysis with an application to motor neuronal data from the Hatsopolous Lab. Written at the 2016 UChicago REU.

[DRAFT] Descent by 2-Isogeny on Elliptic Curves: from Fermat to Weil
My Harvard junior paper, supervised by Noam Elkies.

[DRAFT] A Peripatetic Course in Algebraic Topology
A lengthy survey of basic algebraic topology based on lectures by Peter May at the 2016 UChicago REU.