Accepted Papers

Authors with Google affiliation listed in bold.

Authors who completed the paper at Google denoted with *

Long Papers

Learning to Represent Image and Text with Denotation Graphs

Bowen Zhang*, Hexiang Hu*, Vihan Jain, Eugene Ie, Fei Sha

Zoom Q&A Session 4C: Language Grounding to Vision, Robotics and Beyond

01:00 UTC/GMT

Link to Paper

Non-Autoregressive Machine Translation with Latent Alignments

Chitwan Saharia, William Chan, Saurabh Saxena, Mohammad Norouzi

Gather Session 1A: Machine Translation and Multilinguality

02:00 UTC/GMT

Link to Paper

Local Additivity Based Data Augmentation for Semi-supervised NER

Jiaao Chen, Zhenghui Wang, Ran Tian, Zichao Yang, Diyi Yang

Gather Session 1B: Machine Learning for NLP

02:00 UTC/GMT

Link to Paper

ToTTo: A Controlled Table-To-Text Generation Dataset

Ankur Parikh, Xuezhi Wang, Sebastian Gehrmann, Manaal Faruqui, Bhuwan Dhingra, Diyi Yang, Dipanjan Das

Gather Session 1I: Interpretability and Analysis of Models for NLP; Language Generation

02:00 UTC/GMT

Link to Paper

BLEU might be Guilty but References are not Innocent

Markus Freitag, David Grangier, Isaac Caswell

Zoom Q&A Session 1B: Machine Translation and Multilinguality

16:00 UTC/GMT

Link to Paper

ETC: Encoding Long and Structured Inputs in Transformers

Joshua Ainslie, Santiago Ontanon, Chris Alberti, Vaclav Cvicek, Zachary Fisher, Philip Pham , Anirudh Ravula, Sumit Sanghai, Qifan Wang, Li Yang

Zoom Q&A Session 2A: Machine Learning for NLP

17:00 UTC/GMT

Link to Paper

Data Weighted Training Strategies for Grammatical Error Correction

Jared Lichtarge, Chris Alberti, Shankar Kumar Zoom

Q&A Session 2B: NLP Applications

17:00 UTC/GMT

Link to Paper

Short Papers

Small but Mighty: New Benchmarks for Split and Rephrase

Li Zhang, Huaiyu Zhu, Siddhartha Brahma, Yunyao Li

Gather Session 1I: Interpretability and Analysis of Models for NLP; Language Generation

02:00 UTC/GMT

Link to Paper

Pre-Training Transformers as Energy-Based Cloze Models

Kevin Clark, Minh-Thang Luong, Quoc Le, Christopher D. Manning

Zoom Q&A Session 2A: Machine Learning for NLP

17:00 UTC/GMT

Long Papers

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan

Zoom Q&A Session 9A: Speech and Multimodality

00:00 UTC/GMT

Link to Paper 

An Empirical Study of Generation Order for Machine Translation

William Chan, Mitchell Stern, Jamie Kiros, Jakob Uszkoreit

Zoom Q&A Session 10C: Machine Translation and Multilinguality

01:00 UTC/GMT

Link to Paper

Asking without Telling: Exploring Latent Ontologies in Contextual Representations

Julian Michael*, Jan A. Botha, Ian Tenney

Gather Session 4I: Interpretability and Analysis of Models for NLP; Syntax: Tagging, Chunking, and Parsing

02:00 UTC/GMT

Link to Paper

Interpreting Open-Domain Modifiers: Decomposition of Wikipedia Categories into Disambiguated Property-Value Pairs

Marius Pasca

Gather Session 4G: NLP Applications; Semantics: Lexical Semantics

02:00 UTC/GMT

Link to Paper 

Template Guided Text Generation for Task-Oriented Dialogue

Mihir Kale, Abhinav Rastogi

Gather Session 4H: Discourse and Pragmatics; Language Generation

02:00 UTC/GMT

Link to Paper

LAReQA: Language-agnostic answer retrieval from a multilingual pool

Uma Roy, Noah Constant, Rami Al-Rfou, Aditya Barua, Aaron Phillips, Yinfei Yang

Gather Session 4A: Machine Translation and Multilinguality

02:00 UTC/GMT

Link to Paper

Type B Reflexivization as an Unambiguous Testbed for Multilingual Multi-Task Gender Bias

Ana Valeria González, Maria Barrett, Rasmus Hvingelby, Kellie Webster, Anders Søgaard

Gather Session 2F: Discourse and Pragmatics; Machine Translation and Multilinguality

10:00 UTC/GMT

Link to Paper

Are All Good Word Vector Spaces Isomorphic?

Ivan Vulić, Sebastian Ruder, Anders Søgaard

Gather Session 2L: Interpretability and Analysis of Models for NLP; Semantics: Sentence-level Semantics, Textual Inference and Other areas

10:00 UTC/GMT

Link to Paper

Surprisal Predicts Code-Switching in Chinese-English Bilingual Text

Jesús Calvillo, Le Fang, Jeremy Cole, David Reitter

Zoom Q&A Session 7B: Linguistic Theories, Cognitive Modeling and Psycholinguistics

16:00 UTC/GMT

Link to Paper 

Stepwise Extractive Summarization and Planning with Structured Transformers

Shashi Narayan, Joshua Maynez, Jakub Adamek, Daniele Pighin, Blaz Bratanic, Ryan McDonald

Zoom Q&A Session 7D: Summarization

16:00 UTC/GMT

Link to Paper

Human-centric dialog training via offline reinforcement learning

Natasha Jaques, Judy Hanwen Shen, Asma Ghandeharioun, Agata Lapedriza, Noah Jones, Shixiang Gu, Rosalind Picard

Zoom Q&A Session 7A: Dialog and Interactive Systems

16:00 UTC/GMT

Link to Paper

Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding

Alexander Ku, Peter Anderson, Roma Patel, Eugene Ie, Jason Baldridge

Zoom Q&A Session 8D: Language Grounding to Vision, Robotics and Beyond

17:00 UTC/GMT

Link to Paper

Learning Explainable Linguistic Expressions with Neural Inductive Logic Programming for Sentence Classification

Prithviraj Sen, Marina Danilevsky, Yunyao Li, Siddhartha Brahma, Matthias Boehm, Laura Chiticariu, Rajasekar Krishnamurthy

Zoom Q&A Session 8B: Interpretability and Analysis of Models for NLP

17:00 UTC/GMT

Link to Paper 

Entities as Experts: Sparse Memory Access with Entity Supervision

Thibault Févry, Livio Baldini Soares, Nicholas FitzGerald, Eunsol Choi, Tom Kwiatkowski

Gather Session 3C: Machine Learning for NLP

18:00 UTC/GMT

Link to Paper

Seq2Edits: Sequence Transduction Using Span-level Edit Operations

Felix Stahlberg, Shankar Kumar Gather

Session 3D: Computational Social Science and Social Media; Language Generation

18:00 UTC/GMT

Link to Paper

Text Segmentation by Cross Segment Attention

Michal Lukasik, Boris Dadachev, Kishore Papineni, Goncalo Simoes

Gather Session 3B: NLP Applications

18:00 UTC/GMT

Link to Paper

Short Papers

Inference Strategies for Machine Translation with Conditional Masking

Julia Kreutzer, George Foster, Colin Cherry

Zoom Q&A Session 10A: Phonology, Morphology and Word Segmentation

01:00 UTC/GMT

Link to Paper

Supervised Seeded Iterated Learning for Interactive Language Learning

Yuchen Lu, Soumye Singhal, Florian Strub, Olivier Pietquin, Aaron Courville

Zoom Q&A Session 7A: Dialog and Interactive Systems

16:00 UTC/GMT

Link to Paper

How Much Knowledge Can You Pack Into the Parameters of a Language Model?

Adam Roberts, Colin Raffel, Noam Shazeer

Gather Session 3G: Question Answering; Syntax: Tagging, Chunking, and Parsing

18:00 UTC/GMT

Link to Paper

CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation

Tianlu Wang*, Xuezhi Wang, Yao Qin, Ben Packer, Kang Li, Jilin Chen, Alex Beutel, Ed Chi

Gather Session 3D: Computational Social Science and Social Media; Language Generation

18:00 UTC/GMT

Link to Paper

Semantic label smoothing for sequence to sequence problems

Michal Lukasik, Himanshu Jain, Aditya Menon, Seungyeon Kim, Srinadh Bhojanapalli, Felix Yu, Sanjiv Kumar

Gather Session 3C: Machine Learning for NLP

18:00 UTC/GMT

Link to Paper

Improving Multilingual Models with Language-Clustered Vocabularies

Hyung Won Chung, Dan Garrette, Kiat Chuan Tan, Jason Riesa

Gather Session 3A: Machine Translation and Multilinguality

18:00 UTC/GMT

Link to Paper

Long Papers

"I’d rather just go to bed": Understanding Indirect Answers

Annie Louis, Dan Roth, Filip Radlinski

Zoom Q&A Session 13A: Discourse and Pragmatics

16:00 UTC/GMT

Link to Paper

Entity Linking in 100 Languages

Jan A. Botha, Zifei Shan, Daniel Gillick

Zoom Q&A Session 14D: Information Extraction

17:00 UTC/GMT

Link to Paper 

TeaForN: Teacher-Forcing with N-grams

Sebastian Goodman, Nan Ding, Radu Soricut

Gather Session 5G: Language Generation; Semantics: Lexical Semantics

18:00 UTC/GMT

Link to Paper

Collecting Entailment Data for Pretraining: New Protocols and Negative Results

Samuel R. Bowman*, Jennimaria Palomaki, Livio Baldini Soares, Emily Pitler

Gather Session 5B: Semantics: Sentence-level Semantics, Textual Inference and Other areas

18:00 UTC/GMT

Link to Paper

CapWAP: Captioning with a Purpose

Adam Fisch*, Kenton Lee, Ming-Wei Chang, Jonathan Clark, Regina Barzilay

Gather Session 5F: Language Grounding to Vision, Robotics and Beyond; Speech and Multimodality

18:00 UTC/GMT

Link to Paper

TESA: A Task in Entity Semantic Aggregation for Abstractive Summarization

Clément Jumel, Annie Louis, Jackie Chi Kit Cheung

Gather Session 5I: Information Retrieval and Text Mining; Summarization

18:00 UTC/GMT

Link to Paper 

Short Papers 

Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube

Jack Hessel, Zhenhai Zhu, Bo Pang, Radu Soricut

Gather Session 5F: Language Grounding to Vision, Robotics and Beyond; Speech and Multimodality

18:00 UTC/GMT

Link to Paper

Unsupervised Text Style Transfer with Padded Masked Language Models

Eric Malmi, Aliaksei Severyn, Sascha Rothe

Gather Session 5G: Language Generation; Semantics: Lexical Semantics

18:00 UTC/GMT

Link to Paper

Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations

Wanrong Zhu, Xin Wang, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang

Gather Session 5F: Language Grounding to Vision, Robotics and Beyond; Speech and Multimodality

18:00 UTC/GMT

Link to Paper

Understanding tables with intermediate pre-training

Julian Eisenschlos, Syrine Krichene, Thomas Müller

Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior

Zi Lin, Jeremiah Liu, Zi Yang, Nan Hua, Dan Roth

Controlled Hallucinations: Learning to Generate Faithfully from Noisy Data

Katja Filippova

AirConcierge: Generating Task-Oriented Dialogue via Efficient Large-Scale Knowledge Retrieval

Chieh-Yang Chen, Pei-Hsin Wang, Shih-Chieh Chang, Da-Cheng Juan, Wei Wei, Jia-Yu Pan

FELIX: Flexible Text Editing Through Tagging and Insertion

Jonathan Mallinson, Aliaksei Severyn, Eric Malmi, Guillermo Garrido

Semantically Driven Sentence Fusion: Modeling and Evaluation

Eyal Ben-David, Orgad Keller, Eric Malmi, Idan Szpektor, Roi Reichart

Will it Unblend?

Yuval Pinter, Cassandra L. Jacobs, Jacob Eisenstein

Automatically Identifying Gender Issues in Machine Translation using Perturbations

Hila Gonen, Kellie Webster

Participatory Research for Low-resourced Machine Translation: A Case Study in African Languages

∀, Wilhelmina Nekoto, Vukosi Marivate, Tshinondiwa Matsila, Timi Fasubaa, Taiwo Fagbohungbe, Solomon Oluwole Akinola, Shamsuddeen Muhammad, Salomon KABONGO KABENAMUALU, Salomey Osei, Freshia Sackey, Rubungo Andre Niyongabo, Ricky Macharm, Perez Ogayo, Orevaoghene Ahia, Musie Meressa Berhe, Mofetoluwa Adeyemi, Masabata Mokgesi-Selinga, Lawrence Okegbemi, Laura Martinus, Kolawole Tajudeen , Kevin Degila, Kelechi Ogueji, Kathleen Siminyu, Julia Kreutzer, Jason Webster, Jamiil Toure Ali, Jade Abbott , Iroro Orife, Ignatius Ezeani, Idris Abdulkadir Dangana, Herman Kamper, Hady Elsahar, Goodness Duru, ghollah kioko, Murhabazi Espoir, Elan van Biljon, Daniel Whitenack, Christopher Onyefuluchi, Chris Chinenye Emezue , Bonaventure F. P. Dossou, Blessing Sibanda, Blessing Bassey, Ayodele Olabiyi, Arshath Ramkilowan, Alp Öktem, Adewale Akinfaderin, Abdallah Bashir

Zero-shot Entity Linking with Efficient Long Range Sequence Modeling

Zonghai Yao, Liangliang Cao, Huapu Pan

DiPair: Fast and Accurate Distillation for Trillion-ScaleText Matching and Pair Modeling

Jiecao Chen, Liu Yang, Karthik Raman, Michael Bendersky, Jung-Jung Yeh, Yun Zhou, Marc Najork, Danyang Cai, Ehsan Emadzadeh

CLAR: A Cross-Lingual Argument Regularizer for Semantic Role Labeling

Ishan Jindal, Yunyao Li, Siddhartha Brahma, Huaiyu Zhu

A Multilingual View of Unsupervised Machine Translation

Xavier Garcia, Pierre Foret, Thibault Sellam, Ankur Parikh

KoBE: Knowledge-Based Machine Translation Evaluation

Zorik Gekhman, Roee Aharoni, Genady Beryozkin, Markus Freitag, Wolfgang Macherey

SupMMD: A Sentence Importance Model for Extractive Summarisation using Maximum Mean Discrepancy

Umanga Bista, Alexander Mathews, Aditya Menon, Lexing Xie

Multichannel Generative Language Model: Learning All Possible Factorizations Within and Across Channels

Harris Chan, Jamie Kiros, William Chan

Probabilistic Case-based Reasoning in Knowledge Bases

Rajarshi Das, Ameya Godbole, Nicholas Monath, Manzil Zaheer, Andrew McCallum

Do Language Embeddings capture Scales?

Xikun Zhang*, Deepak Ramachandran, Ian Tenney, Yanai Elazar, Dan Roth Link to Paper