Skip to content

google-research.md

Latest commit

 

History

History
29 lines (21 loc) · 1.4 KB

google-research.md

File metadata and controls

29 lines (21 loc) · 1.4 KB
Raw
sources
summaries/attention-is-all-you-need.md
type Organization
description Google Research is the research division of Google involved in the Transformer paper.

Overview

[[entities/google-research|Google Research]] is a research organization at Google that co-authored [[summaries/attention-is-all-you-need]] and contributed to the development of the [[concepts/transformer-models|Transformer]] architecture.

In this document

In this paper, Google Research authors include Niki Parmar and Jakob Uszkoreit. The document presents the Transformer, an attention-only sequence transduction model that removes recurrence and convolutions in favor of [[concepts/attention-mechanisms|attention mechanisms]].

Key facts from the paper

  • Google Research authors helped design and evaluate the Transformer.
  • The paper reports state-of-the-art translation results on [[entities/wmt-2014|WMT 2014]] tasks, including [[entities/wmt-2014-english-german|English-German]] and [[entities/wmt-2014-english-french|English-French]].
  • The work was presented at [[entities/nips-2017|NIPS 2017]].
  • The paper also references the Tensor2Tensor codebase, associated with [[entities/tensor2tensor|tensor2tensor]].

Related pages

  • [[summaries/attention-is-all-you-need]]
  • [[concepts/transformer-models]]
  • [[concepts/attention-mechanisms]]
  • [[entities/google]]
  • [[entities/google-brain]]
  • [[entities/tensor2tensor]]