Gemini is available to consumers in Bard or Pixel 8 Pro now, with an enterprise model coming Dec. 13.

  • UFO
    link
    fedilink
    English
    51 year ago

    Is this a transformer model? Any details?

      • UFO
        link
        fedilink
        English
        31 year ago

        Thanks! Here’s the high level description from there:

        “Gemini models build on top of Transformer decoders (Vaswani et al., 2017) that are enhanced with improvements in architecture and model optimization to enable stable training at scale and optimized inference on Google’s Tensor Processing Units. They are trained to support 32k context length”