Skip to content
This repository was archived by the owner on May 5, 2025. It is now read-only.

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

T5 deployment with Beam

T5 can be run on the cloud with a single command, using Beam.

  1. Create an account on Beam. It's free and you don't need a credit card.

  2. Install the Beam CLI:

curl https://raw.githubusercontent.com/slai-labs/get-beam/main/get-beam.sh -sSfL | sh
  1. Clone this example to your computer:
beam create-app t5
  1. Deploy and run inference:
beam deploy app.py

This example is called through a task queue. Task queues are used for deploying functions that run asynchronously on Beam. Here, the task queue takes a prompt as one of its input fields. An example prompt and the real response from the model are given below.

Example prompt:

"Translate from English to German: I like to write code"

Example response:

Ich mag Code schreiben