This serves as a guide on how to deploy Feast on GCP. At the end of this guide, we will have provisioned:
- GKE cluster
- Feast services running on GKE
- Google Memorystore (Redis) as online store
- Dataproc cluster
- Kafka running on GKE, exposed to the dataproc cluster via internal load balancer.
- Create a tfvars file, e.g.
my.tfvars. A sample configuration is as below:
gcp_project_name = "kf-feast"
name_prefix = "feast-0-8"
region = "asia-east1"
gke_machine_type = "n1-standard-2"
network = "default"
subnetwork = "default"
dataproc_staging_bucket = "kf-feast-dataproc-staging-test"
- Configure tf state backend, e.g.:
terraform {
backend "gcs" {
bucket = "<your bucket name>"
prefix = "terraform/feast"
}
}
- Use
terraform apply -var-file="my.tfvars"to deploy.