Skip to content

docs: Add blog posts for BatchFeatureView and Spark on Kubernetes#6444

Draft
abhijeet-dhumal wants to merge 3 commits into
feast-dev:masterfrom
abhijeet-dhumal:docs/spark-embedding-pipeline-blog
Draft

docs: Add blog posts for BatchFeatureView and Spark on Kubernetes#6444
abhijeet-dhumal wants to merge 3 commits into
feast-dev:masterfrom
abhijeet-dhumal:docs/spark-embedding-pipeline-blog

Conversation

@abhijeet-dhumal
Copy link
Copy Markdown
Contributor

Summary

Adds two blog posts documenting features enabled by #6310, #6311, and #6317.

Blog 1: From Local to Production: BatchFeatureView + Spark on Kubernetes

  • Part 1: query+path SparkSource pattern — features compute once at materialize time, training reads pre-computed parquet (no UDF re-execution per experiment). Covers TransformationMode.PYTHON and offline-only BFVs for training labels.
  • Part 2: Ordered checklist of what breaks deploying Feast + Spark to Kubernetes — FIPS/Java setup, S3A JARs, Spark 3.5 Window compatibility, MinIO PyArrow endpoint fix, executor OOMKill prevention. Includes full production feature_store.yaml.

Blog 2: GPU-Accelerated Embedding Pipelines with Feast, Spark & Milvus
End-to-end guide for RAG on existing Spark GPU infrastructure — pandas_udf embedding BFV, Milvus online store, baked executor image, incremental materialization, and retrieve_online_documents_v2() serving.

…eatureView

Signed-off-by: abhijeet-dhumal <abhijeetdhumal652@gmail.com>
…as the running example

Signed-off-by: abhijeet-dhumal <abhijeetdhumal652@gmail.com>
Signed-off-by: abhijeet-dhumal <abhijeetdhumal652@gmail.com>
@abhijeet-dhumal abhijeet-dhumal force-pushed the docs/spark-embedding-pipeline-blog branch from 2379505 to aeb87c2 Compare May 28, 2026 07:59
@abhijeet-dhumal abhijeet-dhumal changed the title docs: add two blog posts covering BatchFeatureView + Spark on Kubernetes docs: add blog posts for BatchFeatureView and Spark on Kubernetes May 28, 2026
@abhijeet-dhumal abhijeet-dhumal changed the title docs: add blog posts for BatchFeatureView and Spark on Kubernetes docs: add blog posts for batch feature views and Spark on Kubernetes May 28, 2026
@abhijeet-dhumal abhijeet-dhumal changed the title docs: add blog posts for batch feature views and Spark on Kubernetes docs: Add blog posts for BatchFeatureView and Spark on Kubernetes May 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant