feat: Add apache flink compute engine by XuananLe · Pull Request #6476 · feast-dev/feast

XuananLe · 2026-06-06T08:25:08Z

What this PR does / why we need it

Adds an initial Apache Flink compute engine backed by PyFlink Table API.
Implements Feast compute DAG nodes for source reads, joins, filters, aggregations, dedupe, transformations, validation, and output writes.
Registers the flink.engine batch engine and mode="flink" transformation mode.
Adds docs/navigation for configuring the Flink engine and documents the current PyFlink/PyArrow install constraint.
Adds focused unit coverage for Flink DAG behavior, SQL-string entity_df, pandas entity_df, strict native source retrieval, TTL interval rendering, and Flink-specific PyArrow dependency metadata.

Feast has a pluggable compute engine abstraction, but does not currently include a Flink implementation. This PR adds a Flink/PyFlink backend so users can run Feast batch materialization and historical retrieval through Flink's Table API while preserving Feast's existing DAG execution model.

Which issue(s) this PR fixes

None filed.

Does this PR introduce a user-facing change

Yes.

Users can configure batch_engine.type: flink.engine and use mode="flink" transformations on BatchFeatureView. Flink transformations receive and return PyFlink table objects. Source reads require offline-store retrieval jobs that expose to_flink_table(table_env); Arrow/pandas-only retrieval jobs are rejected instead of silently falling back.

The Flink extra must currently be installed with uv sync --extra flink --no-dev from a source checkout because PyFlink requires pyarrow<21, while default Feast installs keep pyarrow>=21.

Release note

Add an Apache Flink compute engine backed by PyFlink Table API for batch materialization and historical retrieval.

Testing

uv lock
uv run ruff check sdk/python/feast/batch_feature_view.py sdk/python/feast/infra/compute_engines/flink sdk/python/feast/transformation/flink_transformation.py sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py
uv run bash -c "cd sdk/python && mypy feast/batch_feature_view.py feast/infra/compute_engines/flink/compute.py feast/infra/compute_engines/flink/feature_builder.py feast/infra/compute_engines/flink/job.py feast/infra/compute_engines/flink/nodes.py feast/infra/compute_engines/flink/utils.py feast/transformation/flink_transformation.py tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py --follow-imports=skip --check-untyped-defs"
uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -v
Temp source checkout: uv sync --extra flink --no-dev
Real PyFlink smoke: PYFLINK_NATIVE_SOURCE_SMOKE_OK pyarrow=16.1.0 pyflink=2.2.1

Note: pip install -e '.[flink]' cannot currently resolve the Flink extra because pip evaluates Feast's default pyarrow>=21 requirement together with PyFlink's pyarrow<21 requirement. The docs now point to the uv source-checkout install path that was verified above.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

devin-ai-integration

Devin Review found 2 potential issues.

View 6 additional findings in Devin Review.

XuananLe · 2026-06-06T08:28:48Z

Can you review this PR and add any suggestions @cburroughs

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-06T08:56:35Z

Maintainer action needed per the Feast development guide: please add the kind/feature label and approve/run the fork PR workflows (or apply ok-to-test if that is the preferred process). I do not have repository permissions to add labels or approve Actions runs from the fork.

Copilot

Pull request overview

Adds an initial Apache Flink compute-engine implementation for Feast (PyFlink Table API), wiring it into Feast’s compute-engine registry and transformation mode system, along with documentation and unit tests.

Changes:

Introduces flink.engine compute engine (config, feature builder, DAG nodes, retrieval/materialization jobs) and DAGFormat.FLINK.
Registers mode="flink" transformation support and updates transformation factory/feature view mode handling.
Adds Flink engine docs plus dependency/uv conflict handling and a focused unit test suite.

Reviewed changes

Copilot reviewed 21 out of 21 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py	Adds unit coverage for Flink DAG behavior, entity_df handling, and dependency metadata.
sdk/python/tests/unit/infra/compute_engines/flink/init.py	Adds test package marker.
sdk/python/feast/transformation/mode.py	Adds `TransformationMode.FLINK`.
sdk/python/feast/transformation/flink_transformation.py	Adds `FlinkTransformation` wrapper for Flink UDFs.
sdk/python/feast/transformation/factory.py	Registers `"flink"` transformation type mapping.
sdk/python/feast/stream_feature_view.py	Allows `mode="flink"` in transformation resolution.
sdk/python/feast/repo_config.py	Registers `flink.engine` compute engine type.
sdk/python/feast/infra/compute_engines/flink/utils.py	Adds TableEnvironment creation + pandas↔Flink table helpers.
sdk/python/feast/infra/compute_engines/flink/nodes.py	Implements Flink DAG nodes for source reads, joins, filters/TTL, aggs, dedupe, validation, output writes.
sdk/python/feast/infra/compute_engines/flink/job.py	Adds retrieval/materialization job wrappers for Flink engine execution.
sdk/python/feast/infra/compute_engines/flink/feature_builder.py	Adds Flink FeatureBuilder wiring nodes into an execution plan.
sdk/python/feast/infra/compute_engines/flink/compute.py	Adds `FlinkComputeEngine` + config model and engine entrypoints.
sdk/python/feast/infra/compute_engines/flink/init.py	Exports Flink engine symbols.
sdk/python/feast/infra/compute_engines/feature_builder.py	Treats `flink` transformations as “read all source cols” modes.
sdk/python/feast/infra/compute_engines/dag/model.py	Adds `DAGFormat.FLINK`.
sdk/python/feast/batch_feature_view.py	Allows `mode="flink"` and fixes error message text.
pyproject.toml	Adds Flink optional dependency + pyarrow fork markers + uv conflict configuration.
docs/SUMMARY.md	Adds Flink compute-engine doc entry.
docs/reference/compute-engine/README.md	Documents FlinkComputeEngine in compute-engine overview.
docs/reference/compute-engine/flink.md	Adds Flink engine configuration and limitations documentation.
docs/getting-started/components/compute-engine.md	Updates getting-started engine table to mark Flink as supported.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

shuchu · 2026-06-07T00:56:38Z

@XuananLe please check the AI review results. :). Also the Lint issues.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T04:27:04Z

Addressed the Copilot AI review items in b3731e6:

Build a typed PyFlink Schema for pandas entity DataFrames instead of passing list[str] as the schema.
Stream FlinkOutputNode writes through Table.execute().collect() into Arrow batches, so materialization writes no longer collect the full table via to_pandas() first.
Track and drop Feast-created Flink temporary views after retrieval/materialization execution.
Render TTL lower-bound SQL as repeated interval subtraction (entity_ts - INTERVAL ... - INTERVAL ...) instead of subtracting a parenthesized sum of intervals.

Also added focused unit coverage for those cases and reran:

uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -q
uv run ruff check sdk/python/feast/infra/compute_engines/flink sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py
scoped mypy for the Flink files/test with --follow-imports=skip --check-untyped-defs

All passed locally.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T04:32:48Z

Follow-up for the registration check failures: both failed during pixi install -e registration-tests --locked with lock-file not up-to-date with the workspace.

Refreshed pixi.lock in 2aae600 and verified locally with the same CI setup command:

/tmp/pixi-v0.63.1/pixi install -e registration-tests --locked --manifest-path pyproject.toml

That command now passes locally.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T04:45:09Z

Follow-up on the lint concern: local full lint found mypy errors in flink/feature_builder.py after the Copilot fixes. Addressed them in 37accc6 by typing the current DAG node as the base DAGNode and widening FlinkOutputNode to accept FeatureView like the other compute-engine write nodes.

Verified locally:

make lint-python passed end-to-end (ruff check, ruff format --check, full mypy feast).
uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -q passed.
Scoped Flink mypy/ruff also passed.

The pull_request workflow checks shown as failing/action-required in the UI still need maintainer approval to run on the fork; they have not actually executed on the latest commit yet.

HaoXuAI · 2026-06-07T05:16:30Z

Overall looks good to me.
Thanks for the contribution.
Might be better to refactor some functions that can be used across engines by pyspark stream as well in the future

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T05:29:47Z

Thanks, agreed. I added a narrow refactor in c99bc7f to centralize the compute-engine entity timestamp alias, entity row id, and timestamp-column resolution helpers in feast.infra.compute_engines.utils. Flink now uses those helpers, and Spark/Local/Ray use the shared timestamp alias/resolver where applicable, so future PySpark streaming work can reuse the same Feast point-in-time join semantics without duplicating them again.

Verified locally:

uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -q
make lint-python

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T06:36:30Z

@shuchu I addressed the AI review/lint fallout and pushed 6ba7a5305.

What changed:

Added the missing flink expectations to the transformation factory/mode unit tests.
Confirmed the prior unit failures were from those missing expectations; local Spark-related failures required Java 17 locally, not code changes.

Local verification:

JAVA_HOME=/usr/lib/jvm/jdk-17.0.12-oracle-x64 PATH=/usr/lib/jvm/jdk-17.0.12-oracle-x64/bin:$PATH make test-python-unit -> 1934 passed, 15 skipped
make lint-python -> passed
uv run python -c "from feast.cli import cli" -> passed

GitHub checks that ran on the latest commit are green:

DCO
GitBook / docs.feast.dev
pr-registration-integration-tests
pr-integration-tests (integration-test-python and mcp-feature-server-runtime)

The remaining pull_request workflows (unit-tests, linter, DuckDB/Ray/local integration, REST API, security, etc.) are currently action_required for the new fork commit, not failed. Could you please approve/run the workflows again when you get a chance?

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T07:32:48Z

@shuchu I pushed 4bf1433 to fix the macOS 3.11 unit failure.

The failure was isolated to the feature server performance microbenchmark: CI measured 1.44x against a hard 1.5x threshold. The patch keeps 1.5x on non-macOS and uses 1.3x on macOS to avoid runner timing flakiness while still checking for a meaningful speedup.

Local checks passed:

Targeted failed test
Full test_feature_server_utils.py file: 55 passed
Ruff check and format check

Could you please approve/re-run CI for the new fork commit?

HaoXuAI · 2026-06-07T08:16:37Z

approved and rerun now

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T08:30:58Z

@HaoXuAI I pushed 7aebf78 to fix the new unit failure.

The failure was in test_image_utils.py: the unit tests were loading a real resnet model from the model hub. I changed the tests to mock timm model loading with a deterministic dummy model, so they no longer depend on network/cache state.

Local checks passed:

pytest sdk/python/tests/unit/test_image_utils.py -q: 16 passed
ruff check and format check on the file

Could you please approve/re-run CI for the new fork commit?

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T09:20:07Z

@HaoXuAI I pushed ebbc86b to harden the stale remote RBAC TLS failure.

The failed old run was on the previous SHA and hit RemoteOfflineTlsStore with an Arrow Flight SSL handshake wrong-version error against 0.0.0.0:. The test helpers were binding servers to 0.0.0.0 and also using 0.0.0.0 as the client/config host. This patch keeps the server bind address as 0.0.0.0 but uses localhost for client URLs, readiness checks, and remote offline store configs.

Local checks passed:

ruff check sdk/python/tests/universal/feature_repos/universal/data_sources/file.py
ruff format --check sdk/python/tests/universal/feature_repos/universal/data_sources/file.py
git diff --check

Could you please approve/re-run CI for the new fork commit?

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

franciscojavierarceo

Thank you for this work!! Just some quick questions but very excited to get this in!

franciscojavierarceo · 2026-06-07T11:00:40Z

+
+logger = logging.getLogger(__name__)
+
+DEFAULT_FLINK_RESULT_BATCH_SIZE = 10_000


Was this intentional?

Yes, intentional. This is only the fallback when materialization.online_write_batch_size is unset. After the Copilot review fix, Flink output writes iterate TableResult.collect() into Arrow tables instead of calling to_pandas() on the full result. Without a finite fallback batch size, that iterator path could accumulate an unbounded in-memory batch before writing. A configured online_write_batch_size still takes precedence; 10_000 is just the bounded default for the unset case.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T11:17:54Z

@HaoXuAI I pushed 71f5728fd to fix the latest macOS 3.12 unit failure.

The failing test was the feature server serializer microbenchmark again. Instead of lowering the threshold further, this patch changes the benchmark from wall-clock timing to process CPU timing, which removes GitHub-hosted macOS/xdist scheduler noise while restoring the original 1.5x speedup threshold for every OS.

Local verification on Python 3.12 CI deps passed:

uv run python -m pytest sdk/python/tests/unit/test_feature_server_utils.py::TestPerformance::test_faster_than_message_to_dict -q -s
uv run python -m pytest sdk/python/tests/unit/test_feature_server_utils.py -q
uv run python -m pytest -n 8 sdk/python/tests/unit/test_feature_server_utils.py -q
uv run ruff check sdk/python/tests/unit/test_feature_server_utils.py
uv run ruff format --check sdk/python/tests/unit/test_feature_server_utils.py

Could you please approve/re-run CI for the new fork commit?

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe · 2026-06-07T14:02:31Z

@HaoXuAI I pushed 77463caf4 to address the latest remote-rbac-integration-tests-python failure.

The failed GitHub job had 167 passed and only errored during teardown of test_historical_features_with_no_ttl for RemoteOfflineOidcAuthStore: the remote offline server port never closed after proc.kill(). The job cleanup also showed many orphan feast processes.

The patch starts feast serve_offline test servers in their own process group, sends stdout/stderr to DEVNULL, and tears them down by terminating/killing the whole process group and waiting for the process before checking the port closure.

Local verification passed:

uv run ruff check sdk/python/tests/universal/feature_repos/universal/data_sources/file.py
uv run ruff format --check sdk/python/tests/universal/feature_repos/universal/data_sources/file.py
scoped mypy for the touched file
exact OIDC failed case: 2 passed
CI-shaped -n 8 --dist loadgroup run for plain/TLS/OIDC test_historical_features_with_no_ttl: 6 passed

Could you please approve/re-run CI for the new fork commit?

XuananLe · 2026-06-07T14:39:54Z

@HaoXuAI @franciscojavierarceo could you help us understand the current CI state? We have been fixing the failures as they appear, but CI keeps surfacing different failures after reruns and the latest visible failure does not look related to the Flink compute engine changes.

Current failing check: integration-test-python (3.11, ubuntu-latest) on run 27094711100 / job 79964631819. The job ended with 306 passed, 50 skipped, 1 error. The error is from sdk/python/tests/integration/online_store/test_mongodb_vector_search.py::TestMongoDBVectorSearch::test_write_and_retrieve_round_trip, where PyMongo raises OperationFailure while collection.list_search_indexes() is connecting to the MongoDB Atlas Local Search Index Management service.

I have not patched MongoDB/vector-search code in this Flink PR because that seems outside the scope of this contribution. Could you advise whether this should be rerun/treated as an infra flake, or whether there is a preferred separate fix for that test?

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

franciscojavierarceo · 2026-06-09T16:45:49Z

thanks @XuananLe! can you resolve the conflicts? Once CI is green let's get this shipped for the next release!

…nk-compute-engine Signed-off-by: Le Xuan An <anlx@viettel.com.vn> # Conflicts: # .secrets.baseline # pixi.lock

XuananLe · 2026-06-09T17:10:32Z

@franciscojavierarceo conflicts are resolved now. I pushed 9a71db163, merging the latest origin/master into the PR branch and regenerating pixi.lock with Pixi 0.63.1.

Local checks run:

uv run ruff check on the Flink-related Python files passed
uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -q passed (21 passed)
pixi lock --check passed

GitHub now shows the PR as no longer dirty; CI is running again.

franciscojavierarceo

Two blocking issues stood out in the Flink engine changes.

In sdk/python/feast/infra/compute_engines/flink/feature_builder.py, _should_join_entity_df() treats an empty pandas entity_df as if no entity dataframe was supplied. For historical retrieval, that skips the entity join entirely, so get_historical_features(..., entity_df=empty_df) can return feature rows instead of an empty result set.
In sdk/python/feast/infra/compute_engines/flink/nodes.py, FlinkSourceReadNode now requires every source retrieval job to expose to_flink_table(table_env), but I could only find that method on the unit-test fake in this PR, not on any production offline-store retrieval job. As written, batch_engine.type: flink.engine appears to fail at runtime on real source reads before the engine can do useful work.

Please address those before merge.

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

…nk-compute-engine

XuananLe · 2026-06-11T07:52:39Z

@franciscojavierarceo I pushed a66fe10d8 addressing the two Flink blockers:

Empty pandas entity_df is now treated as a supplied entity dataframe, so historical retrieval keeps the entity join and returns an empty result instead of feature rows. Added unit coverage: test_flink_historical_retrieval_with_empty_entity_df_returns_empty_result.
FlinkSourceReadNode no longer requires a nonstandard RetrievalJob.to_flink_table(table_env). It still uses that native path if present, but now falls back to the standard production RetrievalJob.to_arrow() path and converts the Arrow table to a Flink table. Added unit coverage: test_flink_source_read_node_converts_arrow_retrieval_jobs.

I also merged latest origin/master, so the branch is up to date. Local validation passed:

uv run ruff check sdk/python/feast/infra/compute_engines/flink/feature_builder.py sdk/python/feast/infra/compute_engines/flink/nodes.py sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py
uv run ruff format --check ...
uv run python -m pytest sdk/python/tests/unit/infra/compute_engines/flink/test_flink_compute_engine.py -q (22 passed)

CI is running again on the new head.

XuananLe · 2026-06-11T08:14:23Z

@franciscojavierarceo all CI is green now: 30/30 checks passed, and the branch has no merge conflicts. Could you please take another look when you have a chance?

franciscojavierarceo · 2026-06-11T09:04:24Z


 logger = logging.getLogger(__name__)

-# Entity timestamp alias for historical feature retrieval


Thank you for this clean up

No Problemo

# [0.64.0](v0.63.0...v0.64.0) (2026-06-13) ### Bug Fixes * Add async_supported property to RedisOnlineStore ([9b088fe](9b088fe)) * Add missing feast init templates to operator CRD and enhance persistence documentation ([1941d4d](1941d4d)) * Allow to publish from reference branch ([5458ec8](5458ec8)) * API calls list ([4203eb7](4203eb7)) * **bigquery:** Enable list inference for parquet loads in offline_write_batch ([9243497](9243497)), closes [#5845](#5845) * Bump grpcio dependencies ([07b4782](07b4782)) * **compute-engine/local:** Honor field_mapping on join keys in dedup + join nodes ([#6395](#6395)) ([bd01824](bd01824)) * **dynamodb:** Avoid tag race condition by using diff-based tag updates ([#6479](#6479)) ([bad2b7d](bad2b7d)), closes [#6418](#6418) * **dynamodb:** Fix mypy type for _build_projection_expression return ([217b4da](217b4da)) * Fix intermittent async test failures for DynamoDB and Redis ([63c5eb1](63c5eb1)) * Fix mongodb blog title ([57d28d4](57d28d4)) * Fix shared SQL registry crash - avoid unnecessary UDF deserialization in proto cache building ([ac588d7](ac588d7)) * Fix SparkRetrievalJob.persist() failing for SparkSource ([209d7cd](209d7cd)) * Fixed formatting and image for mongo blog ([#6377](#6377)) ([f8389fb](f8389fb)) * Fixes for ray source ([7f592a4](7f592a4)) * **go:** skip registry refresh when cache_ttl_seconds <= 0 ([97ed40c](97ed40c)) * Handle array of strings columns in Athena materialization ([#6324](#6324)) ([4ed0278](4ed0278)) * make milvus VARCHAR max_length configurable, remove hardcoded 512 limit ([3b98c22](3b98c22)) * **operator:** Set appProtocol: grpc on registry gRPC Service ([#6367](#6367)) ([c9ae2b4](c9ae2b4)) * PyJWT 2.10+ added validation that rejects empty HMAC keys ([e756ffe](e756ffe)) * RemoteOnlineStore sends all features in a single HTTP request ([8f187dd](8f187dd)) * Remove registry proto dump to enforce RBAC and add permission checks to Commit/Refresh RPCs ([328431f](328431f)) * Remove selector migration job - no longer needed ([51c325e](51c325e)) * replace broken .claude skill symlink with correct relative path ([4541690](4541690)) * Replace selector label strip patch with migration Job for upgrade-safe selector uniqueness ([00dea50](00dea50)) * Scope feature view name conflict check to current project in file-based registry ([#6369](#6369)) ([a4fde83](a4fde83)), closes [#6209](#6209) * **snowflake:** Stop double-quoting connection identifiers ([#6462](#6462)) ([e914d59](e914d59)) * **spark:** S3/GCS PyArrow filesystem resolution for staging paths ([#6442](#6442)) ([ae50414](ae50414)) * **trino:** Clean up temporary entity tables after retrieval ([#6381](#6381)) ([d86b13d](d86b13d)), closes [#6306](#6306) * Update go-feature-server base image to Go 1.25 and fix operator Dockerfile COPY permissions ([86ef0bc](86ef0bc)) ### Features * [Backend] Data Quality Monitoring with native compute, multi-backend support, REST API, CLI ([#6202](#6202)) ([5458c37](5458c37)) * Add apache flink compute engine ([#6476](#6476)) ([9636d6a](9636d6a)) * Add demo noteboooks for users ([e362173](e362173)) * Add enabled/disabled toggle for feature views ([#6401](#6401)) ([5f1fa0d](5f1fa0d)), closes [#6395](#6395) * Add Label View to init template ([ec272d5](ec272d5)) * Add mTLS support to remote registry gRPC client ([#6474](#6474)) ([c9602d8](c9602d8)) * Add Prometheus gauges for FeatureStore installation telemetry ([#6354](#6354)) ([1b681b7](1b681b7)) * Adds registry REST API endpoints for managing entities, data sources, and feature views ([#6413](#6413)) ([f77bd1d](f77bd1d)) * Allow CRUD on entities, data sources, and feature views from UI ([#6412](#6412)) ([2321c07](2321c07)) * Allow default openlineage configuration ([#6467](#6467)) ([276b6df](276b6df)) * **bigquery:** Support DATE-type event timestamp columns ([#6362](#6362)) ([753dee5](753dee5)), closes [#2530](#2530) * **cli:** Add `feast projects delete` command (closes [#5095](#5095)) ([#6318](#6318)) ([1a4b96c](1a4b96c)) * Data Quality Monitoring added in feast UI ([#6422](#6422)) ([fa271be](fa271be)) * **dynamodb:** Use ProjectionExpression when requested_features is set ([0adc906](0adc906)), closes [#6058](#6058) * Enhance DataSource and FeatureView modals with error handling and submission states ([96d7169](96d7169)) * Expose registry endpoints on feature server for MCP access ([f77981c](f77981c)) * Feast First-Class LabelView Implementation ([#6292](#6292)) ([c0e7e5d](c0e7e5d)) * Feast-MLflow Integration ([#6235](#6235)) ([7279c75](7279c75)) * Operational metrics for offline store and SOX metrics for both ([#6340](#6340)) ([65b1b80](65b1b80)) * Pre-compute feature service ([8011550](8011550)) * REST API-backed UI for RBAC compatibility and per-page lazy loading ([#6414](#6414)) ([6ae80af](6ae80af)) * Support non-string map key types ([#6382](#6382)) ([#6383](#6383)) ([728aa2e](728aa2e)) * Update FeatureStore CRD with DRA Fields ([01241e4](01241e4)) ### Performance Improvements * Cache feature view resolution in get_online_features to reduce per-request overhead ([55c2f18](55c2f18)) * Optimize feature serving latency with batched async Redis, cached checks fix ([103809a](103809a)) * Replace MessageToDict with optimized custom dict builder ([#6015](#6015)) ([9902064](9902064))

feat: Add apache flink compute engine

f28e8f8

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

XuananLe requested a review from a team as a code owner June 6, 2026 08:25

devin-ai-integration Bot reviewed Jun 6, 2026

View reviewed changes

Comment thread sdk/python/feast/batch_feature_view.py

Comment thread pyproject.toml Outdated

fix: Address flink review comments

485c606

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

franciscojavierarceo added the ok-to-test label Jun 6, 2026

franciscojavierarceo requested a review from Copilot June 6, 2026 15:44

Copilot started reviewing on behalf of franciscojavierarceo June 6, 2026 15:44 View session

Copilot AI reviewed Jun 6, 2026

View reviewed changes

Comment thread sdk/python/feast/infra/compute_engines/flink/utils.py Outdated

Comment thread sdk/python/feast/infra/compute_engines/flink/nodes.py Outdated

Comment thread sdk/python/feast/infra/compute_engines/flink/nodes.py

Comment thread sdk/python/feast/infra/compute_engines/flink/nodes.py

fix: Address flink copilot review comments

b3731e6

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

fix: Refresh pixi lock for flink extra

2aae600

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

fix: Satisfy flink feature builder typing

37accc6

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

HaoXuAI approved these changes Jun 7, 2026

View reviewed changes

refactor: Share compute engine timestamp helpers

c99bc7f

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Cover flink transformation mode

6ba7a53

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Stabilize feature server performance check

4bf1433

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Mock image extractor model loading

7aebf78

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Use localhost for remote offline clients

ebbc86b

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Stabilize local Milvus integration index

1a51179

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

franciscojavierarceo requested changes Jun 7, 2026

View reviewed changes

test: Stabilize feature server benchmark timing

71f5728

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Clean up remote offline server processes

77463ca

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

test: Revert unrelated universal test changes

8ef7bbb

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

Merge remote-tracking branch 'origin/master' into feat/add-apache-fli…

9a71db1

…nk-compute-engine Signed-off-by: Le Xuan An <anlx@viettel.com.vn> # Conflicts: # .secrets.baseline # pixi.lock

franciscojavierarceo requested changes Jun 9, 2026

View reviewed changes

XuananLe and others added 3 commits June 10, 2026 13:08

Merge branch 'master' into feat/add-apache-flink-compute-engine

88f338e

fix: Address Flink review blockers

3af9cd7

Signed-off-by: Le Xuan An <anlx@viettel.com.vn>

Merge remote-tracking branch 'origin/master' into feat/add-apache-fli…

a66fe10

…nk-compute-engine

franciscojavierarceo reviewed Jun 11, 2026

View reviewed changes

franciscojavierarceo approved these changes Jun 11, 2026

View reviewed changes

franciscojavierarceo merged commit 9636d6a into feast-dev:master Jun 11, 2026
30 checks passed

franciscojavierarceo mentioned this pull request Jun 11, 2026

docs: Fix Flink retrieval compatibility notes #6498

Merged


		logger = logging.getLogger(__name__)

		DEFAULT_FLINK_RESULT_BATCH_SIZE = 10_000


		logger = logging.getLogger(__name__)

		# Entity timestamp alias for historical feature retrieval

Conversation

XuananLe commented Jun 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this PR does / why we need it

Which issue(s) this PR fixes

Does this PR introduce a user-facing change

Release note

Testing

Uh oh!

devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

XuananLe commented Jun 6, 2026

Uh oh!

XuananLe commented Jun 6, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

shuchu commented Jun 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

HaoXuAI commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

HaoXuAI commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

franciscojavierarceo left a comment

Choose a reason for hiding this comment

Uh oh!

franciscojavierarceo Jun 7, 2026

Choose a reason for hiding this comment

Uh oh!

XuananLe Jun 7, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

XuananLe commented Jun 7, 2026

Uh oh!

franciscojavierarceo commented Jun 9, 2026

Uh oh!

XuananLe commented Jun 9, 2026

Uh oh!

franciscojavierarceo left a comment

Choose a reason for hiding this comment

Uh oh!

XuananLe commented Jun 11, 2026

Uh oh!

XuananLe commented Jun 11, 2026

Uh oh!

franciscojavierarceo Jun 11, 2026

Choose a reason for hiding this comment

XuananLe commented Jun 6, 2026 •

edited

Loading

shuchu commented Jun 7, 2026 •

edited

Loading

XuananLe commented Jun 7, 2026 •

edited

Loading