Skip to content
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
4abfcaa
Add native Iceberg storage support using PyIceberg and DuckDB
tommy-ca Jan 13, 2026
0093113
feat(offline-store): Complete Iceberg offline store Phase 2 implement…
tommy-ca Jan 14, 2026
b9659ad
feat(online-store): Complete Iceberg online store Phase 3 implementation
tommy-ca Jan 14, 2026
7042b0d
docs: Complete Iceberg documentation Phase 4
tommy-ca Jan 14, 2026
8ce4bd8
fix: Phase 5.1 - Fix offline/online store bugs from code audit
tommy-ca Jan 14, 2026
d54624a
feat: Phase 5.2-5.4 - Complete Iceberg integration tests, examples, a…
tommy-ca Jan 14, 2026
2c35063
docs: Update plan.md with Phase 5 completion and Phase 6 roadmap
tommy-ca Jan 14, 2026
d804d79
docs: Update design specs with final statistics and create implementa…
tommy-ca Jan 14, 2026
80b6ab3
docs: Complete Phase 6 - Final review and production readiness
tommy-ca Jan 14, 2026
eca8bc6
docs: Add comprehensive project completion summary
tommy-ca Jan 14, 2026
ed29614
docs: Add comprehensive lessons learned and project closure
tommy-ca Jan 14, 2026
6d440e9
docs: Add comprehensive documentation index and navigation guide
tommy-ca Jan 14, 2026
da09162
fix: Final robust fixes for Iceberg storage integration
tommy-ca Jan 15, 2026
69f0750
docs(specs): streamline Iceberg plan Phase 6 summary
tommy-ca Jan 15, 2026
3b8f2e2
docs(specs): update Iceberg offline store final details
tommy-ca Jan 15, 2026
850a89d
docs(specs): update Iceberg online store final details
tommy-ca Jan 15, 2026
f877d15
docs(specs): fix Iceberg quickstart config examples
tommy-ca Jan 15, 2026
a171cb9
docs(specs): remove stale Iceberg online store status section
tommy-ca Jan 15, 2026
56e51ee
docs(specs): add Iceberg production readiness hardening backlog
tommy-ca Jan 15, 2026
a1dce29
docs(reference): align Iceberg offline store examples with config
tommy-ca Jan 15, 2026
c0c5627
fix(online-store): project columns and align entity_hash partitions
tommy-ca Jan 15, 2026
363e26d
feat(offline-store): validate IcebergSource configuration
tommy-ca Jan 15, 2026
02ba04d
docs: mark Iceberg stores beta and define certified matrix
tommy-ca Jan 15, 2026
637224d
docs(specs): align Iceberg spec dependencies with implementation
tommy-ca Jan 15, 2026
0df1cb2
fix(offline-store): configure DuckDB for S3 endpoints
tommy-ca Jan 15, 2026
87f306c
examples: add Iceberg REST+MinIO certification smoke test
tommy-ca Jan 15, 2026
5496feb
docs: add Iceberg certification checklist and Make targets
tommy-ca Jan 15, 2026
0dda4fa
chore: make Iceberg smoke targets uv-native
tommy-ca Jan 15, 2026
f4ce843
docs(examples): switch Iceberg workflow to uv run
tommy-ca Jan 15, 2026
0bba23e
fix(examples): create iceberg-local data directories
tommy-ca Jan 15, 2026
3282530
chore(make): add Iceberg certification target
tommy-ca Jan 15, 2026
7a955e2
chore(examples): ignore iceberg-local output data
tommy-ca Jan 15, 2026
30e2a2b
docs(specs): update Iceberg hardening schedule
tommy-ca Jan 15, 2026
d36083a
fix(iceberg): critical security and correctness fixes for Iceberg stores
tommy-ca Jan 16, 2026
18f4539
test(iceberg): add comprehensive tests for critical bug fixes
tommy-ca Jan 16, 2026
82baff6
fix(iceberg): resolve P0 critical security issues and additional impr…
tommy-ca Jan 16, 2026
4b638b7
docs(solutions): add security solution for SQL injection and credenti…
tommy-ca Jan 16, 2026
4cc3a88
docs(planning): add rescheduled work plan for remaining P1/P2 issues
tommy-ca Jan 16, 2026
92941a0
docs(summary): add comprehensive session summary
tommy-ca Jan 16, 2026
e1ed1fa
fix(iceberg): resolve Session 1 P1 issues and add TTL validation
tommy-ca Jan 16, 2026
29f1522
docs(todos): verify and close Session 2 issues
tommy-ca Jan 17, 2026
c49ae25
docs(session): update summary with Sessions 1-2 completion
tommy-ca Jan 17, 2026
b1c148d
docs(completion): add comprehensive Sessions 1-2 completion summary
tommy-ca Jan 17, 2026
d7b1634
perf(iceberg): add catalog connection caching to online store
tommy-ca Jan 17, 2026
13e92fc
docs(session): add Session 3 completion summary
tommy-ca Jan 17, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
docs(examples): switch Iceberg workflow to uv run
  • Loading branch information
tommy-ca committed Jan 15, 2026
commit f4ce8433772cae38f66d21182a1151859b8bf9a8
4 changes: 0 additions & 4 deletions docs/reference/offline-stores/iceberg.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,10 +37,6 @@ In order to use this offline store, you'll need to install the Iceberg dependenc
uv sync --extra iceberg
```

Or if using pip:
```bash
pip install 'feast[iceberg]'
```

This installs:
* `pyiceberg[sql,duckdb]>=0.8.0` - Native Iceberg table operations
Expand Down
4 changes: 0 additions & 4 deletions docs/reference/online-stores/iceberg.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,10 +41,6 @@ In order to use this online store, you'll need to install the Iceberg dependenci
uv sync --extra iceberg
```

Or if using pip:
```bash
pip install 'feast[iceberg]'
```

This installs:
* `pyiceberg[sql,duckdb]>=0.8.0` - Native Iceberg table operations
Expand Down
4 changes: 1 addition & 3 deletions docs/specs/README_ICEBERG.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,15 +57,13 @@ Welcome! This README provides a comprehensive guide to the Apache Iceberg storag
# Install Feast with Iceberg support
uv sync --extra iceberg

# Or using pip
pip install 'feast[iceberg]'
```

### Run Local Example

```bash
cd examples/iceberg-local
uv run python run_example.py
PYTHONPATH=../../sdk/python uv run python run_example.py
```

This will:
Expand Down
6 changes: 4 additions & 2 deletions docs/specs/iceberg_production_readiness_hardening.md
Original file line number Diff line number Diff line change
Expand Up @@ -122,18 +122,20 @@ These are the **deterministic** steps to validate the initial certified matrix.
Use the local end-to-end example:

```bash
uv sync --extra iceberg
cd examples/iceberg-local
uv run python run_example.py
PYTHONPATH=../../sdk/python uv run python run_example.py
```

### Certified: REST catalog + S3-compatible warehouse (MinIO / AWS S3)

Use the REST+MinIO smoke stack and script:

```bash
uv sync --extra iceberg
cd examples/iceberg-rest-minio
docker compose up -d
PYTHONPATH=../../sdk/python python smoke_test.py
PYTHONPATH=../../sdk/python uv run python smoke_test.py
docker compose down -v
```

Expand Down
7 changes: 0 additions & 7 deletions docs/specs/iceberg_quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,13 +30,6 @@ uv sync --extra iceberg
# Or add to an existing project
uv add "feast[iceberg]"
```

### Using pip

```bash
pip install "feast[iceberg]"
```

This installs:
- `pyiceberg[sql,duckdb]>=0.8.0` - Native Iceberg support
- `duckdb>=1.0.0` - SQL engine for joins
Expand Down
24 changes: 15 additions & 9 deletions examples/iceberg-local/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,19 @@ This example shows:

## Installation

This repo uses an **uv-native** workflow (no pip).

From the repo root:

```bash
# Install Feast with Iceberg support
pip install feast[iceberg]
uv sync --extra iceberg
```

# Or using uv (recommended)
uv pip install feast[iceberg]
Then run the example:

```bash
cd examples/iceberg-local
PYTHONPATH=../../sdk/python uv run python run_example.py
```

## Project Structure
Expand All @@ -46,7 +53,7 @@ iceberg-local/
Run the complete example:

```bash
python run_example.py
PYTHONPATH=../../sdk/python uv run python run_example.py
```

This script will:
Expand Down Expand Up @@ -255,24 +262,23 @@ For production workloads, consider:
### PyArrow version conflicts
```bash
# Ensure Python < 3.13
python --version
uv run python --version

# Reinstall with explicit PyArrow version
pip install pyarrow==15.0.0 feast[iceberg]
```

### Catalog errors
```bash
# Remove and recreate catalog
rm -rf data/
python run_example.py
PYTHONPATH=../../sdk/python uv run python run_example.py
```

### Import errors
```bash
# Ensure you're in the example directory
cd examples/iceberg-local
python run_example.py
PYTHONPATH=../../sdk/python uv run python run_example.py
```

## Next Steps
Expand Down
2 changes: 1 addition & 1 deletion examples/iceberg-local/run_example.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@
5. Retrieving historical features (point-in-time correct)

Requirements:
pip install feast[iceberg]
uv sync --extra iceberg
"""

import os
Expand Down
9 changes: 6 additions & 3 deletions examples/iceberg-rest-minio/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ It validates that Feast’s Iceberg offline/online store integrations can:
## Prerequisites

- Docker + docker compose
- Python with `pyiceberg`, `pyarrow`, and `duckdb` available
- `uv` (run `uv sync --extra iceberg` from the repo root)

From the Feast repo root, run the smoke test using the repo sources:

Expand All @@ -26,8 +26,11 @@ cd examples/iceberg-rest-minio

docker compose up -d

# Run smoke test against the REST catalog
PYTHONPATH=../../sdk/python python smoke_test.py
# Ensure dependencies are present
uv sync --extra iceberg

# Run smoke test against the REST catalog (use repo sources)
PYTHONPATH=../../sdk/python uv run python smoke_test.py

docker compose down -v
```
Expand Down