Skip to content

Commit dc2c66a

Browse files
committed
in module 3, link to module 1
Signed-off-by: Danny Chiao <danny@tecton.ai>
1 parent 9d6c213 commit dc2c66a

6 files changed

Lines changed: 3 additions & 154 deletions

File tree

module_3/README.md

Lines changed: 3 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -82,15 +82,11 @@ Start up the Docker daemon and then use Docker Compose to spin up the services a
8282
```console
8383
$ docker-compose up
8484
85-
Creating network "module_1_default" with the default driver
86-
Creating zookeeper ... done
85+
Creating network "module_3_default" with the default driver
8786
Creating redis ... done
88-
Creating broker ... done
8987
Creating feast_feature_server ... done
90-
Creating feast_push_server ... done
91-
Creating kafka_events ... done
9288
Creating registry ... done
93-
Attaching to zookeeper, redis, broker, feast_push_server, feast_feature_server, kafka_events, registry
89+
Attaching to redis, feast_feature_server, registry
9490
...
9591
```
9692

@@ -203,7 +199,7 @@ There are two broad approaches with streaming
203199
- This means that Feast only needs to know about a "batch feature" because the assumption is those batch features are sufficiently fresh.
204200
- **BUT** there are limits to how fresh your features are. You won't be able to get to minute level freshness.
205201
2. **[Complex, very fresh features]** Build separate streaming pipelines for very fresh features
206-
- It is on you to build out a separate streaming pipeline (e.g. using Spark Structured Streaming or Flink), ensuring the transformation logic is consistent with batch transformations, and calling the push API as per module 1.
202+
- It is on you to build out a separate streaming pipeline (e.g. using Spark Structured Streaming or Flink), ensuring the transformation logic is consistent with batch transformations, and calling the push API as per [module 1](../module_1/README.md).
207203

208204
Feast will help enforce a consistent schema across batch + streaming features as they land in the online store.
209205

module_3/docker-compose.yml

Lines changed: 0 additions & 47 deletions
Original file line numberDiff line numberDiff line change
@@ -1,59 +1,12 @@
11
---
22
version: '3'
33
services:
4-
zookeeper:
5-
image: confluentinc/cp-zookeeper:7.0.1
6-
container_name: zookeeper
7-
environment:
8-
ZOOKEEPER_CLIENT_PORT: 2181
9-
ZOOKEEPER_TICK_TIME: 2000
10-
11-
broker:
12-
image: confluentinc/cp-kafka:7.0.1
13-
container_name: broker
14-
ports:
15-
- "9092:9092"
16-
- "29092:29092"
17-
depends_on:
18-
- zookeeper
19-
environment:
20-
KAFKA_BROKER_ID: 1
21-
KAFKA_ZOOKEEPER_CONNECT: 'zookeeper:2181'
22-
KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: PLAINTEXT:PLAINTEXT,PLAINTEXT_INTERNAL:PLAINTEXT
23-
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092,PLAINTEXT_INTERNAL://broker:29092
24-
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
25-
KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1
26-
KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
27-
284
redis:
295
image: redis
306
container_name: redis
317
ports:
328
- "6379:6379"
339

34-
kafka_events:
35-
build:
36-
context: .
37-
dockerfile: kafka_demo/Dockerfile
38-
depends_on:
39-
- broker
40-
container_name: kafka_events
41-
42-
push_server:
43-
container_name: feast_push_server
44-
build:
45-
context: .
46-
dockerfile: feature_repo/Dockerfile
47-
depends_on:
48-
feature_server:
49-
condition: service_healthy
50-
registry:
51-
condition: service_healthy
52-
ports:
53-
- "6567:6566"
54-
links:
55-
- redis
56-
5710
feature_server:
5811
container_name: feast_feature_server
5912
build:
-57.4 KB
Binary file not shown.

module_3/kafka_demo/Dockerfile

Lines changed: 0 additions & 12 deletions
This file was deleted.
-57.4 KB
Binary file not shown.

module_3/kafka_demo/kafka_demo.py

Lines changed: 0 additions & 88 deletions
This file was deleted.

0 commit comments

Comments
 (0)