Adding example for kafka/confluent/ksql

pull/330/head
Nathan Zender 5 years ago
parent 85ad9d7c46
commit 1cc6f6d70f
No known key found for this signature in database
GPG Key ID: A012ACCAADC65EF2

@ -89,6 +89,47 @@ with Diagram("Event Processing", show=False):
![event processing diagram](/img/event_processing_diagram.png) ![event processing diagram](/img/event_processing_diagram.png)
## Event Processing with Kafka & Confluent
```
from diagrams import Cluster, Diagram
from diagrams.confluent.streaming import Ksql, Confluent
from diagrams.elastic.elasticsearch import Elasticsearch
from diagrams.onprem.compute import Server
from diagrams.onprem.database import Postgresql
from diagrams.onprem.queue import Kafka
with Diagram("Event Processing with Confluent", show=False):
kafka = Kafka("Kafka")
with Cluster("Source of Data"):
[Server(),
Server(),
Server()] >> kafka
with Cluster("KSQL Cluster"):
ksql = [Ksql(),
Ksql(),
Ksql()]
with Cluster("Kafka Connect Cluster"):
kafka_connect = [Confluent(),
Confluent(),
Confluent()]
with Cluster("Data Sinks"):
postgres = Postgresql()
elasticsearch = Elasticsearch()
kafka >> ksql
ksql >> kafka
kafka >> kafka_connect
kafka_connect >> postgres
kafka_connect >> elasticsearch
```
![event processing diagram_confluent](/img/event_processing_diagram_confluent.png)
## Message Collecting System on GCP ## Message Collecting System on GCP
```python ```python

Binary file not shown.

After

Width:  |  Height:  |  Size: 138 KiB

Loading…
Cancel
Save