项目作者: EJASKHAN
项目描述 :
This FLINK project will consume streams from an azure event-hub and produce to a different event-hub ,and the config files for deploying the same in kubernetes
高级语言: Java
项目地址: git://github.com/EJASKHAN/flink-consume-produce-ek.git
flink-consume-produce-ekThis FLINK project will consume from an azure event-hub and produce to a different event-hub ,and the code for deploying the same in kubernetes
Getting Started with IDESteps for running in IDE like Intellij,
Clone this repo. From Intellij, navigate File->New->Project-> Edit the EH name in FlinkTestConsumerProducer.java and broker name & connection string in consumer.config (if required)From the Maven tool window, perform the lifecycle - clean and compile.Run the main class .Clone the project flink-producer-ek and run the same.
Docker imageOnce you commit the code changes , an image will get generated in ACR.
Kubernetes DeploymentSteps for running in Kubernetes(Manual steps),
Login to your AKS cluster using any command line tools, eg: AzureCLI or AzureCloudShell.OR use minikube for local testing.Clone/Navigate to the project directory.CD KubernetesCreate the resources in the following order.
a. kubectl create -f namespace.yaml b. kubectl create -f dockersecret.yaml c. kubectl create -f flink-configuration-configmap.yaml d. kubectl create -f jobmanager-service.yaml e. kubectl create -f jobmanager-deployment.yaml f. kubectl create -f taskmanager-deployment.yaml
We could manage the above mentioned kubernetes resources and automate the deployment by using either one of the following ways in future1.Helm Charts.2.Kustomize.3.Kubernetes Operator.