Spring Cloud Data Flow Chart

---

NOTE: This chart has been DEPRECATED. Please use stable/spring-cloud-data-flow.

---

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines.

Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Chart Details

This chart will provision a fully functional and fully featured Spring Cloud Data Flow installation that can deploy and manage data processing pipelines in the cluster that it is deployed to.

MySQL and Redis are used as the stores for Spring Cloud Data Flow state and RabbitMQ is used for the pipelines' messaging layer.

For more information on Spring Cloud Data Flow and its capabilities, see it's documentation.

Prerequisites

Assumes that serviceAccount credentials are available so the deployed Data Flow server can access the API server (Works on GKE and Minikube by default). See Configure Service Accounts for Pods

Installing the Chart

To install the chart with the release name my-release:

$ helm install --name my-release incubator/spring-cloud-data-flow

If you are using a cluster that does not have a load balancer (like Minikube) then you can install using a NodePort:

$ helm install --name my-release --set server.service.type=NodePort incubator/spring-cloud-data-flow

Note that this chart pulls in many different Docker images so can take a while to fully install.

Configuration

The following tables list the configurable parameters and their default values.

RBAC Configuration

Parameter	Description	Default
rbac.create	Create RBAC configurations	true

ServiceAccount Configuration

Parameter	Description	Default
serviceAccount.create	Create ServiceAccount	true
serviceAccount.name	ServiceAccount name	(generated if not specified)

Data Flow User Accounts

Parameter	Description	Default
dataflowUsername	The username for the primary user	user
dataflowPassword	The password for the primary user	password
dataflowRoles	The roles assigned to the primary user	ROLE_VIEW, ROLE_CREATE
dataflowAdminUsername	The username for the admin user	admin
dataflowAdminPassword	The password for the admin user	admin
dataflowAdminRoles	The roles assigned to the admin user	ROLE_MANAGE, ROLE_VIEW

Data Flow Server Configuration

Parameter	Description	Default
server.version	The version/tag of the Data Flow server	1.6.2.RELEASE
server.imagePullPolicy	The imagePullPolicy of the Data Flow server	IfNotPresent
server.service.type	The service type for the Data Flow server	LoadBalancer
server.service.externalPort	The external port for the Data Flow server	80

Skipper Server Configuration

Parameter	Description	Default
skipper.version	The version/tag of the Skipper server	1.0.9.RELEASE
skipper.imagePullPolicy	The imagePullPolicy of the Skipper server	IfNotPresent
skipper.platformName	The name of the configured platform account	minikube
skipper.service.type	The service type for the Skipper server	ClusterIP

Metrics Server Configuration

Parameter	Description	Default
metrics.version	The version/tag of the Metrics server	2.0.0.RELEASE
metrics.imagePullPolicy	The imagePullPolicy of the Metrics server	IfNotPresent
metrics.service.type	The service type for the Metrics server	ClusterIP

Spring Cloud Deployer Configuration

Parameter	Description	Default
deployer.resourceLimits.cpu	Deployer resource limit for cpu	500m
deployer.resourceLimits.memory	Deployer resource limit for memory	1024Mi
deployer.readinessProbe.initialDelaySeconds	Deployer readiness probe initial delay	120
deployer.livenessProbe.initialDelaySeconds	Deployer liveness probe initial delay	90

RabbitMQ Configuration

Parameter	Description	Default
rabbitmq.rabbitmqUsername	RabbitMQ user name	user

MySQL Configuration

Parameter	Description	Default
mysql.mysqlDatabase	MySQL database name	dataflow