Version: v0.5.3

Roadmap

Available

NiFi cluster installation

StatusDone
PriorityHigh
Targeted Start dateJan 2020

Graceful NiFi Cluster Scaling

StatusDone
PriorityHigh
Targeted Start dateJan 2020

Apache NiFi is a good candidate to create an operator, because everything is made to orchestrate it through REST Api calls. With this comes automation of actions such as scaling, following all required steps : https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#decommission-nodes.

Communication via SSL

StatusDone
PriorityHigh
Targeted Start dateMay 2020

The operator fully automates NiFi's SSL support. The operator can provision the required secrets and certificates for you, or you can provide your own.

Dataflow lifecycle management via CRD

StatusDone
PriorityHigh
Targeted Start dateAug 2020

Users & access policies management

StatusDone
PriorityHigh
Targeted Start dateNovember 2020

The operator fully automates NiFi's user and access policies management.

Backlog

Monitoring via Prometheus

StatusTo Do
PriorityHigh
Targeted Start dateOct 2020

The NiFi operator exposes NiFi JMX metrics to Prometheus.

Reacting on Alerts

StatusTo Do
PriorityLow
Targeted Start date-

The NiFi Operator acts as a Prometheus Alert Manager. It receives alerts defined in Prometheus, and creates actions based on Prometheus alert annotations.

Currently, there are three actions expected :

  • upscale cluster (add a new Node)
  • downscale cluster (remove a Node)
  • add additional disk to a Node

Seamless Istio mesh support

StatusTo Do
PriorityLow
Targeted Start date-
  • Operator allows to use ClusterIP services instead of Headless, which still works better in case of Service meshes.
  • To avoid too early nifi initialization, which might lead to unready sidecar container. The operator will use a small script to mitigate this behaviour. All NiFi image can be used the only one requirement is an available wget command.
  • To access a NiFi cluster which runs inside the mesh. Operator will supports creating Istio ingress gateways.
Last updated on by Alexandre Guitton