Firebird/Notes

Contents

Deployment

Each pipeline will have
- a kubernete pod for each generator
- a kubernete deployment for non-generator nodes

Pipeline name, node name should not contain --

Current Change

2023-07-06-A

- Use Jinja template file for deployment
- Web UI/Console UI show all pod and deployments
- Allow user to scale pipeline
- a kubernete pod for each generator
- a kubernete deployment for non-generator nodes

pyfirebird

firebird
    libs/k8.py
        K8Accessor        : A helper class for accessing kubernetes
        render_template   : A helper function to render jinja template from file with context
    base.py               : core pipeline classes
        PortType
        Node
        Sink
        Generator
        Port
        Pipeline
    rabbitmq.py           : helper for accessing rabbitmq (wraps pika)
        get_connection
        RabbitMQ
    zkdb.py               : helper for zookeeper access
        ZKDatabase
firebirdconsole
    ui
        views
            apis
                main.py   : PipelinesAPI implement the RestAPI for pipeline management