BackupHub: A Year of Massive Evolution. Orchestrations, Real‑Time Automation, and a Whole New Platform

Posted onLeave a comment

When I first released BackupHub back in April 2025, it was a simple idea brought to life: a clean, open‑source way to manage backup scripts across Linux servers, NAS devices, and home‑lab environments. It shipped with a scheduler, a script editor, and a lightweight agent system, enough to solve my own problems and hopefully help a few others along the way.

Fast‑forward to today, and BackupHub has grown into something far bigger than a “backup tool.” It’s now a distributed automation platform capable of orchestrating complex workflows, coordinating multiple servers, and providing real‑time visibility across your entire environment.

This post highlights everything that’s changed since that first release.

🚀 What’s New in BackupHub

1. Full Orchestration Engine

BackupHub now supports Orchestrations; multi‑step, multi‑agent workflows built using a visual node editor. You can chain tasks, run branches in parallel, add conditional logic, and build full automation pipelines. Think of it as “Ansible‑lite meets Node‑RED,” but built specifically for shell‑based automation.

Key features:

  • Visual orchestration builder UI
  • Parallel and sequential task execution
  • Conditional nodes
  • Real‑time execution monitoring
  • Automatic log streaming from every step

This is the single biggest evolution of the platform.

2. A Re‑Engineered Scheduler with Rule‑Based Triggers

The original scheduler handled cron‑style jobs. The new scheduler handles time‑based, rule‑based, and webhook‑triggered jobs.

You can now trigger jobs when:

  • CPU crosses a threshold
  • Disk space drops below a limit
  • A webhook is received
  • A specific agent comes online

This makes BackupHub useful far beyond backups, it becomes a general automation engine.

3. Deeply Improved Agent System

The agent has been completely redesigned with:

  • A clearer lifecycle
  • Stronger encryption and shared‑secret authentication
  • Real‑time log streaming
  • Automatic status reporting
  • Support for both WebSocket and MQTT transports

Agents now feel like first‑class citizens in the platform, not just remote script runners.

4. Real‑Time UI Powered by Socket.io

The web interface now updates instantly:

  • Job logs stream live
  • Agent status changes appear immediately
  • Orchestration steps animate as they run
  • Running jobs are tracked in real time

This makes BackupHub feel alive, you can literally watch your automation flow across your servers.

5. A Proper Data Layer (LevelDB‑backed)

BackupHub now uses a structured LevelDB data layer with dedicated databases for:

  • Core data (schedules, agents, jobs)
  • User accounts
  • Agent history and metrics

This gives the platform:

  • Faster startup
  • Better reliability
  • Cleaner separation of concerns
  • A foundation for future analytics

6. A Much More Capable Web UI

The UI has grown massively, with entire new sections:

✔ Agent Management Dashboard

View status, metrics, logs, and registration details.

✔ Orchestration Builder & Monitor

Build workflows visually and watch them run.

✔ Job History & Running Jobs Tracker

See everything that’s running or has run recently.

✔ Script Editor & Template Repository

Includes templates for:

  • Proxmox VM backups
  • MySQL/MariaDB dumps
  • Rsync jobs
  • File purging
  • Threshold checks
  • Server reboots …and more.

✔ User Management & Authentication

Multi‑user support with persistent profiles.

✔ Settings & Configuration UI

All environment settings now configurable from the browser.

7. Webhooks Everywhere

BackupHub now exposes:

  • Webhook triggers
  • Webhook management UI
  • REST endpoints for orchestration and job control

This means BackupHub can integrate with:

  • Home Assistant
  • GitHub Actions
  • Proxmox hooks
  • Monitoring systems
  • Anything that can send an HTTP request

8. Cleaner Deployment & CI/CD

The project now includes:

  • A hardened Docker deployment path
  • A release pipeline
  • Automated versioning
  • Better test coverage (server + agent)

Deploying the Hub is now as simple as:
docker run -p 8082:8082 ghcr.io/dpembo/backuphub/hub
And agents can be provisioned with a one‑liner from the UI.

🧭 BackupHub Today: More Than Backups

BackupHub started as a personal backup manager. Today it’s a lightweight automation platform for home labs, NAS devices, and small server fleets.

It now handles:

  • Backups
  • Maintenance tasks
  • Monitoring‑driven triggers
  • Multi‑step workflows
  • Cross‑server orchestration
  • Real‑time automation pipelines

All with a clean UI, a simple agent, and a small footprint.

🔗 Try It, Star It, Break It, Improve It

BackupHub is open‑source and actively evolving.

GitHub: https://github.com/dpembo/BackupHub
Deepwiki: https://deepwiki.com/dpembo/BackupHub

If you’re running a home lab, a Proxmox cluster, or just a couple of Linux servers, give it a try — and let me know what you automate with it.

BackupHub Release (v2025.04.20.01)

Posted onLeave a comment

Introducing the first public release of BackupHub, a free and open source personal backup management platform, particularly for linux, NAS and other home servers, but equally can be used in more complex environments.

BackupHub is something I created for personal use, but figured that it could be useful for many people, especially those with a home lab, and therefore I made this open source on github, productionized it, and this is the result of all that work!

See here for installation, source and license details.

BackupHub provides a web management console, and managed backup agent installations to achieve and manage remote execution of shell commands to remote linux environments.

It can run natively (via node.js) but it’s designed for the server to run primarily as a container, either through docker, or even inside kubernetes. Backup agents can be installed directly from the management console, which run on linux servers, and have a number of options for startup, including:

  • – Container
  • – pm2
  • – cron
  • – service
  • – manual

BackupHub includes the following capabilities:

  • Job Configuration / Scheduler: in list and calendar views, to be able to create, configure and understand backup schedules clearly, with custom colours and icons to uniquely identify schedules
  • Job history management: view previously executed jobs and logs from these jobs
  • Secure Remote Agent provision and management: Manage and provision backup agents onto your servers, manage, and understand their status.
  • Integrated Script Editor: allows you to create and edit backup jobs directly from the management console, as well as pick from a set of template backup jobs which includes the following
    • – Backup proxmox vm
    • – Backup MySQL/MariaDB database
    • – Delete files matching a filter
    • – Reboot Server
    • – Purge files older than configured period
    • – Rsync two directories
    • – Threshold jobs for CPU/Storage
  • Integrated notifications both in the server console, via email, and configurable to use a webhook for external notification however you choose
  • Support for Websocket (preferred) or MQTT for transport of secured server agent communication

For further information, including the quick start guide, source code links and license, please see here:
BackupHub

Coming Soon…

Posted on

BackupHub – a simple (and Open Source) Backup Controller that runs under Docker, with deployable agents that run on remote servers capable of running various backup jobs on a configured schedule, pushed via the controller.

E2Stream v6.7 (installer issues resolved)

Posted on2 Comments

I realised after reinstating my build server setup (via docker!) that the installer wasn’t quite working as it should, and probably explains the reasons why people have asked many times as to how they can install additional apps, or separate the app from the installer.  There was a bug preventing the burger menu from working on the installer, and therefore these options were not accessible.  This has now been resolved and those options now work!

Note this fix only changes the installer, not the app, so for those who have this working as needed, there is no need to update your install on the TV.

Change log:

v6.7 - 14/07/2018

* Fixed installer to allow for download of zip and specify of additional apps directory to install

Please note, the installation and setup requires you to enable a ‘develop’ account on your TV.
You also need Java v7 or v8 to run the installer.

Instructions to setup can be found here

E2Stream v6.7 is now available to download from here:

For any bugs, please email/post or create a new issue here

If you need to try and debug any options/issues, either download the debug build available from the downloads link at the top of this page, which starts the app by default in debug mode, or press the ‘Tools’ button on the remote before you experience the issue to see the debug log.

If you do use E2Stream, please consider donating to support the continued development and hosting costs of this app! You can donate any amount you feel is applicable here:


E2Stream v6.6

Posted on6 Comments

E2Stream v6.6 is now available to download from here:


Change log:

v6.6 - 27/09/20156

* Resolved issue with recordings/movie playback in relation

  to the changes made for the transcoding settings introduced

  in v6.5 that was preventing the playback of recordings.

Please note, the installation and setup requires you to enable a ‘develop’ account on your TV.
You also need Java v7 or v8 to run the installer.

Instructions to setup can be found here

For any bugs, please email/post or create a new issue here

If you do use E2Stream, please consider donating to support the continued development and hosting costs of this app! You can donate any amount you feel is applicable here: