AutoNDP Load Balancer

Archived

A policy-driven load balancing framework for a novel serverless runtime developed by the ICSA within the School of Informatics

View on GitHub
Stack:CC++PythonCeph

Team project

StatusArchived
RoleTeam
Year2024
StackC, C++ +24 technologies
AutoNDP Load Balancer

Problem

AutoNDP is an implementation of FaaS runtime that allows code-migration to enable near-data processing. How can we define an intelligent, policy-driven, load balancer for this runtime that allows informed code offloading in a distributed environment

Highlights

  • 3.13× lower median latency for I/O-intensive workloads.
  • 10× reduction in latency variance under high concurrency.
  • More stable throughput with reduced queuing effects.