Visible to the public One more queue is enough: Minimizing flow completion time with explicit priority notification

TitleOne more queue is enough: Minimizing flow completion time with explicit priority notification
Publication TypeConference Paper
Year of Publication2017
AuthorsLu, Y., Chen, G., Luo, L., Tan, K., Xiong, Y., Wang, X., Chen, E.
Conference NameIEEE INFOCOM 2017 - IEEE Conference on Computer Communications
Date PublishedMay 2017
ISBN Number978-1-5090-5336-0
KeywordsBandwidth, clean slate, clean-slate switch hardware, Collaboration, commodity switches, computer centres, Conferences, Dynamic scheduling, EPN, fine-grained priorities, flow completion time, flow scheduling, flow size information, Hardware, Human Behavior, human factor, human factors, Metrics, packet switching, policy governance, Policy-Governed Secure Collaboration, Processor scheduling, pubcrawl, queue, queueing theory, resilience, Resiliency, scheduling, scheduling mechanism, switch priority queues, Switches, TCP, telecommunication traffic, transport protocols

Ideally, minimizing the flow completion time (FCT) requires millions of priorities supported by the underlying network so that each flow has its unique priority. However, in production datacenters, the available switch priority queues for flow scheduling are very limited (merely 2 or 3). This practical constraint seriously degrades the performance of previous approaches. In this paper, we introduce Explicit Priority Notification (EPN), a novel scheduling mechanism which emulates fine-grained priorities (i.e., desired priorities or DP) using only two switch priority queues. EPN can support various flow scheduling disciplines with or without flow size information. We have implemented EPN on commodity switches and evaluated its performance with both testbed experiments and extensive simulations. Our results show that, with flow size information, EPN achieves comparable FCT as pFabric that requires clean-slate switch hardware. And EPN also outperforms TCP by up to 60.5% if it bins the traffic into two priority queues according to flow size. In information-agnostic setting, EPN outperforms PIAS with two priority queues by up to 37.7%. To the best of our knowledge, EPN is the first system that provides millions of priorities for flow scheduling with commodity switches.

Citation Keylu_one_2017