Visible to the public Distributed Black-Box optimization via Error Correcting Codes

TitleDistributed Black-Box optimization via Error Correcting Codes
Publication TypeConference Paper
Year of Publication2019
AuthorsBartan, Burak, Pilanci, Mert
Conference Name2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton)
KeywordsBlack Box Security, black-box adversarial attacks, composability, convergence, Decoding, decoding step, deep convolutional neural networks, derivative-free optimization framework, distributed black-box optimization, encoding, error correcting codes, error correction codes, evolution strategies, Iterative methods, Linear programming, Metrics, neural nets, objective function, optimisation, Optimization methods, Perturbation methods, pubcrawl, resilience, Resiliency, stragglers, structured exploration methods, structured search directions, telecommunication security
AbstractWe introduce a novel distributed derivative-free optimization framework that is resilient to stragglers. The proposed method employs coded search directions at which the objective function is evaluated, and a decoding step to find the next iterate. Our framework can be seen as an extension of evolution strategies and structured exploration methods where structured search directions were utilized. As an application, we consider black-box adversarial attacks on deep convolutional neural networks. Our numerical experiments demonstrate a significant improvement in the computation times.
Citation Keybartan_distributed_2019