Visible to the public Coresets for Kernel Regression

TitleCoresets for Kernel Regression
Publication TypeConference Paper
Year of Publication2017
AuthorsZheng, Yan, Phillips, Jeff M.
Conference NameProceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
Conference LocationNew York, NY, USA
ISBN Number978-1-4503-4887-4
Keywordscomposability, compressive sampling, coreset, Cyber-physical systems, kernel regression, privacy, pubcrawl, resilience, Resiliency, Sample complexity
AbstractKernel regression is an essential and ubiquitous tool for non-parametric data analysis, particularly popular among time series and spatial data. However, the central operation which is performed many times, evaluating a kernel on the data set, takes linear time. This is impractical for modern large data sets. In this paper we describe coresets for kernel regression: compressed data sets which can be used as proxy for the original data and have provably bounded worst case error. The size of the coresets are independent of the raw number of data points; rather they only depend on the error guarantee, and in some cases the size of domain and amount of smoothing. We evaluate our methods on very large time series and spatial data, and demonstrate that they incur negligible error, can be constructed extremely efficiently, and allow for great computational gains.
Citation Keyzheng_coresets_2017