[Lecture] Peng Liu : Optimal Smooth Approximation for Quantile Matrix Factorization

announcer:钱琳release time:2019-07-12Views:47

Time: 11:00-12:00am, July. 12th, 2019, Friday

Venue: RoomA1514, Science Building, North Zhongshan Road Campus

Spreker: Tenure track Assistant Professor Peng Liu, Department of Statistics, University of Kent, UK

Abstract: Matrix estimation and factorization have wide applications in signal processing and recommender systems. Most existing matrix factorization methods adopt a squared loss function and aim to recover a low-rank matrix to interpret conditional means of matrix entries given noisy observations. Quantile matrix factorization (QMF) adopts a check loss in matrix factorization and can better explain the central tendency of data under realistic noise distributions such as skewed and heavy-tailed noise. However, unlike Least Squares Matrix Factorization (LSMF), the non-smoothness of the check loss has posed significant computational challenges to QMF.

In this paper, we propose NsQMF, a nearly optimal smooth approximation procedure for QMF by extending Nesterov's optimal smooth approximation technique to nonconvex matrix factorization problems. We theoretically show that solving the nonsmooth QMF problem is equivalently to solving the proposed smooth approximation. We then present an efficient algorithm to solve QMF by adapting alternating minimization and a singular value projection algorithm to the proposed NsQMF. Extensive evaluations based on both synthetic and real-world data verify that NsQMF retains the exact recovery property and linear convergence rate of LSMF under the noiseless case and that NsQMF greatly outperforms LSMF and other prior smoothing techniques for QMF in terms of relative recover loss under a range of different noise distributions.

Speaker’s Bio刘鹏,英国肯特大学统计系助理教授(终身职位),2015年获得中国科学院数学与系统科学研究院统计学博士学位,曾先后在香港浸会大学数学系,美国华盛顿大学生物统计系,美国Fred Hutchnison Cancer Research Center,加拿大阿尔伯塔大学数学与统计系等科研院所工作。研究方向包括生物统计,机器学习,加强学习,深度学习,函数型数据分析,data bridging。获得2018年国际数理统计学会IMS new researchers conference travel award。刘鹏博士在国内外核心杂志发表论文5篇,在审5篇,另有10篇工作论文即将投到统计学与机器学习顶级杂志