Hongyang R. Zhang Assistant Professor of Computer Science Khoury College of Computer Sciences Northeastern University ho.zhang@northeastern.edu 177 Huntington Ave, Room 2211 [Google Scholar]  [Resume]

Hi! I am an assistant professor of computer science at Northeastern University. My research interests lie in machine learning, algorithms, learning theory, social and information networks. I am part of the StatsML group and the Theory group.

My recent work has focused on developing the algorithmic and theoretical foundation for modern machine learning techniques. One thrust touches on learning from limited (labeled) data such as multi-task learning, transfer learning under distribution shifts, and data augmentation. The other thrust touches on understanding the dynamics of non-convex optimization algorithms such as SGD in overparametrized neural networks. More broadly, the goal of my work is providing analytical and algorithmic insights for understanding real-world data.

Recent updates

• Sep 2021: Welcoming Dongyue and Virender to the group!

• Aug 2021: A new manuscript that explains positive (and negative) transfer using random matrix theory!

• Mar 2021: Received a Khoury seed grant for investigating fairness in ML (Joint w/ Huy Nguyen).

• Jan 2021: Teaching Advanced Machine Learning this semester!

• A list of old updates

Manuscripts

• Analysis of Information Transfer from Heterogeneous Sources via Precise High-dimensional Asymptotics
  Fan Yang, H.R. Zhang, Sen Wu, Weijie Su, and Christopher Ré

Publications

(asterisk indicates alphabetical authorship or equal contribution)

• On the Generalization Effects of Linear Transformations in Data Augmentation
  Sen Wu*, H. R. Zhang*, Gregory Valiant and Christopher Ré
  International Conference on Machine Learning (ICML) 2020
  [blog]

• Learning Over-Parametrized Two-Layer ReLU Neural Networks beyond NTK
  with Yuanzhi Li and Tengyu Ma
  Conference on Learning Theory (COLT) 2020
  

• Understanding and Improving Information Transfer in Multi-Task Learning
  Sen Wu*, H. R. Zhang* and Christopher Ré
  International Conference on Learning Representations (ICLR) 2020
  [blog] [video] [arxiv]

• Pruning based Distance Sketches with Provable Guarantees on Random Graphs
  H. R. Zhang, Huacheng Yu and Ashish Goel
  The Web Conference (WWW) 2019 (oral presentation)

• Recovery Guarantees for Quadratic Tensors with Limited Observations
  H. R. Zhang, Vatsal Sharan, Moses Charikar and Yingyu Liang
  International Conference on AI and Statistics (AISTATS) 2019

• Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations
  with Yuanzhi Li and Tengyu Ma
  Conference on Learning Theory (COLT) 2018 (Best Paper Award)

• Approximate Personalized PageRank on Dynamic Graphs
  H. R. Zhang, Peter Lofgren and Ashish Goel
  KDD 2016 (oral presentation) [code]

• Incentives for Strategic Behavior in Fisher Market Games
  with Ning Chen, Xiaotie Deng, Bo Tang
  AAAI 2016

• A Note on Modeling Retweet Cascades on Twitter
  with Ashish Goel, Kamesh Munagala, Aneesh Sharma
  Workshop on Algorithms and Models for the Web Graph (WAW) 2015

• Connectivity in Random Forests and Credit Networks
  with Ashish Goel, Sanjeev Khanna, Sharath Raghvendra
  Symposium on Discrete Algorithms (SODA) 2015

• Computing the Nucleolus of Matching, Cover and Clique Games
  with Ning Chen and Pinyan Lu
  AAAI 2012 (oral presentation)

• Incentive Ratios of Fisher Markets
  with Ning Chen, Xiaotie Deng, Jie Zhang
  International Colloquium on Automata, Languages, and Programming (ICALP) 2012

• On Strategy-proof Allocation without Payments or Priors
  with Li Han, Chunzhi Su, Linpeng Tang
  Conference on Web and Internet Economics (WINE) 2011

Teaching

• DS 5220, Supervised Machine Learning and Learning Theory, Fall 2021

• CS 7140, Advanced Machine Learning, Spring 2021

• CS 7180, Special Topics in AI: Algorithmic and Statistical Aspects of Deep Learning, Fall 2020
  

Education

• Ph.D. in Computer Science at Stanford University, advised by Ashish Goel and Greg Valiant.

• B. Eng. in Computer Science at Shanghai Jiao Tong University.

Blog posts

• When Multi-Task Learning Works – And When It Doesn’t
  based on joint work with Sen Wu and Chris Ré.

• Automating the Art of Data Augmentation – Part III Theory
  edited with Sharon Y. Li and Chris Ré.

Misc

My Chinese name written in Chinese characters is 张泓洋.