Announcements

  • (September 2022) Our work on a systematic way to design efficient tensor network embedding is accpted by NeurIPS 2022.
  • (September 2021) Our work on efficient and accurate randomized algorithms for tensor decompositions is accpted by NeurIPS 2021.
  • (May 2021) Excited to be awarded the 2021-2022 Mavis Future Faculty Fellow and the CS Department Kenichi Miura Award!
  • (December 2020) Our work on parallel CP decomposition is accpted by IPDPS 2021.
  • (October 2020) I received the Kuck Computational Science & Engineering Scholarship from UIUC Grainger College of Engineering.
  • (July 2020) Our work on AutoHOOT, an automatic differentiation framework that is efficient for high-order numerical optimization for tensors, is accepted by PACT 2020. The software is available here.
  • (November 2019) Our work on large batch training and Q-BERT are accepted by AAAI 2020.
  • (March 2019) I received the Computer Science Gene Golub Fellowship from UIUC CS Department.
  • (November 2018) We introduced pairwise perturbation, a new approximate alternating least squares scheme for tensor decompositions requiring asymptotically less work.
  • (November 2018) Released a simulation paper advised by Prof. N. R. Aluru presenting a multiscale model for solid oxide electrochemical system.

    • Recent Publications

    • Approximate Contraction of Arbitrary Tensor Networks with a Flexible and Efficient Density Matrix Algorithm,
      L. Ma, M. Fishman, M. Stoudenmire, and E. Solomonik,
      Preprint: arXiv:2406.09769, (2024)

      Paper

    • Leveraging the Human Ventral Visual Stream to Improve Neural Network Robustness
      Z. Shao, L. Ma, B. Li, and D. Beck
      Preprint: arXiv:2405.02564 (2024)

      Paper

    • Towards Efficient Algorithms and Systems for Tensor Decompositions and Tensor Networks
      L. Ma
      Ph.D. Dissertation, University of Illinois Urbana-Champaign (2023)

      Paper Slides

    • Tensor Rank and Other Multipartite Entanglement Measures of Graph States
      L. Schatzki, L. Ma, E. Solomonik and E. Chitambar
      Preprint: arXiv:2209.06320 (2022)

      Paper

    • Cost-efficient Gaussian Tensor Network Embeddings for Tensor-structured Inputs
      L. Ma and E. Solomonik
      NeurIPS 2022, Preprint: arXiv:2205.13163 (2022)

      Paper

    • Low Rank Approximation in Simulations of Quantum Algorithms
      L. Ma and C. Yang
      Journal of Computational Science, Preprint: arXiv:2104.11396 (2022)

      Paper Slides-SIAMCSE21

    • Accelerating Alternating Least Squares for Tensor Decomposition by Pairwise Perturbation
      L. Ma and E. Solomonik
      Numerical Linear Algebra with Applications, Preprint: arXiv:1811.10573 (2022)

      Paper Code Slides-UCB-SCSeminar19 Slides-SIAMPP20 Poster-SIAMPP20

    • Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions
      L. Ma and E. Solomonik
      NeurIPS 2021, Preprint: arXiv:2104.01101 (2021)

      Paper Slides-SIAMLA21 Slides-Neurips21 Poster-Neurips21

    • MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models
      Z. Yao, L. Ma, S. Shen, K. Keutzer, and M. W. Mahoney
      Technical Report, Preprint: arXiv:2105.14636 (2021)

      Paper

    • Comparison of Accuracy and Scalability of Gauss-Newton and Alternating Least Squares for CP Decomposition
      N. Singh, L. Ma, H. Yang, and E. Solomonik
      SIAM Journal on Scientific Computing (SISC), Preprint: arXiv:1910.12331 (2021)

      Paper Code

    • Efficient parallel CP decomposition with pairwise perturbation and multi-sweep dimension tree
      L. Ma and E. Solomonik
      International Parallel and Distributed Processing Symposium (IPDPS), Preprint: arXiv:2010.12056 (2021)

      Paper Slides-IPDPS21 Code

    • AutoHOOT: Automatic High-Order Optimization for Tensors
      L. Ma, J. Ye, and E. Solomonik
      International Conference on Parallel Architectures and Compilation Techniques (PACT'20), Preprint: arXiv:2005.04540 (2020)

      Paper Code Slides-PACT20 Video

    • Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT
      S. Shen, Z. Dong, J. Ye, L. Ma, Z. Yao, A. Gholami, M. W. Mahoney, and K. Keutzer,
      AAAI 2020, Preprint: arXiv:1909.05840 (2020)

      Paper Poster-AAAI20

    • Inefficiency of K-FAC for Large Batch Size Training
      L. Ma, G. Montague, J. Ye, Z. Yao, A. Gholami, K. Keutzer, and M. W. Mahoney,
      AAAI 2020, Preprint: arXiv:1903.06237 (2020)

      Paper Poster-AAAI20

    • A Multiscale Model for Electrochemical Reactions in LSCF Based Solid Oxide Cells
      L. Ma, P. Priya, and N. R. Aluru,
      Journal of the Electrochemical Society (2018)

      Paper Slides-USNCCM17

    • A Multiscale Model for the Oxide Ion Conducting and Proton Conducting Solid Oxide Cells
      L. Ma
      M.S. Thesis, University of Illinois Urbana-Champaign (2018)

      Paper Slides

    Other Projects

    • An empirical study of neural ordinal differential equations

      Report Poster

    • Convex analysis of Nonnegative Matrix Factorization

      Report

    Awards

  • Mavis Future Faculty Fellow, UIUC (2021-2022)
  • Kenichi Miura Award, UIUC (2021)
  • Kuck Computational Science and Engineering Scholarship, UIUC (2020)
  • Computer Science Gene Golub Fellowship, UIUC (2019)
  • Graduate with Honor, ZJU (2016)
  • Meritorious Winner, Mathematical Contest In Modeling, MCM (2015)
  • National Scholarship for Undergraduate, ZJU (2014)
  • The First Class Scholarship for Outstanding Students, ZJU (2013-2014)
  • The First Prize in China Undergraduates Mathematical Contest (2013)

    • Contact