HASP: Hierarchical Asynchronous Parallelism for Multi-NN Tasks

Article Properties
  • Publication Date
    2024/02/01
  • Indian UGC (journal)
  • Refrences
    45
  • Hongyi Li Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Songchen Ma Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Taoyi Wang Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Weihao Zhang Lynxi, Company, Ltd., Beijing, China ORCID (unauthenticated)
  • Guanrui Wang Lynxi, Company, Ltd., Beijing, China ORCID (unauthenticated)
  • Chenhang Song Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Huanyu Qu Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Junfeng Lin Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Cheng Ma Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Jing Pei Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
  • Rong Zhao Center for Brain-Inspired Computing Research, Optical Memory National Engineering Research Center, Tsinghua University-China Electronics Technology HIK Group Co., Joint Research Center for Brian-inspired Computing, IDG/McGovern Institute for Brain Research at Tsinghua University, Department of Precision Instrument, Tsinghua University, Beijing, China ORCID (unauthenticated)
Cite
Li, Hongyi, et al. “HASP: Hierarchical Asynchronous Parallelism for Multi-NN Tasks”. IEEE Transactions on Computers, vol. 73, no. 2, 2024, pp. 366-79, https://doi.org/10.1109/tc.2023.3329937.
Li, H., Ma, S., Wang, T., Zhang, W., Wang, G., Song, C., Qu, H., Lin, J., Ma, C., Pei, J., & Zhao, R. (2024). HASP: Hierarchical Asynchronous Parallelism for Multi-NN Tasks. IEEE Transactions on Computers, 73(2), 366-379. https://doi.org/10.1109/tc.2023.3329937
Li H, Ma S, Wang T, Zhang W, Wang G, Song C, et al. HASP: Hierarchical Asynchronous Parallelism for Multi-NN Tasks. IEEE Transactions on Computers. 2024;73(2):366-79.
Journal Categories
Science
Mathematics
Instruments and machines
Electronic computers
Computer science
Science
Mathematics
Instruments and machines
Electronic computers
Computer science
Computer software
Technology
Electrical engineering
Electronics
Nuclear engineering
Electric apparatus and materials
Electric circuits
Electric networks
Technology
Electrical engineering
Electronics
Nuclear engineering
Electronics
Computer engineering
Computer hardware
Refrences
Title Journal Journal Categories Citations Publication Date
EfficientNet: Rethinking model scaling for convolutional neural networks 2019
A new golden age for computer architecture: Domain-specific hardware/software co-design, enhanced 2018
In-datacenter performance analysis of a tensor processing unit 2017
DianNao 2014
PyTorch captum 2022