Xuanhua Shi Chinese

Ph.D, Professor

Services Computing Technology and System Lab

Big Data Technology and System Lab

School of Computer Science and Technology

Huazhong University of Science and Technology

Contact:

Tel: +86-27-8754-3529

Fax: +86-27-8755-7354

email:

Address: School of Computer, Huazhong University of Science and Technology, Wuhan,430074,China.

 

Research Interests

  • General research interests: parallel and distributed systems.
  • Current research focus: scalability, resilience and autonomy of large-scale distributed systems, such as peta-scale systems, and data centers.

Opening Positions

I am currently recruiting self-motivated and dedicated Ph.D./M.S. students with solid background in systems, mathematics, etc.. If you are interested, come and talk to me, or drop me a message.

Teaching

  • Computer Systems
  • Computer Organization Principle
  • Parallel Programming
  • Parallel and Distributed Systems, Partial supported by the EC Project EuroAsiaGrid under grant CN022 (103-305)

Research Experiences

  • past
    • Key Technologies of Cloud Integration Platform for Mobile Environment (No. 2015DFE12860), supported by International Science & Technology Cooperation Program of China, PI
    • Big scientific data processing optimization theory and technology (No. 61370104), supported by National Natural Science Foundation of China, PI
    • Supporting Infrastructure and Data Processing System for Translation Service Cloud (No. 2012BAH14F02 ), National Science & Technology Pillar Program, PI
    • Massive Education Resource Management over Cloud (No. MOE-INTEL-2012-01), MOE-Intel Special Research Fund of Information Technology, PI
    • High availability for Cloud Data Center (No. 60973037), supported by National Natural Science Foundation of China, PI
    • Desktop Grids for International Scientific Collaboration (DEGISCO), supported by EC FP7
    • Video Encoding, Transfering, and Intelligent Processing in Cloud (NO. 61133008), supported by National Natural Science Foundation of China, Member
    • Interoperation between DG and Cloud, Technical Manager
    • Grid Dependability Evaluation (No. 60603058), supported by National Natural Science Foundation of China, PI
    • Basic Theory and Methodology of Virtualization Technology for Computing System (No. 2007CB310900), National 973 Basic Research Program, supported by Ministry of Science and Technology, member of the research team
    • LSPDS: Large Scale Parallel and Distributed Systems, LIAMA Project, Member
    • HUST-Intel Joint Research on Virtual Machine Management for Cloud Computing Environment, supported by Intel, Co-PI
    • Large Scale Scheduling Technology for Data Center, supported by Huawei Technologies Co., Ltd., PI
    • SafeScale, supported by Agence Nationale de la Recherche, INRIA post-doc in PARIS team
    • Application-supporting Middle-ware for network computing (No. 90412010),The important special project,supported by National Natural Science Foundation of China, member of the research team
    • Service-oriented Maintance Tools - Guardian, Technical Manager
    • Application Placement Framework for Data Centers, Technical Manager
    • Cloud Resource Management for Grid Applications, Technical Manager
    • The "211" important special project, supported by the Ministry of Education of China , first phase
      • Campus Grid Platform Construction in HUST (No.G2003-CG001): Leader of the research team
      • ChinaGrid Grid Platform Construction(CGSP) (No.G2003-GP001): Member of the research team
    • Real-time Information Processing Platform (No. 413150401), member of the research team(PHD student)
    • Cluster Computing Software(No.2002AA1Z2102), National 863 Hi-Tech Research and Development Program, Ministry of Science and Technology, member of the research team (PHD student)

Selected Publications

  • Conferences
      • Bo Liu, Wenbin Jiang, Hai Jin, Xuanhua Shi, and Yang Ma, "Layrub: layer-centric GPU memory reuse and data migration in extreme-scale deep learning systems". in Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP '18), poster, Vienna, Austria,Feb. 24-28, 2018.
      • Xuanhua Shi, Xiong Zhang, Ligang He, Hai Jin, Zhixiang Ke, and Song Wu, "MURS: Mitigating Memory Pressure In Service-Oriented Data Processing Systems". in Proceedings of the 24th IEEE International Conference on Web Services (ICWS), Honolulu, Hawaii, USA, June 25-30, 2017. (Source codes)
      • Xuanhua Shi, Ming Li, Wei Liu, Hai Jin, Chen Yu, and Yong Chen, "SSDUP: A Traffic-Aware SSD Burst Buffer for HPC Systems". in Proceedings of the ACM International Conference on Supercomputing (ICS), Chicago, Illinois, USA, June 13-16, 2017 (Source codes).
      • Qiang-Sheng Hua, Ming Ai, Hai Jin, Dongxiao Yu, and Xuanhua Shi, "Distributively Computing Random Walk Betweenness Centrality in Linear Time". in Proceedings of the IEEE International Conference on Distributed Computing Systems(ICDCS), Atlanta, GA, USA, June 5-8, 2017.
      • Lu Lu, Xuanhua Shi, Yongluan Zhou, Xiong Zhang, Hai Jin, Cheng Pei, Ligang He, Yuanzhen Geng, "Lifetime-Based Memory Management for Distributed Data Processing Systems". in Proceedings of the VLDB Endowment (PVLDB), New Delhi, India, Sept. 5-9, 2016.
      • Qiang-Sheng Hua, Haoqiang Fan, Lixiang Qian, Ming Ai, Yangyang Li, Xuanhua Shi, Hai Jin, "Brief Announcement: A Tight Distributed Algorithm for All-Pairs-Shortest-Paths and Applications". in Proceedings of the ACM Symposium on Parallelism in Algorithms and Architectures (SPAA), California, USA, July 11-13, 2016.
      • Qiang-Sheng Hua, Haoqiang Fan, Ming Ai, Lixiang Qian, Yangyang Li, Xuanhua Shi, Hai Jin, "Nearly Optimal Distributed Algorithm for Computing Betweenness Centrality". in Proceedings of the IEEE International Conference on Distributed Computing Systems(ICDCS), Nara, Japan, June 27-30, 2016.
      • Zhiqiang Liu, Xuanhua Shi, Hai Jin, "Exploiting Sample Diversity in Distributed Machine Learning Systems". IEEE/ACM CCGrid, Cartagena, Colombia, May 16-19, 2016.
      • Xuanhua Shi, Junling Liang, Sheng Di, Bingsheng He, Hai Jin, Lu Lu, Zhixiang Wang, Xuan Luo, Jianlong Zhong, "Optimization of Asynchronous Graph Processing on GPU with Hybrid Coloring Model". in Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP '15), poster, San Francisco, USA, 2015. (Source codes) " updated results "
      • Xuanhua Shi, Haohong Lin, Hai Jin, Bing Bing Zhou, Zuoning Yin, Sheng Di and Song Wu, "GIRAFFE: A Scalable Distributed Coordination Service for Large-scale Systems". in Proceedings of the IEEE Cluster, Madrid, Spain, 2014. Nominated for Best Paper (Source codes)
      • Haibao Chen, Song Wu, Sheng Di, Bing Bing Zhou, Zhenjiang Xie, Hai Jin, Xuanhua Shi, "Communication-driven scheduling for virtual clusters in cloud". HPDC, short paper, 2014
      • Zhixiang Wang, Xuanhua Shi, Hai Jin, Song Wu, Yong Chen, "Iteration Based Collective I/O Strategy for Parallel I/O Systems", CCGrid, 2014
      • Like Zhou, Song Wu, Huahua Sun, Hai Jin, Xuanhua Shi, "Virtual Machine Scheduling for Parallel Soft Real-Time Applications", MASCOTS, 2013
      • Like Zhou, Song Wu, Huahua Sun, Hai Jin, Xuanhua Shi, "Supporting parallel soft real-time applications in virtualized environment". HPDC, poster, 2013
      • Lu Lu, Hai Jin, Xuanhua Shi, Gilles Fedak, "Assessing MapReduce for Internet Computing: A Comparison of Hadoop and BitDew-MapReduce", ACM/IEEE International Conference on Grid Computing (Grid 12), 2012
      • Hai Jin, Li Deng, Song Wu, Xuanhua Shi, "Dynamic Processor Resource Configuration in Virtualized Environments", IEEE International Conference on Services Computing, 2011
      • Dachuan Huang, Xuanhua Shi, Shadi Ibrahim, Lu Lu, Hongzhang Liu, Song Wu, Hai Jin. "MR-scope: a real-time tracing tool for MapReduce". The MapReduce of HPDC, 2010
      • Mingjia Zhang, Hai Jin, Xuanhua Shi, Song Wu, “VirtCFT: A Transparent VM-level Fault-Tolerant System for Virtual Clusters”, Proceeds of the 16th International Conference on Parallel and Distributed Systems, 2010
      • Hai Jin, Li Deng, Song Wu, Xuanhua Shi, Xiaodong Pan, "Live Virtual Machine Migration with Adaptive Memory Compression", IEEE Cluster 2009, 2009
      • Haijun Cao, Hai Jin, Xiaoxin Wu, Song Wu, Xuanhua Shi, "DAGMap: Efficient Scheduling for DAG Grid Workflow Job" , Proceeds of the 9th IEEE/ACM International Conference on Grid Computing (Grid 2008), 2008
      • Xuanhua Shi, Jean-Louis Pazat, Eric Rodriguez, Hai Jin, Hongbo Jiang, "Dynasa: Adapting Grid Applications to Safety using Fault-Tolerant Methods" , in Proceedings of the 17th ACM International Symposium on High Performance Distributed Computing(HPDC 2008), poster, 2008
      • Xuanhua Shi, Hai Jin, Weizhong Qiang, "ALTER: First Step towards Dependable Grids", in Proc. ACM Symposium on Applied Computing (SAC),2006
    • Journals and book chapters
      • Hai Jin, Bo Liu, Wenbin Jiang, Yang Ma, Xuanhua Shi, Bingsheng He, and Shaofeng Zhao, "Layer-centric Memory Reuse and Data Migration for Extreme-Scale Deep Learning on Many-Core Architectures", ACM Transactions on Architecture and Code Optimization, 2018.
      • Dong Dai, Forrest Sheng Bao, Jiang Zhou, Xuanhua Shi, and Yong Chen, "Vectorizing Disks Blocks for Efficient Storage System via Deep Learning", Parallel Computing, 2018.
      • Hai Jin, Na Wang, Dongxiao Yu, Qiang-Sheng Hua, Xuanhua Shi, and Xia Xie, "Core Maintenance in Dynamic Graphs: A Parallel Approach based on Matching", IEEE Transactions on Parallel and Distributed Systems, 2018.
      • Xuanhua Shi, Xuan Luo, Junling Liang, Peng Zhao, Sheng Di, Bingsheng He, Hai Jin, "Frog: Asynchronous Graph Processing on GPU with Hybrid Coloring Model", IEEE Transactions on Knowledge and Data Engineering, 30 (1): 29-42, 2018.(Source codes)
      • Xuanhua Shi, Zhigao Zheng, Yongluan Zhou, Hai Jin, Ligang He, Bo Liu, Qiang-Sheng Hua, "Graph Processing on GPUs: A Survey", ACM Computing Surveys, 50, 6, Article 81, January 2018, 35 pages.
      • Wenyong Zhong, Jianhua Sun, Hao Chen, Jun Xiao, Zhiwen Chen, Cheng Chang, and, Xuanhua Shi, "Optimizing Graph Processing on GPUs", IEEE Transactions on Parallel and Distributed Systems, doi:10.1109/TPDS.2016.2611659, 2016.
      • Yuanzhen Geng, Xuanhua Shi, Cheng Pei, Hai Jin, and Wenbin Jiang, "LCS: An Efficient Data Eviction Strategy for Spark", International Journal of Parallel Programming, doi:10.1007/s10766-016-0470-1, 2016.(Source codes)
      • Song Wu, Like Zhou, Huahua Sun, Hai Jin, and Xuanhua Shi, "Poris: A Scheduler for Parallel Soft Real-Time Applications in Virtualized Environments", IEEE Transactions on Parallel and Distributed Systems, 27(3):841-854, 2016.
      • Xuanhua Shi, Ming Chen, Ligang He, Xu Xie, Lu Lu, Hai Jin, Yong Chen, and Song Wu, "Mammoth: Gearing Hadoop Towards Memory-Intensive MapReduce Applications", IEEE Transactions on Parallel and Distributed Systems, 26(8):2300-2315, 2015. Spotlight paper on Transactions "When data grows big" (Source codes)
      • Hai Jin, Xinhou Wang, Song Wu, Sheng Di, and Xuanhua Shi, "Towards Optimized Fine-Grained Pricing of IaaS Platform", accepted in IEEE Transactions on Cloud Computing, 2014
      • Pingpeng Yuan, Changfeng Xie, Hai Jin, Ling Liu, Guang Yang, Xuanhua Shi, "Dynamic and fast processing of queries on large-scale RDF data", Knowledge and Information Systems, DOI: 10.1007/s10115-013-0726-7, 2013
      • Lu Lu, Xuanhua Shi, Qiuyue Wang, Daxing Yuan, Song Wu, "Morpho: a Decoupled MapReduce Framework for Elastic Cloud Computing" ,Future Generation Computer Systems, 36:80-90, 2014
      • Gang Chen, Hai Jin, Deqing Zou, Bing Bing Zhou, Zhenkai Liang, Weide Zheng and Xuanhua Shi, "SafeStack: Automatically Patching Stack-based Buffer Overflow Vulnerabilities", accepted to appear in IEEE Transactions on Dependable and Secure Computing
      • Yongcai Tao, Hai Jin, Song Wu, Xuanhua Shi, Lei Shi, "Dependable Grid Workflow Scheduling Based on Resource Availability". Journal of Grid Computing, 11(1): 47-61 2013
      • Xuanhua Shi, Hongbo Jiang, Ligang He, Hai Jin, Chonggang Wang, Bo Yu, Xueguang Chen, "Developing an Optimized Application Hosting Framework in Clouds", Journal of Computer and System Sciences,79(8):1214~1229, 2013
      • Xuanhua Shi, Hai Jin, Hongbo Jiang, Xiaodong Pan, Dachuan Huang, and Bo Yu, "Toward Scalable Web Systems on Multicore Clusters: Making Use of Virtual Machines", Journal of Supercomputing, 61(1):27~45, 2012
      • Xuanhua Shi, Hai Jin, Song Wu, Wei Zhu, Li Qi, "Adapting Grid Computing Environments Dependable with Virtual Machines: Design, Implementation and Evaluations", Journal of Supercomputing, DOI: 10.1007/s11227-011-0664-7, 66(3)
      • Hai Jin, Wei Gao, Song Wu, Xuanhua Shi, Xiaoxin Wu, and Fan Zhou, "Optimizing the live migration of virtual machine by CPU scheduling", Journal of Network and Computer Applications, 34(4): 1088-1096, 2011.
      • Xuanhua Shi, and Hai Jin, " ChinaGrid and Related Dependability Research", Grid computing: Infrastructure, technology and service, Taylor and Francis Group LLC - CRC Press, 2009 (ISBN-10: 1420067664)
      • Xuanhua Shi, Jean-Louis Pazat, Eric Rodriguez, Hai Jin, and Hongbo Jiang, "Adapting Grid Applications to Safety using Fault-Tolerant Methods: Design, Implementation and Evaluations", Future Generation Computer Systems, 26(2): 236~244, 2010
      • Yongcai Tao, Hai Jin, Song Wu, and Xuanhua Shi, "Scalable DHT- and ontology-based information service for large-scale grids", Future Generation Computer Systems, 26 (5): 729-739 , 2010

    Invited Talks

    • Gearing Hadoop towards HPC systems, HPC Advisory Council China Workshop 2014, Guangzhou, 2014 (Invited Talk)
    • China Big Data and HPC Initiatives Overview, The 2016 workshop on Big Data and Extreme-scale Computing (BDEC), Frankfurt, 2016 (Invited Talk)
    • In-memory computing: an efficient processing paradigm for big data, Northeast University, 2016 (Invited Talk)
    • Sunway TaihuLight Storage Systems, The International Workshop on HPC Architecture, Software, and Application at an Extreme Scale, Wuxi, 2016 (Invited Talk)
    • Design for Data Intensive Applications at Large Scale, International Workshop on Co-Design, Xi An, 2016 (Invited Talk)
    • Life-time based memory management for distributed data processing, National Supercomputing Center in Guangzhou, 2016 (Invtied Talk)
    • Gabage collection optimization for in-memory data processing, Shenzhen University, 2017 (Invited Talk)

    Awards

    • The Wuhan Chenguang Program, 2010
    • ISC Student Cluster Challenge, HUST Mentor, 2013, Highest LINPACK award
    • ASC Student Supercomputer Challenge, HUST Mentor,2013. Best MIC performance award
    • The first China Student RDMA Programming Competition, HUST Advisor, 2013, first prize
    • ASC Student Supercomputer Challenge, HUST Mentor,2016. Overall Champion award
    • ASC Student Supercomputer Challenge, HUST Mentor,2016. E-Prize award
    • ISC Student Cluster Challenge, HUST Mentor, 2016, Highest LINPACK award
    • The fourth Student RDMA Programming Competition, HUST Advisor, 2016, first prize
    • The Execellent Natural Scientific Paper of Hubei Provence, 2016, first prize
    • The Outstanding Youth Foundation of Hubei Province, 2016

    Supervision

    • Master Degree Completed
      • Yu'e Xi,  Processor Load Based Multi-VM Scheduling System, May 2008. [now at CNWP]
      • Dachuan Huang, Hadoop Deployment and Tracing System, Jan. 2011. [now at  Ohio State Univ.]
      • Yuan Li, Deployment and Scaling System for Web Applications in the Cloud, Jan. 2012. [now at NetEase]
      • Bo Xie, Dynamic and Reusable Scheduler for Cloud Infrastructure, Jan. 2012. [now at NetEase]
      • Xibin Wang, Disk I/O Bandwidth Allocation Mechanism of Virtual Machines, Jan. 2012. [now at Baidu]
      • Pu Liu, Academic Evaluation System Based on Graph-theoretical Clustering, Jun. 2012. [now at Baidu]
      • Chencheng Bao, A Study of Routing and Congestion Control Technology in Delay Tolerant Networks, Jul. 2012. [now at Baosteel]
      • Xiaohu Bo, Response Time-based Replica Managemnet Strategy for Cloud Storage, Jan. 2013. [now at IBM]
      • Lixiang Tang, Web Application Online Development System in Clouds, Feb. 2013. [now at Amazon]
      • Yue Xu, Distributed Memory File Caching System for High Performance Computing, May 2013. [Now at WRI]
      • Haohong Lin, A Scalable Distributed Coordination Service on Cloud Platform, May 2013. [now at Intel]
      • Zhiwei Lu, Vehicle Recognition Based on Multi-feature Fusion, May 2013. [now at Standardchartered]
      • Ming Chen, A Distributed Data Processing System for HPC Cluster, Jan. 2014. [now at Alibaba]
      • Genmao Yu, Gearing MapReduce towards Iterative Computing, Jan. 2014. [now at Alibaba]
      • Junling Liang, An Asynchronous Graph Computing System on GPU with Hybrid Coloring Algorithm, Jun. 2015. [now at Alibaba]
      • Yongkang Liu, Predicting Disk Failures for Large-scale Datacenter by Machine-Learning Method, Jun. 2015. [now at Tencent]
      • Binsheng Zhang, Dynamic Cluster Strategy for Hierarchical Rollback-Recovery Protocols, Jun. 2016. [now at China UnionPay]
      • Huiming Lv, Research on Efficient Graph Computing Method and Programming Model in Out-of-core Environment, June. 2017. [now at Baidu China Ltd]
      • Xuan Luo, Communication Optimization for Graph Processing System Based on Multi-GPUs, Jun. 2017. [now at Fiberhome Telecommunication Technologies China Ltd]

    Professional Activities

    • General Co-Chair, BGP'17
    • PC Co-Chair, NPC 2013, ScalCom 2011, CIT 2009, AGPS08
    • PC Member: ICPP'18, CloudCom'17, Cluster'17, ICPP'17, CCGrid'17, SC'16, CCGrid'16, EuroPar'16, Cluster'15,Cluster'14, ICPP'15, NPC'15, NAS'15, P2S2'16, P2S2'15,CloudCom'13,MAPREDUCE'12,VTDC'12, GPC-2012,TrustCom2012, CloudTech-HPC 12,CloudCom'12, MAPREDUCE'11, APSCC'11, CloudCom'11, ChinaGrid'11, MAPREDUCE'10, ISSR-2010, MAPRED'2010, ChinaGrid'10,ISSR-2009, ADIP-08, GPC2008
    • Track Chair, HPCChina'16, HPCChina'17
    • Publicity Chair, Grid'12
    • Publication Chair, NPC'14,ChinaGrid 2009
    • Guest Editor: IJPP
    • Journal reviewer: CSUR, TPDS, TCC, Parallel Computing, CCPE, JoS, FGCS
    • Panelist: SC'15

    Hobbies

    • Music is my favorite,I don't like all kinds,but I'm interested in all
    • Football and tennis

    Other Links


    last updated: 11/10/2016 web page tracking