何丙胜 & 孙世轩学术报告通知
时间:2024-05-28 09:28:22

时       间:2024年5月30日 上午9:00 – 10:30

地       点:华中科技大学东五楼210学术报告厅

主       题:Rethinking Benchmarks for Machine Learning Systems

嘉       宾:何丙胜 新加坡国立大学  教授  计算机学院副院长


The advent of new machine learning applications presents a unique opportunity to rethink and redesign our benchmarking approaches. This involves re-evaluating how we measure machine learning system performance and abstracting various design factors for these systems. In this presentation, we will discuss our efforts in developing benchmarks tailored to different machine learning applications. First, we have built a benchmark based on distinct design principles for the Non-IID data distributions in federated learning. This benchmark, NIID-Bench (https://github.com/Xtra-Computing/NIID-Bench), is specifically designed to assess model accuracy and other critical aspects of federated learning systems. Second, we have developed a benchmark focusing on real-time feature extractions for online applications, FEBench (https://github.com/decis-bench/febench). Our benchmark studies have yielded numerous intriguing results and insights, particularly in benchmarking machine learning systems. Finally, we will highlight some of the open challenges in creating benchmarks for future machine learning systems.


Dr. Bingsheng He is currently a Professor and Vice-Dean (Research) at School of Computing, National University of Singapore. Before that, he was a faculty member in Nanyang Technological University, Singapore (2010-2016), and held a research position in the System Research group of Microsoft Research Asia (2008-2010), where his major research was building high performance cloud computing systems for Microsoft. He got the Bachelor degree in Shanghai Jiao Tong University (1999-2003), and the Ph.D. degree in Hong Kong University of Science & Technology (2003-2008). His current research interests include cloud computing, database systems and high-performance computing. He has been a winner for industry faculty awards from Microsoft/Google/NVIDIA/Xilinx/Alibaba. His work also won multiple recognitions as “Best papers” collection or awards in top forums such as SIGMOD 2008, VLDB 2013 (demo), IEEE/ACM ICCAD 2017, PACT 2018, IEEE TPDS 2019, FPGA 2021 and VLDB 2023 (industry). Since 2010, he has (co-)chaired a number of international conferences and workshops, including IEEE CloudCom 2014/2015, BigData Congress 2018, ICDCS 2020 and ICDE 2024. He is an ACM Distinguished member (class of 2020).

主       题:面向新兴计算架构的高效图数据处理

嘉       宾:孙世轩  上海交通大学 长聘教轨副教授