Skip navigation

BenchCouncil: International Open Benchmark Council

 

BenchCouncil organizes a series of conferences to fulfill its missions: promotes data or benchmark-based quantitative approaches to tackle multi-disciplinary or inter-disciplinary challenges; advances state-of-the-art and state-of-the-practice benchmarks, data, standards, evaluations, and optimizations; Since 2021, all conferences use a double-blind review process to ensure integrity.

Switch to a picture view.

Bench

The Bench conferences are to further the knowledge and understanding of the benchmarks, standards, evaluations, optimizations, and data communities as a whole. Meanwhile, it connects architecture, system, data management, algorithm, and application communities better to co-design for the inherent workload characterizations. Bench takes a hybrid publication model with the TBench journal. The papers that are accepted to present at the Bench conference will appear in the issue of TBench immediately following acceptance.

Bench Steering Committees

Prof. Dr. Jack Dongarra, University of Tennessee

Prof. Dr. Geoffrey Fox, Indiana University

Prof. Dr. D. K. Panda, The Ohio State University

Prof. Dr. Felix, Wolf, TU Darmstadt.

Prof. Dr. Xiaoyi Lu, University of California, Merced

Dr. Wanling Gao, ICT, Chinese Academy of Sciences & UCAS

Prof. Dr. Jianfeng Zhan, ICT, Chinese Academy of Sciences &BenchCouncil

Conference Sites

2021 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'21)

2020 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'20)

2019 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'19)

2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'18)


BenchCouncil Federated Conferences

The BenchCouncil federated conference (FC) fosters multidisciplinary or interdisciplinary communication, collaboration and promotes data or benchmark-based quantitative approaches to tackle multi-disciplinary or inter-disciplinary challenges. FC assembles a spectrum of affiliated research and industry conferences into a week-long joint meeting consisting of several individual conferences. Generally, we cooperate with Springer or BenchCouncil Transactions to publish the accepted papers.

2021 BenchCouncil Federated Intelligent Computing Conferences (BenchCouncil FICC 2021)

2021 BenchCouncil International Symposium on Intelligent Medical Technology (MedTech 21)

2021 BenchCouncil International Symposium on Intelligent Ocean Technology (IOceanTech 21)

2021 BenchCouncil International Symposium on Unmanned Systems Technology (UnmannedTech 21)

2021 BenchCouncil Federated Chips, Computers and Software Conferences (BenchCouncil FCCS 2021)

2021 BenchCouncil International Symposium on Intelligent Computers (IC 21)

2021 BenchCouncil International Symposium on Chips (Chips 21)

2021 BenchCouncil International Symposium on Quantum computers (QC 21)

2021 BenchCouncil International Symposium on Open-source Software (OSS 21)

2021 BenchCouncil Federated Multidisciplinary and Interdisciplinary Conferences (BenchCouncil FMIC 2021)

2021 BenchCouncil International Symposium on Interdisciplinary Science and Technology (IST 21)

2021 BenchCouncil International Symposium on Financial Technology (FinTech 21)

2021 BenchCouncil International Symposium on Blockchain (BChain 21)

2021 BenchCouncil International Symposium on Education Technology (EduTech 21)

2021 BenchCouncil Federated Instruments, Standards, and Computing Conferences (BenchCouncil FISC 2021)

2021 BenchCouncil International Symposium on Evaluation, Simulation, and Test (ESTest 21)

2021 China National Symposium on Benchmarks and Standards (CStandard 21)

2021 BenchCouncil International Symposium on Scientific Instruments, Data, and Computing (SciDC 21)

2020 BenchCouncil International Federated Intelligent Computing and Block Chain Conferences (FICC 2020)

Oct. 30 - Nov. 3, 2020 @ Qingdao, Shandong, China

The goal of FICC 2020 is to foster the communication, collaboration, and interplay among the communities of artificial intelligence, computer sciences, finance, medicine, and education.


Conference lists

Bench: BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing

2021 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'21)

2020 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'20)

2019 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'19)

2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'18)

Chips: BenchCouncil International Symposium on Chips

2021 BenchCouncil International Symposium on Chips (Chips 21)

2020 BenchCouncil International Symposium on Chips (Chips 20)

2019 BenchCouncil International Symposium on Chips (Chips 19)

IC: BenchCouncil International Symposium on Intelligent Computers

2021 BenchCouncil International Symposium on Intelligent Computers (IC 21)

2020 BenchCouncil International Symposium on Intelligent Computers (IC 20)

2019 BenchCouncil International Symposium on Intelligent Computers (IC 19)

QC: BenchCouncil International Symposium on Quantum Computers

2021 BenchCouncil International Symposium on Quantum Computers (QC 21)

MedTech: BenchCouncil International Symposium on Intelligent Medical Technology

2021 BenchCouncil International Symposium on Intelligent Medical Technology (MedTech 21)

2020 BenchCouncil International Symposium on Intelligent Medical Technology (MedTech 20)

IOceanTech: BenchCouncil International Symposium on Intelligent Ocean Technology

2021 BenchCouncil International Symposium on Intelligent Ocean Technology (IOceanTech 21)

UnmannedTech: BenchCouncil International Symposium on Unmanned Systems Technology

2021 BenchCouncil International Symposium on Unmanned Systems Technology (UnmannedTech 21)

FinTech: BenchCouncil International Symposium on Financial Technology

2021 BenchCouncil International Symposium on Financial Technology (FinTech 21)

2020 BenchCouncil International Symposium on Financial Technology (FinTech 20)

BChain: BenchCouncil International Symposium on Blockchain

2021 BenchCouncil International Symposium on Blockchain (BChain 21)

2020 BenchCouncil International Symposium on Blockchain (BChain 20)

EduTech: BenchCouncil International Symposium on Education Technology

2021 BenchCouncil International Symposium on Education Technology (EduTech 21)

2020 BenchCouncil International Symposium on Education Technology (EduTech 20)

ESTest: BenchCouncil International Symposium on Evaluation, Simulation, and Test

2021 BenchCouncil International Symposium on Evaluation, Simulation, and Test (ESTest 21)

2020 BenchCouncil International Symposium on Evaluation, Simulation, and Test (ESTest 20)

CStandard: China National Symposium on Benchmarks and Standards

2021 China National Symposium on Benchmarks and Standards (CStandard 21)

SciDC: BenchCouncil International Symposium on Scientific Instruments, Data, and Computing

2021 BenchCouncil International Symposium on Scientific Instruments, Data, and Computing (SciDC 21)


Proceedings


Past conferences

Powered by Xinxiu, the link https://app.ic3i.com/org/benchcouncil/en/ provides the videos, talks, and pictures of the past conferences.

2020 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'20)

Nov 14-16, 2020 @ Atlanta, Georgia, USA

2020 BenchCouncil International Federated Intelligent Computing and Block Chain Conferences (FICC 2020)

Oct. 30 - Nov. 3, 2020 @ Qingdao, Shandong, China

The goal of FICC 2020 is to foster the communication, collaboration, and interplay among the communities of artificial intelligence, computer sciences, finance, medicine, and education.

The BenchCouncil Big Data and AI online summit

Local organizers:
Beijing Academy of Frontier Sciences and Technology
Shenzhen Institutes of Advanced Technology,Chinese Academy of Science

2019 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'19)

Nov 14-16, 2019 @ Denver, Colorado, USA
Bench'19 proceeding: https://link.springer.com/book/10.1007/978-3-030-49556-5 (published by Springer).

2019 BenchCouncil Symposium on Chips (Chips 2019)

Dec 18-20, 2019 @ Beijing, China

2019 BenchCouncil International Symposium on Intelligent Computers

June 27-29, 2019 @ Shenzhen, China

2018 BenchCouncil International Symposium on Benchmarking, Measuring and Optimizing (Bench'18)

Dec 10-11, 2018 @ Seattle, WA, USA
Bench'18 proceeding: https://www.springer.com/cn/book/9783030328122 (published by Springer).

Workshop Dates Location
BPOE-1 October 7, 2013 IEEE Big Data Conference, San Jose, CA
BPOE-2 October 31, 2013 CCF HPC China, Guilin, China
BPOE-3 December 5,2013 CCF Big Data Technology Conference 2013, BeiJing, China
BPOE-4 March 1, 2014 ASPLOS 2014, Salt Lake City, Utah, USA
BPOE-5 September 5, 2014 VLDB 2014, Hangzhou, Zhejiang Province, China
BPOE-6 Spetember 4th, 2015 VLDB 2015, Hilton, Waikoloa hotel•Kohala Coast, Hawai’i
BPOE-7 April 3, 2016 ASPLOS 2016, Atlanta, Georgia, USA
BPOE-8 April 9, 2017 ASPLOS 2017, Xi’an, China
BPOE-9 March 25, 2018 ASPLOS 2018, Williamsburg, VA, USA
SDBA-1 June 12, 2018 ICS 2018, Beijing, China

BenchCouncil Conference Review Rules

1. The online discussion is blind. While the reviewers discuss the papers, they don’t know others�?identities beyond reviewer #A, #B; hence, a single reviewer cannot easily assert seniority, silence other voices, or influence them beyond the strength of their arguments.

2. When the reviewers point out closeness to prior work that informs the reviewer’s decision to lower the novelty and contribution of a paper, they should provide a full citation to that previous work.

3. When the reviewers are asking authors to draw a comparison with concurrent work (e.g., work that was published or appeared online after the paper submission deadline) or with preliminary work (e.g., a poster or abstract that is not archival), this comparison should not inform a lower score by the reviewer.

4. Provide useful and constructive feedback to the authors. Be respectful, professional, and positive in your reviews and provide suggestions for the authors to improve their work.

5. Score the paper absolutely and relative to the group of papers you are reviewing.
Absolute overall merit - There are 4 grades you can give to each paper for absolute overall merit; the top 2 ratings mean that you think the paper is acceptable to the conference and the bottom 2 ratings mean that in your opinion the paper is below the threshold for the conference. Please assign these values thinking, whether the paper is above the threshold for the conference or below.
Relative overall merit �?is based on the papers that you are reviewing. You can rank your papers and then group the papers into four bins. Except for fractional errors, you should be dividing your papers equally into four categories.

6. Reviewers must treat all submissions as strictly confidential and destroy all papers once the technical program has been finalized.

7. Reviewers must contact the PC chair or EIC if they feel there is an ethical violation of any sort (e.g., authors seeking support for a paper, authors seeking to identify who the reviewers are).

8. Do not actively look for author identities. Reviewers should judge a paper solely on its merits.

9. If you know the authors, do not publicize the authors. If you would like to recuse yourself from the review task, contact the PC Chair.

10. Reviewers should review the current submission. If you have reviewed a previous submission, make sure your review is based on the current submission.

11. Reviewers must not share the papers with students/colleagues.

12. Reviewers must compose the reviews themselves and provide unbiased reviews.

13. Do not solicit external reviews without consulting the PC chairs or EIC. If you regularly involve your students in the review process as part of their Ph.D. training, contact the PC chairs. You are still responsible for the reviews. You may do this on no more than one of your reviews.

14. Reviewers must keep review discussions (including which papers you reviewed) confidential.

15. Do not discuss the content of a submitted paper/reviews with anyone other than officially on the submission management system like HotCRP during the online discussion period or the PC meeting (from now until paper publication in any venue).

16. Do not reveal the name of paper authors in case reviewers happen to be aware of author identity. (Author names of accepted papers will be revealed after the PC meeting; author names of rejected papers will never be revealed.)

17. Do not disclose the outcome of a paper until its authors are notified of its acceptance or rejection.

18. Do not download or acquire material from the review site you do not need access to.

19. Do not disclose the reviews' content, including the reviewers' identities or discussions about a paper.

Acknowledgments:
This set of review ethics is derived and based on the MICRO 2020, ASPLOS 2020-2021, ISCA 2020-21 review guidelines.