HalluQA:中文大語言模型幻覺問答基準
OpenMOSS/HalluQA
HalluQA 是一個中文大語言模型幻覺問答基準,提供 450 條精心設計的對抗式問題、數據及評測腳本。評測以非幻覺率為指標,並使用 GPT-4 判斷模型回答是否出現幻覺。基準亦提供多項選擇任務及相應評測腳本。
This repository contains data and evaluation scripts of HalluQA (Chinese Hallucination Question-Answering) benchmark. The full data of HalluQA is in HalluQA.json. The paper introducing HalluQA and detailed experimental results of many Chinese large language models is here.
Update
2024.2.28: We add the multiple-choice task for HalluQA. The test data for multiple-choice task is in HalluQA_mc.json. The multiple-choice QA prompt is in prompts/Chinese_QA_prompt_mc.txt .
Data Collection Pipeline
HalluQA contains 450 meticulously designed adversarial questions, spanning multiple domains, and takes into account Chinese historical culture, customs, and social phenomena. The pipeline of data collection is shown above. At step 1, we write questions which we think may induce model hallucinations. At step 2, we use ChatGPT3.5/Puyu/GLM-130B to generate answers and collect adversarial questions. At step 3, we write multiple correct and wrong answers for each adversarial question and add support evidence. At step 4, we check all annotated question-answer pairs and remove low quality samples.
Data Examples
We show some data examples of HalluQA here.

Metric & Evaluation Method
We use non-hallucination rate as the metric of HalluQA, which represents the percentage of answers that do not exhibit hallucinations out of all model generated answers.
For automated evaluation, we use GPT-4 as the evaluator. GPT-4 will judge whether a generated answer exhibit hallucinations based on the given criterias and reference correct answers.
The prompt for GPT-4 based evaluation is in calculate_metrics.py
Run evaluation for your models
- Install requirements
pip install openai
- Run evaluation using our script.
python calculate_metrics.py --response_file_name gpt-4-0613_responses.json("replace with your own responses") --api_key "your openai api key" --organization "organization of your openai account"
- The results and metric will be saved in results.json and non_hallucination_rate.txt respectively.
Multiple-choice task
We also provide a multiple-choice task for HalluQA. You need to first generate answers for each question using the model to be tested, using our multiple-choice prompt, and then calculate the accuracy of the multiple-choice task using the following script.
python calculate_metrics_mc.py --response_file_name <your_results_file_name>
Results
Leaderboard
Non-hallucination rate of each model for different types of questions:
| Model | Misleading | Misleading-hard | Knowledge | Total |
|---|---|---|---|---|
| Retrieval-Augmented Chat Model | ||||
| ERNIE-Bot | 70.86 | 46.38 | 75.73 | 69.33 |
| Baichuan2-53B | 59.43 | 43.48 | 83.98 | 68.22 |
| ChatGLM-Pro | 64.00 | 34.78 | 67.96 | 61.33 |
| SparkDesk | 59.43 | 27.54 | 71.36 | 60.00 |
| Chat Model | ||||
| abab5.5-chat | 60.57 | 39.13 | 57.77 | 56.00 |
| gpt-4-0613 | 76.00 | 57.97 | 32.04 | 53.11 |
| Qwen-14B-chat | 75.43 | 23.19 | 30.58 | 46.89 |
| Baichuan2-13B-chat | 61.71 | 24.64 | 32.04 | 42.44 |
| Baichuan2-7B-chat | 54.86 | 28.99 | 32.52 | 40.67 |
| gpt-3.5-turbo-0613 | 66.29 | 30.43 | 19.42 | 39.33 |
| Xverse-13B-chat | 65.14 | 23.19 | 22.33 | 39.11 |
| Xverse-7B-chat | 64.00 | 13.04 | 21.84 | 36.89 |
| ChatGLM2-6B | 55.43 | 23.19 | 21.36 | 34.89 |
| Qwen-7B-chat | 55.43 | 14.49 | 17.48 | 31.78 |
| Baichuan-13B-chat | 49.71 | 8.70 | 23.30 | 31.33 |
| ChatGLM-6b | 52.57 | 20.29 | 15.05 | 30.44 |
| Pre-Trained Model | ||||
| Qwen-14B | 54.86 | 23.19 | 24.76 | 36.22 |
| Baichuan2-13B-base | 23.43 | 24.64 | 45.63 | 33.78 |
| Qwen-7B | 48.57 | 20.29 | 16.99 | 29.78 |
| Xverse-13B | 18.86 | 24.64 | 32.52 | 27.33 |
| Baichuan-13B-base | 9.71 | 18.84 | 40.78 | 25.33 |
| Baichuan2-7B-base | 8.00 | 21.74 | 41.26 | 25.33 |
| Baichuan-7B-base | 6.86 | 15.94 | 37.38 | 22.22 |
| Xverse-7B | 12.00 | 13.04 | 29.61 | 20.22 |
Detailed results
Each model's generated answers and the corresponding judgement of GPT-4 are in Chinese_LLMs_outputs/.
Multiple-choice task results
Here we report accuracy of the multiple-choice task for seven representative models.

Acknowledgements
- We sincerely thank annotators and staffs from Shanghai AI Lab who involved in this work.
- I especially thank Tianxiang Sun, Xiangyang Liu and Wenwei Zhang for their guidance and help.
- I am also grateful to Xinyang Pu for her help and patience.
Citation
@article{DBLP:journals/corr/abs-2310-03368, author = {Qinyuan Cheng and Tianxiang Sun and Wenwei Zhang and Siyin Wang and Xiangyang Liu and Mozhi Zhang and Junliang He and Mianqiu Huang and Zhangyue Yin and Kai Chen and Xipeng Qiu}, title = {Evaluating Hallucinations in Chinese Large Language Models}, journal = {CoRR}, volume = {abs/2310.03368}, year = {2023}, url = {https://doi.org/10.48550/arXiv.2310.03368}, doi = {10.48550/arXiv.2310.03368}, eprinttype = {arXiv}, eprint = {2310.03368}, timestamp = {Thu, 19 Oct 2023 13:12:52 +0200}, biburl = {https://dblp.org/rec/journals/corr/abs-2310-03368.bib}, bibsource = {dblp computer science bibliography, https://dblp.org} }
來源:OpenMOSS / 復旦NLP / 上海創智 / MOSI · github.com