Files

evaluate

Update README.md

May 28, 2024

54a8ad2 · May 28, 2024

Name		Name	Last commit message	Last commit date
parent directory ..
data_dir		data_dir	add InterLM2_7B eval	Mar 3, 2024
General_evaluation.md		General_evaluation.md	[ADD] add evaluation result of base model on 5/10 epochs	Mar 28, 2024
General_evaluation_EN.md		General_evaluation_EN.md	[ADD] add evaluation result of base model on 5/10 epochs	Mar 28, 2024
InternLM2_7B_chat_eval.py		InternLM2_7B_chat_eval.py	add InternLM2_7B_chat_full eval	Mar 3, 2024
Professional_evaluation.md		Professional_evaluation.md	Update README.md	May 28, 2024
Professional_evaluation_EN.md		Professional_evaluation_EN.md	Update README.md	May 28, 2024
Qwen1_5-0_5B-Chat_eval.py		Qwen1_5-0_5B-Chat_eval.py	add InterLM2_7B eval	Mar 3, 2024
README.md		README.md	Update README.md	Apr 9, 2024
README_EN.md		README_EN.md	Update README_EN.md	Apr 9, 2024
metric.py		metric.py	add InterLM2_7B eval	Mar 3, 2024
qwen_generation_utils.py		qwen_generation_utils.py	add evaluation part	Feb 28, 2024

README.md

EmoLLM评测

通用指标评测

具体评测指标和评测方法见 General_evaluation.md

Model	ROUGE-1	ROUGE-2	ROUGE-L	BLEU-1	BLEU-2	BLEU-3	BLEU-4
Qwen1_5-0_5B-chat	27.23%	8.55%	17.05%	26.65%	13.11%	7.19%	4.05%
InternLM2_7B_chat_qlora	37.86%	15.23%	24.34%	39.71%	22.66%	14.26%	9.21%
InternLM2_7B_chat_full	32.45%	10.82%	20.17%	30.48%	15.67%	8.84%	5.02%
InternLM2_7B_base_qlora_5epoch	41.94%	20.21%	29.67%	42.98%	27.07%	19.33%	14.62%
InternLM2_7B_base_qlora_10epoch	43.47%	22.06%	31.4%	44.81%	29.15%	21.44%	16.72%

专业指标评测

具体评测指标和评测方法见 Professional_evaluation.md

Model	Comprehensiveness	Professionalism	Authenticity	Safety
InternLM2_7B_chat_qlora	1.32	2.20	2.10	1.00
InternLM2_7B_chat_full	1.40	2.45	2.24	1.00
InternLM2_20B_chat_lora	1.42	2.39	2.22	1.00