Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

74 Open 115 Closed
74 Open 115 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇄1�7 + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Compute BLEU score of a Pandas DataFrame with valid rows filtered
#469 opened Jun 29, 2023 by shivanraptor
Rouge evaluator produced 0 score for the same prediction and reference in Chinese.
#465 opened May 26, 2023 by Whisht
does rouge_score = evaluate.load("rouge") support other languages?
#464 opened May 23, 2023 by lixnvege
1
Merged PR #425 doesn't properly address the issue of passing metric specific kwargs to compute or load
#462 opened May 20, 2023 by christian-storm
How to disable NLTK download information output?
#461 opened May 18, 2023 by yiyualt
1
Evaluate SyntaxError: invalid syntax
#460 opened May 16, 2023 by NLBONU1
Quick tour typos
#457 opened May 8, 2023 by trajepl
Module 'accuracy' doesn't exist on the Hugging Face Hub either.
#456 opened May 6, 2023 by AceCHQ
7
Toxicity Measurement Should Allow GPU Usage
#454 opened May 3, 2023 by dni138
SQuAD v2 is missing the NoAns metrics
#453 opened May 3, 2023 by GitMew
Huggingface bertscore metric GPU leak?
#451 opened Apr 29, 2023 by will-maclean
Metrics that use DownloadConfig not working any more
#449 opened Apr 25, 2023 by BramVanroy
3
combined metrics in evaluators/Suite subtasks
#444 opened Apr 5, 2023 by Vipitis
Progress bar when using evaluator
#442 opened Apr 4, 2023 by zxcej
1
evaluate models loading taking too long
#438 opened Mar 30, 2023 by Akhila-Yerukola
1
Unexpected Keyword when running evaluator on whisper-tiny
#437 opened Mar 28, 2023 by sorgfresser
1
ImportError: To be able to use evaluate-metric/rouge, you need to install the following dependencies['nltk'] using 'pip install # Here to have a nice missing dependency error message early on' for instance'
#434 opened Mar 23, 2023 by shuxiaobo
1
Evaluate LLM models like llama/alpaca using evaluate library?
#433 opened Mar 22, 2023 by Jeffwan
2
Evalaute with safetensors
#431 opened Mar 19, 2023 by akdeniz27
3
Unable to use BLEURT in offline mode
#428 opened Mar 1, 2023 by JohnGiorgi
4
Combined metrics ignore some arguments
#423 opened Feb 16, 2023 by mattjeffryes
4
evaluate/metrics/mean_iou computes recall (sensitivity) instead of IoU
#421 opened Feb 14, 2023 by FlorinAndrei
10
redundant code lines in metric
#420 opened Feb 11, 2023 by FlorinAndrei
1
AttributeError: module 'evaluate' has no attribute 'utils'
#415 opened Feb 7, 2023 by mike-duran-mitchell
4
feature request: Dice metric for segmentation models
#414 opened Feb 5, 2023 by FlorinAndrei
3
ProTip! Exclude everything labeled bug with -label:bug.