Latest Articles for Evaluation

A new method for assessing LLMs aligns with human values.

A new tool to evaluate biases in large vision-language models.

A study evaluates how machines create varied and creative poetry compared to humans.

A new method improves how we assess counter narratives to hate speech.

InternLM-Law enhances responses to diverse Chinese legal questions with advanced training.

Exploring how user profiles improve personalization in language models.

Research shows models struggle with step dependencies in cooking recipes.

This paper presents a method to assess language models across various prompts.

New method addresses regional differences in gender bias evaluation.

M2Lingual dataset improves instruction-following capabilities across various languages.

This article presents a new method for assessing text-to-image models effectively.

This study benchmarks Language Models' performance using Italian INVALSI tests.

RAGBench introduces a comprehensive dataset for evaluating Retrieval-Augmented Generation systems.

Dysca introduces a new way to assess LVLM performance using synthetic data.

A look at modern methods in engineering design for efficiency and performance.

A new approach improves causal event extraction using human-centered evaluation.

Assessing how deferring to human experts affects prediction accuracy in ML models.

Introducing a new method for better solutions in complex engineering and robotics tasks.

A study assessing the quality of datasets for identifying hate speech online.

A new method measures how language models adapt their beliefs with new evidence.

New benchmark improves evaluation of multimodal models by minimizing biases.

GraphArena evaluates LLM performance on graph problems using real-world data.

Explore a fair method for sharing credit in group projects.

A new benchmark for assessing large language models in hypothesis testing.

CRAB enhances testing for language models in real-world environments.

This article examines the impact of temporal changes on information retrieval system evaluations.

Introducing FairMedFM to evaluate the fairness of foundation models in healthcare.

New dataset enhances Arabic language model performance and fosters effective communication.

Studying how quantization affects performance in different languages.

Exploring machine learning models and new datasets for improved security.

A new benchmark addresses challenges in code retrieval for developers.

New methods enhance the trustworthiness of text generated by language models.

A tool to identify misleading answers from large language models.

Discover the importance and challenges of assessing LLM performance effectively.

A look into foundation model leaderboards and their evaluation issues.

The study reveals the bias in AI evaluation tools favoring longer responses.

A new approach enhances the accuracy of language model evaluations.

A new method for selecting diverse languages in natural language processing research.

A new benchmark assesses the temporal reasoning abilities of large language models.

Innovative approach to create effective acquisition functions for Bayesian optimization.