Latest Articles for Benchmark

A new benchmark aims to enhance robot training in realistic home settings.

A new benchmarking framework enhances efficiency for evaluating language models.

A fresh approach to improve coding task evaluations for language models.

Research examines the effectiveness of current benchmarks in visualization tasks.

A new framework assesses difficulty in coding tasks for large language models.

Study assesses the reasoning skills of large language models with complex questions.

A new framework for evaluating vision-language models effectively.

Introducing a tool for evaluating unsupervised anomaly detection methods in federated learning.

Evaluating AI models for their ability to follow lab procedures.

A review of recent improvements in model counting tools and their practical applications.

A new benchmark improves evaluation of speech emotion recognition systems across languages and emotions.

This article examines the effectiveness of image-based 3D models in pose estimation.

New benchmarks test AI's causal reasoning using only images.

A new approach to assess LLMs with diverse evaluation sets.

A new benchmark assesses language model agents for handling scientific data analysis.

An analysis of LLMs and their differences from human language acquisition.

Studying how moving cylinders create sound waves in fluids for practical applications.

A new benchmark assesses how LLMs learn through interactions.

O-HuBERT enhances speech recognition by separating content and expressive information.

Introducing PermitQA, a benchmark for evaluating RAG systems in wind energy.

A new method improves speech recognition for Hindi using pseudo-labeling techniques.

A multi-domain benchmark assesses LLMs' code generation abilities across various fields.

A new method tests how AI interprets misleading charts.

A new benchmark project aims to assess Java issue resolution capabilities.

A new approach streamlines safety and helpfulness in language model training.

Improving how machines assist users through better interaction and response measures.

This study examines the effectiveness of LLMs in musicology and their reliability.

A comprehensive tool for evaluating high-performance computing systems.

A system for recording and replaying actions in WebAssembly apps.

Exploring machine learning techniques for efficient VLSI design partitioning.

VisScience tests large models on scientific reasoning using text and images.

OpenACE provides a fair benchmark for assessing audio codecs across various conditions.

Efforts to improve speech technology for the under-resourced Faetar language.

This paper evaluates VLMs' ability to reason about sizes and distances.

Investigating how AI agents reproduce scientific results through a new benchmark.

TDC-2 enhances research in drug development through better data access and multimodal models.

LightSABRE enhances quantum circuit performance with speed and quality improvements.

High energy physics researchers are optimizing software for diverse computing resources.

This approach simplifies choosing effective pretraining datasets for language models.

A new approach to assess AI benchmarks for cultural understanding.