Latest Articles for Benchmark

A new benchmark helps improve GNN performance amid label noise challenges.

Bench2Drive offers a fair evaluation method for autonomous driving technologies.

New methods improve language models' performance on complex reasoning tasks.

A study introduces a new benchmark for prompt performance in creating and retrieving images.

Analyzing existing models reveals insights into language model performance trends as size increases.

A new benchmark to assess LLMs for Java programming tasks.

A new method creates better video captions by focusing on narratives and causality.

A new benchmark tests LLMs' ability to find software vulnerabilities.

A new benchmark assesses multilingual model performance in semantic retrieval tasks.

Discover how CMC-Bench is transforming image compression techniques.

DafnyBench benchmarks software verification tools, paving the way for reliable programming.

A new benchmark aims to assess MLLMs in video understanding across multiple topics.

A new benchmark tests compositional reasoning in advanced models.

A framework to enhance safety in LLM agents across various applications.

A new benchmark assesses how well models understand time and events.

This article examines methods to assess variance in language model evaluation benchmarks.

SEACrowd aims to improve AI representation for Southeast Asian languages and cultures.

A new benchmark helps researchers improve image integrity detection methods.

A study on improving LLMs' problem-solving abilities using a new framework.

A new method enhances testing for language models using real user data.

New methods reveal challenges in unlearning knowledge from language models.

Long-context language models streamline complex tasks and improve interaction with AI.

A new benchmark evaluates reasoning skills in language models.

Examining the advancements in GPU database technology and their performance.

A new benchmark for machine unlearning enhances evaluation and comparison of methods.

A new method improves code generation accuracy using external documents.

CEBench helps businesses and researchers assess LLMs while managing costs and performance.

Research highlights in-context learning abilities in large language models.

New framework evaluates SLAM performance under challenging conditions.

New benchmark assesses how video-language models handle inaccuracies effectively.

Evaluating how LLMs create persuasive text across various topics.

This study benchmarks Language Models' performance using Italian INVALSI tests.

A benchmark tool advances active learning strategies in machine learning.

This article assesses the effectiveness of large language models in creating hardware assertions.

A new AI system enhances accessibility for users with visual impairments through better screen reading.

A benchmark of minimal pairs aims to improve understanding of Russian grammar by language models.

A new model streamlines data analysis in vast datasets using sketches.

A new benchmark for improving biophysical sequence optimization methods.

This study presents a fresh method for detecting anomalies in various contexts.

New benchmark improves evaluation of multimodal models by minimizing biases.