Latest Articles for Benchmark

New benchmarks reveal challenges for MLLMs in real-world tasks with long contexts.

This article explores the bias in code generation models across different languages.

An overview of code hallucinations in LLMs and their impact on software development.

Wake Vision enhances person detection for TinyML with a vast dataset.

This paper discusses the need for explainability in AI text generation models.

New benchmark assesses toxicity in large language models across various languages.

Learn how second order stochastic dominance can enhance your investment strategy.

A new benchmark assesses LLMs' abilities in mathematical modeling processes.

Exploring how GPUs enhance the efficiency of Differential Evolution algorithms.

New benchmark aims to improve AI understanding of text and images.

WeiPer improves out-of-distribution detection in machine learning models using weight adjustments.

This study measures LLMs’ performance in complex math dialogues.

LinkLogic provides clarity and reliability for link prediction in knowledge graphs.

New methods and benchmarks aim to simplify formalizing mathematics through Lean 4.

Recent tests reveal LLMs' weaknesses in simple reasoning despite high benchmark scores.

A new system for assessing language models using real-world data streams.

A new benchmark helps improve GNN performance amid label noise challenges.

Bench2Drive offers a fair evaluation method for autonomous driving technologies.

New methods improve language models' performance on complex reasoning tasks.

A study introduces a new benchmark for prompt performance in creating and retrieving images.

Analyzing existing models reveals insights into language model performance trends as size increases.

A new benchmark to assess LLMs for Java programming tasks.

A new method creates better video captions by focusing on narratives and causality.

A new benchmark tests LLMs' ability to find software vulnerabilities.

A new benchmark assesses multilingual model performance in semantic retrieval tasks.

Discover how CMC-Bench is transforming image compression techniques.

DafnyBench benchmarks software verification tools, paving the way for reliable programming.

A new benchmark aims to assess MLLMs in video understanding across multiple topics.

A new benchmark tests compositional reasoning in advanced models.

A framework to enhance safety in LLM agents across various applications.

A new benchmark assesses how well models understand time and events.

This article examines methods to assess variance in language model evaluation benchmarks.

SEACrowd aims to improve AI representation for Southeast Asian languages and cultures.

A new benchmark helps researchers improve image integrity detection methods.

A study on improving LLMs' problem-solving abilities using a new framework.

A new method enhances testing for language models using real user data.

New methods reveal challenges in unlearning knowledge from language models.

Long-context language models streamline complex tasks and improve interaction with AI.

A new benchmark evaluates reasoning skills in language models.

Examining the advancements in GPU database technology and their performance.