Latest Articles for Model Evaluation

A new benchmark for assessing LLMs in cybersecurity tasks.

This paper proposes new methods to evaluate information fragmentation in machine learning.

This paper introduces an approach for creating easy-to-understand AI classifiers.

This study examines how well pretrained models cluster unseen data.

Introducing new methods to improve forgetting processes in contrastive learning models.

An overview of SVM techniques for handling class imbalance in machine learning.

Tackling the issues of OOD generalization and feature contamination in AI models.

This article explores improvements in sparse autoencoders and their impact on language understanding.

A study on the effectiveness of various lightweight models in image classification.

Introducing a method to evaluate model resilience against data poisoning attacks.

A new benchmark to assess LLMs for Java programming tasks.

This article explores strategies for improving model generalization and understanding gradient behavior.

A toolkit for assessing the safety of advanced language models.

This article analyzes the performance of fine-tuned models versus generative AI in text classification tasks.

This article examines how Visual State Space Models handle visual challenges.

A new data set assesses how LLMs reason with multiple images.

Investigating how LLM predictions align with human choices using statistical modeling.

A new benchmark suite helps assess reasoning shortcuts in artificial intelligence.

A study evaluates language models on handling multiple tasks simultaneously.

A study highlights gaps in reasoning abilities of LLMs for math problem solving.

A fresh method for testing language model safety and multilingual skills.

Methods for identifying important features in low-quality data environments.

New methods reveal challenges in unlearning knowledge from language models.

A study on the decision-making processes of large language models.

A look at how calibration impacts model predictions and reliability.

Long-context language models streamline complex tasks and improve interaction with AI.

A method to evaluate model knowledge through internal processing.

Examining the impact of data contamination on language model performance and evaluation.

This study reveals the limits of text-to-image models in handling numbers.

A new metric improves evaluation of text classification models across different domains.

A deep dive into how well vision models recognize and represent multiple objects.

A study on the effectiveness of OOD detectors against adversarial examples.

Research highlights in-context learning abilities in large language models.

A study highlighting the importance of comprehensive annotations for retrieval evaluation.

A new benchmark highlights the risks of spurious bias in multimodal language models.

Investigating fine-grained feedback for text-to-image models and its practical implications.

New benchmark assesses how video-language models handle inaccuracies effectively.

APIGen generates diverse, high-quality datasets for function-calling agents.

A new method to detect biases in language model training.

SAVE model enhances audio-visual segmentation with efficiency and precision.