Latest Articles for Evaluation

The CHC competition showcased advances in solvers and their applications in program verification.

This study investigates automated systems for providing essay feedback using language models.

Synthetic data provides cost-effective solutions while ensuring privacy and reducing bias.

A new benchmark evaluates language models' understanding of word meanings and relationships.

New metrics improve evaluation of information extraction systems in handwritten documents.

A framework for assessing AI strategies in competitive and cooperative environments.

Assessing the reliability of AI-produced summaries for improved software maintenance.

Examining how ChatGPT impacts healthcare and its potential uses.

DynaMo models generate text faster and with better quality using multi-token prediction.

A new dataset improves the generation of related work sections in scientific papers.

TREC iKAT aims to improve interactions with conversational agents through personalized dialogues.

SCRABLE offers automated solutions for effective app review management.

Assessing the capabilities and challenges of advanced video understanding models.

This study analyzes the effectiveness of LLMs in evaluating AI-generated explanations.

A new framework evaluates how well language models help experts with writing tasks.

PEAVS analyzes how well audio and video work together for better viewer experiences.

A quick way to evaluate DNN performance after new training.

Sparse autoencoders enhance the interpretability of AI systems and their decision-making processes.

A look at how AI models grasp essential knowledge of the world.

New benchmark assesses toxicity in large language models across various languages.

This article discusses the need for better evaluation practices in fuzzing research.

This study assesses saliency methods in NLP through human evaluation.

Introducing PQAH for better understanding of AI heatmaps and their evaluation.

A new method enhances optimization in costly high-dimensional problems.

A new method for assessing language models' alignment with human values.

A new method improves image creation from multiple text prompts.

An overview of behaviors in crowdsourcing communities and their impacts.

This research highlights the need for better evaluation of dialogue systems' use of conversation history.

AdvEval exposes weaknesses in Natural Language Generation evaluation metrics.

New tool converts sketches into clear graphics programs for researchers.

A new method enhances trustworthiness of AI outputs in blockchain environments.

Participants tackle the restoration of degraded images in a competitive setting.

A novel system tracks and recognizes dynamic 3D scenes using a single video.

Evaluating algorithms for effective musical phrase segmentation and structure analysis.

A new method improves how intelligence messages are assessed by prioritizing credibility.

New resources enhance assessment of Korean language models.

This article examines a new way to create algorithms with LLMs.

Learn how seven-valued logic enhances decision-making with multiple criteria.

A challenge focusing on deep generative models for realistic medical image generation.

A model assesses the readability of Wikipedia articles across 14 languages.