Latest Articles for Knowledge Distillation

Computer Vision and Pattern Recognition New Method Improves Brain Blood Vessel Imaging

Researchers develop a new method for analyzing cerebrovascular images using labeled and unlabeled data.

Xi Lin, Shixuan Zhao, Xinxu Wei

2025-05-23T11:59:33+00:00 ― 6 min read

Computation and Language Bridging Knowledge Gaps with FedCoLLM

FedCoLLM connects large and small language models while ensuring privacy and efficiency.

Tao Fan, Yan Kang, Guoqiang Ma

2025-05-20T03:16:00+00:00 ― 7 min read

Computer Vision and Pattern Recognition Knowledge Distillation: Learning Without Limits

Exploring how models can learn without original data.

Logan Frank, Jim Davis

2025-05-18T14:32:00+00:00 ― 5 min read

Computer Vision and Pattern Recognition Knowledge Distillation: Making AI Smarter

A look at how TinTeM improves AI learning with smarter methods.

Evelyn J. Mannix, Liam Hodgkinson, Howard Bondell

2025-05-15T16:26:40+00:00 ― 6 min read

Machine Learning Knowledge Distillation: A New Approach in Machine Learning

Learn how knowledge distillation enhances machine learning model performance.

Pasan Dissanayake, Faisal Hamman, Barproda Halder

2025-05-13T18:26:08+00:00 ― 7 min read

Symbolic Computation Advancements in Multimodal Scientific Computing with Botfip-LLM

Botfip-LLM combines diverse data to enhance understanding in scientific computing.

Tianhao Chen, Pengbo Xu

2025-05-11T06:53:20+00:00 ― 6 min read

Computer Vision and Pattern Recognition MobileMamba: A New Light in Image Processing Models

MobileMamba offers efficient image processing for devices with limited resources.

Haoyang He, Jiangning Zhang, Yuxuan Cai

2025-05-10T13:09:20+00:00 ― 6 min read

Computer Vision and Pattern Recognition MUSE: A Smart Approach to Knowledge Distillation

MUSE offers a new way to train AI models using lower-resolution images.

Minh-Tuan Tran, Trung Le, Xuan-May Le

2025-05-09T19:25:20+00:00 ― 4 min read

Computation and Language Can Students Teach Each Other Better?

Exploring how students learning together can enhance language model training.

Srikrishna Iyer

2025-05-08T17:40:00+00:00 ― 7 min read

Image and Video Processing Improving Video Quality with RTSR Technology

RTSR enhances low-quality videos for a better viewing experience.

Yuxuan Jiang, Jakub Nawała, Chen Feng

2025-05-06T10:09:04+00:00 ― 5 min read

Machine Learning Advancements in EEG Analysis for Mental Health

New techniques improve the analysis of EEG data for diagnosing mental disorders.

Xinxu Wei, Kanhao Zhao, Yong Jiao

2025-05-02T16:50:40+00:00 ― 5 min read

Information Retrieval Revolutionizing Legal Research with QABISAR

QABISAR enhances legal information retrieval, making it accessible for all.

T. Y. S. S. Santosh, Hassan Sarwat, Matthias Grabmair

2025-04-28T03:10:45+00:00 ― 8 min read

Computer Vision and Pattern Recognition Transforming 2D Images into 3D Models

Learn how smaller models are reshaping 3D reconstruction from images.

Aditya Dutt, Ishikaa Lunawat, Manpreet Kaur

2025-04-26T05:52:45+00:00 ― 7 min read

Computer Vision and Pattern Recognition TinyFusion: Transforming Image Generation Efficiently

TinyFusion makes image generation faster without sacrificing quality.

Gongfan Fang, Kunjun Li, Xinyin Ma

2025-04-22T21:20:45+00:00 ― 6 min read

Artificial Intelligence Knowledge-CLIP: A New Ally for Image-Text Matching

Knowledge-CLIP improves image and text alignment through advanced learning strategies.

Kuei-Chun Kao

2025-04-16T21:53:06+00:00 ― 6 min read

Computer Vision and Pattern Recognition Revolutionizing Visual Understanding with Semantic Correspondence

Discover how semantic correspondence improves image recognition and tech applications.

Frank Fundel, Johannes Schusterbauer, Vincent Tao Hu

2025-04-16T21:04:57+00:00 ― 6 min read

Machine Learning Revolutionizing Wireless Sensing with CCS

CCS transforms wireless sensing by keeping data safe and adapting to user needs.

Qunhang Fu, Fei Wang, Mengdie Zhu

2025-04-05T12:13:57+00:00 ― 6 min read

Computer Vision and Pattern Recognition Knowledge Distillation: Smarter AI with Less Power

Learn how lightweight AI models retain knowledge efficiently.

Jiaming Lv, Haoyuan Yang, Peihua Li

2025-03-19T04:32:15+00:00 ― 6 min read

Computer Vision and Pattern Recognition Innovative AI Model Detects Oil Spills Faster

New technology improves early detection of oil spills to protect marine life.

Jaeho Moon, Jeonghwan Yun, Jaehyun Kim

2025-03-19T01:19:39+00:00 ― 6 min read

Computer Vision and Pattern Recognition Fast and Beautiful: Image Generation on Mobile

Create stunning images from text on your smartphone easily.

Dongting Hu, Jierun Chen, Xijie Huang

2025-03-17T07:35:51+00:00 ― 6 min read

Computer Vision and Pattern Recognition Revolutionizing Knowledge Distillation with Tailored Coordinate Systems

Learn how TCS improves AI model training efficiency and adaptability.

Junjie Zhou, Ke Zhu, Jianxin Wu

2025-03-16T04:18:45+00:00 ― 7 min read

Computer Vision and Pattern Recognition Revolutionizing Indoor Localization with Knowledge Transfer

New framework improves indoor positioning using knowledge from different environments.

Son Minh Nguyen, Linh Duy Tran, Duc Viet Le

2025-03-13T14:31:12+00:00 ― 7 min read

Computer Vision and Pattern Recognition Can Students Surpass Their Teachers in AI?

Exploring how students can learn better than their teachers in artificial intelligence.

Jianhua Zhang, Yi Gao, Ruyu Liu

2025-03-09T19:50:15+00:00 ― 6 min read

Computation and Language Data Laundering: AI's Hidden Tricks

How AI models can fake their intelligence through manipulation.

Jonibek Mansurov, Akhmed Sakip, Alham Fikri Aji

2025-03-07T18:53:06+00:00 ― 7 min read

Machine Learning ProFe: Transforming Decentralized Learning

Discover how ProFe improves communication in decentralized federated learning.

Pedro Miguel Sánchez Sánchez, Enrique Tomás Martínez Beltrán, Miguel Fernández Llamas

2025-03-06T05:58:12+00:00 ― 7 min read

Machine Learning Revolutionizing Speech Recognition with SpikeSCR

SpikeSCR combines efficiency and accuracy in speech command recognition using spiking neural networks.

Jiaqi Wang, Liutao Yu, Liwei Huang

2025-02-23T21:59:51+00:00 ― 7 min read

Computation and Language How Small Models Learn Big Lessons from AI

New strategies help smaller AI models learn effectively from larger counterparts.

Vijay Goyal, Mustafa Khan, Aprameya Tirupati

2025-02-21T18:38:15+00:00 ― 7 min read

Computer Vision and Pattern Recognition Unlocking the Secrets of Knowledge Distillation

Learn how small models gain strength from their larger mentors.

Gereziher Adhane, Mohammad Mahdi Dehshibi, Dennis Vetter

2025-02-18T11:59:33+00:00 ― 7 min read

Software Engineering The Push for Leaner Language Models

Researchers aim to optimize language models to enhance efficiency and reduce costs.

Giordano d'Aloisio, Luca Traini, Federica Sarro

2025-02-17T03:53:33+00:00 ― 7 min read

Computation and Language RNNs Make a Comeback in Language Models

RNNs show surprising effectiveness against transformers in low-resource language modeling.

Patrick Haller, Jonas Golde, Alan Akbik

2025-02-08T15:15:18+00:00 ― 7 min read

Machine Learning Shrinking Giants: Efficiency in Language Models

Researchers refine large language models for better efficiency and task focus.

Jorge García-Carrasco, Alejandro Maté, Juan Trujillo

2025-02-07T20:47:51+00:00 ― 7 min read

Image and Video Processing Advancing Medical Image Segmentation: An International Challenge

Innovative tools for medical imaging improve diagnosis and treatment worldwide.

Jun Ma, Feifei Li, Sumin Kim

2025-02-05T00:09:00+00:00 ― 6 min read

Computer Vision and Pattern Recognition Reviving History: Handwritten Text Recognition Breakthrough

HTR technology transforms old manuscripts into accessible machine-readable texts.

Mohammed Hamdan, Abderrahmane Rahiche, Mohamed Cheriet

2025-01-28T03:11:42+00:00 ― 6 min read