Chebotar, Y. and Waters, A. (2016) Distilling Knowledge from Ensembles of Neural Networks for Speech Recognition. Inter Speech 2016, San Francisco, 8-12 September 2016, 3439-3443.
https://doi.org/10.21437/interspeech.2016-1190

has been cited by the following article:

• TITLE: Unsupervised Anomaly Detection Algorithm Based on Bidirectional Knowledge Distillation Network

  AUTHORS: Hao Zhong, Shuai Kang, Ao Xiong

  KEYWORDS: Anomaly Detection, Knowledge Distillation, Unsupervised Learning

  JOURNAL NAME: Open Journal of Applied Sciences, Vol.15 No.3, March 21, 2025

  ABSTRACT: Industrial appearance anomaly detection (AD) focuses on accurately identifying and locating abnormal regions in images. However, due to issues such as scarce abnormal samples, complex abnormal manifestations, and difficult abnormal annotation, the detection accuracy is limited. To solve these problems, based on the knowledge distillation framework, this paper proposes an unsupervised anomaly detection algorithm—Bidirectional knowledge distillation AD (BKD). This algorithm combines the advantages of forward and reverse distillation, enabling efficient anomaly detection. Experimental results have shown that the proposed method outperforms the state-of-the-art AD methods by 3% - 8% in AUC on the MVTec benchmarks.