TOPIC> Physics Materials and Devices of Conventional Semiconductors

11 Tera-OPs photonic convolutional accelerator for optical neural networks

Xingyuan Xu1, Mengxi Tan1, Bill Corcoran2, Jiayang Wu1, Andreas Boes3, Thach G. Nguyen3, Sai T. Chu4, Brent E. Little5, Damien G. Hicks1,6, Roberto Morandotti7,8, Arnan Mitchell3, and and David J. Moss1

  • 1. Swinburne University of Technology, Australia; 
  • 2. Monash University, Australia; 
  • 3. RMIT University, Australia; 
  • 4. City University of Hong Kong, China; 
  • 5. Xi’an Institute of Optics and Precision Mechanics Precision Mechanics of CAS, China; 
  • 6. Walter & Eliza Hall Institute of Medical Research, Australia; 
  • 7. INRS-Énergie, Matériaux et Télécommunications, 1650 Boulevard Lionel-Boulet, Varennes, Québec, J3X 1S2, Canada; 
  • 8. Institute of Fundamental and Frontier Sciences, University of Electronic Science and Technology of China, Chengdu 610054, China; 

Corresponding Author: ${correspondingAuthorString}

Abstract: Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric complexity and enhance the predicting accuracy. They are of significant interest for machine learning tasks such as computer vision, speech recognition, playing board games and medical diagnosis [1-7]. Optical neural networks offer the promise of dramatically accelerating computing speed to overcome the inherent bandwidth bottleneck of electronics. Here, we demonstrate a universal optical vector convolutional accelerator operating beyond 10 Tera-FLOPS (floating point operations per second), generating convolutions of images of 250,000 pixels with 8-bit resolution for 10 kernels simultaneously — enough for facial image recognition. We then use the same hardware to sequentially form a deep optical CNN with ten output neurons, achieving successful recognition of full 10 digits with 900 pixel handwritten digit images with 88% accuracy. Our results are based on simultaneously interleaving temporal, wavelength and spatial dimensions enabled by an integrated microcomb source. This approach is scalable and trainable to much more complex networks for demanding applications such as unmanned vehicle and real-time video recognition.

Key words: Microcombs; Neural Networks; Convolutional Accelerator; Photonics; Deep Optical Neural Networks; Ultrahigh speed


Cite as: JOSarXiv.202102.0002


Recommended references: Xingyuan Xu, Mengxi Tan, Bill Corcoran, Jiayang Wu, Andreas Boes, Thach G. Nguyen, Sai T. Chu, Brent E. Little, Damien G. Hicks, Roberto Morandotti, Arnan Mitchell, and David J. Moss . (2021). 11 Tera-OPs photonic convolutional accelerator for optical neural networks. [JOSarXiv.202102.0002]   (Copy)

Version History

[V2] 2021-02-24 09:49:49 JOSarXiv.202102.0002V2Download
[V1] 2021-02-21 07:18:55 JOSarXiv.202102.0002V1Download

Article Metrics

Article views: 135 Times PDF downloads: 6 Times

History

Manuscript received: 24 February 2021

Manuscript published: 24 February 2021

Email This Article

User name:
Email:*请输入正确邮箱
Code:*验证码错误