Next Meetup Scheduled: A Fast Convolution Algorithm for Accelerating Private Model Inference
on July 27th, 4pm CEST (Paris, FR)
Greetings cryptographers!
This week’s Meetup is scheduled for Thursday, July 27th at 4pm CEST (Paris, FR).
The meetup features Huan-Chih Wang presenting A Fast Convolution Algorithm for Accelerating Private Model Inference.
Here is the link to register:
Abstract
The convolution layer is essential in Convolutional Neural Networks (CNNs); however, it is the main bottleneck during inference because many multiplications are involved. Besides, the burden of computations with encrypted data makes it even more difficult to build applications with CNN regarding privacy concerns. This work aims to accelerate the execution time of the convolutional layers in the encrypted domain. We derive an encryption-domain-friendly convolution algorithm by applying some tricks to reduce the multiplications required for an existing convolution algorithm.
The derived algorithm can process 8000+ images simultaneously, having the same result as the direct convolution algorithm. In other words, it does not affect model accuracy when applied to convolution-based inference tasks. We test the derived algorithm with the MNIST and CIFAR-10 datasets associated with plaintext and ciphertext model parameters. Experimental results justify that the proposed algorithm improves the inference performance, especially with ciphertext model parameters. Compared to the direct convolution algorithm, it saves 40% inference time with the MNIST dataset and nearly 60% with the CIFAR-10 dataset.
About the speakers
Huan-Chih Wang received the B.S. and M.S. degrees in computer science and information engineering (CSIE) from National Cheng Kung University in 2015, and National Taiwan University in 2018, respectively. He is currently a Ph.D. candidate in CSIE at National Taiwan University. His research interests include machine learning and data security and privacy.
Resources from last meetup
You can access resources from the last meetup PARMESAN: Parallel ARithMEticS over ENcrypted data on the FHE.org website here.
Never miss an update
Join the discord server to discuss FHE related topics with the community: discord.fhe.org
See you soon!
The FHE.org team