Spiking Neural Networks (SNNs) have been considered a potential competitor to Artificial Neural Networks (ANNs) due to their high biological plausibility and energy efficiency. However, the architecture design of SNN has not been well studied. Previous studies either use ANN architectures or directly search for SNN architectures under a highly constrained search space. In this paper, we aim to introduce much more complex connection topologies to SNNs to further exploit the potential of SNN architectures. To this end, we propose the topology-aware search space, which is the first search space that enables a more diverse and flexible design for both the spatial and temporal topology of the SNN architecture. Then, to efficiently obtain architecture from our search space, we propose the spatio-temporal topology sampling (STTS) algorithm. By leveraging the benefits of random sampling, STTS can yield powerful architecture without the need for an exhaustive search process, making it significantly more efficient than alternative search strategies. Extensive experiments on CIFAR-10, CIFAR-100, and ImageNet demonstrate the effectiveness of our method. Notably, we obtain 70.79% top-1 accuracy on ImageNet with only 4 time steps, 1.79% higher than the second best model. Our code is available under https://github.com/stiger1000/Random-Sampling-SNN.

Center for Data Science Peking University China

National Key Lab of General AI School of Intelligence Science and Technology Peking University China

National Key Lab of General AI School of Intelligence Science and Technology Peking University China; Institute for Artificial Intelligence Peking University China

National Key Lab of General AI School of Intelligence Science and Technology Peking University China; Institute for Artificial Intelligence Peking University China; Peng Cheng Laboratory Shenzhen 518055 China

The Chinese University of Hong Kong Shenzhen China; Shenzhen Research Institute of Big Data Shenzhen 518115 China

Citace poskytuje Crossref.org