Deep Tensor Network
Yifan Zhang
In this paper, we delve into the foundational principles of tensor
categories, harnessing the universal property of the tensor product to pioneer
novel methodologies in deep network architectures. Our primary contribution is
the introduction of the Tensor Attention and Tensor Interaction Mechanism, a
groundbreaking approach that leverages the tensor category to enhance the
computational efficiency and the expressiveness of deep networks, and can even
be generalized into the quantum realm.