Categorical representation learning and RG flow operators for algorithmic classifiers

Sheshmani, Artan and You, Yi-Zhuang and Fu, Wenbo and Azizi, Ahmadreza (2023) Categorical representation learning and RG flow operators for algorithmic classifiers. Machine Learning: Science and Technology, 4 (1). 015012. ISSN 2632-2153

[thumbnail of Sheshmani_2023_Mach._Learn.__Sci._Technol._4_015012.pdf] Text
Sheshmani_2023_Mach._Learn.__Sci._Technol._4_015012.pdf - Published Version

Download (46MB)

Abstract

Following the earlier formalism of the categorical representation learning, we discuss the construction of the 'RG-flow-based categorifier'. Borrowing ideas from the theory of renormalization group (RG) flows in quantum field theory, holographic duality, and hyperbolic geometry and combining them with neural ordinary differential equation techniques, we construct a new algorithmic natural language processing architecture, called the RG-flow categorifier or for short the RG categorifier, which is capable of data classification and generation in all layers. We apply our algorithmic platform to biomedical data sets and show its performance in the field of sequence-to-function mapping. In particular, we apply the RG categorifier to particular genomic sequences of flu viruses and show how our technology is capable of extracting the information from given genomic sequences, finding their hidden symmetries and dominant features, classifying them, and using the trained data to make a stochastic prediction of new plausible generated sequences associated with a new set of viruses which could avoid the human immune system.

Item Type: Article
Subjects: Pustaka Library > Multidisciplinary
Depositing User: Unnamed user with email support@pustakalibrary.com
Date Deposited: 14 Oct 2023 05:41
Last Modified: 14 Oct 2023 05:41
URI: http://archive.bionaturalists.in/id/eprint/1374

Actions (login required)

View Item
View Item