A note on knot Floer homology and fixed points of monodromy. Using an argument of Baldwin Hu Sivek, we prove that if K is a hyperbolic fibered knot with fiber F in a closed, oriented 3 manifold Y , and widehat HFK (Y,K, F , g(F) 1) has rank 1 , then the monodromy of K is freely isotopic to a pseudo Anosov map with no fixed points. In particular, this shows that the monodromy of a hyperbolic L space knot is freely isotopic to a map with no fixed points.


Atomic Motion Induced Quasi Collective Effects in Laser Spectroscopy of Atomic Gases. We develop the theory of propagation of laser wave in a gas of two level atoms (with an optical transition frequency omega 0 ) under the condition of inhomogeneous Doppler broadening, considering the self consistent solution of the Maxwell Bloch equations in the mean field approximation and for one atomic density matrix. The nonlinear effects in the atomic density n , caused by the free motion of atoms, are found. These effects distort the lineshape (shift, asymmetry, broadening), but are not associated with atom atom interaction. Moreover, in the case nk 3 0 1 (where k 0 omega 0 c ) and temperatures T gtrsim 300 K, these quasi collective effects exceed the well known influence of the dipole dipole interatomic interaction (e.g., Lorentz Lorenz shift) by more than one order of magnitude. It was also found that for some area of parameters, the frequency interval appears, within which the non trivial self consistent solution of the Maxwell Bloch equations is absent at all. Thus, the physical picture of collective effects in a gas medium should be substantially revised.


Self supervised Contrastive Learning of Multi view Facial Expressions. Facial expression recognition (FER) has emerged as an important component of human computer interaction systems. Despite recent advancements in FER, performance often drops significantly for non frontal facial images. We propose Contrastive Learning of Multi view facial Expressions (CL MEx) to exploit facial images captured simultaneously from different angles towards FER. CL MEx is a two step training framework. In the first step, an encoder network is pre trained with the proposed self supervised contrastive loss, where it learns to generate view invariant embeddings for different views of a subject. The model is then fine tuned with labeled data in a supervised setting. We demonstrate the performance of the proposed method on two multi view FER datasets, KDEF and DDCF, where state of the art performances are achieved. Further experiments show the robustness of our method in dealing with challenging angles and reduced amounts of labeled data.


Hausdorff dimension of sets with restricted, slowly growing partial quotients. I. J. Good (1941) showed that the set of irrational numbers in (0,1) whose partial quotients a n tend to infinity is of Hausdorff dimension 1 2 . A number of related results impose restrictions of the type a n in B or a n geq f(n) , where B is an infinite subset of mathbb N and f is a rapidly growing function with n . We show that, for an arbitrary B and an arbitrary f with values in min B, infty) and tending to infinity, the set of irrational numbers in (0,1) such that a n in B, a n leq f(n) text for all n in mathbb N , and a n to infty text as n to infty is of Hausdorff dimension tau(B) 2, where tau(B) is the exponent of convergence of B .


Automated Machine Learning Techniques for Data Streams. Automated machine learning techniques benefited from tremendous research progress in recently. These developments and the continuous growing demand for machine learning experts led to the development of numerous AutoML tools. However, these tools assume that the entire training dataset is available upfront and that the underlying distribution does not change over time. These assumptions do not hold in a data stream mining setting where an unbounded stream of data cannot be stored and is likely to manifest concept drift. Industry applications of machine learning on streaming data become more popular due to the increasing adoption of real time streaming patterns in IoT, microservices architectures, web analytics, and other fields. The research summarized in this paper surveys the state of the art open source AutoML tools, applies them to data collected from streams, and measures how their performance changes over time. For comparative purposes, batch, batch incremental and instance incremental estimators are applied and compared. Moreover, a meta learning technique for online algorithm selection based on meta feature extraction is proposed and compared while model replacement and continual AutoML techniques are discussed. The results show that off the shelf AutoML tools can provide satisfactory results but in the presence of concept drift, detection or adaptation techniques have to be applied to maintain the predictive accuracy over time.


Maximum Principle and Asymptotic Properties of Hermite Pad 'e Polynomials. In the paper, we discuss how it would be possible to succeed in Stahl's novel approach, 1987 1988, to explore Hermite Pad 'e polynomials based on Riemann surface properties. In particular, we explore the limit zero distribution of type I Hermite Pad 'e polynomials Q n,0 ,Q n,1 ,Q n,2 , operatorname deg Q n,j leq n , for a collection of three analytic elements 1,f infty,f 2 infty . The element f infty is an element of a function f from the class mathbb C(z,w) where w is supposed to be from the class Z pm1 2 ( 1,1 ) of multivalued analytic functions generated by the inverse Zhukovskii function with the exponents from the set pm1 2 . The Riemann surface corresponding to f in mathbb C(z,w) is a four sheeted Riemann surface mathfrak R 4(w) and all branch points of f are of the first order (i.e., all branch points are of square root type). Since the algebraic function f in mathbb C(z,w) is of fourth order and we consider the triple of the analytic elements 1,f infty,f 2 infty but not the quadruple 1,f infty,f 2 infty,f 3 infty ones, the result is new and does not follow from the known results. As in previous paper arXiv 2108.00339 and following to Stahl's ideas, 1987 1988, we do not use the orthogonality relations at all. The proof is based on the maximum principle only.


A vanishing theorem for quadratic intersection multiplicities. We study intersection theoretic problems in the setting of Chow Witt groups with coefficients in a fixed Milnor Witt cycle algebra over a perfect field. We prove that the product maps on such groups satisfy the following property given two points in a regular local scheme with supports which do not intersect properly, their product vanishes. This gives an analogue of Serre's vanishing result for intersection multiplicities.


Nonsmooth mean field games with state constraints. In this paper, we consider a mean field game model inspired by crowd motion where agents aim to reach a closed set, called target set, in minimal time. Congestion phenomena are modeled through a constraint on the velocity of an agent that depends on the average density of agents around their position. The model is considered in the presence of state constraints roughly speaking, these constraints may model walls, columns, fences, hedges, or other kinds of obstacles at the boundary of the domain which agents cannot cross. After providing a more detailed description of the model, the paper recalls some previous results on the existence of equilibria for such games and presents the main difficulties that arise due to the presence of state constraints. Our main contribution is to show that equilibria of the game satisfy a system of coupled partial differential equations, known mean field game system, thanks to recent techniques to characterize optimal controls in the presence of state constraints. These techniques not only allow to deal with state constraints but also require very few regularity assumptions on the dynamics of the agents.


PointCLIP Point Cloud Understanding by CLIP. Recently, zero shot and few shot learning via Contrastive Vision Language Pre training (CLIP) have shown inspirational performance on 2D visual recognition, which learns to match images with their corresponding texts in open vocabulary settings. However, it remains under explored that whether CLIP, pre trained by large scale image text pairs in 2D, can be generalized to 3D recognition. In this paper, we identify such a setting is feasible by proposing PointCLIP, which conducts alignment between CLIP encoded point cloud and 3D category texts. Specifically, we encode a point cloud by projecting it into multi view depth maps without rendering, and aggregate the view wise zero shot prediction to achieve knowledge transfer from 2D to 3D. On top of that, we design an inter view adapter to better extract the global feature and adaptively fuse the few shot knowledge learned from 3D into CLIP pre trained in 2D. By just fine tuning the lightweight adapter in the few shot settings, the performance of PointCLIP could be largely improved. In addition, we observe the complementary property between PointCLIP and classical 3D supervised networks. By simple ensembling, PointCLIP boosts baseline's performance and even surpasses state of the art models. Therefore, PointCLIP is a promising alternative for effective 3D point cloud understanding via CLIP under low resource cost and data regime. We conduct thorough experiments on widely adopted ModelNet10, ModelNet40 and the challenging ScanObjectNN to demonstrate the effectiveness of PointCLIP. The code is released at https github.com ZrrSkywalker PointCLIP.


Iterative Decoding for Compositional Generalization in Transformers. Deep learning models generalize well to in distribution data but struggle to generalize compositionally, i.e., to combine a set of learned primitives to solve more complex tasks. In sequence to sequence (seq2seq) learning, transformers are often unable to predict correct outputs for longer examples than those seen at training. This paper introduces iterative decoding, an alternative to seq2seq that (i) improves transformer compositional generalization in the PCFG and Cartesian product datasets and (ii) evidences that, in these datasets, seq2seq transformers do not learn iterations that are not unrolled. In iterative decoding, training examples are broken down into a sequence of intermediate steps that the transformer learns iteratively. At inference time, the intermediate outputs are fed back to the transformer as intermediate inputs until an end of iteration token is predicted. We conclude by illustrating some limitations of iterative decoding in the CFQ dataset.


The consequences of non differentiable angular dispersion in optics Tilted pulse fronts versus space time wave packets. Conventional diffractive and dispersive devices introduce angular dispersion (AD) into pulsed optical fields thus producing so called 'tilted pulse fronts'. Naturally, it is always assumed that the functional form of the wavelength dependent propagation angle associated with AD is differentiable with respect to wavelength. Recent developments in the study of space time wave packets pulsed beams in which the spatial and temporal degrees of freedom are inextricably intertwined have pointed to the existence of non differentiable AD field configurations in which the propagation angle does not possess a derivative at some wavelength. Here we investigate the consequences of introducing non differentiable AD into a pulsed field and show that it is the crucial ingredient required to realize group velocities that deviate from c (the speed of light in vacuum) along the propagation axis in free space. In contrast, the on axis phase and group velocities are always equal in conventional scenarios. Furthermore, we show that non differentiable AD is needed for realizing anomalous or normal group velocity dispersion along the propagation axis, while simultaneously suppressing all higher order dispersion terms. These and several other consequences of non differentiable AD are verified experimentally using a pulsed beam shaper capable of introducing AD with arbitrary spectral profile. Rather than being an exotic phenomenon, non differentiable AD is an accessible, robust, and versatile resource for sculpting pulsed optical fields.


Robust Vision Based Cheat Detection in Competitive Gaming. Game publishers and anti cheat companies have been unsuccessful in blocking cheating in online gaming. We propose a novel, vision based approach that captures the final state of the frame buffer and detects illicit overlays. To this aim, we train and evaluate a DNN detector on a new dataset, collected using two first person shooter games and three cheating software. We study the advantages and disadvantages of different DNN architectures operating on a local or global scale. We use output confidence analysis to avoid unreliable detections and inform when network retraining is required. In an ablation study, we show how to use Interval Bound Propagation to build a detector that is also resistant to potential adversarial attacks and study its interaction with confidence analysis. Our results show that robust and effective anti cheating through machine learning is practically feasible and can be used to guarantee fair play in online gaming.


Identification of Bias Against People with Disabilities in Sentiment Analysis and Toxicity Detection Models. Sociodemographic biases are a common problem for natural language processing, affecting the fairness and integrity of its applications. Within sentiment analysis, these biases may undermine sentiment predictions for texts that mention personal attributes that unbiased human readers would consider neutral. Such discrimination can have great consequences in the applications of sentiment analysis both in the public and private sectors. For example, incorrect inferences in applications like online abuse and opinion analysis in social media platforms can lead to unwanted ramifications, such as wrongful censoring, towards certain populations. In this paper, we address the discrimination against people with disabilities, PWD, done by sentiment analysis and toxicity classification models. We provide an examination of sentiment and toxicity analysis models to understand in detail how they discriminate PWD. We present the Bias Identification Test in Sentiments (BITS), a corpus of 1,126 sentences designed to probe sentiment analysis models for biases in disability. We use this corpus to demonstrate statistically significant biases in four widely used sentiment analysis tools (TextBlob, VADER, Google Cloud Natural Language API and DistilBERT) and two toxicity analysis models trained to predict toxic comments on Jigsaw challenges (Toxic comment classification and Unintended Bias in Toxic comments). The results show that all exhibit strong negative biases on sentences that mention disability. We publicly release BITS Corpus for others to identify potential biases against disability in any sentiment analysis tools and also to update the corpus to be used as a test for other sociodemographic variables as well.


The Galerkin analysis for the random periodic solution of semilinear stochastic evolution equations. In this paper we study the numerical method for approximating the random periodic solution of semiliear stochastic evolution equations. The main challenge lies in proving a convergence over an infinite time horizon while simulating infinite dimensional objects. We first show the existence and uniqueness of the random periodic solution to the equation as the limit of the pull back flows of the equation, and observe that its mild form is well defined in the intersection of a family of decreasing Hilbert spaces. Then we propose a Galerkin type exponential integrator scheme and establish its convergence rate of the strong error to the mild solution, where the order of convergence directly depends on the space (among the family of Hilbert spaces) for the initial point to live. We finally conclude with the best order of convergence that is arbitrarily close to 0.5.


Thermodynamics education for energy transformation a Stirling Engine experiment. We present a thermodynamics experiment suitable for first year undergraduate students employing Stirling Engines to create a demonstration of energy transformation and to measure the mechanical efficiency of such engines. Using an inexpensive transparent chambered Stirling Engine, students can connect concepts such as the theoretical pressure volume diagram with the physical movements of the engine's pistons and the resultant useful output work of a spinning wheel. We found the majority of students successfully complete this experiment obtaining results similar to when performed by the authors. In addition to the core thermodynamics lesson, this experiment incorporates DC circuits, oscilloscopes, and data analysis so it can be integrated into a wider undergraduate physics course to combine the teaching of multiple subjects.


PixMix Dreamlike Pictures Comprehensively Improve Safety Measures. In real world applications of machine learning, reliable and safe systems must consider measures of performance beyond standard test set accuracy. These other goals include out of distribution (OOD) robustness, prediction consistency, resilience to adversaries, calibrated uncertainty estimates, and the ability to detect anomalous inputs. However, improving performance towards these goals is often a balancing act that today's methods cannot achieve without sacrificing performance on other safety axes. For instance, adversarial training improves adversarial robustness but sharply degrades other classifier performance metrics. Similarly, strong data augmentation and regularization techniques often improve OOD robustness but harm anomaly detection, raising the question of whether a Pareto improvement on all existing safety measures is possible. To meet this challenge, we design a new data augmentation strategy utilizing the natural structural complexity of pictures such as fractals, which outperforms numerous baselines, is near Pareto optimal, and roundly improves safety measures.


Controlling arrival and service rates to reduce sensitivity of queueing systems with customer abandonment. The Erlang A model an M M s queue with exponential abandonment is often used to represent a service system with impatient customers. For this system, the popular square root staffing rule determines the necessary staffing level to achieve the desirable QED (quality and efficiency driven) service regime however, the rule also implies that properties of large systems are highly sensitive to parameters. We reveal that the origin of this high sensitivity is due to the operation of large systems at a point of singularity in a phase diagram of service regimes. We can avoid this singularity by implementing a congestion based control (CBC) scheme a scheme that allows the system to change its arrival and service rates under congestion. We analyze a modified Erlang A model under the CBC scheme using a Markov chain decomposition method, derive non asymptotic and asymptotic normal representations of performance indicators, and confirm that the CBC scheme makes large systems less sensitive than the original Erlang A model.


The tropical symplectic Grassmannian. We launch the study of the tropicalization of the symplectic Grassmannian, that is, the space of all linear subspaces that are isotropic with respect to a fixed symplectic form. We formulate tropical analogues of several equivalent characterizations of the symplectic Grassmannian and determine all implications between them. In the process, we show that the Pl "ucker and symplectic relations form a tropical basis if and only if the rank is at most 2. We provide plenty of examples that show that several features of the symplectic Grassmannian do not hold after tropicalizing. We show exactly when do conormal fans of matroids satisfy these characterizations, as well as doing the same for a non constant coefficient generalization. Finally, we propose several directions to extend the study of the tropical symplectic Grassmannian.


Selecting a Match Exploration vs Decision. In a dynamic matching market, such as a marriage or job market, how should agents balance accepting a proposed match with the cost of continuing their search? We consider this problem in a discrete setting, in which agents have cardinal values and finite lifetimes, and proposed matches are random. We seek to quantify how well the agents can do. We provide upper and lower bounds on the collective losses of the agents, with a polynomially small failure probability, where the notion of loss is with respect to a plausible baseline we define. These bounds are tight up to constant factors. We highlight two aspects of this work. First, in our model, agents have a finite time in which to enjoy their matches, namely the minimum of their remaining lifetime and that of their partner this implies that unmatched agents become less desirable over time, and suggests that their decision rules should change over time. Second, we use a discrete rather than a continuum model for the population. The discreteness causes variance which induces localized imbalances in the two sides of the market. One of the main technical challenges we face is to bound these imbalances. In addition, we present the results of simulations on moderate sized problems for both the discrete and continuum versions. For these size problems, there are substantial ongoing fluctuations in the discrete setting whereas the continuum version converges reasonably quickly.


Coupled Torsional and Transverse Vibration Analysis of Panels Partially Supported by Elastic Beam. This study presents torsional and transverse vibration analysis of a solar panel including a rectangular thin plate locally supported by an elastic beam. The plate is totally free in all boundaries, except for the local part attached to the beam. The response of the system, which is subjected to a combination of torsional and transverse vibration, identifies with a couple of PDEs developed by the Euler Bernoulli assumption and classical plate theory. To calculate the system's natural frequencies, the domain of the solution is discretized by zeroes of the Chebyshev polynomials to apply the Modified Generalized Differential Quadrature method (MGDQ). Furthermore, governing equations along with continuity and boundary conditions are discretized. After obtaining solutions to the eigenvalue problem, several studies are investigated to validate the accuracy of the proposed method. As can be concluded from the tables, MGDQ improves the accuracy of results obtained by GDQ. Results for various case studies reveal that MGDQ is properly devised for the vibration analysis of systems with local boundary and continuity conditions.


A Style and Semantic Memory Mechanism for Domain Generalization. Mainstream state of the art domain generalization algorithms tend to prioritize the assumption on semantic invariance across domains. Meanwhile, the inherent intra domain style invariance is usually underappreciated and put on the shelf. In this paper, we reveal that leveraging intra domain style invariance is also of pivotal importance in improving the efficiency of domain generalization. We verify that it is critical for the network to be informative on what domain features are invariant and shared among instances, so that the network sharpens its understanding and improves its semantic discriminative ability. Correspondingly, we also propose a novel "jury" mechanism, which is particularly effective in learning useful semantic feature commonalities among domains. Our complete model called STEAM can be interpreted as a novel probabilistic graphical model, for which the implementation requires convenient constructions of two kinds of memory banks semantic feature bank and style feature bank. Empirical results show that our proposed framework surpasses the state of the art methods by clear margins.


Monitoring Over the Long Term Intermittent Deployment and Sensing Strategies for Multi Robot Teams. In this paper, we formulate and solve the intermittent deployment problem, which yields strategies that couple emph when heterogeneous robots should sense an environmental process, with where a deployed team should sense in the environment. As a motivation, suppose that a spatiotemporal process is slowly evolving and must be monitored by a multi robot team, e.g., unmanned aerial vehicles monitoring pasturelands in a precision agriculture context. In such a case, an intermittent deployment strategy is necessary as persistent deployment or monitoring is not cost efficient for a slowly evolving process. At the same time, the problem of where to sense once deployed must be solved as process observations yield useful feedback for determining effective future deployment and monitoring decisions. In this context, we model the environmental process to be monitored as a spatiotemporal Gaussian process with mutual information as a criterion to measure our understanding of the environment. To make the sensing resource efficient, we demonstrate how to use matroid constraints to impose a diverse set of homogeneous and heterogeneous constraints. In addition, to reflect the cost sensitive nature of real world applications, we apply budgets on the cost of deployed heterogeneous robot teams. To solve the resulting problem, we exploit the theories of submodular optimization and matroids and present a greedy algorithm with bounds on sub optimality. Finally, Monte Carlo simulations demonstrate the correctness of the proposed method.


Ethically aligned Deep Learning Unbiased Facial Aesthetic Prediction. Facial beauty prediction (FBP) aims to develop a machine that automatically makes facial attractiveness assessment. In the past those results were highly correlated with human ratings, therefore also with their bias in annotating. As artificial intelligence can have racist and discriminatory tendencies, the cause of skews in the data must be identified. Development of training data and AI algorithms that are robust against biased information is a new challenge for scientists. As aesthetic judgement usually is biased, we want to take it one step further and propose an Unbiased Convolutional Neural Network for FBP. While it is possible to create network models that can rate attractiveness of faces on a high level, from an ethical point of view, it is equally important to make sure the model is unbiased. In this work, we introduce AestheticNet, a state of the art attractiveness prediction network, which significantly outperforms competitors with a Pearson Correlation of 0.9601. Additionally, we propose a new approach for generating a bias free CNN to improve fairness in machine learning.


Actively Learning Concepts and Conjunctive Queries under ELr Ontologies. We consider the problem to learn a concept or a query in the presence of an ontology formulated in the description logic ELr, in Angluin's framework of active learning that allows the learning algorithm to interactively query an oracle (such as a domain expert). We show that the following can be learned in polynomial time (1) EL concepts, (2) symmetry free ELI concepts, and (3) conjunctive queries (CQs) that are chordal, symmetry free, and of bounded arity. In all cases, the learner can pose to the oracle membership queries based on ABoxes and equivalence queries that ask whether a given concept query from the considered class is equivalent to the target. The restriction to bounded arity in (3) can be removed when we admit unrestricted CQs in equivalence queries. We also show that EL concepts are not polynomial query learnable in the presence of ELI ontologies.


DexDeepFM Ensemble Diversity Enhanced Extreme Deep Factorization Machine Model. Predicting user positive response (e.g., purchases and clicks) probability is a critical task in Web applications. To identify predictive features from raw data, the state of the art extreme deep factorization machine model (xDeepFM) introduces a new interaction network to leverage feature interactions at the vector wise level explicitly. However, since each hidden layer in the interaction network is a collection of feature maps, it can be viewed essentially as an ensemble of different feature maps. In this case, only using a single objective to minimize the prediction loss may lead to overfitting and generate correlated errors. In this paper, an ensemble diversity enhanced extreme deep factorization machine model (DexDeepFM) is proposed, which designs the ensemble diversity measure in each hidden layer and considers both ensemble diversity and prediction accuracy in the objective function. In addition, the attention mechanism is introduced to discriminate the importance of ensemble diversity measures with different feature interaction orders. Extensive experiments on three public real world datasets are conducted to show the effectiveness of the proposed model.


Influencing the Influencers Evaluating Person to Person Influence on Social Networks Using Granger Causality. We introduce a novel method for analyzing person to person content influence on Twitter. Using an Ego Alter framework and Granger Causality, we examine President Donald Trump (the Ego) and the people he retweets (Alters) as a case study. We find that each Alter has a different scope of influence across multiple topics, different magnitude of influence on a given topic, and the magnitude of a single Alter's influence can vary across topics. This work is novel in its focus on person to person influence and content based influence. Its impact is two fold (1) identifying "canaries in the coal mine" who could be observed by misinformation researchers or platforms to identify misinformation narratives before super influencers spread them to large audiences, and (2) enabling digital marketing targeted toward upstream Alters of super influencers.


Multitask Balanced and Recalibrated Network for Medical Code Prediction. Human coders assign standardized medical codes to clinical documents generated during patients' hospitalization, which is error prone and labor intensive. Automated medical coding approaches have been developed using machine learning methods such as deep neural networks. Nevertheless, automated medical coding is still challenging because of the imbalanced class problem, complex code association, and noise in lengthy documents. To solve these issues, we propose a novel neural network called Multitask Balanced and Recalibrated Neural Network. Significantly, the multitask learning scheme shares the relationship knowledge between different code branches to capture the code association. A recalibrated aggregation module is developed by cascading convolutional blocks to extract high level semantic features that mitigate the impact of noise in documents. Also, the cascaded structure of the recalibrated module can benefit the learning from lengthy notes. To solve the class imbalanced problem, we deploy the focal loss to redistribute the attention of low and high frequency medical codes. Experimental results show that our proposed model outperforms competitive baselines on a real world clinical dataset MIMIC III.


Tverberg's theorem for cell complexes. The topological Tverberg theorem states that any continuous map of a (d 1)(r 1) simplex into the Euclidean d space maps some points from r pairwise disjoint faces of the simplex to the same point whenever r is a prime power. We substantially generalize this theorem to continuous maps of certain CW complexes, including simplicial ((d 1)(r 1) 1) spheres, into the Euclidean d space. We also discuss the atomicity of the Tverberg property.


Global well posedness to stochastic reaction diffusion equations on the real line mathbb R with superlinear drifts driven by multiplicative space time white noise. Consider the stochastic reaction diffusion equation with logarithmic nonlinearity driven by space time white noise begin align label 1.a left begin aligned mathrm d u(t,x) frac 1 2 Delta u(t,x) , mathrm d t b(u(t,x)) , mathrm d t nonumber sigma(u(t,x)) ,W( mathrm d t, mathrm d x), t 0, x in I , u(0,x) u 0(x), quad x in I . nonumber end aligned right. end align When I is a compact interval, say I 0,1 , the well posedness of the above equation was established in DKZ (Ann. Prob. 47 1,2019). The case where I mathbb R was left open. The essential obstacle is caused by the explosion of the supremum norm of the solution, sup x in mathbb R u(t,x) infty , making the usual truncation procedure invalid. In this paper, we prove that there exists a unique global solution to the stochastic reaction diffusion equation on the whole real line mathbb R with logarithmic nonlinearity. Because of the nature of the nonlinearity, to get the uniqueness, we are forced to work with the first order moment of the solutions on the space C tem ( mathbb R ) with a specially designed norm sup t leq T, x in mathbb R left( u(t,x) e lambda x e beta t right), where, unlike the usual norm in C tem ( mathbb R ) , the exponent also depends on time t in a particular way. Our approach depends heavily on the new, precise lower order moment estimates of the stochastic convolution and a new type of Gronwall's inequalities we obtained, which are of interest on their own right.


Sharp estimates for the Gaussian torsional rigidity with Robin boundary conditions. In this paper we provide a comparison result between the solutions to the torsion problem for the Hermite operator with Robin boundary conditions and the one of a suitable symmetrized problem.


The Horn Non Clausal Class and its Polynomiality. The expressiveness of propositional non clausal (NC) formulas is exponentially richer than that of clausal formulas. Yet, clausal efficiency outperforms non clausal one. Indeed, a major weakness of the latter is that, while Horn clausal formulas, along with Horn algorithms, are crucial for the high efficiency of clausal reasoning, no Horn like formulas in non clausal form had been proposed. To overcome such weakness, we define the hybrid class mathbb H NC of Horn Non Clausal (Horn NC) formulas, by adequately lifting the Horn pattern to NC form, and argue that mathbb H NC , along with future Horn NC algorithms, shall increase non clausal efficiency just as the Horn class has increased clausal efficiency. Secondly, we (i) give the compact, inductive definition of mathbb H NC (ii) prove that syntactically mathbb H NC subsumes the Horn class but semantically both classes are equivalent, and (iii) characterize the non clausal formulas belonging to mathbb H NC . Thirdly, we define the Non Clausal Unit Resolution calculus, UR NC , and prove that it checks the satisfiability of mathbb H NC in polynomial time. This fact, to our knowledge, makes mathbb H NC the first characterized polynomial class in NC reasoning. Finally, we prove that mathbb H NC is linearly recognizable, and also that it is both strictly succincter and exponentially richer than the Horn class. We discuss that in NC automated reasoning, e.g. satisfiability solving, theorem proving, logic programming, etc., can directly benefit from mathbb H NC and UR NC and that, as a by product of its proved properties, mathbb H NC arises as a new alternative to analyze Horn functions and implication systems.


An Upper Confidence Bound for Simultaneous Exploration and Exploitation in Heterogeneous Multi Robot Systems. Heterogeneous multi robot systems are advantageous for operations in unknown environments because functionally specialised robots can gather environmental information, while others perform tasks. We define this decomposition as the scout task robot architecture and show how it avoids the need to explicitly balance exploration and exploitation by permitting the system to do both simultaneously. The challenge is to guide exploration in a way that improves overall performance for time limited tasks. We derive a novel upper confidence bound for simultaneous exploration and exploitation based on mutual information and present a general solution for scout task coordination using decentralised Monte Carlo tree search. We evaluate the performance of our algorithms in a multi drone surveillance scenario in which scout robots are equipped with low resolution, long range sensors and task robots capture detailed information using short range sensors. The results address a new class of coordination problem for heterogeneous teams that has many practical applications.


Ventricle features as reliable differentiators between the bvFTD and other dementias. INTRODUCTION Lateral ventricles are reliable and sensitive indicators of brain atrophy and disease progression in behavioral variant frontotemporal dementia (bvFTD). We aimed to investigate whether an automated tool using ventricular features could improve diagnostic accuracy in bvFTD across neurodegenerative diseases. METHODS Using 678 subjects (2750 timepoints), differences in ventricular features were assessed between bvFTD, normal controls and other dementia cohorts. RESULTS Ventricular antero posterior ratio (APR) was the only feature that was significantly different and increased faster in bvFTD compared to all other cohorts. We achieved a 10 fold cross validation accuracy of 80 (77 sensitivity, 82 specificity) in differentiating bvFTD from all other cohorts with ventricular features, and 76 accuracy using only the single APR feature. DISCUSSION APR could be a useful and easy to implement feature to aid bvFTD diagnosis. We have made our ventricle feature estimation and bvFTD diagnostic tool publicly available, allowing application of our model in other studies.


Flow based Community Detection in Hypergraphs. To connect structure, dynamics and function in systems with multibody interactions, network scientists model random walks on hypergraphs and identify communities that confine the walks for a long time. The two flow based community detection methods Markov stability and the map equation identify such communities based on different principles and search algorithms. But how similar are the resulting communities? We explain both methods' machinery applied to hypergraphs and compare them on synthetic and real world hypergraphs using various hyperedge size biased random walks and time scales. We find that the map equation is more sensitive to time scale changes and that Markov stability is more sensitive to hyperedge size biases.


A mathematical perspective on edge centric functional connectivity. Edge centric functional connectivity (eFC) has recently been proposed to characterise the finest time resolution on the FC dynamics without the concomitant assumptions of sliding window approaches. Here, we lay the mathematical foundations for the edge centric analysis and examine its main findings from a quantitative perspective. The proposed framework provides a theoretical explanation for the observed occurrence of high amplitude edge cofluctuations across datasets and clarifies why a few large events drive the node centric FC (nFC). Our exposition also constitutes a critique of the edge centric approach as currently applied to functional MRI (fMRI) time series. The central argument is that the existing findings based on edge time series can be derived from the static nFC under a null hypothesis that only accounts for the observed static spatial correlations and not the temporal ones. Challenging our analytic predictions against fMRI data from the Human Connectome Project confirms that the nFC is sufficient to replicate the eFC matrix, the edge communities, the large cofluctuations, and the corresponding brain activity mode. We conclude that the temporal structure of the edge time series has not so far been exploited sufficiently and encourage further work to explore features that cannot be explained by the presented static null model.


Active feature selection discovers minimal gene sets for classifying cell types and disease states with single cell mRNA seq data. Sequencing costs currently prohibit the application of single cell mRNA seq to many biological and clinical analyses. Targeted single cell mRNA sequencing reduces sequencing costs by profiling reduced gene sets that capture biological information with a minimal number of genes. Here, we introduce an active learning method (ActiveSVM) that identifies minimal but highly informative gene sets that enable the identification of cell types, physiological states, and genetic perturbations in single cell data using a small number of genes. Our active feature selection procedure generates minimal gene sets from single cell data through an iterative cell type classification task where misclassified cells are examined at each round of analysis to identify maximally informative genes through an active' support vector machine (ActiveSVM) classifier. By focusing computational resources on misclassified cells, ActiveSVM scales to analyze data sets with over a million single cells. We demonstrate that ActiveSVM feature selection identifies gene sets that enable 90 cell type classification accuracy across a variety of data sets including cell atlas and disease characterization data sets. The method generalizes to reveal genes that respond to genetic perturbations and to identify region specific gene expression patterns in spatial transcriptomics data. The discovery of small but highly informative gene sets should enable substantial reductions in the number of measurements necessary for application of single cell mRNA seq to clinical tests, therapeutic discovery, and genetic screens.


Finding optimal strategies in sequential games with the novel selection monad. The recently discovered monad, Tx Selection (x r) r, provides an elegant way to finnd optimal strategies in sequential games. During this thesis, a library was developed which provides a set of useful functions using the selection monad to compute optimal games and AIs for sequential games. In order to explore the selection monads ability to support these AI implementations, three example case studies were developed using Haskell The two player game Connect Four, a Sudoku solver and a simplified version of Chess. These case studies show how to elegantly implement a game AI. Furthermore, a performance analysis of these case studies was done, identifying the major points where performance can be increased.


A comparative study of split advection algorithms on Moment of Fluid (MOF) method for incompressible flow. The moment of fluid method (MOF) is known as an extension of the volume of fluid method with piecewise linear interface construction (VOF PLIC). In this study, several directional splitting advection algorithms are extended from the VOF PLIC method to the MOF method. Those methods, along with some existing directional splitting algorithms, are presented in detail, especially on the geometrical and non geometrical nature of the advection algorithm. Besides, we also proposed a simple and efficient analytic form to calculate the volume and centroid of the intersection polyhedron in 3D. Several numerical tests, including both 2D and 3D tests, are carried out to investigate mass conservation and geometrical error. Numerical results suggest that the mixed EI and LE scheme (EILE2D) citep aulisa geometrical 2003 has the best overall performance in 2D and Weymouth and Yue's scheme (WY) has the best overall performance in 3D.


Cross modal Zero shot Hashing by Label Attributes Embedding. Cross modal hashing (CMH) is one of the most promising methods in cross modal approximate nearest neighbor search. Most CMH solutions ideally assume the labels of training and testing set are identical. However, the assumption is often violated, causing a zero shot CMH problem. Recent efforts to address this issue focus on transferring knowledge from the seen classes to the unseen ones using label attributes. However, the attributes are isolated from the features of multi modal data. To reduce the information gap, we introduce an approach called LAEH (Label Attributes Embedding for zero shot cross modal Hashing). LAEH first gets the initial semantic attribute vectors of labels by word2vec model and then uses a transformation network to transform them into a common subspace. Next, it leverages the hash vectors and the feature similarity matrix to guide the feature extraction network of different modalities. At the same time, LAEH uses the attribute similarity as the supplement of label similarity to rectify the label embedding and common subspace. Experiments show that LAEH outperforms related representative zero shot and cross modal hashing methods.


An Information theoretic Progressive Framework for Interpretation. Both brain science and the deep learning communities have the problem of interpreting neural activity. For deep learning, even though we can access all neurons' activity data, interpretation of how the deep network solves the task is still challenging. Although a large amount of effort has been devoted to interpreting a deep network, there is still no consensus of what interpretation is. This paper tries to push the discussion in this direction and proposes an information theoretic progressive framework to synthesize interpretation. Firstly, we discuss intuitions of interpretation interpretation is meta information interpretation should be at the right level inducing independence is helpful to interpretation interpretation is naturally progressive interpretation doesn't have to involve a human. Then, we build the framework with an information map splitting idea and implement it with the variational information bottleneck technique. After that, we test the framework with the CLEVR dataset. The framework is shown to be able to split information maps and synthesize interpretation in the form of meta information.


A note on the Gaffney Laplacian on infinite metric graphs. We show that the deficiency indices of the minimal Gaffney Laplacian on an infinite locally finite metric graph are equal to the number of finite volume graph ends. Moreover, we provide criteria, formulated in terms of finite volume graph ends, for the Gaffney Laplacian to be closed.


VisEvent Reliable Object Tracking via Collaboration of Frame and Event Flows. Different from visible cameras which record intensity images frame by frame, the biologically inspired event camera produces a stream of asynchronous and sparse events with much lower latency. In practice, the visible cameras can better perceive texture details and slow motion, while event cameras can be free from motion blurs and have a larger dynamic range which enables them to work well under fast motion and low illumination. Therefore, the two sensors can cooperate with each other to achieve more reliable object tracking. In this work, we propose a large scale Visible Event benchmark (termed VisEvent) due to the lack of a realistic and scaled dataset for this task. Our dataset consists of 820 video pairs captured under low illumination, high speed, and background clutter scenarios, and it is divided into a training and a testing subset, each of which contains 500 and 320 videos, respectively. Based on VisEvent, we transform the event flows into event images and construct more than 30 baseline methods by extending current single modality trackers into dual modality versions. More importantly, we further build a simple but effective tracking algorithm by proposing a cross modality transformer, to achieve more effective feature fusion between visible and event data. Extensive experiments on the proposed VisEvent dataset, FE108, and two simulated datasets (i.e., OTB DVS and VOT DVS), validated the effectiveness of our model. The dataset and source code have been released at our project page url https sites.google.com view viseventtrack .


Combining Attention with Flow for Person Image Synthesis. Pose guided person image synthesis aims to synthesize person images by transforming reference images into target poses. In this paper, we observe that the commonly used spatial transformation blocks have complementary advantages. We propose a novel model by combining the attention operation with the flow based operation. Our model not only takes the advantage of the attention operation to generate accurate target structures but also uses the flow based operation to sample realistic source textures. Both objective and subjective experiments demonstrate the superiority of our model. Meanwhile, comprehensive ablation studies verify our hypotheses and show the efficacy of the proposed modules. Besides, additional experiments on the portrait image editing task demonstrate the versatility of the proposed combination.


Dynamic Network Assisted D2D Aided Coded Distributed Learning. Today, various machine learning (ML) applications offer continuous data processing and real time data analytics at the edge of a wireless network. Distributed real time ML solutions are highly sensitive to the so called straggler effect caused by resource heterogeneity and alleviated by various computation offloading mechanisms that seriously challenge the communication efficiency, especially in large scale scenarios. To decrease the communication overhead, we rely on device to device (D2D) connectivity that improves spectrum utilization and allows efficient data exchange between devices in proximity. In particular, we design a novel D2D aided coded federated learning method (D2D CFL) for efficient load balancing across devices. The proposed solution captures system dynamics, including data (time dependent learning model, varied intensity of data arrivals), device (diverse computational resources and volume of training data), and deployment (varied locations and D2D graph connectivity). To minimize the number of communication rounds, we derive an optimal compression rate for achieving minimum processing time and establish its connection with the convergence time. The resulting optimization problem provides suboptimal compression parameters, which improve the total training time. Our proposed method is beneficial for real time collaborative applications, where the users continuously generate training data resulting in the model drift.


Towards the use of conservative thermodynamic variables in data assimilation a case study using ground based microwave radiometer measurements. This study aims at introducing two conservative thermodynamic variables (moist air entropy potential temperature and total water content) into a one dimensional variational data assimilation system (1D Var) to demonstrate the benefit for future operational assimilation schemes. This system is assessed using microwave brightness temperatures from a ground based radiometer installed during the field campaign SOFOG3D dedicated to fog forecast improvement. An underlying objective is to ease the specification of background error covariance matrices that are highly dependent on weather conditions when using classical variables, making difficult the optimal retrievals of cloud and thermodynamic properties during fog conditions. Background error covariance matrices for these new conservative variables have thus been computed by an ensemble approach based on the French convective scale model AROME, for both all weather and fog conditions. A first result shows that the use of these matrices for the new variables reduces some dependencies to the meteorological conditions (diurnal cycle, presence or not of clouds) compared to usual variables (temperature, specific humidity). Then, two 1D Var experiments (classical vs. conservative variables) are evaluated over a full diurnal cycle characterized by a stratus evolving radiative fog situation, using hourly brightness temperatures. Results show, as expected, that analysed brightness temperatures by the 1D Var are much closer to the observed ones than background values for both variable choices. This is especially the case for channels sensitive to water vapour and liquid water. On the other hand, analysis increments in model space (water vapour, liquid water) show significant differences between the two sets of variables.


Multistationarity in cyclic sequestration transmutation networks. We consider a natural class of reaction networks which consist of reactions where either two species can inactivate each other (i.e., sequestration), or some species can be transformed into another (i.e., transmutation), in a way that gives rise to a feedback cycle. We completely characterize the capacity of multistationarity of these networks. This is especially interesting because such networks provide simple examples of "atoms of multistationarity", i.e., minimal networks that can give rise to multiple positive steady states


Coupling, lifetimes and "strong coupling" maps for single molecules at plasmonic interfaces. The interaction between excited states of a molecule and excited states of metal nanostructure (e.g. plasmons) leads to hybrid states with modified optical properties. When plasmon resonance is swept through molecular transition frequency an avoided crossing may be observed, which is often regarded as a signature of strong coupling between plasmons and molecules. Such strong coupling is expected to be realized when 2 U hbar Gamma 1 , where U and Gamma are the molecule plasmon coupling and the spectral width of the optical transition respectively. Because both U and Gamma strongly increase with decreasing distance between a molecule and a plasmonic structure it is not obvious that this condition can be satisfied for any molecule metal surface distance. In this work we investigate the behavior of U and Gamma for several geometries. Surprisingly, we find that if the only contributions to Gamma are lifetime broadenings associated with the radiative and nonradiative relaxation of a single molecular vibronic transition, including effects on molecular radiative and nonradiative lifetimes induced by the metal, the criterion 2 U hbar Gamma 1 is easily satisfied by many configurations irrespective of the metal molecule distance. This implies that the Rabi splitting can be observed in such structures if other sources of broadening are suppressed. Additionally, when the molecule metal surface distance is varied keeping all other molecular and metal parameters constant, this behavior is mitigated due to the spectral shift associated with the same molecule plasmon interaction, making the observation of Rabi splitting more challenging.


Link Prediction Approach to Recommender Systems. The problem of recommender system is very popular with myriad available solutions. A novel approach that uses the link prediction problem in social networks has been proposed in the literature that model the typical user item information as a bipartite network in which link prediction would actually mean recommending an item to a user. The standard recommender system methods suffer from the problems of sparsity and scalability. Since link prediction measures involve computations pertaining to small neighborhoods in the network, this approach would lead to a scalable solution to recommendation. One of the issues in this conversion is that link prediction problem is modelled as a binary classification task whereas the problem of recommender systems is solved as a regression task in which the rating of the link is to be predicted. We overcome this issue by predicting top k links as recommendations with high ratings without predicting the actual rating. Our work extends similar approaches in the literature by focusing on exploiting the probabilistic measures for link prediction. Moreover, in the proposed approach, prediction measures that utilize temporal information available on the links prove to be more effective in improving the accuracy of prediction. This approach is evaluated on the benchmark 'Movielens' dataset. We show that the usage of temporal probabilistic measures helps in improving the quality of recommendations. Temporal random walk based measure T Flow improves recommendation accuracy by 4 and Temporal cooccurrence probability measure improves prediction accuracy by 10 over item based collaborative filtering method in terms of AUROC score.


Feature Fusion Vision Transformer for Fine Grained Visual Categorization. The core for tackling the fine grained visual categorization (FGVC) is to learn subtle yet discriminative features. Most previous works achieve this by explicitly selecting the discriminative parts or integrating the attention mechanism via CNN based approaches.However, these methods enhance the computational complexity and make the modeldominated by the regions containing the most of the objects. Recently, vision trans former (ViT) has achieved SOTA performance on general image recognition tasks. Theself attention mechanism aggregates and weights the information from all patches to the classification token, making it perfectly suitable for FGVC. Nonetheless, the classifi cation token in the deep layer pays more attention to the global information, lacking the local and low level features that are essential for FGVC. In this work, we proposea novel pure transformer based framework Feature Fusion Vision Transformer (FFVT)where we aggregate the important tokens from each transformer layer to compensate thelocal, low level and middle level information. We design a novel token selection mod ule called mutual attention weight selection (MAWS) to guide the network effectively and efficiently towards selecting discriminative tokens without introducing extra param eters. We verify the effectiveness of FFVT on three benchmarks where FFVT achieves the state of the art performance.


Pre training without Natural Images. Is it possible to use convolutional neural networks pre trained without any natural images to assist natural image understanding? The paper proposes a novel concept, Formula driven Supervised Learning. We automatically generate image patterns and their category labels by assigning fractals, which are based on a natural law existing in the background knowledge of the real world. Theoretically, the use of automatically generated images instead of natural images in the pre training phase allows us to generate an infinite scale dataset of labeled images. Although the models pre trained with the proposed Fractal DataBase (FractalDB), a database without natural images, does not necessarily outperform models pre trained with human annotated datasets at all settings, we are able to partially surpass the accuracy of ImageNet Places pre trained models. The image representation with the proposed FractalDB captures a unique feature in the visualization of convolutional layers and attentions.


Quasi universality of Reeb graph distances. We establish bi Lipschitz bounds certifying quasi universality (universality up to a constant factor) for various distances between Reeb graphs the interleaving distance, the functional distortion distance, and the functional contortion distance. The definition of the latter distance is a novel contribution, and for the special case of contour trees we also prove strict universality of this distance. Furthermore, we prove that for the special case of merge trees the functional contortion distance coincides with the interleaving distance, yielding universality of all four distances in this case.


Several Weighted Hardy, Hardy Sobolev Maz'ya and Related Inequalities. In this paper we establish several Hardy and Hardy Sobolev type inequalities with homogeneous weights on the first orthant displaystyle mathbb R n (x 1, ldots, x n) x 1 0, ldots, x n 0 . We then use some of them to produce Hardy type inequalities with remainder terms. Furthermore, we obtain some interpolation inequalities and Maz'ya type inequalities with remainder terms with the help of Maz'ya inequality and Sobolev inequality of Cabr 'e and Ros Orton on the upper half space mathbb R n x (x 1, ldots, x n) , x n 0 .


A mixed multifractal analysis for quasi Ahlfors vector valued measures. The multifractal formalism for measures in its original formulation is checked for special classes of measures such as doubling, self similar, and Gibbs like ones. Out of these classes, suitable conditions should be taken into account to prove the validity of the multifractal formalism. In the present work, a large class of measures satisfying a weak condition known as quasi Ahlfors is considered in the framework of mixed multifractal analysis. A joint multifractal analysis of finitely many quasi Ahlfors probability measures is developed. Mixed variants of multifractal generalizations of Hausdorff and packing measures, and corresponding dimensions are introduced. By applying convexity arguments, some properties of these measures and dimensions are established. Finally, an associated multifractal formalism is introduced and proved to hold for the class of quasi Ahlfors measures.


Multi dimensional rho almost periodic type functions and applications. In this paper, we analyze various classes of multi dimensional rho almost periodic type functions F I times X rightarrow Y and multi dimensional ( omega, rho) almost periodic type functions F I times X rightarrow Y, where n in mathbb N , emptyset neq I subseteq mathbb R n , X and Y are complex Banach spaces and rho is a binary relation on Y. The proposed notion is new even in the one dimensional setting, for the functions of the form F I rightarrow Y. The main structural properties and characterizations for the introduced classes of functions are presented. We provide certain applications of our theoretical results to the abstract Volterra integro differential equations, as well.


Calibrating the negative interpretation. The minimum classical extension S g of a classically sound theory S based on intuitionistic logic, defined by adding to S the Gentzen negative interpretations of its mathematical axioms, contains a faithful translation S g of the classical version S ( A A) of S. S g may be called the classical content of S. First and second order intuitionistic arithmetic contain their classical contents, but intuitionistic recursive analysis cannot prove the negative interpretation of its quantifier free countable choice axiom. Variants of Kuroda's double negation shift principle (including the G "odel Dyson Kreisel axiom equivalent to the weak completeness of intuitionistic predicate logic), and doubly negated characteristic function principles, provide neat characterizations of the minimum classical extensions of classically sound subsystems of Kleene's intuitionistic analysis I. Two sorted basic constructive recursive mathematics contains its classical content. Bishop's constructive analysis has the same classical content as the neutral subsystem B of Kleene's I. By a result of Vafeiadou, minimum classical extensions of consistent, classically unsound theories (such as I) depend essentially on omega models of their classically consistent subtheories.


Energy Management in Data Centers with Server Setup Delay A Semi MDP Approximation. The energy management schemes in multi server data centers with setup time mostly consider thresholds on the number of idle servers or waiting jobs to switch servers textit on or textit off . An optimal energy management policy can be characterized as a textit Markov decision process (MDP) at large, given that the system parameters evolve Markovian. The resulting optimal reward can be defined as the weighted sum of mean power usage and mean delay of requested jobs. For large scale data centers however, these models become intractable due to the colossal state action space, thus making conventional algorithms inefficient in finding the optimal policy. In this paper, we propose an approximate textit semi MDP (SMDP) approach, known as textit multi level SMDP ', based on state aggregation and Markovian analysis of the system behavior. Rather than averaging the transition probabilities of aggregated states as in typical methods, we introduce an approximate Markovian framework for calculating the transition probabilities of the proposed multi level SMDP accurately. Moreover, near optimal performance can be attained at the expense of increased state space dimensionality by tuning the number of levels in the multi level approach. Simulation results show that the proposed approach reduces the SMDP size while yielding better rewards as against existing fixed threshold based policies and aggregation methods.


Effectiveness of Optimization Algorithms in Deep Image Classification. Adam is applied widely to train neural networks. Different kinds of Adam methods with different features pop out. Recently two new adam optimizers, AdaBelief and Padam are introduced among the community. We analyze these two adam optimizers and compare them with other conventional optimizers (Adam, SGD Momentum) in the scenario of image classification. We evaluate the performance of these optimization algorithms on AlexNet and simplified versions of VGGNet, ResNet using the EMNIST dataset. (Benchmark algorithm is available at hyperref https github.com chuiyunjun projectCSC413 https github.com chuiyunjun projectCSC413 ).


Enhanced Correlation Matching based Video Frame Interpolation. We propose a novel DNN based framework called the Enhanced Correlation Matching based Video Frame Interpolation Network to support high resolution like 4K, which has a large scale of motion and occlusion. Considering the extensibility of the network model according to resolution, the proposed scheme employs the recurrent pyramid architecture that shares the parameters among each pyramid layer for optical flow estimation. In the proposed flow estimation, the optical flows are recursively refined by tracing the location with maximum correlation. The forward warping based correlation matching enables to improve the accuracy of flow update by excluding incorrectly warped features around the occlusion area. Based on the final bi directional flows, the intermediate frame at arbitrary temporal position is synthesized using the warping and blending network and it is further improved by refinement network. Experiment results demonstrate that the proposed scheme outperforms the previous works at 4K video data and low resolution benchmark datasets as well in terms of objective and subjective quality with the smallest number of model parameters.


GSIP Green Semantic Segmentation of Large Scale Indoor Point Clouds. An efficient solution to semantic segmentation of large scale indoor scene point clouds is proposed in this work. It is named GSIP (Green Segmentation of Indoor Point clouds) and its performance is evaluated on a representative large scale benchmark the Stanford 3D Indoor Segmentation (S3DIS) dataset. GSIP has two novel components 1) a room style data pre processing method that selects a proper subset of points for further processing, and 2) a new feature extractor which is extended from PointHop. For the former, sampled points of each room form an input unit. For the latter, the weaknesses of PointHop's feature extraction when extending it to large scale point clouds are identified and fixed with a simpler processing pipeline. As compared with PointNet, which is a pioneering deep learning based solution, GSIP is green since it has significantly lower computational complexity and a much smaller model size. Furthermore, experiments show that GSIP outperforms PointNet in segmentation performance for the S3DIS dataset.


A note on calculi for non deterministic many valued logics. We present two deductively equivalent calculi for non deterministic many valued logics. One is defined by axioms and the other by rules of inference. The two calculi are obtained from the truth tables of the logic under consideration in a straightforward manner. We prove soundness and strong completeness theorems for both calculi and also prove the cut elimination theorem for the calculi defined by rules of inference.


The consistency strength of determinacy when all sets are universally Baire. It is known that the large cardinal strength of the Axiom of Determinacy when enhanced with the hypothesis that all sets of reals are universally Baire is much stronger than the Axiom of Determinacy itself. Sargsyan conjectured it to be as strong as the existence of a cardinal that is both a limit of Woodin cardinals and a limit of strong cardinals. Larson, Sargsyan and Wilson used a generalization of Woodin's derived model construction to show that this conjectured result would be optimal. In this paper we introduce a new translation procedure for hybrid mice extending work of Steel, Zhu and Sargsyan and apply it to prove Sargsyan's conjecture.


SIM ECG A Signal Importance Mask driven ECGClassification System. Heart disease is the number one killer, and ECGs can assist in the early diagnosis and prevention of deadly outcomes. Accurate ECG interpretation is critical in detecting heart diseases however, they are often misinterpreted due to a lack of training or insufficient time spent to detect minute anomalies. Subsequently, researchers turned to machine learning to assist in the analysis. However, existing systems are not as accurate as skilled ECG readers, and black box approaches to providing diagnosis result in a lack of trust by medical personnel in a given diagnosis. To address these issues, we propose a signal importance mask feedback based machine learning system that continuously accepts feedback, improves accuracy, and ex plains the resulting diagnosis. This allows medical personnel to quickly glance at the output and either accept the results, validate the explanation and diagnosis, or quickly correct areas of misinterpretation, giving feedback to the system for improvement. We have tested our system on a publicly available dataset consisting of healthy and disease indicating samples. We empirically show that our algorithm is better in terms of standard performance measures such as F score and MacroAUC compared to normal training baseline (without feedback) we also show that our model generates better interpretability maps.


Shaping Visual Representations with Attributes for Few Shot Learning. Few shot recognition aims to recognize novel categories under low data regimes. Some recent few shot recognition methods introduce auxiliary semantic modality, i.e., category attribute information, into representation learning, which enhances the feature discrimination and improves the recognition performance. Most of these existing methods only consider the attribute information of support set while ignoring the query set, resulting in a potential loss of performance. In this letter, we propose a novel attribute shaped learning (ASL) framework, which can jointly perform query attributes generation and discriminative visual representation learning for few shot recognition. Specifically, a visual attribute generator (VAG) is constructed to predict the attributes of queries. By leveraging the attributes information, an attribute visual attention module (AVAM) is designed, which can adaptively utilize attributes and visual representations to learn more discriminative features. Under the guidance of attribute modality, our method can learn enhanced semantic aware representation for classification. Experiments demonstrate that our method can achieve competitive results on CUB and SUN benchmarks. Our source code is available at url https github.com chenhaoxing ASL .


Notes on algebraic structure of truth tables of bracketed formulae connected by implications. In this paper we investigate the algebraic structure of the truth tables of all bracketed formulae with n distinct variables connected by the binary connective of implication.


Arabic Speech Emotion Recognition Employing Wav2vec2.0 and HuBERT Based on BAVED Dataset. Recently, there have been tremendous research outcomes in the fields of speech recognition and natural language processing. This is due to the well developed multi layers deep learning paradigms such as wav2vec2.0, Wav2vecU, WavBERT, and HuBERT that provide better representation learning and high information capturing. Such paradigms run on hundreds of unlabeled data, then fine tuned on a small dataset for specific tasks. This paper introduces a deep learning constructed emotional recognition model for Arabic speech dialogues. The developed model employs the state of the art audio representations include wav2vec2.0 and HuBERT. The experiment and performance results of our model overcome the previous known outcomes.


Mining frequency based sequential trajectory co clusters. Co clustering is a specific type of clustering that addresses the problem of finding groups of objects without necessarily considering all attributes. This technique has shown to have more consistent results in high dimensional sparse data than traditional clustering. In trajectory co clustering, the methods found in the literature have two main limitations first, the space and time dimensions have to be constrained by user defined thresholds second, elements (trajectory points) are clustered ignoring the trajectory sequence, assuming that the points are independent among them. To address the limitations above, we propose a new trajectory co clustering method for mining semantic trajectory co clusters. It simultaneously clusters the trajectories and their elements taking into account the order in which they appear. This new method uses the element frequency to identify candidate co clusters. Besides, it uses an objective cost function that automatically drives the co clustering process, avoiding the need for constraining dimensions. We evaluate the proposed approach using real world a publicly available dataset. The experimental results show that our proposal finds frequent and meaningful contiguous sequences revealing mobility patterns, thereby the most relevant elements.


Resultants of skew polynomials over division rings. Let mathbb F be a division ring. In this paper, we extent some of the main well known results about the resultant of two univariate polynomials to the more general context of an Ore extension mathbb F x sigma, delta . Finally, some algorithms and Magma programs are given as a numerical application of the main theoretical results of this paper.


Fiber optic vector acoustic receiver based on adaptive holographic interferometer. A mobile scalar vector acoustic receiver is proposed, experimentally implemented and investigated. The key components of the receiver are (i) the six channel fiber optic coil type sensor configured as to detect three projections of acoustic intensity vector, (ii) the six channel optical phase demodulator based on six channel adaptive holographic interferometer configured with use of dynamic holograms multiplexed in a photorefractive crystal of cadmium telluride and (iii) the signals recording ADC based system combined with software package for data processing. Field tests of the developed receiver applied for obtaining scalar and vector parameters of acoustic waves generated by a stationary and moving acoustic source in open air and water area are carried out. Experimental results show perceptiveness of use of the fiber optical adaptive interferometry system for bearing of weak acoustic sources in real conditions.


Neural Network Quantization for Efficient Inference A Survey. As neural networks have become more powerful, there has been a rising desire to deploy them in the real world however, the power and accuracy of neural networks is largely due to their depth and complexity, making them difficult to deploy, especially in resource constrained devices. Neural network quantization has recently arisen to meet this demand of reducing the size and complexity of neural networks by reducing the precision of a network. With smaller and simpler networks, it becomes possible to run neural networks within the constraints of their target hardware. This paper surveys the many neural network quantization techniques that have been developed in the last decade. Based on this survey and comparison of neural network quantization techniques, we propose future directions of research in the area.


PARL Enhancing Diversity of Ensemble Networks to Resist Adversarial Attacks via Pairwise Adversarially Robust Loss Function. The security of Deep Learning classifiers is a critical field of study because of the existence of adversarial attacks. Such attacks usually rely on the principle of transferability, where an adversarial example crafted on a surrogate classifier tends to mislead the target classifier trained on the same dataset even if both classifiers have quite different architecture. Ensemble methods against adversarial attacks demonstrate that an adversarial example is less likely to mislead multiple classifiers in an ensemble having diverse decision boundaries. However, recent ensemble methods have either been shown to be vulnerable to stronger adversaries or shown to lack an end to end evaluation. This paper attempts to develop a new ensemble methodology that constructs multiple diverse classifiers using a Pairwise Adversarially Robust Loss (PARL) function during the training procedure. PARL utilizes gradients of each layer with respect to input in every classifier within the ensemble simultaneously. The proposed training procedure enables PARL to achieve higher robustness against black box transfer attacks compared to previous ensemble methods without adversely affecting the accuracy of clean examples. We also evaluate the robustness in the presence of white box attacks, where adversarial examples are crafted using parameters of the target classifier. We present extensive experiments using standard image classification datasets like CIFAR 10 and CIFAR 100 trained using standard ResNet20 classifier against state of the art adversarial attacks to demonstrate the robustness of the proposed ensemble methodology.


Bio JOIE Joint Representation Learning of Biological Knowledge Bases. The widespread of Coronavirus has led to a worldwide pandemic with a high mortality rate. Currently, the knowledge accumulated from different studies about this virus is very limited. Leveraging a wide range of biological knowledge, such as gene ontology and protein protein interaction (PPI) networks from other closely related species presents a vital approach to infer the molecular impact of a new species. In this paper, we propose the transferred multi relational embedding model Bio JOIE to capture the knowledge of gene ontology and PPI networks, which demonstrates superb capability in modeling the SARS CoV 2 human protein interactions. Bio JOIE jointly trains two model components. The knowledge model encodes the relational facts from the protein and GO domains into separated embedding spaces, using a hierarchy aware encoding technique employed for the GO terms. On top of that, the transfer model learns a non linear transformation to transfer the knowledge of PPIs and gene ontology annotations across their embedding spaces. By leveraging only structured knowledge, Bio JOIE significantly outperforms existing state of the art methods in PPI type prediction on multiple species. Furthermore, we also demonstrate the potential of leveraging the learned representations on clustering proteins with enzymatic function into enzyme commission families. Finally, we show that Bio JOIE can accurately identify PPIs between the SARS CoV 2 proteins and human proteins, providing valuable insights for advancing research on this new disease.


Balanced pairs on triangulated categories. Let mathcal C be a triangulated category. We first introduce the notion of balanced pairs in mathcal C , and then establish the bijective correspondence between balanced pairs and proper classes xi with enough xi projectives and enough xi injectives. Assume that xi xi mathcal X xi mathcal Y is the proper class induced by a balanced pair ( mathcal X , mathcal Y ) . We prove that ( mathcal C , mathbb E xi, mathfrak s xi) is an extriangulated category. Moreover, it is proved that ( mathcal C , mathbb E xi, mathfrak s xi) is a triangulated category if and only if mathcal X mathcal Y 0 and that ( mathcal C , mathbb E xi, mathfrak s xi) is an exact category if and only if mathcal X mathcal Y mathcal C . As an application, we produce a large variety of examples of extriangulated categories which are neither exact nor triangulated.


On symplectic automorphisms of elliptic surfaces acting on mathrm CH 0 . Let S be a complex smooth projective surface of Kodaira dimension one. We show that the group mathrm Aut s(S) of symplectic automorphisms acts trivially on the Albanese kernel mathrm CH 0(S) mathrm alb of the 0 th Chow group mathrm CH 0(S) , unless the geometric genus and the irregularity satisfy p g(S) q(S) in 1,2 . In the exceptional case, the image of the homomorphism mathrm Aut s(S) rightarrow mathrm Aut ( mathrm CH 0(S) mathrm alb ) is either trivial or possibly isomorphic to mathbb Z 3 mathbb Z . Our main arguments actually take care of the group mathrm Aut f(S) of fibration preserving automorphisms of elliptic surfaces f colon S rightarrow B . We prove that, if sigma in mathrm Aut f(S) induces the trivial action on H i,0 (S) for i 0 , then it induces trivial action on mathrm CH 0(S) mathrm alb . Also, if S is additionally a K3 surface, then mathrm Aut f(S) cap mathrm Aut s(S) acts trivially on mathrm CH 0(S) mathrm alb .


Global and Local Contrastive Self Supervised Learning for Semantic Segmentation of HR Remote Sensing Images. Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self supervised learning (SSL), can be used to solve such problems by pre training a general model with a large number of unlabeled images and then fine tuning it on a downstream task with very few labeled samples. Contrastive learning is a typical method of SSL that can learn general invariant features. However, most existing contrastive learning methods are designed for classification tasks to obtain an image level representation, which may be suboptimal for semantic segmentation tasks requiring pixel level discrimination. Therefore, we propose a global style and local matching contrastive learning network (GLCNet) for remote sensing image semantic segmentation. Specifically, 1) the global style contrastive learning module is used to better learn an image level representation, as we consider that style features can better represent the overall image features. 2) The local features matching contrastive learning module is designed to learn representations of local regions, which is beneficial for semantic segmentation. The experimental results show that our method mostly outperforms SOTA self supervised methods and the ImageNet pre training method. Specifically, with 1 annotation from the original dataset, our approach improves Kappa by 6 on the ISPRS Potsdam dataset relative to the existing baseline. Moreover, our method outperforms supervised learning methods when there are some differences between the datasets of upstream tasks and downstream tasks. Since SSL could directly learn the essential characteristics of data from unlabeled data, which is easy to obtain in the remote sensing field, this may be of great significance for tasks such as global mapping. The source code is available at https github.com GeoX Lab G RSIM.


High power 1640 nm Er Y2O3 ceramic laser at room temperature. We report on high power operation of Er Y2O3 ceramic laser at 1.6 mu m using low scattering loss, 0.25 at. Er3 doped ceramic sample fabricated in house via co precipitation process. The laser is in band pumped by an Er, Yb fiber laser at 1535.6 nm and generates 10.2 W of continuous wave (CW) output power at 1640.4 nm with a slope efficiency of 25 with respect to the absorbed pump power. To the best of our knowledge, this is the first demonstration of 1.6 mu m Er Y2O3 laser at room temperature. The prospects for further scaling in output power and lasing efficiency via low Er3 doping and reduced energy transfer upconversion are discussed.


Maintaining Constant Pulse duration in Highly Dispersive Media using Nonlinear Potentials. A method is shown for preventing temporal broadening of ultrafast optical pulses in highly dispersive and fluctuating media for arbitrary signal pulse profiles. Pulse pairs, consisting of a strong field control pulse and a weak field signal pulse co propagate, whereby the specific profile of the strong field pulse precisely compensates for dispersive phase in the weak pulse. A numerical example is presented in an optical system consisting of both resonant and gain dispersive effects. Here we show signal pulses that do not temporally broaden across a vast propagation distance, even in the presence of dispersion that fluctuates several orders of magnitude and in sign (for example within a material resonance) across the pulse's bandwidth. Our approach illustrates the potential for using cross phase modulation to compensate for dispersive effects on a signal pulse and fills the gap in the current understanding of this nonlinear phenomenon.


A numerical scheme for filter boundary conditions in topology optimization on regular and irregular meshes. In density based topology optimization, design variables associated to the boundaries of the design domain require unique treatment to negate boundary effects arising from the filtering technique. An effective approach to deal with filtering boundary conditions is to extend the design domain beyond the borders using void densities. Although the approach is easy to implement, it introduces extra computational cost required to store the additional Finite Elements (FEs). This work proposes a numerical technique for the density filter that emulates an extension of the design domain, thus, it avoids boundary effects without demanding additional computational cost, besides it is very simple to implement on both regular and irregular meshes. The numerical scheme is demonstrated using the compliance minimization problem on two dimensional design domains. In addition, this article presents a discussion regarding the use of a real extension of the design domain, where the Finite Element Analysis (FEA) and volume restriction are influenced. Through a quantitative study, it is shown that affecting FEA or volume restriction with an extension of the FE mesh promotes the disconnection of material from the boundaries of the design domain, which is interpreted as a numerical instability promoting convergence towards local optimums.


Favelas 4D Scalable methods for morphology analysis of informal settlements using terrestrial laser scanning data. One billion people live in informal settlements worldwide. The complex and multilayered spaces that characterize this unplanned form of urbanization pose a challenge to traditional approaches to mapping and morphological analysis. This study proposes a methodology to study the morphological properties of informal settlements based on terrestrial LiDAR (Light Detection and Ranging) data collected in Rocinha, the largest favela in Rio de Janeiro, Brazil. Our analysis operates at two resolutions, including a emph global analysis focused on comparing different streets of the favela to one another, and a emph local analysis unpacking the variation of morphological metrics within streets. We show that our methodology reveals meaningful differences and commonalities both in terms of the global morphological characteristics across streets and their local distributions. Finally, we create morphological maps at high spatial resolution from LiDAR data, which can inform urban planning assessments of concerns related to crowding, structural safety, air quality, and accessibility in the favela. The methods for this study are automated and can be easily scaled to analyze entire informal settlements, leveraging the increasing availability of inexpensive LiDAR scanners on portable devices such as cellphones.


Filters and compactness on small categories and locales. In analogy with the classical theory of filters, for fi nite ly complete or small cat e go ries, we provide the concepts of fil ter, mathfrak G neigh bor hood (short for "Grothendieck neigh bor hood") and cover neigh bor hood of points of such categories, with the goal of studying convergence, cluster point, closure of sieves and compactness on objects of that kind of categories. Finally, we study all these concepts in the category bf Loc of locales.


Improved LP based Approximation Algorithms for Facility Location with Hard Capacities. The Capacitated Facility Location (CFL), a long standing classic problem with intriguing approximability and literature dated back to the 90s, is considered. Following the open question posted in Williamson and Shmoys, 2011 and the notable work due to An et al., FOCS 2014 , we present an LP based approximation algorithm with a guarantee of (10 sqrt 67 ) 2 approx 9.0927 , a significant improvement upon the previous LP based ratio of 288 due to An et al. in 2014. Our contribution for this part is a simple and elegant rounding algorithm that brings clear insights for the MFN relaxation and the CFL problem. For CFL with cardinality facility cost (CFL CFC), we present an LP based 4 approximation algorithm, which improves upon the decades old ratio of 5 due to Levi et al. that ages up since 2004. Prior to our work, it was not clear whether or not LP based methods can be used to provide a guarantee better than 5 for the CFL problem, even for restricted versions of this problem, for which natural LPs are already known to have small integrality gaps. Our rounding algorithm provides the first affirmative answer on the case with cadinality facility cost.


Determination of approximate quantum labels based on projections of the total angular momentum on the molecule fixed axis. Molecular line lists, particularly those computed for high temperature applications, often have very few states assigned local quantum numbers. These are often important components for accurately determining line shape parameters required for radiative transfer simulations. The projection of the total angular momentum onto the molecule fixed axis ( k ) is investigated in the Radau internal coordinate system to determine when it can be considered a good quantum number. In such a coordinate system, when the square of the k th component of the wavefunction is greater than one half, then we can classify k as a good quantum number in accordance with the theorem of Hose and Taylor. Furthermore, it is demonstrated that when this holds true, oblate and prolate quantum labels K a and K c can reliably be predicted. This is demonstrated for the water and ozone molecules.


Automated Design of Heuristics for the Container Relocation Problem. The container relocation problem is a challenging combinatorial optimisation problem tasked with finding a sequence of container relocations required to retrieve all containers by a given order. Due to the complexity of this problem, heuristic methods are often applied to obtain acceptable solutions in a small amount of time. These include relocation rules (RRs) that determine the relocation moves that need to be performed to efficiently retrieve the next container based on certain yard properties. Such rules are often designed manually by domain experts, which is a time consuming and challenging task. This paper investigates the application of genetic programming (GP) to design effective RRs automatically. The experimental results show that GP evolved RRs outperform several existing manually designed RRs. Additional analyses of the proposed approach demonstrate that the evolved rules generalise well across a wide range of unseen problems and that their performance can be further enhanced. Therefore, the proposed method presents a viable alternative to existing manually designed RRs and opens a new research direction in the area of container relocation problems.


Limited Data Emotional Voice Conversion Leveraging Text to Speech Two stage Sequence to Sequence Training. Emotional voice conversion (EVC) aims to change the emotional state of an utterance while preserving the linguistic content and speaker identity. In this paper, we propose a novel 2 stage training strategy for sequence to sequence emotional voice conversion with a limited amount of emotional speech data. We note that the proposed EVC framework leverages text to speech (TTS) as they share a common goal that is to generate high quality expressive voice. In stage 1, we perform style initialization with a multi speaker TTS corpus, to disentangle speaking style and linguistic content. In stage 2, we perform emotion training with a limited amount of emotional speech data, to learn how to disentangle emotional style and linguistic information from the speech. The proposed framework can perform both spectrum and prosody conversion and achieves significant improvement over the state of the art baselines in both objective and subjective evaluation.


Expanding the Design Space for Electrically Driven Soft Robots through Handed Shearing Auxetics. Handed Shearing Auxetics (HSA) are a promising structure for making electrically driven robots with distributed compliance that convert a motors rotation and torque into extension and force. We overcame past limitations on the range of actuation, blocked force, and stiffness by focusing on two key design parameters the point of an HSA's auxetic trajectory that is energetically preferred, and the number of cells along the HSAs length. Modeling the HSA as a programmable spring, we characterize the effect of both on blocked force, minimum energy length, spring constant, angle range and holding torque. We also examined the effect viscoelasticity has on actuation forces over time. By varying the auxetic trajectory point, we were able to make actuators that can push, pull, or do both. We expanded the range of forces possible from 5N to 150N, and the range of stiffness from 2 N mm to 89 N mm. For a fixed point on the auxetic trajectory, we found decreasing length can improve force output, at the expense of needing higher torques, and having a shorter throw. We also found that the viscoelastic effects can limit the amount of force a 3D printed HSA can apply over time.


Asymptotic analysis in multivariate average case approximation with Gaussian kernels. We consider tensor product random fields Y d , d in mathbb N , whose covariance funtions are Gaussian kernels. The average case approximation complexity n Y d ( varepsilon) is defined as the minimal number of evaluations of arbitrary linear functionals needed to approximate Y d , with relative 2 average error not exceeding a given threshold varepsilon in(0,1) . We investigate the growth of n Y d ( varepsilon) for arbitrary fixed varepsilon in(0,1) and d to infty . Namely, we find criteria of boundedness for n Y d ( varepsilon) on d and of tending n Y d ( varepsilon) to infty , d to infty , for any fixed varepsilon in(0,1) . In the latter case we obtain necessary and sufficient conditions for the following logarithmic asymptotics begin eqnarray ln n Y d ( varepsilon) a d q( varepsilon)b d o(b d), quad d to infty, end eqnarray with any varepsilon in(0,1) . Here q colon (0,1) to mathbb R is a non decreasing function, (a d) d in mathbb N is a sequence and (b d) d in mathbb N is a positive sequence such that b d to infty , d to infty . We show that only special quantiles of self decomposable distribution functions appear as functions q in a given asymptotics. These general results apply to n Y d ( varepsilon) under particular assumptions on the length scale parameters.


THP Topological Hawkes Processes for Learning Granger Causality on Event Sequences. Learning Granger causality among event types on multi type event sequences is an important but challenging task. Existing methods, such as the Multivariate Hawkes processes, mostly assumed that each sequence is independent and identically distributed. However, in many real world applications, it is commonplace to encounter a topological network behind the event sequences such that an event is excited or inhibited not only by its history but also by its topological neighbors. Consequently, the failure in describing the topological dependency among the event sequences leads to the error detection of the causal structure. By considering the Hawkes processes from the view of temporal convolution, we propose a Topological Hawkes processes (THP) to draw a connection between the graph convolution in topology domain and the temporal convolution in time domains. We further propose a Granger causality learning method on THP in a likelihood framework. The proposed method is featured with the graph convolution based likelihood function of THP and a sparse optimization scheme with an Expectation Maximization of the likelihood function. Theoretical analysis and experiments on both synthetic and real world data demonstrate the effectiveness of the proposed method.


A Dual Process Model for Optimizing Cross Entropy in Neural Networks. Minimizing cross entropy is a widely used method for training artificial neural networks. Many training procedures based on backpropagation use cross entropy directly as their loss function. Instead, this theoretical essay investigates a dual process model with two processes, in which one process minimizes the Kullback Leibler divergence while its dual counterpart minimizes the Shannon entropy. Postulating that learning consists of two dual processes complementing each other, the model defines an equilibrium state for both processes in which the loss function assumes its minimum. An advantage of the proposed model is that it allows deriving the optimal learning rate and momentum weight to update network weights for backpropagation. Furthermore, the model introduces the golden ratio and complex numbers as important new concepts in machine learning.


A Graphical Representation of Membrane Filtration. We analyze the performance of membrane filters represented by pore networks using two criteria 1) total volumetric throughput of filtrate over the filter lifetime and 2) accumulated foulant concentration in the filtrate. We first formulate the governing equations of fluid flow on a general network, and we model transport and adsorption of particles (foulants) within the network by imposing an advection equation with a sink term on each pore (edge) as well as conservation of fluid and foulant volumetric flow rates at each pore junction (network vertex). Such a setup yields a system of partial differential equations on the network. We study the influence of three geometric network parameters on filter performance 1) average number of neighbors of each vertex 2) initial total void volume of the pore network and 3) tortuosity of the network. We find that total volumetric throughput depends more strongly on the initial void volume than on average number of neighbors. Tortuosity, however, turns out to be a universal parameter, leading to almost perfect collapse of all results for a variety of different network architectures. In particular, the accumulated foulant concentration in the filtrate shows an exponential decay as tortuosity increases.