Explicit physics informed neural networks for non linear upscaling closure the case of transport in tissues. In this work, we use a combination of formal upscaling and data driven machine learning for explicitly closing a nonlinear transport and reaction process in a multiscale tissue. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used for numerically solving the upscaled (coarse grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are two outcomes of this work of particular note 1) we find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically structured tissues despite the significantly different scale and geometry of the two example tissue types and 2) the approach results in an upscaled PDE with an effectiveness factor that is predicted (implicitly) via the trained neural network. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.


Effects of Temperature Anneal Cycling on a Cryogenically Proton Irradiated CCD. Throughout a typical Earth orbit a satellite is constantly bombarded by radiation with trapped and solar protons being of particular concern as they gradually damage the focal plane devices throughout the mission and degrade their performance. To understand the impact the damage has on CCDs and how it varies with their thermal history a proton radiation campaign has been carried out using a CCD280. The CCD is irradiated at 153 K and gradually warmed to 188 K in 5 K increments with Fe55 X ray, dark current and trap pumping images taken at 153 K after each anneal step. The results show that despite the trap landscape changing throughout the anneal it has little impact on parallel charge transfer inefficiency. This is thought to be because most traps are unaffected and a lot of those that do anneal only move from the continuum between distinct trap species and into a nearby divacancy trap 'peak' whose emission time constant is similar enough to still impact the CTI. In terms of using a CCD280 or similar devices in a mission the CTI being unaffected by thermal annealing up to 188 K means that any CTI correction needed as the radiation damage builds up does not have to take into account the thermal history of the focal plane. However, it is possible that a significant amount of annealing will occur at temperatures greater than 188 K and care should be taken when a mission is operating in this range to gather accurate pre flight data.


Generating Active Explicable Plans in Human Robot Teaming. Intelligent robots are redefining a multitude of critical domains but are still far from being fully capable of assisting human peers in day to day tasks. An important requirement of collaboration is for each teammate to maintain and respect an understanding of the others' expectations of itself. Lack of which may lead to serious issues such as loose coordination between teammates, reduced situation awareness, and ultimately teaming failures. Hence, it is important for robots to behave explicably by meeting the human's expectations. One of the challenges here is that the expectations of the human are often hidden and can change dynamically as the human interacts with the robot. However, existing approaches to generating explicable plans often assume that the human's expectations are known and static. In this paper, we propose the idea of active explicable planning to relax this assumption. We apply a Bayesian approach to model and predict dynamic human belief and expectations to make explicable planning more anticipatory. We hypothesize that active explicable plans can be more efficient and explicable at the same time, when compared to explicable plans generated by the existing methods. In our experimental evaluation, we verify that our approach generates more efficient explicable plans while successfully capturing the dynamic belief change of the human teammate.


A tactile closed loop device for musical interaction. This paper presents a device implementing a closed tactile loop for musical interaction, based on a small freely held magnet which serves as the medium for both input and output. The component parts as well as an example of its programmable behaviour are described.


A Spatially Dependent Probabilistic Model for House Hunting in Ant Colonies. Ant species such as Temnothorax albipennis select a new nest site in a distributed fashion that, if modeled correctly, can serve as useful information for site selection algorithms for robotic swarms and other applications. Studying and replicating the ants' house hunting behavior will also illuminate useful distributed strategies that have evolved in nature. Many of the existing models of househunting behaviour for T. albipennis make the assumption that all candidate nest sites are equally distant from the ants' home nest, or that an ant has an equal probability of finding each candidate nest site. However, realistically this is not the case, as nests that are further away from the home nest and nests that are difficult to access are less likely to be found, even if they are of higher quality. We extend previous house hunting models to account for a pairwise distance metric between nests, compare our results to those of real colonies, and use our results to examine the effects of house hunting in nests of different spatial orientations. Our incorporation of distances in the ant model appear to match empirical data in situations where a distance quality tradeoff between nests is relevant. Furthermore, the model continues to be on par with previous house hunting models in experiments where all candidate nests are equidistant from the home nest, as is typically assumed.


P adic L functions for GL(3). Let Pi be a regular algebraic cuspidal automorphic representation of mathrm GL 3( mathbb A mathbb Q ) . When Pi is p ordinary for the maximal standard parabolic with Levi mathrm GL 1 times mathrm GL 2 , we construct a p adic L function for Pi . More precisely, we construct a (single) bounded measure L p( Pi) on mathbb Z p times attached to Pi , and show it interpolates all the critical values L( Pi times eta, j) at p in the left half of the critical strip for Pi (for varying eta and j ). This proves conjectures of Coates Perrin Riou and Panchishkin in this case. Our construction uses the theory of spherical varieties to build a "Betti Euler system'', a norm compatible system of classes in the Betti cohomology of a locally symmetric space for mathrm GL 3 . We work in arbitrary cohomological weight, allow arbitrary ramification at p along the other maximal standard parabolic, and make no self duality assumption.


Composition operators on Hardy Sobolev spaces and BMO quasiconformal mappings. In this paper we consider composition operators on Hardy Sobolev spaces in connections with BMO quasiconformal mappings. Using the duality of Hardy spaces and BMO spaces we prove that BMO quasiconformal mappings generate bounded composition operators from Hardy Sobolev spaces to Sobolev spaces.


Subcritical escape waves in schooling fish. Living systems such as neuronal networks and animal groups process information about their environment via the dynamics of interacting units. These can transition between distinct macroscopic behaviors. Near such a transition (or critical point) collective computation is generally thought to be optimized, due to the associated maximal sensitivity to perturbations and fast dissemination of information. For biological systems, however, optimality depends on environmental context, making the flexible, context dependent adoption of different distances to a critical point potentially more beneficial than its unique properties. Here, studying escape waves in schooling fish at two levels of perceived environmental risk, we investigate a) if and how distance to criticality is regulated in response to environmental changes and b) how the individual level benefits derived from special properties of the critical point compare to those achieved via regulation of the group's distance to it. We find that the observed fish schools are subcritical (not maximally responsive and sensitive to environmental cues), but decrease their distance to criticality with increased perceived risk. Considering an individual's hypothetical costs of two detection error types, we find that optimal distance to criticality depends on the riskiness and noisiness of the environment, which may explain the observed behavior. Our results highlight the benefit of evaluating biological consequences of different distances to criticality for individuals within animal collectives. This provides insights into the adaptive function of a collective system and motivates future questions about the evolutionary forces that brought the system to make this particular trade off.


Counterfactuals and Causability in Explainable Artificial Intelligence Theory, Algorithms, and Applications. There has been a growing interest in model agnostic methods that can make deep learning models more transparent and explainable to a user. Some researchers recently argued that for a machine to achieve a certain degree of human level explainability, this machine needs to provide human causally understandable explanations, also known as causability. A specific class of algorithms that have the potential to provide causability are counterfactuals. This paper presents an in depth systematic review of the diverse existing body of literature on counterfactuals and causability for explainable artificial intelligence. We performed an LDA topic modelling analysis under a PRISMA framework to find the most relevant literature articles. This analysis resulted in a novel taxonomy that considers the grounding theories of the surveyed algorithms, together with their underlying properties and applications in real world data. This research suggests that current model agnostic counterfactual algorithms for explainable AI are not grounded on a causal theoretical formalism and, consequently, cannot promote causability to a human decision maker. Our findings suggest that the explanations derived from major algorithms in the literature provide spurious correlations rather than cause effects relationships, leading to sub optimal, erroneous or even biased explanations. This paper also advances the literature with new directions and challenges on promoting causability in model agnostic approaches for explainable artificial intelligence.


A Unified Objective for Novel Class Discovery. In this paper, we study the problem of Novel Class Discovery (NCD). NCD aims at inferring novel object categories in an unlabeled set by leveraging from prior knowledge of a labeled set containing different, but related classes. Existing approaches tackle this problem by considering multiple objective functions, usually involving specialized loss terms for the labeled and the unlabeled samples respectively, and often requiring auxiliary regularization terms. In this paper, we depart from this traditional scheme and introduce a UNified Objective function (UNO) for discovering novel classes, with the explicit purpose of favoring synergy between supervised and unsupervised learning. Using a multi view self labeling strategy, we generate pseudo labels that can be treated homogeneously with ground truth labels. This leads to a single classification objective operating on both known and unknown classes. Despite its simplicity, UNO outperforms the state of the art by a significant margin on several benchmarks ( 10 on CIFAR 100 and 8 on ImageNet). The project page is available at https ncd uno.github.io.


Detect Reject for Transferability of Black box Adversarial Attacks Against Network Intrusion Detection Systems. In the last decade, the use of Machine Learning techniques in anomaly based intrusion detection systems has seen much success. However, recent studies have shown that Machine learning in general and deep learning specifically are vulnerable to adversarial attacks where the attacker attempts to fool models by supplying deceptive input. Research in computer vision, where this vulnerability was first discovered, has shown that adversarial images designed to fool a specific model can deceive other machine learning models. In this paper, we investigate the transferability of adversarial network traffic against multiple machine learning based intrusion detection systems. Furthermore, we analyze the robustness of the ensemble intrusion detection system, which is notorious for its better accuracy compared to a single model, against the transferability of adversarial attacks. Finally, we examine Detect Reject as a defensive mechanism to limit the effect of the transferability property of adversarial network traffic against machine learning based intrusion detection systems.


Quasi geometric infinite divisibility. The object of this paper is to introduce and study the concept of quasi geometric infinite divisibility for distributions on bf R . These distributions arise as mixing distributions of (discrete) geometric infinitely divisible Poisson mixtures. Several characterizations and closure properties are presented. A connection between quasi geometric infinite divisibility and log convex (log concave) distributions is established. A generalized notion of quasi infinite divisibility is also discussed.


Fully Dynamic Algorithms for Minimum Weight Cycle and Related Problems. We consider the directed minimum weight cycle problem in the fully dynamic setting. To the best of our knowledge, so far no fully dynamic algorithms have been designed specifically for the minimum weight cycle problem in general digraphs. One can achieve tilde O (n 2) amortized update time by simply invoking the fully dynamic APSP algorithm of Demetrescu and Italiano J. ACM'04 . This bound, however, yields no improvement over the trivial recompute from scratch algorithm for sparse graphs. Our first contribution is a very simple deterministic (1 epsilon) approximate algorithm supporting vertex updates (i.e., changing all edges incident to a specified vertex) in conditionally near optimal tilde O (m log (W) epsilon) amortized time for digraphs with real edge weights in 1,W . Using known techniques, the algorithm can be implemented on planar graphs and also gives some new sublinear fully dynamic algorithms maintaining approximate cuts and flows in planar digraphs. Additionally, we show a Monte Carlo randomized exact fully dynamic minimum weight cycle algorithm with tilde O (mn 2 3 ) worst case update that works for real edge weights. To this end, we generalize the exact fully dynamic APSP data structure of Abraham et al. SODA'17 to solve the multiple pairs shortest paths problem'', where one is interested in computing distances for some k (instead of all n 2 ) fixed source target pairs after each update. We show that in such a scenario, tilde O ((m k)n 2 3 ) worst case update time is possible.


On behavior of solutions to a Petrovsky equation with damping and variable exponent source. This paper deals with the following Petrovsky equation with damping and nonlinear source u tt Delta 2 u M( nabla u 2 2) Delta u Delta u t u t m(x) 2 u t u p(x) 2 u under initial boundary value conditions, where M(s) a bs gamma is a positive C 1 function with parameters a 0, b 0, gamma geq 1 , and m(x), p(x) are given measurable functions. The upper bound of the blow up time is derived for low initial energy using the differential inequality technique. For m(x) equiv2 , in particular, the upper bound of the blow up time is obtained by the combination of Levine's concavity method and some differential inequalities under high initial energy. In addition, by making full use of the strong damping, the lower bound of the blow up time is discussed. Moreover, the global existence of solutions and an energy decay estimate are presented by establishing some energy estimates and by exploiting a key integral inequality.


Urban traffic dynamic rerouting framework A DRL based model with fog cloud architecture. Past research and practice have demonstrated that dynamic rerouting framework is effective in mitigating urban traffic congestion and thereby improve urban travel efficiency. It has been suggested that dynamic rerouting could be facilitated using emerging technologies such as fog computing which offer advantages of low latency capabilities and information exchange between vehicles and roadway infrastructure. To address this question, this study proposes a two stage model that combines GAQ (Graph Attention Network Deep Q Learning) and EBkSP (Entropy Based k Shortest Path) using a fog cloud architecture, to reroute vehicles in a dynamic urban environment and therefore to improve travel efficiency in terms of travel speed. First, GAQ analyzes the traffic conditions on each road and for each fog area, and then assigns a road index based on the information attention from both local and neighboring areas. Second, EBkSP assigns the route for each vehicle based on the vehicle priority and route popularity. A case study experiment is carried out to investigate the efficacy of the proposed model. At the model training stage, different methods are used to establish the vehicle priorities, and their impact on the results is assessed. Also, the proposed model is tested under various scenarios with different ratios of rerouting and background (non rerouting) vehicles. The results demonstrate that vehicle rerouting using the proposed model can help attain higher speed and reduces possibility of severe congestion. This result suggests that the proposed model can be deployed by urban transportation agencies for dynamic rerouting and ultimately, to reduce urban traffic congestion.


Relaxed Lagrangian duality in convex infinite optimization reverse strong duality and optimality. We associate with each convex optimization problem posed on some locally convex space with an infinite index set T, and a given non empty family H formed by finite subsets of T, a suitable Lagrangian Haar dual problem. We provide reverse H strong duality theorems, H Farkas type lemmas and optimality theorems. Special attention is addressed to infinite and semi infinite linear optimization problems.


The effects of halide anions on the electroreduction of CO2 to C2H4 a density functional theory study. The halide anions present in the electrolyte gradually improves the Faradaic efficiencies (FEs) of the multi hydrocarbon (C2 ) products for the electrochemical reduction of CO2 over copper (Cu) catalysts in the order of F Cl Br I . However, the mechanism behind the increased yield of C2 products with the addition of halide anions still remains indistinct. In this study, we analysed the mechanism by investigating the electronic structures and computing the relative free energies of intermediates formed from CO2 to C2H4 on the Cu (100) facet based on density functional theory (DFT) calculations. The results show that formyl CHO species from the hydrogenation reaction of the adsorbed CO acts as the key intermediate, and the C C coupling reaction occurs preferentially between the CHO and CO with the formation of a CHO CO intermediate. Subsequently, the free energy pathway of C2H4 formation has been proposed, and we found that the presence of halide anions significantly decreases the free energy of the CHOCH intermediate, and enhances the desorption capacity of C2H4 in the order of F Cl Br I . Lastly, the obtained results are rationalized by the Bader charge analysis.


Z DP (n) is upperly bounded by n 2 (n 3) 2 . DP coloring was introduced by Dvo v r ' a k and Postle and is a generalization of proper coloring. For any graph G , let chi(G) and chi DP (G) denote the chromatic number and the DP chromatic number of G respectively. In this article, we show that chi DP (G vee K s) chi(G vee K s) holds for s left lceil frac 4(k 1)m 2k 1 right rceil le lceil 2.4m rceil , where k chi(G) , m E(G) and G vee K s is the join of G and the complete graph K s . Hence Z DP (n) le n 2 (n 3) 2 holds for every integer n ge 2 , where Z DP (n) is the minimum natural number s such that chi DP (G vee K s) chi(G vee K s) holds for every graph G of order n . Our result improves the best current upper bound Z DP (n) le 1.5n 2 due to Bernshteyn, Kostochka and Zhu.


The local behavior of positive solutions for higher order equation with isolated singularity. We use blow up analysis for local integral equations to provide a blow up rates of solutions of higher order Hardy Henon equation in a bounded domain with an isolated singularity, and show the asymptotic radial symmetry of the solutions near the singularity. This work generalizes the correspondence results of Jin Xiong 8 on higher order conformally invariant equations with an isolated singularity.


Towards Enabling Meta Learning from Target Models. Meta learning can extract an inductive bias from previous learning experience and assist the training of new tasks. It is often realized through optimizing a meta model with the evaluation loss of task specific solvers. Most existing algorithms sample non overlapping mathit support sets and mathit query sets to train and evaluate the solvers respectively due to simplicity ( mathcal S mathcal Q protocol). Different from mathcal S mathcal Q protocol, we can also evaluate a task specific solver by comparing it to a target model mathcal T , which is the optimal model for this task or a model that behaves well enough on this task ( mathcal S mathcal T protocol). Although being short of research, mathcal S mathcal T protocol has unique advantages such as offering more informative supervision, but it is computationally expensive. This paper looks into this special evaluation method and takes a step towards putting it into practice. We find that with a small ratio of tasks armed with target models, classic meta learning algorithms can be improved a lot without consuming many resources. We empirically verify the effectiveness of mathcal S mathcal T protocol in a typical application of meta learning, mathit i.e. , few shot learning. In detail, after constructing target models by fine tuning the pre trained network on those hard tasks, we match the task specific solvers and target models via knowledge distillation.


An Empirical Study of Graph Based Approaches for Semi Supervised Time Series Classification. Time series data play an important role in many applications and their analysis reveals crucial information for understanding the underlying processes. Among the many time series learning tasks of great importance, we here focus on semi supervised learning based on a graph representation of the data. Two main aspects are involved in this task. A suitable distance measure to evaluate the similarities between time series, and a learning method to make predictions based on these distances. However, the relationship between the two aspects has never been studied systematically in the context of graph based learning. We describe four different distance measures, including (Soft) DTW and MPDist, a distance measure based on the Matrix Profile, as well as four successful semi supervised learning methods, including the graph Allen Cahn method and a Graph Convolutional Neural Network. We then compare the performance of the algorithms on binary classification data sets. In our findings we compare the chosen graph based methods using all distance measures and observe that the results vary strongly with respect to the accuracy. As predicted by the no free lunch'' theorem, no clear best combination to employ in all cases is found. Our study provides a reproducible framework for future work in the direction of semi supervised learning for time series with a focus on graph representations.


Representations and identities of plactic like monoids. We exhibit faithful representations of the hypoplactic, stalactic, taiga, sylvester, Baxter and right patience sorting monoids of each finite rank as monoids of upper triangular matrices over any semiring from a large class including the tropical semiring and fields of characteristic 0 . By analysing the image of these representations, we show that the variety generated by a single hypoplactic (respectively, stalactic or taiga) monoid of rank at least 2 coincides with the variety generated by the natural numbers together with a fixed finite monoid mathcal H (respectively, mathcal F ) forming a proper subvariety of the variety generated by the plactic monoid of rank 2 .


A convex dual variational formulation for non convex optimization applied to a non linear model of plates. This article develops duality principles applicable to the non linear Kirchhoff Love model of plates. The results are obtained through standard tools of convex analysis, functional analysis, calculus of variations and duality theory. The main duality principle concerns a convex (in fact concave) dual variational formulation and related new optimality conditions for the model in question. Finally, in the last section we develop some global existence results for a similar model in elasticity.


Combinatorial Differential Algebra of x p . We link n jets of the affine monomial scheme defined by x p to the stable set polytope of some perfect graph. We prove that, as p varies, the dimension of the coordinate ring of a certain subscheme of the scheme of n jets as a mathbb C vector space is a polynomial of degree n 1 , namely the Ehrhart polynomial of the stable set polytope of that graph. One main ingredient for our proof is a result of Zobnin who determined a differential Gr " o bner basis of the differential ideal generated by x p . We generalize Zobnin's result to the bivariate case. We study (m,n) jets, a higher dimensional analog of jets, and relate them to regular unimodular triangulations.


On the Lebesgue measure of the boundary of the evoluted set. The evoluted set is the set of configurations reached from an initial set via a fixed flow for all times in a fixed interval. We find conditions on the initial set and on the flow ensuring that the evoluted set has negligible boundary (i.e. its Lebesgue measure is zero). We also provide several counterexample showing that the hypotheses of our theorem are close to sharp.


Hippocampal formation inspired probabilistic generative model. In building artificial intelligence (AI) agents, referring to how brains function in real environments can accelerate development by reducing the design space. In this study, we propose a probabilistic generative model (PGM) for navigation in uncertain environments by integrating the neuroscientific knowledge of hippocampal formation (HF) and the engineering knowledge in robotics and AI, namely, simultaneous localization and mapping (SLAM). We follow the approach of brain reference architecture (BRA) (Yamakawa, 2021) to compose the PGM and outline how to verify the model. To this end, we survey and discuss the relationship between the HF findings and SLAM models. The proposed hippocampal formation inspired probabilistic generative model (HF PGM) is designed to be highly consistent with the anatomical structure and functions of the HF. By referencing the brain, we elaborate on the importance of integration of egocentric allocentric information from the entorhinal cortex to the hippocampus and the use of discrete event queues.


Back translation for Large Scale Multilingual Machine Translation. This paper illustrates our approach to the shared task on large scale multilingual machine translation in the sixth conference on machine translation (WMT 21). This work aims to build a single multilingual translation system with a hypothesis that a universal cross language representation leads to better multilingual translation performance. We extend the exploration of different back translation methods from bilingual translation to multilingual translation. Better performance is obtained by the constrained sampling method, which is different from the finding of the bilingual translation. Besides, we also explore the effect of vocabularies and the amount of synthetic data. Surprisingly, the smaller size of vocabularies perform better, and the extensive monolingual English data offers a modest improvement. We submitted to both the small tasks and achieved the second place.


Defaultable term structures driven by semimartingales. We consider a market with a term structure of credit risky bonds in the single name case. We aim at minimal assumptions extending existing results in this direction first, the random field of forward rates is driven by a general semimartingale. Second, the Heath Jarrow Morton approach is extended with an additional component capturing those future jumps in the term structure which are visible from the current time. Third, the associated recovery scheme is as general as possible, it is only assumed to be non increasing. In this general setting we derive generalized drift conditions which characterize when a given measure is a local martingale measure, thus yielding no asymptotic free lunch with vanishing risk (NAFLVR), the right notion for this large financial market to be free of arbitrage.


A Comparative Analysis of Machine Learning and Grey Models. Artificial Intelligence (AI) has recently shown its capabilities for almost every field of life. Machine Learning, which is a subset of AI, is a HOT' topic for researchers. Machine Learning outperforms other classical forecasting techniques in almost all natural applications. It is a crucial part of modern research. As per this statement, Modern Machine Learning algorithms are hungry for big data. Due to the small datasets, the researchers may not prefer to use Machine Learning algorithms. To tackle this issue, the main purpose of this survey is to illustrate, demonstrate related studies for significance of a semi parametric Machine Learning framework called Grey Machine Learning (GML). This kind of framework is capable of handling large datasets as well as small datasets for time series forecasting likely outcomes. This survey presents a comprehensive overview of the existing semi parametric machine learning techniques for time series forecasting. In this paper, a primer survey on the GML framework is provided for researchers. To allow an in depth understanding for the readers, a brief description of Machine Learning, as well as various forms of conventional grey forecasting models are discussed. Moreover, a brief description on the importance of GML framework is presented.


Universal Adversarial Perturbations Through the Lens of Deep Steganography Towards A Fourier Perspective. The booming interest in adversarial attacks stems from a misalignment between human vision and a deep neural network (DNN), i.e. a human imperceptible perturbation fools the DNN. Moreover, a single perturbation, often called universal adversarial perturbation (UAP), can be generated to fool the DNN for most images. A similar misalignment phenomenon has recently also been observed in the deep steganography task, where a decoder network can retrieve a secret image back from a slightly perturbed cover image. We attempt explaining the success of both in a unified manner from the Fourier perspective. We perform task specific and joint analysis and reveal that (a) frequency is a key factor that influences their performance based on the proposed entropy metric for quantifying the frequency distribution (b) their success can be attributed to a DNN being highly sensitive to high frequency content. We also perform feature layer analysis for providing deep insight on model generalization and robustness. Additionally, we propose two new variants of universal perturbations (1) Universal Secret Adversarial Perturbation (USAP) that simultaneously achieves attack and hiding (2) high pass UAP (HP UAP) that is less visible to the human eye.


What Do Developers Discuss about Code Comments?. Code comments are important for program comprehension, development, and maintenance tasks. Given the varying standards for code comments, and their unstructured or semi structured nature, developers get easily confused (especially novice developers) about which convention(s) to follow, or what tools to use while writing code documentation. Thus, they post related questions on external online sources to seek better commenting practices. In this paper, we analyze code comment discussions on online sources such as Stack Overflow (SO) and Quora to shed some light on the questions developers ask about commenting practices. We apply Latent Dirichlet Allocation (LDA) to identify emerging topics concerning code comments. Then we manually analyze a statistically significant sample set of posts to derive a taxonomy that provides an overview of the developer questions about commenting practices. Our results highlight that on SO nearly 40 of the questions mention how to write or process comments in documentation tools and environments, and nearly 20 of the questions are about potential limitations and possibilities of documentation tools to add automatically and consistently more information in comments. On the other hand, on Quora, developer questions focus more on background information (35 of the questions) or asking opinions (16 of the questions) about code comments. We found that (i) not all aspects of comments are covered in coding style guidelines, e.g., how to add a specific type of information, (ii) developers need support in learning the syntax and format conventions to add various types of information in comments, and (iii) developers are interested in various automated strategies for comments such as detection of bad comments, or verify comment style automatically, but lack tool support to do that.


The ergodic Mean Field Game system for a type of state constraint condition. This paper investigates the well posedness of a type of state constraint ergodic Mean Field Game system in a bounded domain in which the Hamilton Jacobi Bellman equation is paired with an infinite Dirichlet boundary condition. In this setting, the infinite boundary condition prevents the underlying stochastic trajectories from reaching the boundary, resulting in a state constraint solution. We consider a class of superlinear power like Hamiltonians and establish existence and uniqueness results under appropriate assumptions on the coupling. We treat both non local and local couplings, and establish the uniqueness of the system by exploiting the decay of the density near the boundary.


Double Resonant Tunable Second Harmonic Generation in Two dimensional Layered Materials through Band Nesting. We proposed a mechanism to generate giant anisotropic second harmonic nonlinear response via double resonance effect, achieved through electronic bandstructure engineering. The ideal band setup would be a triplet of nested bands separated by the fundamental resonance energy, hbar omega . We demonstrate theoretically that the proposed phenomenon can be realized in bilayer SnS by band tuning with perpendicular electrical bias, which maximizes the second harmonic susceptibility by several orders of magnitude. Moreover, the tunability of the polarization anisotropy can be useful for realizing novel polarization sensitive devices.


Strong Call by Value is Reasonable, Implosively. Whether the number of beta steps in the lambda calculus can be taken as a reasonable time cost model (that is, polynomially related to the one of Turing machines) is a delicate problem, which depends on the notion of evaluation strategy. Since the nineties, it is known that weak (that is, out of abstractions) call by value evaluation is a reasonable strategy while L 'evy's optimal parallel strategy, which is strong (that is, it reduces everywhere), is not. The strong case turned out to be subtler than the weak one. In 2014 Accattoli and Dal Lago have shown that strong call by name is reasonable, by introducing a new form of useful sharing and, later, an abstract machine with an overhead quadratic in the number of beta steps. Here we show that also strong call by value evaluation is reasonable for time, via a new abstract machine realizing useful sharing and having a linear overhead. Moreover, our machine uses a new mix of sharing techniques, adding on top of useful sharing a form of implosive sharing, which on some terms brings an exponential speed up. We give examples of families that the machine executes in time logarithmic in the number of beta steps.


Adaptive finite element approximations for elliptic problems using regularized forcing data. We propose an adaptive finite element algorithm to approximate solutions of elliptic problems whose forcing data is locally defined and is approximated by regularization (or mollification). We show that the energy error decay is quasi optimal in two dimensional space and sub optimal in three dimensional space. Numerical simulations are provided to confirm our findings.


The PCP like Theorem for Sub linear Time Inapproximability. In this paper we propose the PCP like theorem for sub linear time inapproximability. Abboud et al. have devised the distributed PCP framework for proving sub quadratic time inapproximability. Here we try to go further in this direction. Staring from SETH, we first find a problem denoted as Ext k SAT, which can not be computed in linear time, then devise an efficient MA like protocol for this problem. To use this protocol to prove the sub linear time inapproximability of other problems, we devise a new kind of reduction denoted as Ext reduction, and it is different from existing reduction techniques. We also define two new hardness class, the problems in which can be computed in linear time, but can not be efficiently approximated in sub linear time. Some problems are shown to be in the newly defined hardness class.


The World of an Octopus How Reporting Bias Influences a Language Model's Perception of Color. Recent work has raised concerns about the inherent limitations of text only pretraining. In this paper, we first demonstrate that reporting bias, the tendency of people to not state the obvious, is one of the causes of this limitation, and then investigate to what extent multimodal training can mitigate this issue. To accomplish this, we 1) generate the Color Dataset (CoDa), a dataset of human perceived color distributions for 521 common objects 2) use CoDa to analyze and compare the color distribution found in text, the distribution captured by language models, and a human's perception of color and 3) investigate the performance differences between text only and multimodal models on CoDa. Our results show that the distribution of colors that a language model recovers correlates more strongly with the inaccurate distribution found in text than with the ground truth, supporting the claim that reporting bias negatively impacts and inherently limits text only training. We then demonstrate that multimodal models can leverage their visual training to mitigate these effects, providing a promising avenue for future research.


Chaos in the incompressible Euler equation on manifolds of high dimension. We construct finite dimensional families of non steady solutions to the Euler equations, existing for all time, and exhibiting all kinds of qualitative dynamics in the phase space, for example strange attractors and chaos, invariant manifolds of arbitrary topology, and quasiperiodic invariant tori of any dimension. The main theorem of the paper, from which these families of solutions are obtained, states that for any given vector field X on a closed manifold N , there is a Riemannian manifold M on which the following holds N is diffeomorphic to a finite dimensional manifold in the phase space of fluid velocities (the space of divergence free vector fields on M ) that is invariant under the Euler evolution, and on which the Euler equation reduces to a finite dimensional ODE that is given by an arbitrarily small perturbation of the vector field X on N .


Method for Calculating Excited Electronic States Using Density Functionals and Direct Orbital Optimization with Real Space Grid or Plane Wave Basis Set. A direct orbital optimization method is presented for density functional calculations of excited electronic states using either a real space grid or a plane wave basis set. The method is variational, provides atomic forces in the excited states, and can be applied to Kohn Sham (KS) functionals as well as orbital density dependent functionals (ODD) including explicit self interaction correction. The implementation for KS functionals involves two nested loops (1) An inner loop for finding a stationary point in a subspace spanned by the occupied and a few virtual orbitals corresponding to the excited state (2) an outer loop for minimizing the energy in a tangential direction in the space of the orbitals. For ODD functionals, a third loop is used to find the unitary transformation that minimizes the energy functional among occupied orbitals only. Combined with the maximum overlap method, the algorithm converges in challenging cases where conventional self consistent field algorithms tend to fail. The benchmark tests presented include two charge transfer excitations in nitrobenzene and an excitation of CO to degenerate pi ast orbitals where the importance of complex orbitals is illustrated. An application of the method to several metal to ligand charge transfer and metal centred excited states of an Fe rm II photosensitizer complex is described and the results compared to reported experimental estimates. The method is also used to study the effect of Perdew Zunger self interaction correction on valence and Rydberg excited states of several molecules, both singlet and triplet states, and the performance compared to semilocal and hybrid functionals.


MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture. MixUp is a computer vision data augmentation technique that uses convex interpolations of input data and their labels to enhance model generalization during training. However, the application of MixUp to the natural language understanding (NLU) domain has been limited, due to the difficulty of interpolating text directly in the input space. In this study, we propose MixUp methods at the Input, Manifold, and sentence embedding levels for the transformer architecture, and apply them to finetune the BERT model for a diverse set of NLU tasks. We find that MixUp can improve model performance, as well as reduce test loss and model calibration error by up to 50 .


Reinforcement Learning with Expert Trajectory For Quantitative Trading. In recent years, quantitative investment methods combined with artificial intelligence have attracted more and more attention from investors and researchers. Existing related methods based on the supervised learning are not very suitable for learning problems with long term goals and delayed rewards in real futures trading. In this paper, therefore, we model the price prediction problem as a Markov decision process (MDP), and optimize it by reinforcement learning with expert trajectory. In the proposed method, we employ more than 100 short term alpha factors instead of price, volume and several technical factors in used existing methods to describe the states of MDP. Furthermore, unlike DQN (deep Q learning) and BC (behavior cloning) in related methods, we introduce expert experience in training stage, and consider both the expert environment interaction and the agent environment interaction to design the temporal difference error so that the agents are more adaptable for inevitable noise in financial data. Experimental results evaluated on share price index futures in China, including IF (CSI 300) and IC (CSI 500), show that the advantages of the proposed method compared with three typical technical analysis and two deep leaning based methods.


Network analytics for drug repurposing in COVID 19. To better understand the potential of drug repurposing in COVID 19, we analyzed control strategies over essential host factors for SARS CoV 2 infection. We constructed comprehensive directed protein protein interaction networks integrating the top ranked host factors, drug target proteins, and directed protein protein interaction data. We analyzed the networks to identify drug targets and combinations thereof that offer efficient control over the host factors. We validated our findings against clinical studies data and bioinformatics studies. Our method offers a new insight into the molecular details of the disease and into potentially new therapy targets for it. Our approach for drug repurposing is significant beyond COVID 19 and may be applied also to other diseases.


On the value group of the transseries. We prove that the value group of the field of transseries is isomorphic to the additive reduct of the field.


Characterizing (Un)moderated Textual Data in Social Systems. Despite the valuable social interactions that online media promote, these systems provide space for speech that would be potentially detrimental to different groups of people. The moderation of content imposed by many social media has motivated the emergence of a new social system for free speech named Gab, which lacks moderation of content. This article characterizes and compares moderated textual data from Twitter with a set of unmoderated data from Gab. In particular, we analyze distinguishing characteristics of moderated and unmoderated content in terms of linguistic features, evaluate hate speech and its different forms in both environments. Our work shows that unmoderated content presents different psycholinguistic features, more negative sentiment and higher toxicity. Our findings support that unmoderated environments may have proportionally more online hate speech. We hope our analysis and findings contribute to the debate about hate speech and benefit systems aiming at deploying hate speech detection approaches.


Parameterized Problems Complete for Nondeterministic FPT time and Logarithmic Space. Let XNLP be the class of parameterized problems such that an instance of size n with parameter k can be solved nondeterministically in time f(k)n O(1) and space f(k) log(n) (for some computable function f ). We give a wide variety of XNLP complete problems, such as sc List Coloring and sc Precoloring Extension with pathwidth as parameter, sc Scheduling of Jobs with Precedence Constraints , with both number of machines and partial order width as parameter, sc Bandwidth and variants of sc Weighted CNF Satisfiability and reconfiguration problems. In particular, this implies that all these problems are W t hard for all t . This also answers a long standing question on the parameterized complexity of the sc Bandwidth problem.


Positive unlabeled Learning for Cell Detection in Histopathology Images with Incomplete Annotations. Cell detection in histopathology images is of great value in clinical practice. textit Convolutional neural networks (CNNs) have been applied to cell detection to improve the detection accuracy, where cell annotations are required for network training. However, due to the variety and large number of cells, complete annotations that include every cell of interest in the training images can be challenging. Usually, incomplete annotations can be achieved, where positive labeling results are carefully examined to ensure their reliability but there can be other positive instances, i.e., cells of interest, that are not included in the annotations. This annotation strategy leads to a lack of knowledge about true negative samples. Most existing methods simply treat instances that are not labeled as positive as truly negative during network training, which can adversely affect the network performance. In this work, to address the problem of incomplete annotations, we formulate the training of detection networks as a positive unlabeled learning problem. Specifically, the classification loss in network training is revised to take into account incomplete annotations, where the terms corresponding to negative samples are approximated with the true positive samples and the other samples of which the labels are unknown. To evaluate the proposed method, experiments were performed on a publicly available dataset for mitosis detection in breast cancer cells, and the experimental results show that our method improves the performance of cell detection given incomplete annotations for training.


Tensors Fitting Perfectly. Multidimensional arrays (NDArrays) are a central abstraction in modern scientific computing environments. Unfortunately, they can make reasoning about programs harder as the number of different array shapes used in an execution of a program is usually very large, and they rarely appear explicitly in program text. To make things worse, many operators make implicit assumptions about the shapes of their inputs array addition is commonly enriched with broadcasting semantics, while matrix multiplication assumes that the lengths of contracted dimensions are equal. Because precise reasoning about shapes is crucial to write correct programs using NDArrays, and because shapes are often hard to infer from a quick glance at the program, we developed Tensors Fitting Perfectly, a static analysis tool that reasons about NDArray shapes in Swift for TensorFlow programs by synthesizing a set of shape constraints from an abstract interpretation of the program. It can both (1) check for possible inconsistencies, and (2) provide direct insights about the shapes of intermediate values appearing in the program, including via a mechanism called shape holes. The static analysis works in concert with optional runtime assertions to improve the productivity of program authors.


Berry Esseen bounds for the multivariate mathcal B free CLT and operator valued matrices. We provide bounds of Berry Esseen type for fundamental limit theorems in operator valued free probability theory such as the operator valued free Central Limit Theorem and the asymptotic behaviour of distributions of operator valued matrices. Our estimates are on the level of operator valued Cauchy transforms and the L 'evy distance. We address the single variable as well as the multivariate setting for which we consider linear matrix pencils and noncommutative polynomials as test functions. The estimates are in terms of operator valued moments and yield the first quantitative bounds on the L 'evy distance for the operator valued free Central Limit Theorem. Our results also yield quantitative estimates on joint noncommutative distributions of operator valued matrices having a general covariance profile. In the scalar valued multivariate case, these estimates could be passed to explicit bounds on the order of convergence under the Kolmogorov distance.


Spatial Uncertainty Aware Semi Supervised Crowd Counting. Semi supervised approaches for crowd counting attract attention, as the fully supervised paradigm is expensive and laborious due to its request for a large number of images of dense crowd scenarios and their annotations. This paper proposes a spatial uncertainty aware semi supervised approach via regularized surrogate task (binary segmentation) for crowd counting problems. Different from existing semi supervised learning based crowd counting methods, to exploit the unlabeled data, our proposed spatial uncertainty aware teacher student framework focuses on high confident regions' information while addressing the noisy supervision from the unlabeled data in an end to end manner. Specifically, we estimate the spatial uncertainty maps from the teacher model's surrogate task to guide the feature learning of the main task (density regression) and the surrogate task of the student model at the same time. Besides, we introduce a simple yet effective differential transformation layer to enforce the inherent spatial consistency regularization between the main task and the surrogate task in the student model, which helps the surrogate task to yield more reliable predictions and generates high quality uncertainty maps. Thus, our model can also address the task level perturbation problems that occur spatial inconsistency between the primary and surrogate tasks in the student model. Experimental results on four challenging crowd counting datasets demonstrate that our method achieves superior performance to the state of the art semi supervised methods.


cuConv A CUDA Implementation of Convolution for CNN Inference. Convolutions are the core operation of deep learning applications based on Convolutional Neural Networks (CNNs). Current GPU architectures are highly efficient for training and deploying deep CNNs, and hence, these are largely used in production for this purpose. State of the art implementations, however, present a lack of efficiency for some commonly used network configurations. In this paper we propose a GPU based implementation of the convolution operation for CNN inference that favors coalesced accesses, without requiring prior data transformations. Our experiments demonstrate that our proposal yields notable performance improvements in a range of common CNN forward propagation convolution configurations, with speedups of up to 2.29x with respect to the best implementation of convolution in cuDNN, hence covering a relevant region in currently existing approaches.


Normalization for multimodal type theory. We consider the conversion problem for multimodal type theory (MTT) by characterizing the normal forms of the type theory and proving normalization. Normalization follows from a novel adaptation of Sterling's Synthetic Tait Computability which generalizes the framework to accommodate a type theory with modalities and multiple modes. As a corollary of our main result, we reduce the conversion problem of MTT to the conversion problem of its mode theory and show the injectivity of type constructors. Finally, we conclude that MTT enjoys decidable type checking when instantiated with a decidable mode theory.


Agree to Disagree Subjective Fairness in Privacy Restricted Decentralised Conflict Resolution. Fairness is commonly seen as a property of the global outcome of a system and assumes centralisation and complete knowledge. However, in real decentralised applications, agents only have partial observation capabilities. Under limited information, agents rely on communication to divulge some of their private (and unobservable) information to others. When an agent deliberates to resolve conflicts, limited knowledge may cause its perspective of a correct outcome to differ from the actual outcome of the conflict resolution. This is subjective unfairness. To enable decentralised, fairness aware conflict resolution under privacy constraints, we have two contributions (1) a novel interaction approach and (2) a formalism of the relationship between privacy and fairness. Our proposed interaction approach is an architecture for privacy aware explainable conflict resolution where agents engage in a dialogue of hypotheses and facts. To measure the privacy fairness relationship, we define subjective and objective fairness on both the local and global scope and formalise the impact of partial observability due to privacy in these different notions of fairness. We first study our proposed architecture and the privacy fairness relationship in the abstract, testing different argumentation strategies on a large number of randomised cultures. We empirically demonstrate the trade off between privacy, objective fairness, and subjective fairness and show that better strategies can mitigate the effects of privacy in distributed systems. In addition to this analysis across a broad set of randomised abstract cultures, we analyse a case study for a specific scenario we instantiate our architecture in a multi agent simulation of prioritised rule aware collision avoidance with limited information disclosure.


Near Delaunay Metrics. We study metrics that assess how close a triangulation is to being a Delaunay triangulation, for use in contexts where a good triangulation is desired but constraints (e.g., maximum degree) prevent the use of the Delaunay triangulation itself. Our near Delaunay metrics derive from common Delaunay properties and satisfy a basic set of design criteria, such as being invariant under similarity transformations. We compare the metrics, showing that each can make different judgments as to which triangulation is closer to Delaunay. We also present a preliminary experiment, showing how optimizing for these metrics under different constraints gives similar, but not necessarily identical results, on random and constructed small point sets.


Substrate matters Surface polariton enhanced infrared nanospectroscopy of molecular vibrations. Infrared nanospectroscopy based on Fourier transform infrared near field spectroscopy (nano FTIR) is an emerging nanoanalytical tool with large application potential for label free mapping and identification of organic and inorganic materials with nanoscale spatial resolution. However, the detection of thin molecular layers and nanostructures on standard substrates is still challenged by weak signals. Here, we demonstrate a significant enhancement of nano FTIR signals of a thin organic layer by exploiting polariton resonant tip substrate coupling and surface polariton illumination of the probing tip. When the molecular vibration matches the tip substrate resonance, we achieve up to nearly one order of magnitude signal enhancement on a phonon polaritonic quartz (c SiO2) substrate, as compared to nano FTIR spectra obtained on metal (Au) substrates, and up to two orders of magnitude when compared to the standard infrared spectroscopy substrate CaF2. Our results will be of critical importance for boosting nano FTIR spectroscopy towards the routine detection of monolayers and single molecules.


A machine learning pipeline for aiding school identification from child trafficking images. Child trafficking in a serious problem around the world. Every year there are more than 4 million victims of child trafficking around the world, many of them for the purposes of child sexual exploitation. In collaboration with UK Police and a non profit focused on child abuse prevention, Global Emancipation Network, we developed a proof of concept machine learning pipeline to aid the identification of children from intercepted images. In this work, we focus on images that contain children wearing school uniforms to identify the school of origin. In the absence of a machine learning pipeline, this hugely time consuming and labor intensive task is manually conducted by law enforcement personnel. Thus, by automating aspects of the school identification process, we hope to significantly impact the speed of this portion of child identification. Our proposed pipeline consists of two machine learning models i) to identify whether an image of a child contains a school uniform in it, and ii) identification of attributes of different school uniform items (such as color texture of shirts, sweaters, blazers etc.). We describe the data collection, labeling, model development and validation process, along with strategies for efficient searching of schools using the model predictions.


Contemporary Amharic Corpus Automatically Morpho Syntactically Tagged Amharic Corpus. We introduced the contemporary Amharic corpus, which is automatically tagged for morpho syntactic information. Texts are collected from 25,199 documents from different domains and about 24 million orthographic words are tokenized. Since it is partly a web corpus, we made some automatic spelling error correction. We have also modified the existing morphological analyzer, HornMorpho, to use it for the automatic tagging.


Is learning for the unit commitment problem a low hanging fruit?. The blast wave of machine learning and artificial intelligence has also reached the power systems community, and amid the frenzy of methods and black box tools that have been left in its wake, it is sometimes difficult to perceive a glimmer of Occam's razor principle. In this letter, we use the unit commitment problem (UCP), an NP hard mathematical program that is fundamental to power system operations, to show that simplicity must guide any strategy to solve it, in particular those that are based on learning from past UCP instances. To this end, we apply a naive algorithm to produce candidate solutions to the UCP and show, using a variety of realistically sized power systems, that we are able to find optimal or quasi optimal solutions with remarkable speedups. Our claim is thus that any sophistication of the learning method must be backed up with a statistically significant improvement of the results in this letter.


Non degeneracy of multi bump solutions for the prescribed scalar curvature equations and applications. We consider the following prescribed scalar curvature equations in mathbb R N Delta u K( y )u 2 1 , quad u 0 quad mbox in quad mathbb R N, quad u in D 1, 2 ( mathbb R N), where K(r) is a positive function, 2 frac 2N N 2 . We modify the methods and improve the results in 15 .


Stability of the Volume Preserving Mean Curvature Flow in Hyperbolic Space. We consider the dynamic property of the volume preserving mean curvature flow. This flow was introduced by Huisken who also proved it converges to a round sphere of the same enclosed volume if the initial hypersurface is strictly convex in Euclidean space. We study the stability of this flow in hyperbolic space. In particular, we prove that if the initial hypersurface is hyperbolically mean convex and close to an umbilical sphere in the L 2 sense, then the flow exists for all time and converges exponentially to an umbilical sphere.


Sparse Training Theory for Scalable and Efficient Agents. A fundamental task for artificial intelligence is learning. Deep Neural Networks have proven to cope perfectly with all learning paradigms, i.e. supervised, unsupervised, and reinforcement learning. Nevertheless, traditional deep learning approaches make use of cloud computing facilities and do not scale well to autonomous agents with low computational resources. Even in the cloud, they suffer from computational and memory limitations, and they cannot be used to model adequately large physical worlds for agents which assume networks with billions of neurons. These issues are addressed in the last few years by the emerging topic of sparse training, which trains sparse networks from scratch. This paper discusses sparse training state of the art, its challenges and limitations while introducing a couple of new theoretical research directions which has the potential of alleviating sparse training limitations to push deep learning scalability well beyond its current boundaries. Nevertheless, the theoretical advancements impact in complex multi agents settings is discussed from a real world perspective, using the smart grid case study.


Partially dissipative one dimensional hyperbolic systems in the critical regularity setting, and applications. Here we develop a method for investigating global strong solutions of partially dissipative hyperbolic systems in the critical regularity setting. Compared to the recent works by Kawashima and Xu, we use hybrid Besov spaces with different regularity exponent in low and high frequency. This allows to consider more general data and to track the exact dependency on the dissipation parameter for the solution. Our approach enables us to go beyond the L 2 framework in the treatment of the low frequencies of the solution, which is totally new, to the best of our knowledge. Focus is on the one dimensional setting (the multi dimensional case will be considered in a forthcoming paper) and, for expository purpose, the first part of the paper is devoted to a toy model that may be seen as a simplification of the compressible Euler system with damping. More elaborated systems (including the compressible Euler system with general increasing pressure law) are considered at the end of the paper.


Super Neurons. Operational Neural Networks (ONNs) are new generation network models that can perform any (non linear) transformation with a proper combination of "nodal" and "pool" operators. However, they still have a certain restriction, which is the sole usage of a single nodal operator for all (synaptic) connections of each neuron. The idea behind the "generative neurons" was born as a remedy for this restriction where each nodal operator can be "customized" during the training in order to maximize the learning performance. Self Organized ONNs (Self ONNs) composed with the generative neurons can achieve an utmost level of diversity even with a compact configuration however, it still suffers from the last property that was inherited from the CNNs localized kernel operations which imposes a severe limitation to the information flow between layers. It is, therefore, desirable for the neurons to gather information from a larger area in the previous layer maps without increasing the kernel size. For certain applications, it might be even more desirable "to learn" the kernel locations of each connection during the training process along with the customized nodal operators so that both can be optimized simultaneously. This study introduces the super (generative) neuron models that can accomplish this without altering the kernel sizes and will enable a significant diversity in terms of information flow. The two models of super neurons proposed in this study vary on the localization process of the kernels i) randomly localized kernels within a bias range set for each layer, ii) optimized locations of each kernel during the Back Propagation (BP) training. The extensive set of comparative evaluations show that Self ONNs with super neurons can indeed achieve a superior learning and generalization capability without any significant rise of the computational complexity.


A Distributed Continuous time Modified Newton Raphson Algorithm. We propose a continuous time second order optimization algorithm for solving unconstrained convex optimization problems with bounded Hessian. We show that this alternative algorithm has a comparable convergence rate to that of the continuous time Newton Raphson method, however structurally, it is amenable to a more efficient distributed implementation. We present a distributed implementation of our proposed optimization algorithm and prove its convergence via Lyapunov analysis. A numerical example demonstrates our results.


What do Indian Researchers download from Sci Hub. Recently three foreign academic publishers filed a case of copyright infringement against Sci Hub and LibGen before the Delhi High Court and prayed for complete blocking these websites in India. In this context, this paper attempted to assess the impact that blocking of Sci Hub may have on Indian research community. The download requests originating from India on a daily basis are counted, geotagged and analysed by discipline, publisher, country and publication year etc. Results indicate that blocking Sci Hub in India may actually hurt Indian research community in a significant way.


Small doubling, atomic structure and ell divisible set families. Let mathcal F subset 2 n be a set family such that the intersection of any two members of mathcal F has size divisible by ell . The famous Eventown theorem states that if ell 2 then mathcal F leq 2 lfloor n 2 rfloor , and this bound can be achieved by, e.g., an atomic' construction, i.e. splitting the ground set into disjoint pairs and taking their arbitrary unions. Similarly, splitting the ground set into disjoint sets of size ell gives a family with pairwise intersections divisible by ell and size 2 lfloor n ell rfloor . Yet, as was shown by Frankl and Odlyzko, these families are far from maximal. For infinitely many ell , they constructed families mathcal F as above of size 2 Omega(n log ell ell) . On the other hand, if the intersection of any number of sets in mathcal F subset 2 n has size divisible by ell , then it is easy to show that mathcal F leq 2 lfloor n ell rfloor . In 1983 Frankl and Odlyzko conjectured that mathcal F leq 2 (1 o(1)) n ell holds already if one only requires that for some k k( ell) any k distinct members of mathcal F have an intersection of size divisible by ell . We completely resolve this old conjecture in a strong form, showing that mathcal F leq 2 lfloor n ell rfloor O(1) if k is chosen appropriately, and the O(1) error term is not needed if (and only if) ell , , n , and n is sufficiently large. Moreover the only extremal configurations have atomic' structure as above. Our main tool, which might be of independent interest, is a structure theorem for set systems with small 'doubling'.


Discovering Collaborative Signals for Next POI Recommendation with Iterative Seq2Graph Augmentation. Being an indispensable component in location based social networks, next point of interest (POI) recommendation recommends users unexplored POIs based on their recent visiting histories. However, existing work mainly models check in data as isolated POI sequences, neglecting the crucial collaborative signals from cross sequence check in information. Furthermore, the sparse POI POI transitions restrict the ability of a model to learn effective sequential patterns for recommendation. In this paper, we propose Sequence to Graph (Seq2Graph) augmentation for each POI sequence, allowing collaborative signals to be propagated from correlated POIs belonging to other sequences. We then devise a novel Sequence to Graph POI Recommender (SGRec), which jointly learns POI embeddings and infers a user's temporal preferences from the graph augmented POI sequence. To overcome the sparsity of POI level interactions, we further infuse category awareness into SGRec with a multi task learning scheme that captures the denser category wise transitions. As such, SGRec makes full use of the collaborative signals for learning expressive POI representations, and also comprehensively uncovers multi level sequential patterns for user preference modelling. Extensive experiments on two real world datasets demonstrate the superiority of SGRec against state of the art methods in next POI recommendation.


Scene Text Retrieval via Joint Text Detection and Similarity Learning. Scene text retrieval aims to localize and search all text instances from an image gallery, which are the same or similar to a given query text. Such a task is usually realized by matching a query text to the recognized words, outputted by an end to end scene text spotter. In this paper, we address this problem by directly learning a cross modal similarity between a query text and each text instance from natural images. Specifically, we establish an end to end trainable network, jointly optimizing the procedures of scene text detection and cross modal similarity learning. In this way, scene text retrieval can be simply performed by ranking the detected text instances with the learned similarity. Experiments on three benchmark datasets demonstrate our method consistently outperforms the state of the art scene text spotting retrieval approaches. In particular, the proposed framework of joint detection and similarity learning achieves significantly better performance than separated methods. Code is available at https github.com lanfeng4659 STR TDSL.


Integral representations of shallow neural network with Rectified Power Unit activation function. In this effort, we derive a formula for the integral representation of a shallow neural network with the Rectified Power Unit activation function. Mainly, our first result deals with the univariate case of representation capability of RePU shallow networks. The multidimensional result in this paper characterizes the set of functions that can be represented with bounded norm and possibly unbounded width.


A fuzzy take on the logical issues of statistical hypothesis testing. Statistical Hypothesis Testing (SHT) is a class of inference methods whereby one makes use of empirical data to test a hypothesis and often emit a judgment about whether to reject it or not. In this paper we focus on the logical aspect of this strategy, which is largely independent of the adopted school of thought, at least within the various frequentist approaches. We identify SHT as taking the form of an unsound argument from Modus Tollens in classical logic, and, in order to rescue SHT from this difficulty, we propose that it can instead be grounded in t norm based fuzzy logics. We reformulate the frequentists' SHT logic by making use of a fuzzy extension of modus Tollens to develop a model of truth valuation for its premises. Importantly, we show that it is possible to preserve the soundness of Modus Tollens by exploring the various conventions involved with constructing fuzzy negations and fuzzy implications (namely, the S and R conventions). We find that under the S convention, it is possible to conduct the Modus Tollens inference argument using Zadeh's compositional extension and any possible t norm. Under the R convention we find that this is not necessarily the case, but that by mixing R implication with S negation we can salvage the product t norm, for example. In conclusion, we have shown that fuzzy logic is a legitimate framework to discuss and address the difficulties plaguing frequentist interpretations of SHT.


Online Graph Dictionary Learning. Dictionary learning is a key tool for representation learning, that explains the data as linear combination of few basic elements. Yet, this analysis is not amenable in the context of graph learning, as graphs usually belong to different metric spaces. We fill this gap by proposing a new online Graph Dictionary Learning approach, which uses the Gromov Wasserstein divergence for the data fitting term. In our work, graphs are encoded through their nodes' pairwise relations and modeled as convex combination of graph atoms, i.e. dictionary elements, estimated thanks to an online stochastic algorithm, which operates on a dataset of unregistered graphs with potentially different number of nodes. Our approach naturally extends to labeled graphs, and is completed by a novel upper bound that can be used as a fast approximation of Gromov Wasserstein in the embedding space. We provide numerical evidences showing the interest of our approach for unsupervised embedding of graph datasets and for online graph subspace estimation and tracking.


MASTAF A Model Agnostic Spatio Temporal Attention Fusion Network for Few shot Video Classification. We propose MASTAF, a Model Agnostic Spatio Temporal Attention Fusion network for few shot video classification. MASTAF takes input from a general video spatial and temporal representation,e.g., using 2D CNN, 3D CNN, and video Transformer. Then, to make the most of such representations, we use self and cross attention models to highlight the critical spatio temporal region to increase the inter class distance and decrease the intra class distance. Last, MASTAF applies a lightweight fusion network and a nearest neighbor classifier to classify each query video. We demonstrate that MASTAF improves the state of the art performance on three few shot video classification benchmarks(UCF101, HMDB51, and Something Something V2), e.g., by up to 91.6 , 69.5 , and 60.7 for five way one shot video classification, respectively.


AM2iCo Evaluating Word Meaning in Context across Low Resource Languages with Adversarial Examples. Capturing word meaning in context and distinguishing between correspondences and variations across languages is key to building successful multilingual and cross lingual text representation models. However, existing multilingual evaluation datasets that evaluate lexical semantics "in context" have various limitations. In particular, 1) their language coverage is restricted to high resource languages and skewed in favor of only a few language families and areas, 2) a design that makes the task solvable via superficial cues, which results in artificially inflated (and sometimes super human) performances of pretrained encoders, on many target languages, which limits their usefulness for model probing and diagnostics, and 3) little support for cross lingual evaluation. In order to address these gaps, we present AM2iCo (Adversarial and Multilingual Meaning in Context), a wide coverage cross lingual and multilingual evaluation set it aims to faithfully assess the ability of state of the art (SotA) representation models to understand the identity of word meaning in cross lingual contexts for 14 language pairs. We conduct a series of experiments in a wide range of setups and demonstrate the challenging nature of AM2iCo. The results reveal that current SotA pretrained encoders substantially lag behind human performance, and the largest gaps are observed for low resource languages and languages dissimilar to English.


Steenrod operations on the modular invariants. In this paper, we compute the action of the mod p Steenrod operations on the modular invariants of the linear groups with p an odd prime number.


Subgraph Contrastive Link Representation Learning. Graph representation learning (GRL) has emerged as a powerful technique for solving graph analytics tasks. It can effectively convert discrete graph data into a low dimensional space where the graph structural information and graph properties are maximumly preserved. While there is rich literature on node and whole graph representation learning, GRL for link is relatively less studied and less understood. One common practice in previous works is to generate link representations by directly aggregating the representations of their incident nodes, which is not capable of capturing effective link features. Moreover, common GRL methods usually rely on full graph training, suffering from poor scalability and high resource consumption on large scale graphs. In this paper, we design Subgraph Contrastive Link Representation Learning (SCLRL) a self supervised link embedding framework, which utilizes the strong correlation between central links and their neighborhood subgraphs to characterize links. We extract the "link centric induced subgraphs" as input, with a subgraph level contrastive discrimination as pretext task, to learn the intrinsic and structural link features via subgraph mini batch training. Extensive experiments conducted on five datasets demonstrate that SCLRL has significant performance advantages in link representation learning on benchmark datasets and prominent efficiency advantages in terms of training speed and memory consumption on large scale graphs, when compared with existing link representation learning methods.


Guided Policy Search for Parameterized Skills using Adverbs. We present a method for using adverb phrases to adjust skill parameters via learned adverb skill groundings. These groundings allow an agent to use adverb feedback provided by a human to directly update a skill policy, in a manner similar to traditional local policy search methods. We show that our method can be used as a drop in replacement for these policy search methods when dense reward from the environment is not available but human language feedback is. We demonstrate improved sample efficiency over modern policy search methods in two experiments.


Analytic ranks of automorphic L functions and Landau Siegel zeros. We relate the study of Landau Siegel zeros to the ranks of Jacobians J 0(q) of modular curves for large primes q . By a conjecture of Brumer Murty, the rank should be equal to half of the dimension. Equivalently, almost all newforms of weight two and level q have analytic rank leq 1 . We show that either Landau Siegel zeros do not exist, or that almost all such newforms have analytic rank leq 2 . In particular, almost all odd newforms have analytic rank equal to one. Additionally, for a sparse set of primes q we show the rank of J 0(q) is asymptotically equal to the rank predicted by the Brumer Murty conjecture.


MoCL Data driven Molecular Fingerprint via Knowledge aware Contrastive Learning from Molecular Graph. Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug related problems. However, like any other deep architectures, GNNs are data hungry. While requiring labels in real world is often expensive, pretraining GNNs in an unsupervised manner has been actively explored. Among them, graph contrastive learning, by maximizing the mutual information between paired graph augmentations, has been shown to be effective on various downstream tasks. However, the current graph contrastive learning framework has two limitations. First, the augmentations are designed for general graphs and thus may not be suitable or powerful enough for certain domains. Second, the contrastive scheme only learns representations that are invariant to local perturbations and thus does not consider the global structure of the dataset, which may also be useful for downstream tasks. Therefore, in this paper, we study graph contrastive learning in the context of biomedical domain, where molecular graphs are present. We propose a novel framework called MoCL, which utilizes domain knowledge at both local and global level to assist representation learning. The local level domain knowledge guides the augmentation process such that variation is introduced without changing graph semantics. The global level knowledge encodes the similarity information between graphs in the entire dataset and helps to learn representations with richer semantics. The entire model is learned through a double contrast objective. We evaluate MoCL on various molecular datasets under both linear and semi supervised settings and results show that MoCL achieves state of the art performance.


Learning Fair Equilibria in Sponsored Search Auctions. In this work we investigate the strategic learning implications of the deployment of sponsored search auction mechanisms that obey to fairness criteria. We introduce a new class of mechanisms composing a traditional Generalized Second Price auction (GSP) with different fair division schemes to achieve some desired level of fairness between two groups of Bayesian strategic advertisers. We propose two mechanisms, beta Fair GSP and GSP EFX, that compose GSP with, respectively, an envy free up to one item (EF1), and an envy free up to any item (EFX) fair division scheme. The payments of GSP are adjusted in order to compensate the advertisers that suffer a loss of efficiency due the fair division stage. We prove that, for both mechanisms, if bidders play so as to minimize their external regret they are guaranteed to reach an equilibrium with good social welfare. We also prove that the mechanisms are budget balanced, so that the payments charged by the traditional GSP mechanism are a good proxy of the total compensation offered to the advertisers. Finally, we evaluate the quality of the allocations of the two mechanisms through experiments on real world data.


Solving Infinite Games in the Baire Space. Infinite games (in the form of Gale Stewart games) are studied where a play is a sequence of natural numbers chosen by two players in alternation, the winning condition being a subset of the Baire space omega omega . We consider such games defined by a natural kind of parity automata over the alphabet mathbb N , called mathbb N MSO automata, where transitions are specified by monadic second order formulas over the successor structure of the natural numbers. We show that the classical B "uchi Landweber Theorem (for finite state games in the Cantor space 2 omega ) holds again for the present games A game defined by a deterministic parity mathbb N MSO automaton is determined, the winner can be computed, and an mathbb N MSO transducer realizing a winning strategy for the winner can be constructed.


Well posedness of a nonlinear shallow water model for an oscillating water column with time dependent air pressure. We propose in this paper a new nonlinear mathematical model of an oscillating water column. The one dimensional shallow water equations in the presence of this device are essentially reformulated as two transmission problems the first one is associated with a step in front of the device and the second one is related to the interaction between waves and a fixed partially immersed structure. By taking advantage of free surface Bernoulli's equation, we close the system by deriving a transmission condition that involves a time dependent air pressure inside the chamber of the device, instead of a constant atmospheric pressure as in the previous work cite bocchihevergara2021 . We then show that the second transmission problem can be reduced to a quasilinear hyperbolic initial boundary value problem with a semilinear boundary condition determined by an ODE depending on the trace of the solution to the PDE at the boundary. Local well posedness for general problems of this type is established via an iterative scheme by using linear estimates for the PDE and nonlinear estimates for the ODE. Finally, the well posedness of the transmission problem related to the wave structure interaction in the oscillating water column is obtained as an application of the general theory.


Continuous control of an underground loader using deep reinforcement learning. Reinforcement learning control of an underground loader is investigated in simulated environment, using a multi agent deep neural network approach. At the start of each loading cycle, one agent selects the dig position from a depth camera image of the pile of fragmented rock. A second agent is responsible for continuous control of the vehicle, with the goal of filling the bucket at the selected loading point, while avoiding collisions, getting stuck, or losing ground traction. It relies on motion and force sensors, as well as on camera and lidar. Using a soft actor critic algorithm the agents learn policies for efficient bucket filling over many subsequent loading cycles, with clear ability to adapt to the changing environment. The best results, on average 75 of the max capacity, are obtained when including a penalty for energy usage in the reward.


Quantum dot photoluminescence as a versatile probe to visualize the interaction between plasma and nanoparticles on a surface. We experimentally demonstrate that the interaction between plasma and nanometer sized semiconductor quantum dots (QDs) is directly connected to a change in their photoluminescence (PL) spectrum. This is done by taking in situ, high resolution, and temporally resolved spectra of the light emitted by laser excited QDs on an electrically floating sample exposed to a low pressure argon plasma. Our results show a fast redshift of the PL emission peak indicating the quantum confined Stark effect due to direct plasma charging of these nanostructures and the substrate surface, while other plasma induced (thermal and ion) effects on longer time scales could clearly be distinguished from these charging effects. The presented results and method open up novel pathways to direct visualization and understanding of fundamental plasma particle interactions on nanometer length scales.


Scale invariant multilevel Monte Carlo method. In this paper, the scale invariant version of the mean and variance multi level Monte Carlo estimate is proposed. The optimization of the computation cost over the grid levels is done with the help of a novel normalized error based on t statistic. In this manner, the algorithm convergence is made invariant to the physical scale at which the estimate is computed. The novel algorithm is tested on the linear elastic example, the constitutive law of which is described by material uncertainty including both heterogeneity and anisotropy.


Computational homogenization of higher order continua. We introduce a novel computational framework for the multiscale simulation of higher order continua that allows for the consideration of first , second and third order effects at both micro and macro level. In line with classical two scale approaches, we describe the microstructure via representative volume elements (RVE) that are attached at each integration point of the macroscopic problem. To take account of the extended continuity requirements of independent fields at micro and macro level, we discretize both scales via isogeometric analysis (IGA). As a result, we obtain an IGA2 method that is conceptually similar to the well known FE2 method. We demonstrate the functionality and accuracy of this novel multiscale method by means of a series of multiscale simulations involving different kinds of higher order continua.


High rate storage codes on triangle free graphs. Consider an assignment of bits to the vertices of a connected graph G(V,E) with the property that the value of each vertex is a function of the values of its neighbors. A collection of such assignments is called a em storage code of length V on G . The storage code problem can be equivalently formulated as maximizing the probability of success in a em guessing game on graphs, or constructing em index codes of small rate. If G contains many cliques, it is easy to construct codes of rate close to 1, so a natural problem is to construct high rate codes on triangle free graphs, where constructing codes of rate 1 2 is a nontrivial task, with few known results. In this work we construct infinite families of linear storage codes with high rate relying on coset graphs of binary linear codes. We also derive necessary conditions for such codes to have high rate, and even rate potentially close to one. We also address correction of multiple erasures in the codeword, deriving recovery guarantees based on expansion properties of the graph. Finally, we point out connections between linear storage codes and quantum CSS codes, a link to bootstrap percolation and contagion spread in graphs, and formulate a number of open problems.


A Frequency Perspective of Adversarial Robustness. Adversarial examples pose a unique challenge for deep learning systems. Despite recent advances in both attacks and defenses, there is still a lack of clarity and consensus in the community about the true nature and underlying properties of adversarial examples. A deep understanding of these examples can provide new insights towards the development of more effective attacks and defenses. Driven by the common misconception that adversarial examples are high frequency noise, we present a frequency based understanding of adversarial examples, supported by theoretical and empirical findings. Our analysis shows that adversarial examples are neither in high frequency nor in low frequency components, but are simply dataset dependent. Particularly, we highlight the glaring disparities between models trained on CIFAR 10 and ImageNet derived datasets. Utilizing this framework, we analyze many intriguing properties of training robust models with frequency constraints, and propose a frequency based explanation for the commonly observed accuracy vs. robustness trade off.


Conditional super network weights. Modern Neural Architecture Search methods have repeatedly broken state of the art results for several disciplines. The super network, a central component of many such methods, enables quick estimates of accuracy or loss statistics for any architecture in the search space. They incorporate the network weights of all candidate architectures and can thus approximate specific ones by applying the respective operations. However, this design ignores potential dependencies between consecutive operations. We extend super networks with conditional weights that depend on combinations of choices and analyze their effect. Experiments in NAS Bench 201 and NAS Bench Macro based search spaces show improvements in the architecture selection and that the resource overhead is nearly negligible for sequential network designs.


Data vs classifiers, who wins?. The experiments covered by Machine Learning (ML) must consider two important aspects to assess the performance of a model datasets and algorithms. Robust benchmarks are needed to evaluate the best classifiers. For this, one can adopt gold standard benchmarks available in public repositories. However, it is common not to consider the complexity of the dataset when evaluating. This work proposes a new assessment methodology based on the combination of Item Response Theory (IRT) and Glicko 2, a rating system mechanism generally adopted to assess the strength of players (e.g., chess). For each dataset in a benchmark, the IRT is used to estimate the ability of classifiers, where good classifiers have good predictions for the most difficult test instances. Tournaments are then run for each pair of classifiers so that Glicko 2 updates performance information such as rating value, rating deviation and volatility for each classifier. A case study was conducted hereby which adopted the OpenML CC18 benchmark as the collection of datasets and pool of various classification algorithms for evaluation. Not all datasets were observed to be really useful for evaluating algorithms, where only 10 were considered really difficult. Furthermore, the existence of a subset containing only 50 of the original amount of OpenML CC18 was verified, which is equally useful for algorithm evaluation. Regarding the algorithms, the methodology proposed herein identified the Random Forest as the algorithm with the best innate ability.


physics.geo-ph cs.CE cs.NA math.NA physics.flu-dyn

A hybrid discrete continuum approach to model hydro mechanical behaviour of soil during desiccation. Desiccation cracking in clayey soils occurs when they lose moisture, leading to an increase in their compressibility and hydraulic conductivity and hence significant reduction of soil strength. The prediction of desiccation cracking in soils is challenging due to the lack of insights into the complex coupled hydro mechanical process at the grain scale. In this paper, a new hybrid discrete continuum numerical framework, capable of capturing hydro mechanical behaviour of soil at both grain and macro scales, is proposed for predicting desiccation cracking in clayey soil. In this framework, a soil layer is represented by an assembly of DEM particles, each occupies an equivalent continuum space and carries physical properties governing unsaturated flow. These particles move freely in the computational space following the discrete element method (DEM), while their contact network and the continuum mixture theory are used to model the unsaturated flow. The dependence of particle to particle contact behaviour on water content is represented by a cohesive frictional contact model, whose material properties are governed by the water content. In parallel with the theoretical development is a series of experiments on 3D soil desiccation cracking to determine essential properties and provide data for the validation of mechanical and physical behaviour. Very good agreement in both physical behaviour (e.g. evolution of water content) and mechanical behaviour (e.g. occurrence and development of cracks, and distribution of compressive and tensile strains) demonstrates that the proposed framework is capable of capturing the hydro mechanical behaviour of soil during desiccation. The capability of the proposed framework facilitates numerical experiments for insights into the hydro mechanical behaviour of unsaturated soils that have not been possible before.


Smoothing and Shrinking the Sparse Seq2Seq Search Space. Current sequence to sequence models are trained to minimize cross entropy and use softmax to compute the locally normalized probabilities over target sequences. While this setup has led to strong results in a variety of tasks, one unsatisfying aspect is its length bias models give high scores to short, inadequate hypotheses and often make the empty string the argmax the so called cat got your tongue problem. Recently proposed entmax based sparse sequence to sequence models present a possible solution, since they can shrink the search space by assigning zero probability to bad hypotheses, but their ability to handle word level tasks with transformers has never been tested. In this work, we show that entmax based models effectively solve the cat got your tongue problem, removing a major source of model error for neural machine translation. In addition, we generalize label smoothing, a critical regularization technique, to the broader family of Fenchel Young losses, which includes both cross entropy and the entmax losses. Our resulting label smoothed entmax loss models set a new state of the art on multilingual grapheme to phoneme conversion and deliver improvements and better calibration properties on cross lingual morphological inflection and machine translation for 6 language pairs.


Multivariate approximation by polynomial and generalised rational functions. In this paper we develop an optimisation based approach to multivariate Chebyshev approximation on a finite grid. We consider two models multivariate polynomial approximation and multivariate generalised rational approximation. In the second case the approximations are ratios of linear forms and the basis functions are not limited to monomials. It is already known that in the case of multivariate polynomial approximation on a finite grid the corresponding optimisation problems can be reduced to solving a linear programming problem, while the area of multivariate rational approximation is not so well understood.In this paper we demonstrate that in the case of multivariate generalised rational approximation the corresponding optimisation problems are quasiconvex. This statement remains true even when the basis functions are not limited to monomials. Then we apply a bisection method, which is a general method for quasiconvex optimisation. This method converges to an optimal solution with given precision. We demonstrate that the convex feasibility problems appearing in the bisection method can be solved using linear programming. Finally, we compare the deviation error and computational time for multivariate polynomial and generalised rational approximation with the same number of decision variables.