On the magic square C algebra of size 4. In this paper, we investigate the structure of the magic square C algebra A(4) of size 4. We show that a certain twisted crossed product of A(4) is isomorphic to the homogeneous C algebra M 4(C( mathbb R P 3)) . Using this result, we show that A(4) is isomorphic to the fixed point algebra of M 4(C( mathbb R P 3)) by a certain action. From this concrete realization of A(4) , we compute the K groups of A(4) and their generators.


Efficient solvers for Armijo's backtracking problem. Backtracking is an inexact line search procedure that selects the first value in a sequence x 0, x 0 beta, x 0 beta 2... that satisfies g(x) leq 0 on mathbb R with g(x) leq 0 iff x leq x . This procedure is widely used in descent direction optimization algorithms with Armijo type conditions. It both returns an estimate in ( beta x ,x and enjoys an upper bound lceil log beta epsilon x 0 rceil on the number of function evaluations to terminate, with epsilon a lower bound on x . The basic bracketing mechanism employed in several root searching methods is adapted here for the purpose of performing inexact line searches, leading to a new class of inexact line search procedures. The traditional bisection algorithm for root searching is transposed into a very simple method that completes the same inexact line search in at most lceil log 2 log beta epsilon x 0 rceil function evaluations. A recent bracketing algorithm for root searching which presents both minmax function evaluation cost (as the bisection algorithm) and superlinear convergence is also transposed, asymptotically requiring sim log log log epsilon x 0 function evaluations for sufficiently smooth functions. Other bracketing algorithms for root searching can be adapted in the same way. Numerical experiments suggest time savings of 50 to 80 in each call to the inexact search procedure.


Lightning Stokes solver. Gopal and Trefethen recently introduced "lightning solvers" for the 2D Laplace and Helmholtz equations, based on rational functions with poles exponentially clustered near singular corners. Making use of the Goursat representation in terms of analytic functions, we extend these methods to the biharmonic equation, specifically to 2D Stokes flow. Solutions to model problems are computed to 10 digit accuracy in less than a second of laptop time. As an illustration of the high accuracy, we resolve two or more counter rotating Moffatt eddies near a singular corner.


Super accuracy calculation for the width of a Voigt profile. A simple approximation scheme to describe the width of the Voigt profile as a function of the relative contributions of Gaussian and Lorentzian broadening is presented. The proposed approximation scheme is highly accurate and provides accuracy better than 10 17 for arbitrary aLaG ratios. In particular, the accuracy reaches an astonishing 10 34 (quadruple precision) in the domain aLaG less than 0.2371 and aLaG greater than 33.8786.


Affine semigroups of maximal projective dimension. We generalize the notion of symmetric semigroups, pseudo symmetric semigroups, and row factorization matrices for pseudo Frobenius elements of numerical semigroups to the case of semigroups with maximal projective dimension (MPD semigroups).


Dynamic Class Queue for Large Scale Face Recognition In the Wild. Learning discriminative representation using large scale face datasets in the wild is crucial for real world applications, yet it remains challenging. The difficulties lie in many aspects and this work focus on computing resource constraint and long tailed class distribution. Recently, classification based representation learning with deep neural networks and well designed losses have demonstrated good recognition performance. However, the computing and memory cost linearly scales up to the number of identities (classes) in the training set, and the learning process suffers from unbalanced classes. In this work, we propose a dynamic class queue (DCQ) to tackle these two problems. Specifically, for each iteration during training, a subset of classes for recognition are dynamically selected and their class weights are dynamically generated on the fly which are stored in a queue. Since only a subset of classes is selected for each iteration, the computing requirement is reduced. By using a single server without model parallel, we empirically verify in large scale datasets that 10 of classes are sufficient to achieve similar performance as using all classes. Moreover, the class weights are dynamically generated in a few shot manner and therefore suitable for tail classes with only a few instances. We show clear improvement over a strong baseline in the largest public dataset Megaface Challenge2 (MF2) which has 672K identities and over 88 of them have less than 10 instances. Code is available at https github.com bilylee DCQ


Donoho Starks and Hardys Uncertainty Principles for the Shortotime Quaternion Offset Linear Canonical Transform Donoho Stark's and Hardy's Uncertainty Principles for the Short time Quaternion Offset Linear Canonical Transform. The quaternion offset linear canonical transform (QOLCT) which is time shifted and frequency modulated version of the quaternion linear canonical transform (QLCT) provides a more general framework of most existing signal processing tools. For the generalized QOLCT, the classical Heisenbergs and Liebs uncertainty principles have been studied recently. In this paper, we first define the shorttime quaternion offset linear canonical transform (STQOLCT) and drive its relationship with the quaternion Fourier transform (QFT). The crux of the paper lies in the generalization of several well known uncertainty principles for the STQOLCT, including Donoho Starks uncertainty principle, Hardys uncertainty principle, Beurlings uncertainty principle, and Logarithmic uncertainty principle.


An Improvement of a Key Exchange Protocol Relying on Polynomial Maps. Akiyama et al. (Int. J. Math. Indust., 2019) proposed a post quantum key exchange protocol that is based on the hardness of solving a system of multivariate non linear polynomial equations but has a design strategy different from ordinary multivariate cryptography. However, their protocol has a drawback that the probability of failing to establish a common key is impractically high. In this paper, we improve the success probability of Akiyama et al.'s key exchange protocol significantly while keeping the security, by restricting each component of the correct common key from the whole of the coefficient field to its small subset. We give theoretical and experimental evaluations showing that our proposed parameter set for our protocol is expected to achieve both failure probability 2 120 and 128 bit security level.


Rankin Selberg convolutions for mathrm GL (n) times mathrm GL (n) and mathrm GL (n) times mathrm GL (n 1) for principal series representations. Let mathsf k be a local field. Let I nu and I nu' be smooth principal series representations of mathrm GL n( mathsf k) and mathrm GL n 1 ( mathsf k) respectively. The Rankin Selberg integrals yield a continuous bilinear map I nu times I nu' rightarrow mathbb C with a certain invariance property. We study integrals over a certain open orbit that also yield a continuous bilinear map I nu times I nu' rightarrow mathbb C with the same invariance property, and show that these integrals equal the Rankin Selberg integrals up to an explicit constant. Similar results are also obtained for Rankin Selberg integrals for mathrm GL n( mathsf k) times mathrm GL n( mathsf k) .


Can Romeo and Juliet Meet? Or Rendezvous Games with Adversaries on Graphs. We introduce the rendezvous game with adversaries. In this game, two players, sl Facilitator and sl Disruptor , play against each other on a graph. Facilitator has two agents, and Disruptor has a team of k agents located in some vertices of the graph. They take turns in moving their agents to adjacent vertices (or staying). Facilitator wins if his agents meet in some vertex of the graph. The goal of Disruptor is to prevent the rendezvous of Facilitator's agents. Our interest is to decide whether Facilitator can win. It appears that, in general, the problem is PSPACE hard and, when parameterized by k , co W 2 hard. Moreover, even the game's variant where we ask whether Facilitator can ensure the meeting of his agents within tau steps is co NP complete already for tau 2 . On the other hand, for chordal and P 5 free graphs, we prove that the problem is solvable in polynomial time. These algorithms exploit an interesting relation of the game and minimum vertex cuts in certain graph classes. Finally, we show that the problem is fixed parameter tractable parameterized by both the graph's neighborhood diversity and tau .


Actions of tame abelian product groups. A Polish group G is tame if for any continuous action of G , the corresponding orbit equivalence relation is Borel. When G prod n Gamma n for countable abelian Gamma n , Solecki (1995) gave a characterization for when G is tame. Ding and Gao (2017) showed that for such G , the orbit equivalence relation must in fact be potentially mathbf Pi 0 6 , while conjecturing that the optimal bound could be mathbf Pi 0 3 . We show that the optimal bound is D( mathbf Pi 0 5) by constructing an action of such a group G which is not potentially mathbf Pi 0 5 , and show how to modify the analysis of Ding and Gao to get this slightly better upper bound. It follows, using the results of Hjorth, Kechris, and Louvaeu (1998), that this is the optimal bound for the potential complexity of actions of tame abelian product groups. Our lower bound analysis involves forcing over models of set theory where choice fails for sequences of finite sets.


Margin Calibration for Long Tailed Visual Recognition. The long tailed class distribution in visual recognition tasks poses great challenges for neural networks on how to handle the biased predictions between head and tail classes, i.e., the model tends to classify tail classes as head classes. While existing research focused on data resampling and loss function engineering, in this paper, we take a different perspective the classification margins. We study the relationship between the margins and logits (classification scores) and empirically observe the biased margins and the biased logits are positively correlated. We propose MARC, a simple yet effective MARgin Calibration function to dynamically calibrate the biased margins for unbiased logits. We validate MARC through extensive experiments on common long tailed benchmarks including CIFAR LT, ImageNet LT, Places LT, and iNaturalist LT. Experimental results demonstrate that our MARC achieves favorable results on these benchmarks. In addition, MARC is extremely easy to implement with just three lines of code. We hope this simple method will motivate people to rethink the biased margins and biased logits in long tailed visual recognition.


Codimension 2 transfer of higher index invariants. This paper is devoted to the study of the higher index theory of codimension 2 submanifolds originated by Gromov Lawson and Hanke Pape Schick. The first main result is to construct the codimension 2 transfer' map from the Higson Roe analytic surgery exact sequence of a manifold M to that of its codimension 2 submanifold N under some assumptions on homotopy groups. This map sends the primary and secondary higher index invariants of M to those of N . The second is to establish that the codimension 2 transfer map is adjoint to the co transfer map in cyclic cohomology, defined by the cup product with a group cocycle. This relates the Connes Moscovici higher index pairing and Lott's higher rho number of M with those of N .


A shadow of the repulsive Rutherford scattering and Hamilton vector. The fact that repulsive Rutherford scattering casts a paraboloidal shadow is rarely exploited in introductory mechanics textbooks. Another rarely used construction in such textbooks is the Hamilton vector, a cousin of the more famous Laplace Runge Lenz vector. We will show how the latter (Hamilton's vector) can be used to explain and clarify the former (paraboloidal shadow).


cliquematch Finding correspondence via cliques in large graphs. The maximum clique problem finds applications in computer vision, bioinformatics, and network analysis, many of which involve the construction of correspondence graphs to find similarities between two given objects. cliquematch is a Python package designed for this purpose it provides a simple framework to construct correspondence graphs, and implements an algorithm to find and enumerate maximum cliques in C , that can process graphs of a few million edges on consumer hardware, with comparable performance to publicly available methods.


Plan Based Relaxed Reward Shaping for Goal Directed Tasks. In high dimensional state spaces, the usefulness of Reinforcement Learning (RL) is limited by the problem of exploration. This issue has been addressed using potential based reward shaping (PB RS) previously. In the present work, we introduce Final Volume Preserving Reward Shaping (FV RS). FV RS relaxes the strict optimality guarantees of PB RS to a guarantee of preserved long term behavior. Being less restrictive, FV RS allows for reward shaping functions that are even better suited for improving the sample efficiency of RL algorithms. In particular, we consider settings in which the agent has access to an approximate plan. Here, we use examples of simulated robotic manipulation tasks to demonstrate that plan based FV RS can indeed significantly improve the sample efficiency of RL over plan based PB RS.


Performance of wall modeled LES for external aerodynamics in the NASA Juncture Flow. We investigate the performance of wall modeled LES for external aerodynamics in the NASA Juncture Flow. We characterize the errors in the prediction of mean velocity profiles and pressure coefficient for three different locations over the aircraft the upstream region of the fuselage, the wing body juncture, and the wing body juncture close to the trailing edge. The last two locations are characterized by strong mean flow three dimensionality and separation. The message conveyed by our error analysis is that WMLES performs as expected in regions where the flow resembles a zero pressure gradient flat plate boundary layer. However, there is a clear decline of the current models in the presence of wing body junctions and, more acutely, in separated zones. The slow convergence to the solution in these regions renders the brute force grid refinement approach to improve the accuracy of the solution unfeasible. The results reported above pertain to the mean velocity profile predicted using the typical grid resolution for external aerodynamics applications, i.e., 5 20 points per boundary layer thickness. The prediction of the pressure coefficient is below 5 error for all grid sizes considered, even when boundary layers were marginally resolved. The latter accuracy can be attributed to the outer layer nature of the mean pressure, which becomes less sensitive to flow details within the turbulent boundary layer. Finally, we show that boundary layer conforming grids (i.e., grids maintaining a constant number of points per boundary layer thickness) allow for a more efficient distribution of grid points and smaller errors. Our results suggest that novel modeling venues encompassing physical insights, together with numerical and gridding advancements, must be exploited to attain predictions within the tolerance required for Certification by Analysis.


A structure preserving front tracking finite element method for the Mullins Sekerka problem. We introduce and analyse a fully discrete approximation for a mathematical model for the solidification and liquidation of materials of negligible specific heat. The model is a two sided Mullins Sekerka problem. The discretization uses finite elements in space and an independent parameterization of the moving free boundary. We prove unconditional stability and exact volume conservation for the introduced scheme. Several numerical simulations, including for nearly crystalline surface energies, demonstrate the practicality and accuracy of the presented numerical method.


The multivariate functional de Jong CLT. We prove a multivariate functional version of de Jong's CLT (1990) yielding that, given a sequence of vectors of Hoeffding degenerate U statistics, the corresponding empirical processes on 0,1 weakly converge in the Skorohod space as soon as their fourth cumulants in t 1 vanish asymptotically and a certain strengthening of the Lindeberg type condition is verified. As an application, we lift to the functional level the universality of Wiener chaos' phenomenon first observed in Nourdin, Peccati and Reinert (2010).


Inverse design enables large scale high performance meta optics reshaping virtual reality. Meta optics has achieved major breakthroughs in the past decade however, conventional forward design faces challenges as functionality complexity and device size scale up. Inverse design aims at optimizing meta optics design but has been currently limited by expensive brute force numerical solvers to small devices, which are also difficult to realize experimentally. Here, we present a general inverse design framework for aperiodic large scale complex meta optics in three dimensions, which alleviates computational cost for both simulation and optimization via a fast approximate solver and an adjoint method, respectively. Our framework naturally accounts for fabrication constraints via a surrogate model. In experiments, we demonstrate, for the first time, aberration corrected metalenses working in the visible with high numerical aperture, poly chromatic focusing, and large diameter up to centimeter scale. Such large scale meta optics opens a new paradigm for applications, and we demonstrate its potential for future virtual reality platforms by using a meta eyepiece and a laser back illuminated micro Liquid Crystal Display.


Plug and Play, Model Based Reinforcement Learning. Sample efficient generalisation of reinforcement learning approaches have always been a challenge, especially, for complex scenes with many components. In this work, we introduce Plug and Play Markov Decision Processes, an object based representation that allows zero shot integration of new objects from known object classes. This is achieved by representing the global transition dynamics as a union of local transition functions, each with respect to one active object in the scene. Transition dynamics from an object class can be pre learnt and thus would be ready to use in a new environment. Each active object is also endowed with its reward function. Since there is no central reward function, addition or removal of objects can be handled efficiently by only updating the reward functions of objects involved. A new transfer learning mechanism is also proposed to adapt reward function in such cases. Experiments show that our representation can achieve sample efficiency in a variety of set ups.


A General Approach for Lookback Option Pricing under Markov Models. We propose a very efficient method for pricing various types of lookback options under Markov models. We utilize the model free representations of lookback option prices as integrals of first passage probabilities. We combine efficient numerical quadrature with continuous time Markov chain approximation for the first passage problem to price lookbacks. Our method is applicable to a variety of models, including one dimensional time homogeneous and time inhomogeneous Markov processes, regime switching models and stochastic local volatility models. We demonstrate the efficiency of our method through various numerical examples.


Learning RAW to sRGB Mappings with Inaccurately Aligned Supervision. Learning RAW to sRGB mapping has drawn increasing attention in recent years, wherein an input raw image is trained to imitate the target sRGB image captured by another camera. However, the severe color inconsistency makes it very challenging to generate well aligned training pairs of input raw and target sRGB images. While learning with inaccurately aligned supervision is prone to causing pixel shift and producing blurry results. In this paper, we circumvent such issue by presenting a joint learning model for image alignment and RAW to sRGB mapping. To diminish the effect of color inconsistency in image alignment, we introduce to use a global color mapping (GCM) module to generate an initial sRGB image given the input raw image, which can keep the spatial location of the pixels unchanged, and the target sRGB image is utilized to guide GCM for converting the color towards it. Then a pre trained optical flow estimation network (e.g., PWC Net) is deployed to warp the target sRGB image to align with the GCM output. To alleviate the effect of inaccurately aligned supervision, the warped target sRGB image is leveraged to learn RAW to sRGB mapping. When training is done, the GCM module and optical flow network can be detached, thereby bringing no extra computation cost for inference. Experiments show that our method performs favorably against state of the arts on ZRR and SR RAW datasets. With our joint learning model, a light weight backbone can achieve better quantitative and qualitative performance on ZRR dataset. Codes are available at https github.com cszhilu1998 RAW to sRGB.


Tamed exhaustion functions and Schwarz type lemmas for almost Hermitian manifolds. In this paper, we study a special exhaustion function on almost Hermitian manifolds and establish the existence result by using the Hessian comparison theorem. From the viewpoint of the exhaustion function, we establish related Schwarz type lemmas for almost holomorphic maps between two almost Hermitian manifolds. As corollaries, we deduce Liouville type theorems for almost holomorphic maps.


Sentiment Analysis for Open Domain Conversational Agent. The applicability of common sentiment analysis models to open domain human robot interaction is investigated within this paper. The models are used on a dataset specific to user interaction with the Alana system (a Alexa prize system) in order to determine which would be more appropriate for the task of identifying sentiment when a user interacts with a non human driven socialbot. With the identification of a model, various improvements are attempted and detailed prior to integration into the Alana system. The study showed that a Random Forest Model with 25 trees trained on the dataset specific to user interaction with the Alana system combined with the dataset present in NLTK Vader outperforms other models. The new system (called 'Rob') matches it's output utterance sentiment with the user's utterance sentiment. This method is expected to improve user experience because it builds upon the overall sentiment detection which makes it seem that new system sympathises with user feelings. Furthermore, the results obtained from the user feedback confirms our expectation.


Mixed Nash Equilibria in the Adversarial Examples Game. This paper tackles the problem of adversarial examples from a game theoretic point of view. We study the open question of the existence of mixed Nash equilibria in the zero sum game formed by the attacker and the classifier. While previous works usually allow only one player to use randomized strategies, we show the necessity of considering randomization for both the classifier and the attacker. We demonstrate that this game has no duality gap, meaning that it always admits approximate Nash equilibria. We also provide the first optimization algorithms to learn a mixture of classifiers that approximately realizes the value of this game, emph i.e. procedures to build an optimally robust randomized classifier.


An interview method for engaging personal data. Whether investigating research questions or designing systems, many researchers and designers need to engage users with their personal data. However, it is difficult to successfully design user facing tools for interacting with personal data without first understanding what users want to do with their data. Techniques for raw data exploration, sketching, or physicalization can avoid the perils of tool development, but prevent direct analytical access to users' rich personal data. We present a new method that directly tackles this challenge the data engagement interview. This interview method incorporates an analyst to provide real time personal data analysis, granting interview participants the opportunity to directly engage with their data, and interviewers to observe and ask questions throughout this engagement. We describe the method's development through a case study with asthmatic participants, share insights and guidance from our experience, and report a broad set of insights from these interviews.


'1e0a' A Computational Approach to Rhythm Training. We present a computational assessment system that promotes the learning of basic rhythmic patterns. The system is capable of generating multiple rhythmic patterns with increasing complexity within various cycle lengths. For a generated rhythm pattern the performance assessment of the learner is carried out through the statistical deviations calculated from the onset detection and temporal assessment of a learner's performance. This is compared with the generated pattern, and their performance accuracy forms the feedback to the learner. The system proceeds to generate a new pattern of increased complexity when performance assessment results are within certain error bounds. The system thus mimics a learner teacher relationship as the learner progresses in their feedback based learning. The choice of progression within a cycle for each pattern is determined by a predefined complexity metric. This metric is based on a coded element model for the perceptual processing of sequential stimuli. The model earlier proposed for a sequence of tones and non tones, is now used for onsets and silences. This system is developed into a web based application and provides accessibility for learning purposes. Analysis of the performance assessments shows that the complexity metric is indicative of the perceptual processing of rhythm patterns and can be used for rhythm learning.


Freely floating objects on a fluid governed by the Boussinesq equations. We investigate here the interactions of waves governed by a Boussinesq system with a partially immersed body allowed to move freely in the vertical direction. We show that the whole system of equations can be reduced to a transmission problem for the Boussinesq equations with transmission conditions given in terms of the vertical displacement of the object and of the average horizontal discharge beneath it these two quantities are in turn determined by two nonlinear ODEs with forcing terms coming from the exterior wave field. Understanding the dispersive contribution to the added mass phenomenon allows us to solve these equations, and a new dispersive hidden regularity effect is used to derive uniform estimates with respect to the dispersive parameter. We then derive an abstract general Cummins equation describing the motion of the solid in the return to equilibrium problem and show that it takes an explicit simple form in two cases, namely, the nonlinear non dispersive and the linear dispersive cases we show in particular that the decay rate towards equilibrium is much smaller in the presence of dispersion. The latter situation also involves an initial boundary value problem for a nonlocal scalar equation that has an interest of its own and for which we consequently provide a general analysis.


Numerical analysis of 2D Navier Stokes equations with additive stochastic forcing. We propose and study a temporal, and spatio temporal discretisation of the 2D stochastic Navier Stokes equations in bounded domains supplemented with no slip boundary conditions. Considering additive noise, we base its construction on the related nonlinear random PDE, which is solved by a transform of the solution of the stochastic Navier Stokes equations. We show strong rate (up to) 1 in probability for a corresponding discretisation in space and time (and space time). Convergence of order (up to) 1 in time was previously only known for linear SPDEs.


Trends, Directions for Further Research, and Some Open Problems of Fractional Calculus. The area of fractional calculus (FC) has been fast developing and is presently being applied in all scientific fields. Therefore, it is of key relevance to assess the present state of development and to foresee, if possible, the future evolution, or, at least, the challenges identified in the scope of advanced research works. This paper gives a vision about the directions for further research as well as some open problems of FC. A number of topics in mathematics, numerical algorithms and physics are analyzed, giving a systematic perspective for future research.


Exploiting Action Impact Regularity and Exogenous State Variables for Offline Reinforcement Learning. Offline reinforcement learning learning a policy from a batch of data is known to be hard for general MDPs. In this work, we explore a restricted class of MDPs to obtain guarantees for offline reinforcement learning. The key property, which we call Action Impact Regularity (AIR), is that actions primarily impact a part of the state (an endogenous component) with limited impact on the remaining part of the state (an exogenous component). We propose an algorithm that exploits the AIR property, and provide theoretical guarantees for the outputted policy. Finally, we demonstrate that our algorithm outperforms existing offline reinforcement learning algorithms across different data collection policies in simulated and real world environments where the regularity holds.


The Benefit of the Doubt Uncertainty Aware Sensing for Edge Computing Platforms. Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well being and health, state of the art uncertainty estimation techniques are computationally expensive when applied to resource constrained devices. We propose an efficient framework for predictive uncertainty estimation in NNs deployed on embedded edge systems with no need for fine tuning or re training strategies. To meet the energy and latency requirements of these embedded platforms the framework is built from the ground up to provide predictive uncertainty based only on one forward pass and a negligible amount of additional matrix multiplications with theoretically proven correctness. Our aim is to enable already trained deep learning models to generate uncertainty estimates on resource limited devices at inference time focusing on classification tasks. This framework is founded on theoretical developments casting dropout training as approximate inference in Bayesian NNs. Our layerwise distribution approximation to the convolution layer cascades through the network, providing uncertainty estimates in one single run which ensures minimal overhead, especially compared with uncertainty techniques that require multiple forwards passes and an equal linear rise in energy and latency requirements making them unsuitable in practice. We demonstrate that it yields better performance and flexibility over previous work based on multilayer perceptrons to obtain uncertainty estimates. Our evaluation with mobile applications datasets shows that our approach not only obtains robust and accurate uncertainty estimations but also outperforms state of the art methods in terms of systems performance, reducing energy consumption (up to 28x), keeping the memory overhead at a minimum while still improving accuracy (up to 16 ).


Where Did You Learn That From? Surprising Effectiveness of Membership Inference Attacks Against Temporally Correlated Data in Deep Reinforcement Learning. While significant research advances have been made in the field of deep reinforcement learning, a major challenge to widespread industrial adoption of deep reinforcement learning that has recently surfaced but little explored is the potential vulnerability to privacy breaches. In particular, there have been no concrete adversarial attack strategies in literature tailored for studying the vulnerability of deep reinforcement learning algorithms to membership inference attacks. To address this gap, we propose an adversarial attack framework tailored for testing the vulnerability of deep reinforcement learning algorithms to membership inference attacks. More specifically, we design a series of experiments to investigate the impact of temporal correlation, which naturally exists in reinforcement learning training data, on the probability of information leakage. Furthermore, we study the differences in the performance of emph collective and emph individual membership attacks against deep reinforcement learning algorithms. Experimental results show that the proposed adversarial attack framework is surprisingly effective at inferring the data used during deep reinforcement training with an accuracy exceeding 84 in individual and 97 in collective mode on two different control tasks in OpenAI Gym, which raises serious privacy concerns in the deployment of models resulting from deep reinforcement learning. Moreover, we show that the learning state of a reinforcement learning algorithm significantly influences the level of the privacy breach.


Expansion formulas for multiple basic hypergeometric series over root systems. We extend expansion formulas of Liu given in 2013 to the context of multiple series over root systems. Liu and others have shown the usefulness of these formulas in Special Functions and number theoretic contexts. We extend Wang and Ma's generalizations of Liu's work which they obtained using q Lagrange inversion. We use the A n and C n Bailey transformation and other summation theorems due to Gustafson, Milne, Milne and Lilly, and others, from the theory of A n , C n and D n basic hypergeometric series.


Context Aware Image Inpainting with Learned Semantic Priors. Recent advances in image inpainting have shown impressive results for generating plausible visual details on rather simple backgrounds. However, for complex scenes, it is still challenging to restore reasonable contents as the contextual information within the missing regions tends to be ambiguous. To tackle this problem, we introduce pretext tasks that are semantically meaningful to estimating the missing contents. In particular, we perform knowledge distillation on pretext models and adapt the features to image inpainting. The learned semantic priors ought to be partially invariant between the high level pretext task and low level image inpainting, which not only help to understand the global context but also provide structural guidance for the restoration of local textures. Based on the semantic priors, we further propose a context aware image inpainting model, which adaptively integrates global semantics and local features in a unified image generator. The semantic learner and the image generator are trained in an end to end manner. We name the model SPL to highlight its ability to learn and leverage semantic priors. It achieves the state of the art on Places2, CelebA, and Paris StreetView datasets.


A surprisal duration trade off across and within the world's languages. While there exist scores of natural languages, each with its unique features and idiosyncrasies, they all share a unifying theme enabling human communication. We may thus reasonably predict that human cognition shapes how these languages evolve and are used. Assuming that the capacity to process information is roughly constant across human populations, we expect a surprisal duration trade off to arise both across and within languages. We analyse this trade off using a corpus of 600 languages and, after controlling for several potential confounds, we find strong supporting evidence in both settings. Specifically, we find that, on average, phones are produced faster in languages where they are less surprising, and vice versa. Further, we confirm that more surprising phones are longer, on average, in 319 languages out of the 600. We thus conclude that there is strong evidence of a surprisal duration trade off in operation, both across and within the world's languages.


q-bio.MN cs.LG physics.bio-ph q-bio.BM q-bio.QM

AI challenges for predicting the impact of mutations on protein stability. Stability is a key ingredient of protein fitness and its modification through targeted mutations has applications in various fields such as protein engineering, drug design and deleterious variant interpretation. Many studies have been devoted over the past decades to building new, more effective methods for predicting the impact of mutations on protein stability, based on the latest developments in artificial intelligence (AI). We discuss their features, algorithms, computational efficiency, and accuracy estimated on an independent test set. We focus on a critical analysis of their limitations, the recurrent biases towards the training set, their generalizability and interpretability. We found that the accuracy of the predictors has stagnated at around 1 kcal mol for over 15 years. We conclude by discussing the challenges that need to be addressed to reach improved performance.


Exploring Text transformers in AAAI 2021 Shared Task COVID 19 Fake News Detection in English. In this paper, we describe our system for the AAAI 2021 shared task of COVID 19 Fake News Detection in English, where we achieved the 3rd position with the weighted F1 score of 0.9859 on the test set. Specifically, we proposed an ensemble method of different pre trained language models such as BERT, Roberta, Ernie, etc. with various training strategies including warm up,learning rate schedule and k fold cross validation. We also conduct an extensive analysis of the samples that are not correctly classified. The code is available at https github.com archersama 3rd solution COVID19 Fake News Detection in English.


Monte Carlo Scene Search for 3D Scene Understanding. We explore how a general AI algorithm can be used for 3D scene understanding to reduce the need for training data. More exactly, we propose a modification of the Monte Carlo Tree Search (MCTS) algorithm to retrieve objects and room layouts from noisy RGB D scans. While MCTS was developed as a game playing algorithm, we show it can also be used for complex perception problems. Our adapted MCTS algorithm has few easy to tune hyperparameters and can optimise general losses. We use it to optimise the posterior probability of objects and room layout hypotheses given the RGB D data. This results in an analysis by synthesis approach that explores the solution space by rendering the current solution and comparing it to the RGB D observations. To perform this exploration even more efficiently, we propose simple changes to the standard MCTS' tree construction and exploration policy. We demonstrate our approach on the ScanNet dataset. Our method often retrieves configurations that are better than some manual annotations, especially on layouts.


How Do Your Biomedical Named Entity Recognition Models Generalize to Novel Entities?. The number of biomedical literature on new biomedical concepts is rapidly increasing, which necessitates a reliable biomedical named entity recognition (BioNER) model for identifying new and unseen entity mentions. However, it is questionable whether existing models can effectively handle them. In this work, we systematically analyze the three types of recognition abilities of BioNER models memorization, synonym generalization, and concept generalization. We find that although current best models achieve state of the art performance on benchmarks based on overall performance, they have limitations in identifying synonyms and new biomedical concepts, indicating they are overestimated in terms of their generalization abilities. We also investigate failure cases of models and identify several difficulties in recognizing unseen mentions in biomedical literature as follows (1) models tend to exploit dataset biases, which hinders the models' abilities to generalize, and (2) several biomedical names have novel morphological patterns with weak name regularity, and models fail to recognize them. We apply a statistics based debiasing method to our problem as a simple remedy and show the improvement in generalization to unseen mentions. We hope that our analyses and findings would be able to facilitate further research into the generalization capabilities of NER models in a domain where their reliability is of utmost importance.


Compatible systems of ell adic sheaves. We introduce a notion of compatibility for families ( mathcal F ell ) ell of bounded constructible ell adic complexes of 'etale sheaves on schemes. For schemes of finite type over a field, this notion is preserved by the usual six functors. We prove that the compatibility of a family is preserved by the nearby cycles functor and by the linearized varepsilon factors introduced recently by the author. We establish independence of ell for the characteristic cycles and characteristic varepsilon cycles of compatible families.


Improving Optimal Power Flow Relaxations Using 3 Cycle Second Order Cone Constraints. This paper develops a novel second order cone relaxation of the semidefinite programming formulation of optimal power flow, that does not imply the angle relaxation'. We build on a technique developed by Kim et al., extend it for complex matrices, and apply it to 3x3 positive semidefinite matrices to generate novel second order cone constraints that augment upon the well known 2x2 principal minor based second order cone constraints. Finally, we apply it to optimal power flow in meshed networks and provide numerical illustrations.


The Two Weight Inequality for Poisson Semigroup on Manifold with Ends. Let M mathbb R m sharp mathcal R n be a non doubling manifold with two ends mathbb R m sharp mathcal R n , m n ge 3 . Let Delta be the Laplace Beltrami operator which is non negative self adjoint on L 2(M) . Then Delta and its square root sqrt Delta generate the semigroups e t Delta and e t sqrt Delta on L 2(M) , respectively. We give testing conditions for the two weight inequality for the Poisson semigroup e t sqrt Delta to hold in this setting. In particular, we prove that for a measure mu on M M times (0, infty) and sigma on M mathsf P sigma(f) L 2(M mu) lesssim f L 2(M sigma) , with mathsf P sigma(f)(x,t) int M mathsf P t(x,y)f(y) ,d sigma(y) if and only if testing conditions hold for the Poisson semigroup and its adjoint. Further, the norm of the operator is shown to be equivalent to the best constant in these testing conditions.


Explicit RIP matrices an update. Leveraging recent advances in additive combinatorics, we exhibit explicit matrices satisfying the Restricted Isometry Property with better parameters. Namely, for varepsilon 3.26 cdot 10 7 , large k and k 2 varepsilon le N le k 2 varepsilon , we construct n times N RIP matrices of order k with k Omega( n 1 2 varepsilon 4 ) .


Inspect, Understand, Overcome A Survey of Practical Methods for AI Safety. The use of deep neural networks (DNNs) in safety critical applications like mobile health and autonomous driving is challenging due to numerous model inherent shortcomings. These shortcomings are diverse and range from a lack of generalization over insufficient interpretability to problems with malicious inputs. Cyber physical systems employing DNNs are therefore likely to suffer from safety concerns. In recent years, a zoo of state of the art techniques aiming to address these safety concerns has emerged. This work provides a structured and broad overview of them. We first identify categories of insufficiencies to then describe research activities aiming at their detection, quantification, or mitigation. Our paper addresses both machine learning experts and safety engineers The former ones might profit from the broad range of machine learning topics covered and discussions on limitations of recent methods. The latter ones might gain insights into the specifics of modern ML methods. We moreover hope that our contribution fuels discussions on desiderata for ML systems and strategies on how to propel existing approaches accordingly.


Measuring Intelligence and Growth Rate Variations on Hibbard's Intelligence Measure. In 2011, Hibbard suggested an intelligence measure for agents who compete in an adversarial sequence prediction game. We argue that Hibbard's idea should actually be considered as two separate ideas first, that the intelligence of such agents can be measured based on the growth rates of the runtimes of the competitors that they defeat and second, one specific (somewhat arbitrary) method for measuring said growth rates. Whereas Hibbard's intelligence measure is based on the latter growth rate measuring method, we survey other methods for measuring function growth rates, and exhibit the resulting Hibbard like intelligence measures and taxonomies. Of particular interest, we obtain intelligence taxonomies based on Big O and Big Theta notation systems, which taxonomies are novel in that they challenge conventional notions of what an intelligence measure should look like. We discuss how intelligence measurement of sequence predictors can indirectly serve as intelligence measurement for agents with Artificial General Intelligence (AGIs).


Generalized LRS Estimator for Min entropy Estimation. The min entropy is a widely used metric to quantify the randomness of generated random numbers, which measures the difficulty of guessing the most likely output. It is difficult to accurately estimate the min entropy of a non independent and identically distributed (non IID) source. Hence, NIST Special Publication (SP) 800 90B adopts ten different min entropy estimators and then conservatively selects the minimum value among ten min entropy estimates. Among these estimators, the longest repeated substring (LRS) estimator estimates the collision entropy instead of the min entropy by counting the number of repeated substrings. Since the collision entropy is an upper bound on the min entropy, the LRS estimator inherently provides emph overestimated outputs. In this paper, we propose two techniques to estimate the min entropy of a non IID source accurately. The first technique resolves the overestimation problem by translating the collision entropy into the min entropy. Next, we generalize the LRS estimator by adopting the general R ' e nyi entropy instead of the collision entropy (i.e., R ' e nyi entropy of order two). We show that adopting a higher order can reduce the variance of min entropy estimates. By integrating these techniques, we propose a generalized LRS estimator that effectively resolves the overestimation problem and provides stable min entropy estimates. Theoretical analysis and empirical results support that the proposed generalized LRS estimator improves the estimation accuracy significantly, which makes it an appealing alternative to the LRS estimator.


Arithmetic dynamics of random polynomials. We investigate from a statistical perspective the arithmetic properties of the dynamics of polynomials of fixed degree and defined over the field of rational numbers. To start with, ordering their affine conjugacy classes by height, we show that their average number of rational preperiodic points is equal to zero, thereby proving a strong average version of the uniform boundedness conjecture of Morton and Silverman. Next, inspired by the analogy with the successive minima of a lattice we define the dynamical successive minima of a polynomial. Noting that these quantities are invariant under the action by conjugacy of the affine group we study their average behaviour using the aforementioned ordering by height. In particular, we prove an optimal statistical version of the dynamical Lang conjecture on the canonical height of rational non preperiodic points.


Chemo mechanical model of a cell as a stochastic active gel. While it is commonly observed that the shape dynamics of mammalian cells can undergo large random fluctuations, theoretical models aiming at capturing cell mechanics often focus on the deterministic part of the motion. In this paper, we present a framework that couples an active gel model of the cell mechanical scaffold with the complex cell metabolic system stochastically delivering the chemical energy needed to sustain an active stress in the scaffold. Our closure assumption setting the magnitude of the fluctuations is that the chemo mechanical free energy of the cell is controlled at a target homeostatic value. Our model rationalizes the experimental observation that the cell shape fluctuations depend on the mechanical environment that constraints the cell. We apply our framework to the simple case of a cell migrating on a one dimensional track to successfully capture the different regimes of the cell mean square displacement along the track as well as the magnitude of the long time scale effective diffusive motion of the cell.


Consequences of Misaligned AI. AI systems often rely on two key components a specified goal or reward function and an optimization algorithm to compute the optimal behavior for that goal. This approach is intended to provide value for a principal the user on whose behalf the agent acts. The objectives given to these agents often refer to a partial specification of the principal's goals. We consider the cost of this incompleteness by analyzing a model of a principal and an agent in a resource constrained world where the L attributes of the state correspond to different sources of utility for the principal. We assume that the reward function given to the agent only has support on J L attributes. The contributions of our paper are as follows 1) we propose a novel model of an incomplete principal agent problem from artificial intelligence 2) we provide necessary and sufficient conditions under which indefinitely optimizing for any incomplete proxy objective leads to arbitrarily low overall utility and 3) we show how modifying the setup to allow reward functions that reference the full state or allowing the principal to update the proxy objective over time can lead to higher utility solutions. The results in this paper argue that we should view the design of reward functions as an interactive and dynamic process and identifies a theoretical scenario where some degree of interactivity is desirable.


Robust Counterfactual Explanations on Graph Neural Networks. Massive deployment of Graph Neural Networks (GNNs) in high stake applications generates a strong demand for explanations that are robust to noise and align well with human intuition. Most existing methods generate explanations by identifying a subgraph of an input graph that has a strong correlation with the prediction. These explanations are not robust to noise because independently optimizing the correlation for a single input can easily overfit noise. Moreover, they do not align well with human intuition because removing an identified subgraph from an input graph does not necessarily change the prediction result. In this paper, we propose a novel method to generate robust counterfactual explanations on GNNs by explicitly modelling the common decision logic of GNNs on similar input graphs. Our explanations are naturally robust to noise because they are produced from the common decision boundaries of a GNN that govern the predictions of many similar input graphs. The explanations also align well with human intuition because removing the set of edges identified by an explanation from the input graph changes the prediction significantly. Exhaustive experiments on many public datasets demonstrate the superior performance of our method.


Eliminating Multicollinearity Issues in Neural Network Ensembles Incremental, Negatively Correlated, Optimal Convex Blending. Given a features, target dataset, we introduce an incremental algorithm that constructs an aggregate regressor, using an ensemble of neural networks. It is well known that ensemble methods suffer from the multicollinearity issue, which is the manifestation of redundancy arising mainly due to the common training dataset. In the present incremental approach, at each stage we optimally blend the aggregate regressor with a newly trained neural network under a convexity constraint which, if necessary, induces negative correlations. Under this framework, collinearity issues do not arise at all, rendering so the method both accurate and robust.


On the arithmetic Siegel Weil formula for GSpin Shimura varieties. We formulate and prove a local arithmetic Siegel Weil formula for GSpin Rapoport Zink spaces, which is a precise identity between the arithmetic intersection numbers of special cycles on GSpin Rapoport Zink spaces and the derivatives of local representation densities of quadratic forms. As a first application, we prove a semi global arithmetic Siegel Weil formula as conjectured by Kudla, which relates the arithmetic intersection numbers of special cycles on GSpin Shimura varieties at a place of good reduction and the central derivatives of nonsingular Fourier coefficients of incoherent Siegel Eisenstein series.


A Large scale Temporal Measurement of Android Malicious Apps Persistence, Migration, and Lessons Learned. We study the temporal dynamics of potentially harmful apps (PHAs) on Android by leveraging 8.8M daily on device detections collected among 11.7M customers of a popular mobile security product between 2019 and 2020. We show that the current security model of Android, which limits security products to run as regular apps and prevents them from automatically removing malicious apps opens a significant window of opportunity for attackers. Such apps warn users about the newly discovered threats, but users do not promptly act on this information, allowing PHAs to persist on their device for an average of 24 days after they are detected. We also find that while app markets remove PHAs after these become known, there is a significant delay between when PHAs are identified and when they are removed PHAs persist on Google Play for 77 days on average and 34 days on third party marketplaces. Finally, we find evidence of PHAs migrating to other marketplaces after being removed on the original one. This paper provides an unprecedented view of the Android PHA landscape, showing that current defenses against PHAs on Android are not as effective as commonly thought, and identifying multiple research directions that the security community should pursue, from orchestrating more effective PHA takedowns to devising better alerts for mobile security products.


Deep Reinforcement Learning for Backup Strategies against Adversaries. Many defensive measures in cyber security are still dominated by heuristics, catalogs of standard procedures, and best practices. Considering the case of data backup strategies, we aim towards mathematically modeling the underlying threat models and decision problems. By formulating backup strategies in the language of stochastic processes, we can translate the challenge of finding optimal defenses into a reinforcement learning problem. This enables us to train autonomous agents that learn to optimally support planning of defense processes. In particular, we tackle the problem of finding an optimal backup scheme in the following adversarial setting Given k backup devices, the goal is to defend against an attacker who can infect data at one time but chooses to destroy or encrypt it at a later time, potentially also corrupting multiple backups made in between. In this setting, the usual round robin scheme, which always replaces the oldest backup, is no longer optimal with respect to avoidable exposure. Thus, to find a defense strategy, we model the problem as a hybrid discrete continuous action space Markov decision process and subsequently solve it using deep deterministic policy gradients. We show that the proposed algorithm can find storage device update schemes which match or exceed existing schemes with respect to various exposure metrics.


Challenges of Translating HPC codes to Workflows for Heterogeneous and Dynamic Environments. In this paper we would like to share our experience for transforming a parallel code for a Computational Fluid Dynamics (CFD) problem into a parallel version for the RedisDG workflow engine. This system is able to capture heterogeneous and highly dynamic environments, thanks to opportunistic scheduling strategies. We show how to move to the field of "HPC as a Service" in order to use heterogeneous platforms. We mainly explain, through the CFD use case, how to transform the parallel code and we exhibit challenges to 'unfold' the task graph dynamically in order to improve the overall performance (in a broad sense) of the workflow engine. We discuss in particular of the impact on the workflow engine of such dynamic feature. This paper states that new models for High Performance Computing are possible, under the condition we revisit our mind in the direction of the potential of new paradigms such as cloud, edge computing.


Combining the Projective Consciousness Model and Virtual Humans to assess ToM capacity in Virtual Reality a proof of concept. Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. We implemented the principles of the Projective Consciousness Model into artificial agents embodied as virtual humans, as a proof of concept for a methodological framework aimed at simulating behaviours and assessing underlying psychological parameters, in the context of experiments in virtual reality. We focus on simulating the role of Theory of Mind (ToM) in the choice of strategic behaviours of approach and avoidance to optimise the satisfaction of agents' preferences. We designed an experiment in a virtual environment that could be used with real humans, allowing us to classify behaviours as a function of order of ToM, up to the second order. We show that our agents demonstrate expected behaviours with consistent parameters of ToM in this experiment. We also show that the agents can be used to estimate correctly each other order of ToM. A similar approach could be used with real humans in virtual reality experiments not only to enable human participants to interact with parametric, virtual humans as stimuli, but also as a mean of inference to derive model based psychological assessments of the participants.


E Cyclist Implementation of an Efficient Validation of FOLID Cyclic Induction Reasoning. Checking the soundness of cyclic induction reasoning for first order logic with inductive definitions (FOLID) is decidable but the standard checking method is based on an exponential complement operation for B "uchi automata. Recently, we introduced a polynomial checking method whose most expensive steps recall the comparisons done with multiset path orderings. We describe the implementation of our method in the Cyclist prover. Referred to as E Cyclist, it successfully checked all the proofs included in the original distribution of Cyclist. Heuristics have been devised to automatically define, from the analysis of the proof derivations, the trace based ordering measures that guarantee the soundness property.


Decision making Oriented Clustering Application to Pricing and Power Consumption Scheduling. Data clustering is an instrumental tool in the area of energy resource management. One problem with conventional clustering is that it does not take the final use of the clustered data into account, which may lead to a very suboptimal use of energy or computational resources. When clustered data are used by a decision making entity, it turns out that significant gains can be obtained by tailoring the clustering scheme to the final task performed by the decision making entity. The key to having good final performance is to automatically extract the important attributes of the data space that are inherently relevant to the subsequent decision making entity, and partition the data space based on these attributes instead of partitioning the data space based on predefined conventional metrics. For this purpose, we formulate the framework of decision making oriented clustering and propose an algorithm providing a decision based partition of the data space and good representative decisions. By applying this novel framework and algorithm to a typical problem of real time pricing and that of power consumption scheduling, we obtain several insightful analytical results such as the expression of the best representative price profiles for real time pricing and a very significant reduction in terms of required clusters to perform power consumption scheduling as shown by our simulations.


An Interactive Visualization Tool for Understanding Active Learning. Despite recent progress in artificial intelligence and machine learning, many state of the art methods suffer from a lack of explainability and transparency. The ability to interpret the predictions made by machine learning models and accurately evaluate these models is crucially important. In this paper, we present an interactive visualization tool to elucidate the training process of active learning. This tool enables one to select a sample of interesting data points, view how their prediction values change at different querying stages, and thus better understand when and how active learning works. Additionally, users can utilize this tool to compare different active learning strategies simultaneously and inspect why some strategies outperform others in certain contexts. With some preliminary experiments, we demonstrate that our visualization panel has a great potential to be used in various active learning experiments and help users evaluate their models appropriately.


Long range contact process and percolation on a random lattice. We study the phase transition phenomena for long range oriented percolation and contact process. We studied a contact process in which the range of each vertex are independent, updated dynamically and given by some distribution N . We also study an analogous oriented percolation model on the hyper cubic lattice, here there is a special direction where long range oriented bonds are allowed the range of all vertices are given by an i.i.d. sequence of random variables with common distribution N . For both models, we prove some results about the existence of a phase transition in terms of the distribution N .


Adversarial Robustness Comparison of Vision Transformer and MLP Mixer to CNNs. Convolutional Neural Networks (CNNs) have become the de facto gold standard in computer vision applications in the past years. Recently, however, new model architectures have been proposed challenging the status quo. The Vision Transformer (ViT) relies solely on attention modules, while the MLP Mixer architecture substitutes the self attention modules with Multi Layer Perceptrons (MLPs). Despite their great success, CNNs have been widely known to be vulnerable to adversarial attacks, causing serious concerns for security sensitive applications. Thus, it is critical for the community to know whether the newly proposed ViT and MLP Mixer are also vulnerable to adversarial attacks. To this end, we empirically evaluate their adversarial robustness under several adversarial attack setups and benchmark them against the widely used CNNs. Overall, we find that the two architectures, especially ViT, are more robust than their CNN models. Using a toy example, we also provide empirical evidence that the lower adversarial robustness of CNNs can be partially attributed to their shift invariant property. Our frequency analysis suggests that the most robust ViT architectures tend to rely more on low frequency features compared with CNNs. Additionally, we have an intriguing finding that MLP Mixer is extremely vulnerable to universal adversarial perturbations.


Application of Reversible Data Hiding for Printing with Special Color Inks to Preserve Compatibility with Normal Printing. We propose an efficient framework with compatibility between normal printing and printing with special color inks in this paper. Special color inks can be used for printing to represent some particular colors and specific optical properties, which are difficult to express using only CMYK inks. Special color layers are required in addition to the general color layer for printing with special color inks. We introduce a reversible data hiding (RDH) method to embed the special color layers into the general color layer without visible artifacts. The proposed method can realize both normal printing and printing with special color inks by using a single layer. Our experimental results show that the quality of the marked image is virtually identical to that of the original image, i.e., the general color layer.


Side Channel Attacks on RISC V Processors Current Progress, Challenges, and Opportunities. Side channel attacks on microprocessors, like the RISC V, exhibit security vulnerabilities that lead to several design challenges. Hence, it is imperative to study and analyze these security vulnerabilities comprehensively. In this paper, we present a brief yet comprehensive study of the security vulnerabilities in modern microprocessors with respect to side channel attacks and their respective mitigation techniques. The focus of this paper is to analyze the hardware exploitable side channel attack using power consumption and software exploitable side channel attacks to manipulate cache. Towards this, we perform an in depth analysis of the applicability and practical implications of cache attacks on RISC V microprocessors and their associated challenges. Finally, based on the comparative study and our analysis, we highlight some key research directions to develop robust RISC V microprocessors that are resilient to side channel attacks.


Shape Inference and Grammar Induction for Example based Procedural Generation. Designers increasingly rely on procedural generation for automatic generation of content in various industries. These techniques require extensive knowledge of the desired content, and about how to actually implement such procedural methods. Algorithms for learning interpretable generative models from example content could alleviate both difficulties. We propose SIGI, a novel method for inferring shapes and inducing a shape grammar from grid based 3D building examples. This interpretable grammar is well suited for co creative design. Applied to Minecraft buildings, we show how the shape grammar can be used to automatically generate new buildings in a similar style.


On the Smallest Non trivial Action of SAut(Fn) for Small n. In this paper we investigate actions of operatorname SAut (F n) , the unique index 2 subgroup of operatorname Aut (F n) , on small sets, improving upon results by Baumeister Kielak Pierro for several small values of n . Using a computational approach for n geqslant 5 , we show that every action of operatorname SAut (F n) on a set containing fewer than 18 elements is trivial.


Groups with a small average number of zeros in the character table. We classify finite groups with a small average number of zeros in the character table.


Enclosing Depth and other Depth Measures. We study families of depth measures defined by natural sets of axioms. We show that any such depth measure is a constant factor approximation of Tukey depth. We further investigate the dimensions of depth regions, showing that the Cascade conjecture, introduced by Kalai for Tverberg depth, holds for all depth measures which satisfy our most restrictive set of axioms, which includes Tukey depth. Along the way, we introduce and study a new depth measure called enclosing depth, which we believe to be of independent interest, and show its relation to a constant fraction Radon theorem on certain two colored point sets.


A bound for the p domination number of a graph in terms of its eigenvalue multiplicities. Let G be a connected graph of order n with domination number gamma(G) . Wang, Yan, Fang, Geng and Tian Linear Algebra Appl. 607 (2020), 307 318 showed that for any Laplacian eigenvalue lambda of G with multiplicity m G( lambda) , it holds that gamma(G) leq n m G( lambda) . Using techniques from the theory of star sets, in this work we prove that the same bound holds when lambda is an arbitrary adjacency eigenvalue of a non regular graph, and we characterize the cases of equality. Moreover, we show a result that gives a relationship between start sets and the p domination number, and we apply it to extend the aforementioned spectral bound to the p domination number using the adjacency and Laplacian eigenvalue multiplicities.


Accelerated Zeroth order Algorithm for Stochastic Distributed Nonconvex Optimization. This paper investigates how to accelerate the convergence of distributed optimization algorithms on nonconvex problems with zeroth order information available only. We propose a zeroth order (ZO) distributed primal dual stochastic coordinates algorithm equipped with "powerball" method to accelerate. We prove that the proposed algorithm has a convergence rate of mathcal O ( sqrt p sqrt nT ) for general nonconvex cost functions. We consider solving the generation of adversarial examples from black box DNNs problem to compare with the existing state of the art centralized and distributed ZO algorithms. The numerical results demonstrate the faster convergence rate of the proposed algorithm and match the theoretical analysis.


Rough stochastic differential equations. We build a hybrid theory of rough stochastic analysis which seamlessly combines the advantages of both It o's stochastic and Lyons' rough differential equations. This gives a direct and intrinsic understanding of multidimensional diffusion with Brownian noise (B, tilde B) dY t( omega) b( omega,t,Y t( omega))dt sigma( omega,t,Y t( omega))dB t( omega) f( omega,t ,Y t( omega))d tilde B t ,, in the annealed form, when conditioned on its environmental noise tilde B . This situation arises naturally e.g. in filtering theory, for Feynman Kac representations of solutions to stochastic partial differential equations, in Lions Souganidis' theory of pathwise stochastic control, and for McKean Vlasov stochastic differential equations with common noise. In fact, we establish well posedness of rough stochastic differential equations, with tilde B replaced by a genuine rough path. As consequence, the annealed' process Y is a locally Lipschitz function of its environmental noise in rough path metrics. There is also interest in taking tilde B tilde B H , a fractional Brownian motion which fits our theory for H 1 3 . Our assumptions for b, sigma agree with those from It o theory, those for f with rough paths theory, including an extension of Davie's critical regularity result for deterministic rough differential equations. A major role in our analysis is played by a new scale of stochastic controlled rough paths spaces, related to a (L m,L n) variant of stochastic sewing.


SelfReg Self supervised Contrastive Regularization for Domain Generalization. In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real world situations, a difference in the distribution between two datasets, domain shift, may occur, which becomes a major factor impeding the generalization performance of the model. The research field to solve this problem is called domain generalization, and it alleviates the domain shift problem by extracting domain invariant features explicitly or implicitly. In recent studies, contrastive learning based domain generalization approaches have been proposed and achieved high performance. These approaches require sampling of the negative data pair. However, the performance of contrastive learning fundamentally depends on quality and quantity of negative data pairs. To address this issue, we propose a new regularization method for domain generalization based on contrastive learning, self supervised contrastive regularization (SelfReg). The proposed approach use only positive data pairs, thus it resolves various problems caused by negative pair sampling. Moreover, we propose a class specific domain perturbation layer (CDPL), which makes it possible to effectively apply mixup augmentation even when only positive data pairs are used. The experimental results show that the techniques incorporated by SelfReg contributed to the performance in a compatible manner. In the recent benchmark, DomainBed, the proposed method shows comparable performance to the conventional state of the art alternatives. Codes are available at https github.com dnap512 SelfReg.


A Spatial Temporal Graph Neural Network Framework for Automated Software Bug Triaging. The bug triaging process, an essential process of assigning bug reports to the most appropriate developers, is related closely to the quality and costs of software development. As manual bug assignment is a labor intensive task, especially for large scale software projects, many machine learning based approaches have been proposed to automatically triage bug reports. Although developer collaboration networks (DCNs) are dynamic and evolving in the real world, most automated bug triaging approaches focus on static tossing graphs at a single time slice. Also, none of the previous studies consider periodic interactions among developers. To address the problems mentioned above, in this article, we propose a novel spatial temporal dynamic graph neural network (ST DGNN) framework, including a joint random walk (JRWalk) mechanism and a graph recurrent convolutional neural network (GRCNN) model. In particular, JRWalk aims to sample local topological structures in a graph with two sampling strategies by considering both node importance and edge importance. GRCNN has three components with the same structure, i.e., hourly periodic, daily periodic, and weekly periodic components, to learn the spatial temporal features of dynamic DCNs. We evaluated our approach's effectiveness by comparing it with several state of the art graph representation learning methods in two domain specific tasks that belong to node classification. In the two tasks, experiments on two real world, large scale developer collaboration networks collected from the Eclipse and Mozilla projects indicate that the proposed approach outperforms all the baseline methods.


Adaptive Control of Underactuated Planar Pronking Hexapod. Underactuated legged robots depict highly nonlinear and complex dynamical behaviors that create significant challenges in accurately modeling system dynamics using both first principles and system identification approaches. Hence, it makes a more substantial challenge to design stabilizing controllers. If physical parameters on mathematical models have miscalibrations due to uncertainty in identifying and modeling processes, designed controllers could perform poorly or even result in unstable responses. Moreover, these parameters can certainly change over time due to operation and environmental conditions. In that respect, analogous to a living organism modifying its behavior in response to novel conditions, adapting updating system parameters, such as spring constant, to compensate for modeling errors could provide the advantage of constructing a stable gait level controller without needing "exact" dynamical parameter values. This paper presents an online, model based adaptive control approach for an underactuated planar hexapod robot's pronking behavior adopted from antelope species. We show through systematic simulation studies that the adaptive control policy is robust to high levels of parameter uncertainties compared to a non adaptive model based dead beat controller.


LegoDNN Block grained Scaling of Deep Neural Networks for Mobile Vision. Deep neural networks (DNNs) have become ubiquitous techniques in mobile and embedded systems for applications such as image object recognition and classification. The trend of executing multiple DNNs simultaneously exacerbate the existing limitations of meeting stringent latency accuracy requirements on resource constrained mobile devices. The prior art sheds light on exploring the accuracy resource tradeoff by scaling the model sizes in accordance to resource dynamics. However, such model scaling approaches face to imminent challenges (i) large space exploration of model sizes, and (ii) prohibitively long training time for different model combinations. In this paper, we present LegoDNN, a lightweight, block grained scaling solution for running multi DNN workloads in mobile vision systems. LegoDNN guarantees short model training times by only extracting and training a small number of common blocks (e.g. 5 in VGG and 8 in ResNet) in a DNN. At run time, LegoDNN optimally combines the descendant models of these blocks to maximize accuracy under specific resources and latency constraints, while reducing switching overhead via smart block level scaling of the DNN. We implement LegoDNN in TensorFlow Lite and extensively evaluate it against state of the art techniques (FLOP scaling, knowledge distillation and model compression) using a set of 12 popular DNN models. Evaluation results show that LegoDNN provides 1,296x to 279,936x more options in model sizes without increasing training time, thus achieving as much as 31.74 improvement in inference accuracy and 71.07 reduction in scaling energy consumptions.


An Error Representation for the Time Sliced Thawed Gaussian Propagation Method. We study the time sliced thawed Gaussian propagation method, which was recently proposed for solving the time dependent Schr "odinger equation. We introduce a triplet of quadrature based analysis, synthesis and re initialization operators to give a rigorous mathematical formulation of the method. Further, we derive a combined error representation for the discretization of the wave packet transform and the time propagation of the thawed Gaussian basis functions. Numerical experiments in 1D illustrate the theoretical results.


Modeling Censored Mobility Demand through Quantile Regression Neural Networks. Shared mobility services require accurate demand models for effective service planning. On one hand, modeling the full probability distribution of demand is advantageous, because the full uncertainty structure preserves valuable information for decision making. On the other hand, demand is often observed through usage of the service itself, so that the observations are censored, as they are inherently limited by available supply. Since the 1980s, various works on Censored Quantile Regression models have shown them to perform well under such conditions, and in the last two decades, several works have proposed to implement them flexibly through Neural Networks (CQRNN). However, apparently no works have yet applied CQRNN in the Transport domain. We address this gap by applying CQRNN to datasets from two shared mobility providers in the Copenhagen metropolitan area in Denmark, as well as common synthetic baseline datasets. The results show that CQRNN can estimate the intended distributions better than both censorship unaware models and parametric censored models.


On generalized quasi Einstein manifolds. A rigidity result for a class of compact generalized quasi Einstein manifolds with constant scalar curvature is obtained. Moreover, under some geometric assumptions, the rigidity for the noncompact case is also proved. Considering non constant scalar curvature, we characterize the generalized quasi Einstein manifolds which are conformal to the Euclidean space and we show that there exist two classes of complete manifolds, which are obtained by considering potential functions and conformal factors either to be radial or invariant under the action of an (n 1) dimensional translation group. Explicit examples are given.


A fast and efficient tool to study the rheology of dense suspensions. A cutting edge software is presented to tackle the Newton Euler equations governing the dynamics of granular flows and dense suspensions in Newtonian fluids. In particular, we propose an implementation of a fixed radius near neighbours search based on an efficient counting sort algorithm with an improved symmetric search. The adopted search method drastically reduces the computational cost and allows an efficient parallelisation even on a single node through the multi threading paradigm. Emphasis is also given to the memory efficiency of the code since the history of the contacts among particles has to be traced to model the frictional contributions, when dealing with granular flows of rheological interest that consider non smooth interacting particles. An effective procedure based on an estimate of the maximum number of the smallest particles surrounding the largest one (given the radii distribution) and a sort applied only to the surrounding particles only is implemented, allowing us to effectively tackle the rheology of non monodispersed particles with high size ratio in large domains. Finally, we present validations and verification of the numerical procedure, by comparing with previous simulations and experiments, and present new software capabilities.


Learning Bounds for Open Set Learning. Traditional supervised learning aims to train a classifier in the closed set world, where training and test samples share the same label space. In this paper, we target a more challenging and realistic setting open set learning (OSL), where there exist test samples from the classes that are unseen during training. Although researchers have designed many methods from the algorithmic perspectives, there are few methods that provide generalization guarantees on their ability to achieve consistent performance on different training samples drawn from the same distribution. Motivated by the transfer learning and probably approximate correct (PAC) theory, we make a bold attempt to study OSL by proving its generalization error given training samples with size n, the estimation error will get close to order O p(1 sqrt n ). This is the first study to provide a generalization bound for OSL, which we do by theoretically investigating the risk of the target classifier on unknown classes. According to our theory, a novel algorithm, called auxiliary open set risk (AOSR) is proposed to address the OSL problem. Experiments verify the efficacy of AOSR. The code is available at github.com Anjin Liu Openset Learning AOSR.


Automatic punctuation restoration with BERT models. We present an approach for automatic punctuation restoration with BERT models for English and Hungarian. For English, we conduct our experiments on Ted Talks, a commonly used benchmark for punctuation restoration, while for Hungarian we evaluate our models on the Szeged Treebank dataset. Our best models achieve a macro averaged F 1 score of 79.8 in English and 82.2 in Hungarian. Our code is publicly available.


Composing Conversational Negation. Negation in natural language does not follow Boolean logic and is therefore inherently difficult to model. In particular, it takes into account the broader understanding of what is being negated. In previous work, we proposed a framework for negation of words that accounts for worldly context'. In this paper, we extend that proposal now accounting for the compositional structure inherent in language, within the DisCoCirc framework. We compose the negations of single words to capture the negation of sentences. We also describe how to model the negation of words whose meanings evolve in the text.


MAPGN MAsked Pointer Generator Network for sequence to sequence pre training. This paper presents a self supervised learning method for pointer generator networks to improve spoken text normalization. Spoken text normalization that converts spoken style text into style normalized text is becoming an important technology for improving subsequent processing such as machine translation and summarization. The most successful spoken text normalization method to date is sequence to sequence (seq2seq) mapping using pointer generator networks that possess a copy mechanism from an input sequence. However, these models require a large amount of paired data of spoken style text and style normalized text, and it is difficult to prepare such a volume of data. In order to construct spoken text normalization model from the limited paired data, we focus on self supervised learning which can utilize unpaired text data to improve seq2seq models. Unfortunately, conventional self supervised learning methods do not assume that pointer generator networks are utilized. Therefore, we propose a novel self supervised learning method, MAsked Pointer Generator Network (MAPGN). The proposed method can effectively pre train the pointer generator network by learning to fill masked tokens using the copy mechanism. Our experiments demonstrate that MAPGN is more effective for pointer generator networks than the conventional self supervised learning methods in two spoken text normalization tasks.


Semantic similarity metrics for learned image registration. We propose a semantic similarity metric for image registration. Existing metrics like Euclidean Distance or Normalized Cross Correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our approach learns dataset specific features that drive the optimization of a learning based registration model. We train both an unsupervised approach using an auto encoder, and a semi supervised approach using supplemental segmentation data to extract semantic features for image registration. Comparing to existing methods across multiple image modalities and applications, we achieve consistently high registration accuracy. A learned invariance to noise gives smoother transformations on low quality images.


Application of the NIP wave theorem to PSDM and an approximation for RPSM to zero offset. The concept of residual migration to zero offset is introduced for the case that a prestack migration and a subsequent residual moveout analysis have been performed for a seismic survey and a new depth model has not yet been determined. Travel times of reflected events for individual traces are determined for diffraction points situated along horizons of analysis. These events are downward continued into the model used for the migration of the survey. The NIP wave theorem can then be applied to events exhibiting small subsurface offsets in order to determine residual radii of curvature to be used in the updating of seismic velocity model by seismic stripping. Alternatively, it is suggested to construct an aplanat and hence to determine a focus point of the reflected event without knowledge of the true velocity model. The distance of the estimated point of focus from the observed zero offset response of the migrated reflector serves as an indication of the focusing of the considered event at the particular subsurface offset and can be used as a measure for the necessity of a subsequent remigration of the survey with a new velocity model. A summation over the first Fresnel zone at the migrated zero offset position is suggested as an alternative to conventional stacking leading to improvement of the signal to noise ratio. Applications to model computations and to a seismic survey over an overthrust structure show promising results regarding the applicability of the suggested method.


A User Study on Hybrid Graph Visualizations. Hybrid visualizations mix different metaphors in a single layout of a network. In particular, the popular NodeTrix model, introduced by Henry, Fekete, and McGuffin in 2007, combines node link diagrams and matrix based representations to support the analysis of real world networks that are globally sparse but locally dense. That idea inspired a series of works, proposing variants or alternatives to NodeTrix. We present a user study that compares the classical node link model and three hybrid visualization models designed to work on the same types of networks. The results of our study provide interesting indications about advantages drawbacks of the considered models on performing classical tasks of analysis. At the same time, our experiment has some limitations and opens up to further research on the subject.


Linear vortex symmetrization the spectral density function. We investigate solutions of the 2d incompressible Euler equations, linearized around steady states which are radially decreasing vortices. Our main goal is to understand the smoothness of what we call the spectral density function associated with the linearized operator, which we hope will be a step towards proving full nonlinear asymptotic stability of radially decreasing vortices. The motivation for considering the spectral density function is that it is not possible to describe the vorticity or the stream function in terms of one modulated profile. There are in fact two profiles, both at the level of the physical vorticity and at the level of the stream function. The spectral density function allows us to identify these profiles, and its smoothness leads to pointwise decay of the stream function which is consistent with the decay estimates first proved in Bedrossian Coti Zelati Vicol in 5 .


Topical Language Generation using Transformers. Large scale transformer based language models (LMs) demonstrate impressive capabilities in open text generation. However, controlling the generated text's properties such as the topic, style, and sentiment is challenging and often requires significant changes to the model architecture or retraining and fine tuning the model on new supervised data. This paper presents a novel approach for Topical Language Generation (TLG) by combining a pre trained LM with topic modeling information. We cast the problem using Bayesian probability formulation with topic probabilities as a prior, LM probabilities as the likelihood, and topical language generation probability as the posterior. In learning the model, we derive the topic probability distribution from the user provided document's natural structure. Furthermore, we extend our model by introducing new parameters and functions to influence the quantity of the topical features presented in the generated text. This feature would allow us to easily control the topical properties of the generated text. Our experimental results demonstrate that our model outperforms the state of the art results on coherency, diversity, and fluency while being faster in decoding.


Shapes of Emotions Multimodal Emotion Recognition in Conversations via Emotion Shifts. Emotion Recognition in Conversations (ERC) is an important and active research problem. Recent work has shown the benefits of using multiple modalities (e.g., text, audio, and video) for the ERC task. In a conversation, participants tend to maintain a particular emotional state unless some external stimuli evokes a change. There is a continuous ebb and flow of emotions in a conversation. Inspired by this observation, we propose a multimodal ERC model and augment it with an emotion shift component. The proposed emotion shift component is modular and can be added to any existing multimodal ERC model (with a few modifications), to improve emotion recognition. We experiment with different variants of the model, and results show that the inclusion of emotion shift signal helps the model to outperform existing multimodal models for ERC and hence showing the state of the art performance on MOSEI and IEMOCAP datasets.


Neural Architecture Dilation for Adversarial Robustness. With the tremendous advances in the architecture and scale of convolutional neural networks (CNNs) over the past few decades, they can easily reach or even exceed the performance of humans in certain tasks. However, a recently discovered shortcoming of CNNs is that they are vulnerable to adversarial attacks. Although the adversarial robustness of CNNs can be improved by adversarial training, there is a trade off between standard accuracy and adversarial robustness. From the neural architecture perspective, this paper aims to improve the adversarial robustness of the backbone CNNs that have a satisfactory accuracy. Under a minimal computational overhead, the introduction of a dilation architecture is expected to be friendly with the standard performance of the backbone CNN while pursuing adversarial robustness. Theoretical analyses on the standard and adversarial error bounds naturally motivate the proposed neural architecture dilation algorithm. Experimental results on real world datasets and benchmark neural networks demonstrate the effectiveness of the proposed algorithm to balance the accuracy and adversarial robustness.


Algorithm Fairness in AI for Medicine and Healthcare. In the current development and deployment of many artificial intelligence (AI) systems in healthcare, algorithm fairness is a challenging problem in delivering equitable care. Recent evaluation of AI models stratified across race sub populations have revealed inequalities in how patients are diagnosed, given treatments, and billed for healthcare costs. In this perspective article, we summarize the intersectional field of fairness in machine learning through the context of current issues in healthcare, outline how algorithmic biases (e.g. image acquisition, genetic variation, intra observer labeling variability) arise in current clinical workflows and their resulting healthcare disparities. Lastly, we also review emerging technology for mitigating bias via federated learning, disentanglement, and model explainability, and their role in AI SaMD development.


Network Traffic Characteristics of IoT Devices in Smart Homes. Understanding network traffic characteristics of IoT devices plays a critical role in improving both the performance and security of IoT devices, including IoT device identification, classification, and anomaly detection. Although a number of existing research efforts have developed machine learning based algorithms to help address the challenges in improving the security of IoT devices, none of them have provided detailed studies on the network traffic characteristics of IoT devices. In this paper we collect and analyze the network traffic generated in a typical smart homes environment consisting of a set of common IoT (and non IoT) devices. We analyze the network traffic characteristics of IoT devices from three complementary aspects remote network servers and port numbers that IoT devices connect to, flow level traffic characteristics such as flow duration, and packet level traffic characteristics such as packet inter arrival time. Our study provides critical insights into the operational and behavioral characteristics of IoT devices, which can help develop more effective security and performance algorithms for IoT devices.


Hybrid high order methods. A primer with application to solid mechanics. This book is organized into eight chapters. The first three gently introduce the basic principles of hybrid high order methods on a linear diffusion problem, the key ideas underlying the mathematical analysis, and some useful variants of the method as well as links to other methods from the literature. The following four present various challenging applications to solid mechanics, including linear elasticity and hyperelasticity, elastodynamics, contact friction, and plasticity. The last chapter reviews implementation aspects. This book is primarily intended for graduate students, researchers (in applied mathematics, numerical analysis, and computational mechanics), and engineers working in related fields of application. Basic knowledge of the devising and analysis of finite element methods is assumed. Special effort was made to streamline the presentation so as to pinpoint the essential ideas, address key mathematical aspects, present examples, and provide bibliographic pointers.


Kolmogorov variation KAM with knobs ( a la Kolmogorov). In this paper we reconsider the original Kolmogorov normal form algorithm with a variation on the handling of the frequencies. At difference with respect to the Kolmogorov approach, we do not keep the frequencies fixed along the normalization procedure. Besides we select the frequencies of the final invariant torus and determine a posteriori the corresponding starting one. In particular, we replace the classical translation step with a change of the frequencies. The algorithm is based on classical expansion in a small parameter and particular attention is paid to the constructive aspect we produce an explicit algorithm that can be effectively applied, e.g., with the aid of an algebraic manipulator, and that we prove to be absolutely convergent.


Minimal and characteristic polynomials of symmetric matrices in characteristic two. Let k be a field of characteristic two. We prove that a non constant monic polynomial f in k X of degree n is the minimal characteristic polynomial of a symmetric matrix with entries in k if and only if it is not the product of pairwise distinct inseparable irreducible polynomials. In this case, we prove that f is the minimal polynomial of a symmetric matrix of size n . We also prove that any element alpha in k alg of degree n geq 1 is the eigenvalue of a symmetrix matrix of size n or n 1 , the first case happening if and only if the minimal polynomial of alpha is not the product of pairwise distinct inseparable irreducible polynomials.


Bayesian Optimisation for a Biologically Inspired Population Neural Network. We have used Bayesian Optimisation (BO) to find hyper parameters in an existing biologically plausible population neural network. The 8 dimensional optimal hyper parameter combination should be such that the network dynamics simulate the resting state alpha rhythm (8 13 Hz rhythms in brain signals). Each combination of these eight hyper parameters constitutes a 'datapoint' in the parameter space. The best combination of these parameters leads to the neural network's output power spectral peak being constraint within the alpha band. Further, constraints were introduced to the BO algorithm based on qualitative observation of the network output time series, so that high amplitude pseudo periodic oscillations are removed. Upon successful implementation for alpha band, we further optimised the network to oscillate within the theta (4 8 Hz) and beta (13 30 Hz) bands. The changing rhythms in the model can now be studied using the identified optimal hyper parameters for the respective frequency bands. We have previously tuned parameters in the existing neural network by the trial and error approach however, due to time and computational constraints, we could not vary more than three parameters at once. The approach detailed here, allows an automatic hyper parameter search, producing reliable parameter sets for the network.