Convergence of a Lagrangian discretization for barotropic fluids and porous media flow. When expressed in Lagrangian variables, the equations of motion for compressible (barotropic) fluids have the structure of a classical Hamiltonian system in which the potential energy is given by the internal energy of the fluid. The dissipative counterpart of such a system coincides with the porous medium equation, which can be cast in the form of a gradient flow for the same internal energy. Motivated by these related variational structures, we propose a particle method for both problems in which the internal energy is replaced by its Moreau Yosida regularization in the L2 sense, which can be efficiently computed as a semi discrete optimal transport problem. Using a modulated energy argument which exploits the convexity of the problem in Eulerian variables, we prove quantitative convergence estimates towards smooth solutions. We verify such estimates by means of several numerical tests.


Transition density estimates for subordinated reflected Brownian motion on simple nested fractals. In this paper we prove matching upper and lower bounds for the transition density function of the subordinate reflected Brownian motion on fractals.


Consistent and symmetry preserving data driven interface reconstruction for the level set method. Recently, machine learning has been used to substitute parts of conventional computational fluid dynamics, e.g. the cell face reconstruction in finite volume solvers or the curvature computation in the Volume of Fluid (VOF) method. The latter showed improvements in terms of accuracy for coarsely resolved interfaces, however at the expense of convergence and symmetry. In this work, a combined approach is proposed, adressing the aforementioned shortcomings. We focus on interface reconstruction (IR) in the level set method, i.e. the computation of the volume fraction and apertures. The combined model consists of a classification neural network, that chooses between the conventional (linear) IR and the neural network IR depending on the local interface resolution. The proposed approach improves accuracy for coarsely resolved interfaces and recovers the conventional IR for high resolutions, yielding first order overall convergence. Symmetry is preserved by mirroring and rotating the input level set grid and subsequently averaging the predictions. The combined model is implemented into a CFD solver and demonstrated for two phase flows. Furthermore, we provide details of floating point symmetric implementation and computational efficiency.


Graph Neural Network for Traffic Forecasting A Survey. Traffic forecasting is important for the success of intelligent transportation systems. Deep learning models, including convolution neural networks and recurrent neural networks, have been extensively applied in traffic forecasting problems to model spatial and temporal dependencies. In recent years, to model the graph structures in transportation systems as well as contextual information, graph neural networks have been introduced and have achieved state of the art performance in a series of traffic forecasting problems. In this survey, we review the rapidly growing body of research using different graph neural networks, e.g. graph convolutional and graph attention networks, in various traffic forecasting problems, e.g. road traffic flow and speed forecasting, passenger flow forecasting in urban rail transit systems, and demand forecasting in ride hailing platforms. We also present a comprehensive list of open data and source resources for each problem and identify future research directions. To the best of our knowledge, this paper is the first comprehensive survey that explores the application of graph neural networks for traffic forecasting problems. We have also created a public GitHub repository where the latest papers, open data, and source resources will be updated.


Mobile Robot Yielding Cues for Human Robot Spatial Interaction. Mobile robots are increasingly being deployed in public spaces such as shopping malls, airports, and urban sidewalks. Most of these robots are designed with human aware motion planning capabilities but are not designed to communicate with pedestrians. Pedestrians encounter these robots without prior understanding of the robots' behaviour, which can cause discomfort, confusion, and delayed social acceptance. In this research, we explore the common human robot interaction at a doorway or bottleneck in a structured environment. We designed and evaluated communication cues used by a robot when yielding to a pedestrian in this scenario. We conducted an online user study with 102 participants using videos of a set of robot to human yielding cues. Results show that a Robot Retreating cue was the most socially acceptable cue. The results of this work help guide the development of mobile robots for public spaces.


Multidimensional Persistence Invariants and Parameterization. This article grew out of the theoretical part of my Master's thesis at the Faculty of Mathematics and Information Science at Ruprecht Karls Universit "at Heidelberg under the supervision of PD Dr. Andreas Ott. Following the work of G. Carlsson and A. Zomorodian on the theory of multidimensional persistence in 2007 and 2009, the main goal of this article is to give a complete classification and parameterization for the algebraic objects corresponding to the homology of a multifiltered simplicial complex. As in the work of G. Carlsson and A. Zomorodian, this classification and parameterization result is then used to show that it is only possible to obtain a discrete and complete invariant for these algebraic objects in the case of one dimensional persistence, and that it is impossible to obtain the same in dimensions greater than one.


Isometries of the Space of Sasaki Potentials. Given any two K "ahler manifolds X 1 and X 2 , L. Lempert recently proved that if their spaces of K "ahler potentials are isometric with respect to the Mabuchi metric, then X 1 and X 2 must be diffeomorphic. We prove that this is no longer the case for Sasaki manifolds. Then, considering regular Sasaki manifolds M 1 and M 2 , we prove that if the spaces of potentials are isometric, then M 1 and M 2 must have, among others, the same universal covering space. Finally, getting rid of the regularity assumption on M 1 and M 2 , we investigate the consequences of the existence of affine Mabuchi isometries this leads to a family of Sasaki isospectral structures.


For Manifold Learning, Deep Neural Networks can be Locality Sensitive Hash Functions. It is well established that training deep neural networks gives useful representations that capture essential features of the inputs. However, these representations are poorly understood in theory and practice. In the context of supervised learning an important question is whether these representations capture features informative for classification, while filtering out non informative noisy ones. We explore a formalization of this question by considering a generative process where each class is associated with a high dimensional manifold and different classes define different manifolds. Under this model, each input is produced using two latent vectors (i) a "manifold identifier" gamma and (ii) a "transformation parameter" theta that shifts examples along the surface of a manifold. E.g., gamma might represent a canonical image of a dog, and theta might stand for variations in pose, background or lighting. We provide theoretical and empirical evidence that neural representations can be viewed as LSH like functions that map each input to an embedding that is a function of solely the informative gamma and invariant to theta , effectively recovering the manifold identifier gamma . An important consequence of this behavior is one shot learning to unseen classes.


Slicing Scheduling for Supporting Critical Traffic in Beyond 5G. One of the most challenging services fifth generation (5G) mobile network is designed to support, is the critical services in need of very low latency, and or high reliability. It is now clear that such critical services will also be at the core of beyond 5G (B5G) networks. While 5G radio design accommodates such supports by introducing more flexibility in timing, how efficiently those services could be scheduled over a shared network with other broadband services remains as a challenge. In this paper, we use network slicing as an enabler for network sharing and propose an optimization framework to schedule resources to critical services via puncturing technique with minimal impact on the regular broadband services. We then thoroughly examine the performance of the framework in terms of throughput and reliability through simulation.


Putting the dynamic pathosome in practice a novel way of analyzing longitudinal data. Previously we have developed the concept of the dynamic pathosome, which suggests that individual patterns of phenotype development, i.e., phenotypic trajectories, contain more information than is commonly appreciated and that a phenotype's past trajectory predicts its future development. In this article, we present a pathosome inspired approach to analyzing longitudinal data by functional linear models. We demonstrate how to use this approach and compare it with classical linear models on data from the Czech section of the European Longitudinal Study of Pregnancy and Childhood (ELSPAC). Our results show that functional linear models explain more observed variance in age at menarche from height and weight data than the commonly used approaches. Furthermore, we demonstrate that functional linear models can be used to identify crucial time points that can be used to create linear models achieving almost the same performance as functional linear models. In addition, we use data from the Berkeley growth study (BGS) to demonstrate that growth trajectories from birth to 15 years can be used to explain 97 of observed variance of height at 18 years, thus supporting the notion that a phenotype's past trajectory affects its future course. Overall, this article presents experimental support for the concept of the dynamic pathosome and presents a method that can be used as a powerful tool for analyzing quantitative longitudinal data.


Multi point dimensionality reduction to improve projection layout reliability. In ordinary Dimensionality Reduction (DR), each data instance in an m dimensional space (original space) is mapped to one point in a d dimensional space (visual space), preserving as much as possible distances and or neighborhood relationships. Despite their popularity, even for simple datasets, the existing DR techniques unavoidably may produce misleading visual representations. The problem is not with the existing solutions but with problem formulation. For two dimensional visual space, if data instances are not co planar or do not lie on a 2D manifold, there is no solution for the problem, and the possible approximations usually result in layouts with inaccuracies in the distance preservation and overlapped neighborhoods. In this paper, we elaborate on the concept of Multi point Dimensionality Reduction where each data instance can be mapped to possibly more than one point in the visual space by providing the first general solution to it as a step toward mitigating this issue. By duplicating points, background information is added to the visual representation making local neighborhoods in the visual space more faithful to the original space. Our solution, named Red Gray Plus, is built upon and extends a combination of ordinary DR and graph drawing techniques. We show that not only Multi point Dimensionality Reduction can be one of the potential directions to improve DR layouts' reliability but also that our initial solution to the problem outperforms popular ordinary DR methods quantitatively.


Efficient Attentions for Long Document Summarization. The quadratic computational and memory complexities of large Transformers have limited their scalability for long document summarization. In this paper, we propose Hepos, a novel efficient encoder decoder attention with head wise positional strides to effectively pinpoint salient information from the source. We further conduct a systematic study of existing efficient self attentions. Combined with Hepos, we are able to process ten times more tokens than existing models that use full attentions. For evaluation, we present a new dataset, GovReport, with significantly longer documents and summaries. Results show that our models produce significantly higher ROUGE scores than competitive comparisons, including new state of the art results on PubMed. Human evaluation also shows that our models generate more informative summaries with fewer unfaithful errors.


Semi Supervised Disparity Estimation with Deep Feature Reconstruction. Despite the success of deep learning in disparity estimation, the domain generalization gap remains an issue. We propose a semi supervised pipeline that successfully adapts DispNet to a real world domain by joint supervised training on labeled synthetic data and self supervised training on unlabeled real data. Furthermore, accounting for the limitations of the widely used photometric loss, we analyze the impact of deep feature reconstruction as a promising supervisory signal for disparity estimation.


A model for calculating volumes of trains as flows given demand and capacity restriction. This report presents a novel approach to calculate volumes of trains from a set of requirements describing the transportation demands. The model presented is based on a multi commodity network flow model. The model comprises three different layers the demand level in which the requirements on the transports are presented, the route layer which describes the routes possible to implement the demands and the flow layer in which the resulting flows of train volumes are calculated and distributed over discrete time periods. This structure corresponds well to other industrial planning processes where different products or services that are to be accomplished are first decomposed by methods into different layers of tasks, by e.g. a work breakdown structure (WBS). Resources are then allocated to the tasks as well as scheduled in time. The most important feature of the proposed model is that it is volume based, i.e. volume of trains are handled instead of scheduling individual trains. Scheduling a timetable is a very complex task, and by concentrating on the volumes of trains over time rather than the detailed scheduling of them, the complexity is greatly reduced which is a large computational advantage. The disadvantage is that the representation of capacity in terms of volumes of trains with different properties becomes crucial. The report discusses these advantages and disadvantages as well as gives two examples of the use of the model.


A Tail Estimate with Exponential Decay for the Randomized Incremental Construction of Search Structures. The Randomized Incremental Construction (RIC) of search DAGs for point location in planar subdivisions, nearest neighbor search in 2D points, and extreme point search in 3D convex hulls, are well known to take cal O (n log n) expected time for structures of cal O (n) expected size. Moreover, searching takes w.h.p. cal O ( log n) comparisons in the first and w.h.p. cal O ( log 2 n) comparisons in the latter two DAGs. However, the expected depth of the DAGs and high probability bounds for their size are unknown. Using a novel analysis technique, we show that the three DAGs have w.h.p. i) a size of cal O (n) , ii) a depth of cal O ( log n) , and iii) a construction time of cal O (n log n) . One application of these new and improved results are emph remarkably simple Las Vegas verifiers to obtain search DAGs with optimal worst case bounds. This positively answers the conjectured logarithmic search cost in the DAG of Delaunay triangulations Guibas et al. ICALP 1990 and a conjecture on the depth of the DAG of Trapezoidal subdivisions Hemmer et al. ESA 2012 . It also shows that history based RIC circumvents a lower bound on runtime tail estimates of conflict graph RICs Sen STACS 2019 .


The generalized join the shortest orbit queue system Stability, exact tail asymptotics and stationary approximations. We introduce the textit generalized join the shortest queue model with retrials and two infinite capacity orbit queues. Three independent Poisson streams of jobs, namely a textit smart , and two textit dedicated streams, flow into a single server system, which can hold at most one job. Arriving jobs that find the server occupied are routed to the orbits as follows Blocked jobs from the textit smart stream are routed to the shortest orbit queue, and in case of a tie, they choose an orbit randomly. Blocked jobs from the textit dedicated streams are routed directly to their orbits. Orbiting jobs retry to connect with the server at different retrial rates, i.e., heterogeneous orbit queues. Applications of such a system are found in the modelling of wireless cooperative networks. We are interested in the asymptotic behaviour of the stationary distribution of this model, provided that the system is stable. More precisely, we investigate the conditions under which the tail asymptotic of the minimum orbit queue length is exactly geometric. Moreover, we apply a heuristic asymptotic approach to obtain approximations of the steady state joint orbit queue length distribution. Useful numerical examples are presented, and shown that the results obtained through the asymptotic analysis and the heuristic approach agreed.


Validation of a model for an ionic electro active polymer in the static case. IPMCs consist of a Nafion(R) ionic polymer film coated on both sides with a thin layer of metallic electrodes. The polymer completely dissociates when it is saturated with water, releasing small cations while anions remain bound to the polymer chains. When this strip is subject to an orthogonal electric field, the cations migrate towards the negative electrode, carrying water away by osmosis. This leads to the bending of the strip. We have previously published a modelling of this system based on the thermodynamics of irreversible processes. In this paper, we use this model to simulate numerically the bending of a strip. Since the amplitude of the deflection is large, we use a beam model in large displacements. In addition, the material permittivity may increase with ion concentration. We therefore test three permittivity models. We plot the profiles of the cations concentration, pressure, electric potential and induction, and we study the influence of the strip geometry on the tip displacement and on the blocking force. The results we obtain are in good agreement with the experimental data published in the literature. The variation of these quantities with the imposed electric potential allow us to discriminate between the three models.


An attempt at axiomatization of extending mechanism of solutions to the fluid dynamical systems. Note that some classic fluid dynamical systems such as the Navier Stokes equations, Magnetohydrodynamics (MHD), Boussinesq equations, and etc are observably different from each other but obey some energy inequalities of the similar type. In this paper, we attempt to axiomatize the extending mechanism of solutions to these systems, merely starting from several basic axiomatized conditions such as the local existence, joint property of solutions and some energy inequalities. The results established have nothing to do with the concrete forms of the systems and, thus, give the extending mechanisms in a unified way to all systems obeying the axiomatized conditions. The key tools are several new multiplicative interpolation inequalities of Besov type, which have their own interests.


The impact of outgassing of CO2 and prior calcium precipitation to the isotope composition of calcite precipitated on stalagmites. Implications for reconstructing climate information from proxies. Degassing of CO2 and precipitation of calcite to the surface of stalagmites can strongly impact isotope signals imprinted into the calcite of these speleothems. Here, we show that in all the variety of conditions occurring in nature only two distinct types of degassing exist. First, when a thin film of calcareous solution comes in contact to cave air lower pCO2 value than that of the aqueous CO2 in the water, molecular CO2 escapes by physical diffusion in several seconds. In a next step lasting several ten seconds, pH and DIC in the solution achieve chemical equilibrium with respect to the CO2 in the cave atmosphere. This solution becomes supersaturated with respect to calcite. During precipitation for each unit CaCO3 deposited one molecule of CO2 is generated and escapes from the solution. This precipitation driven degassing is active during precipitation only. We show that all variations of out gassing proposed in the literature are either diffusive outgassing or precipitation driven degassing and that diffusive outgassing has no influence on the isotope composition of the HCO3 pool and consequently on that of calcite. Its isotope imprint is determined solely by precipitation driven degassing in contrast to most explanations in the literature. We present a theoretical model of d13C and d18O that explains the contributions of various parameters such as changes in temperature, changes of pCO2 in the cave atmosphere, and changes in the drip intervals to the isotope composition of calcite precipitated to the apex of the stalagmite. We use this model to calculate quantitatively changes of d13C and d18O observed in field experiments (Carlson et al., 2020) in agreement to their experimental data. We also apply our model to prior calcite precipitation (PCP) in the field as reported by Mickler et al. (2019). We discuss how PCP influences isotope composition signals. ...


A recursive approach for the enumeration of the homomorphisms from a poset P to the chain C 3 . Let cal H (P,C 3) be the set of order homomorphisms from a poset P to the chain C 3 1 2 3 . We develop a recursive approach for the calculation of the cardinality of cal H (P,C 3) , and we apply it on several types of posets, including P C 3 times C 3 times C k and P cal H (C k, C 3) for the latter poset P , we derive a direct formula for cal H ( P, C 3 ) .


Wiles defect for modules and criteria for freeness. F. Diamond proved a numerical criterion for modules over local rings to be free modules over complete intersection rings. We formulate a refinement of these results using the notion of Wiles defect. A key step in the proof is a formula that expresses the Wiles defect of a module in terms of the Wiles defect of the underlying ring.


On the density of visible lattice points along polynomials. Recently, the notion of visibility from the origin has been generalized by viewing lattice points through curved lines of sights, where the family of curves considered are y mx k , k in mathbb N . In this note, we generalize the notion of visible lattice points for a given polynomial family of curves passing through the origin, and study the density of visible lattice points for this family. The density of visible lattice points for family of curves y mx k , k in mathbb N is well understood as one has nice arithmetic interpretations in terms of a generalized gcd function, which seems to be absent for general polynomial families. We pose "Visibility density conjecture" regarding the density of visible lattice points for polynomial families passing through the origin, and show some numerical results supporting the conjecture. We obtain a lower bound on the density for a class of quadratic families. In addition, we discuss some ideas of the proof of the conjecture for the simplest quadratic family.


DialoGraph Incorporating Interpretable Strategy Graph Networks into Negotiation Dialogues. To successfully negotiate a deal, it is not enough to communicate fluently pragmatic planning of persuasive negotiation strategies is essential. While modern dialogue agents excel at generating fluent sentences, they still lack pragmatic grounding and cannot reason strategically. We present DialoGraph, a negotiation system that incorporates pragmatic strategies in a negotiation dialogue using graph neural networks. DialoGraph explicitly incorporates dependencies between sequences of strategies to enable improved and interpretable prediction of next optimal strategies, given the dialogue context. Our graph based method outperforms prior state of the art negotiation models both in the accuracy of strategy dialogue act prediction and in the quality of downstream dialogue response generation. We qualitatively show further benefits of learned strategy graphs in providing explicit associations between effective negotiation strategies over the course of the dialogue, leading to interpretable and strategic dialogues.


Reconstruction for Powerful Graph Representations. Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are significantly harder to implement, may not scale well, and have not been shown to outperform well tuned GNNs in real world tasks. Thus, devising simple, scalable, and expressive GRL architectures that also achieve real world improvements remains an open challenge. In this work, we show the extent to which graph reconstruction reconstructing a graph from its subgraphs can mitigate the theoretical and practical problems currently faced by GRL architectures. First, we leverage graph reconstruction to build two new classes of expressive graph representations. Secondly, we show how graph reconstruction boosts the expressive power of any GNN architecture while being a (provably) powerful inductive bias for invariances to vertex removals. Empirically, we show how reconstruction can boost GNN's expressive power while maintaining its invariance to permutations of the vertices by solving seven graph property tasks not solvable by the original GNN. Further, we demonstrate how it boosts state of the art GNN's performance across nine real world benchmark datasets.


Use of Deterministic Transforms to Design Weight Matrices of a Neural Network. Self size estimating feedforward network (SSFN) is a feedforward multilayer network. For the existing SSFN, a part of each weight matrix is trained using a layer wise convex optimization approach (a supervised training), while the other part is chosen as a random matrix instance (an unsupervised training). In this article, the use of deterministic transforms instead of random matrix instances for the SSFN weight matrices is explored. The use of deterministic transforms provides a reduction in computational complexity. The use of several deterministic transforms is investigated, such as discrete cosine transform, Hadamard transform, Hartley transform, and wavelet transforms. The choice of a deterministic transform among a set of transforms is made in an unsupervised manner. To this end, two methods based on features' statistical parameters are developed. The proposed methods help to design a neural net where deterministic transforms can vary across its layers' weight matrices. The effectiveness of the proposed approach vis a vis the SSFN is illustrated for object classification tasks using several benchmark datasets.


Relativistic Frozen Density Embedding calculations of solvent effects on the NMR shielding constants of transition metal nuclei. Nuclear Magnetic Resonance (NMR) shielding constants of transition metals in solvated complexes are computed at the relativistic density functional theory (DFT) level. The solvent effects evaluated with subsystem DFT approaches are compared with the reference solvent shifts predicted from supermolecular calculations. Two subsystem DFT approaches are analyzed in the standard frozen density embedding (FDE) scheme the transition metal complexes are embedded in an environment of solvent molecules whose density is kept frozen, in the second approach the densities of the complex and of its environment are relaxed in the "freeze and thaw" procedure. The latter approach improves the description of the solvent effects in most cases, nevertheless the FDE deficiencies are rather large in some cases.


Investigating Cross Linguistic Gender Bias in Hindi English Across Domains. Measuring, evaluating and reducing Gender Bias has come to the forefront with newer and improved language embeddings being released every few months. But could this bias vary from domain to domain? We see a lot of work to study these biases in various embedding models but limited work has been done to debias Indic languages. We aim to measure and study this bias in Hindi language, which is a higher order language (gendered) with reference to English, a lower order language. To achieve this, we study the variations across domains to quantify if domain embeddings allow us some insight into Gender bias for this pair of Hindi English model. We will generate embeddings in four different corpora and compare results by implementing different metrics like with pre trained State of the Art Indic English translation model, which has performed better at many NLP tasks than existing models.


Blockchain Enabled Secure Authentication for Unmanned Aircraft Systems. The integration of air and ground smart vehicles is becoming a new paradigm of future transportation. A decent number of smart unmanned vehicles or UAS will be sharing the national airspace for various purposes, such as express delivery, surveillance, etc. However, the proliferation of UAS also brings challenges considering the safe integration of them into the current Air Traffic Management (ATM) systems. Especially when the current Automatic Dependent Surveillance Broadcasting (ADS B) systems do not have message authentication mechanisms, it can not distinguish whether an authorized UAS is using the corresponding airspace. In this paper, we aim to address these practical challenges in two folds. We first use blockchain to provide a secure authentication platform for flight plan approval and sharing between the existing ATM facilities. We then use the fountain code to encode the authentication payloads and adapt them into the de facto communication protocol of ATM. This maintains backward compatibility and ensures the verification success rate under the noisy broadcasting channel. We simulate the realistic wireless communication scenarios and theoretically prove that our proposed authentication framework is with low latency and highly compatible with existing ATM communication protocols.


Parameterized discrete uniformization theorems and curvature flows for polyhedral surfaces, II. This paper investigates the combinatorial alpha curvature for vertex scaling of piecewise hyperbolic metrics on polyhedral surfaces, which is a parameterized generalization of the classical combinatorial curvature. A discrete uniformization theorem for combinatorial alpha curvature is established, which generalizes Gu Guo Luo Sun Wu's discrete uniformization theorem for classical combinatorial curvature. We further introduce combinatorial alpha Yamabe flow and combinatorial alpha Calabi flow for vertex scaling to find piecewise hyperbolic metrics with prescribed combinatorial alpha curvatures. To handle the potential singularities along the combinatorial curvature flows, we do surgery along the flows by edge flipping. Using the discrete conformal theory established by Gu Guo Luo Sun Wu, we prove the longtime existence and convergence of combinatorial alpha Yamabe flow and combinatorial alpha Calabi flow with surgery, which provide effective algorithms for finding piecewise hyperbolic metrics with prescribed combinatorial alpha curvatures.


NAS BERT Task Agnostic and Adaptive Size BERT Compression with Neural Architecture Search. While pre trained language models (e.g., BERT) have achieved impressive results on different natural language processing tasks, they have large numbers of parameters and suffer from big computational and memory costs, which make them difficult for real world deployment. Therefore, model compression is necessary to reduce the computation and memory cost of pre trained models. In this work, we aim to compress BERT and address the following two challenging practical issues (1) The compression algorithm should be able to output multiple compressed models with different sizes and latencies, in order to support devices with different memory and latency limitations (2) The algorithm should be downstream task agnostic, so that the compressed models are generally applicable for different downstream tasks. We leverage techniques in neural architecture search (NAS) and propose NAS BERT, an efficient method for BERT compression. NAS BERT trains a big supernet on a search space containing a variety of architectures and outputs multiple compressed models with adaptive sizes and latency. Furthermore, the training of NAS BERT is conducted on standard self supervised pre training tasks (e.g., masked language model) and does not depend on specific downstream tasks. Thus, the compressed models can be used across various downstream tasks. The technical challenge of NAS BERT is that training a big supernet on the pre training task is extremely costly. We employ several techniques including block wise search, search space pruning, and performance approximation to improve search efficiency and accuracy. Extensive experiments on GLUE and SQuAD benchmark datasets demonstrate that NAS BERT can find lightweight models with better accuracy than previous approaches, and can be directly applied to different downstream tasks with adaptive model sizes for different requirements of memory or latency.


E voting System Using Homomorphic Encryption and Blockchain Technology to Encrypt Voter Data. Homomorphic encryption and blockchain technology are regarded as two significant technologies for improving e voting systems. In this paper, we suggest a novel e voting system using homomorphic encryption and blockchain technology that is focused on encrypting voter data. By encrypting voter information rather than cast votes, the system enables various statistical analyses regarding the vote result while securing the credibility, privacy, and verifiability of overall e voting system. We checked the efficiency of the overall system by comparing the speed of the proposed system with the speed of other e voting systems that use homomorphic encryption and blockchain technology.


Multiwavelet based Operator Learning for Differential Equations. The solution of a partial differential equation can be obtained by computing the inverse operator map between the input and the solution space. Towards this end, we introduce a textit multiwavelet based neural operator learning scheme that compresses the associated operator's kernel using fine grained wavelets. By explicitly embedding the inverse multiwavelet filters, we learn the projection of the kernel onto fixed multiwavelet polynomial bases. The projected kernel is trained at multiple scales derived from using repeated computation of multiwavelet transform. This allows learning the complex dependencies at various scales and results in a resolution independent scheme. Compare to the prior works, we exploit the fundamental properties of the operator's kernel which enable numerically efficient representation. We perform experiments on the Korteweg de Vries (KdV) equation, Burgers' equation, Darcy Flow, and Navier Stokes equation. Compared with the existing neural operator approaches, our model shows significantly higher accuracy and achieves state of the art in a range of datasets. For the time varying equations, the proposed method exhibits a ( 2X 10X ) improvement ( 0.0018 ( 0.0033 ) relative L2 error for Burgers' (KdV) equation). By learning the mappings between function spaces, the proposed method has the ability to find the solution of a high resolution input after learning from lower resolution data.


The SpaceNet Multi Temporal Urban Development Challenge. Building footprints provide a useful proxy for a great many humanitarian applications. For example, building footprints are useful for high fidelity population estimates, and quantifying population statistics is fundamental to 1 4 of the United Nations Sustainable Development Goals Indicators. In this paper we (the SpaceNet Partners) discuss efforts to develop techniques for precise building footprint localization, tracking, and change detection via the SpaceNet Multi Temporal Urban Development Challenge (also known as SpaceNet 7). In this NeurIPS 2020 competition, participants were asked identify and track buildings in satellite imagery time series collected over rapidly urbanizing areas. The competition centered around a brand new open source dataset of Planet Labs satellite imagery mosaics at 4m resolution, which includes 24 images (one per month) covering 100 unique geographies. Tracking individual buildings at this resolution is quite challenging, yet the winning participants demonstrated impressive performance with the newly developed SpaceNet Change and Object Tracking (SCOT) metric. This paper details the top 5 winning approaches, as well as analysis of results that yielded a handful of interesting anecdotes such as decreasing performance with latitude.


A Survey on Multi modal Summarization. The new era of technology has brought us to the point where it is convenient for people to share their opinions over an abundance of platforms. These platforms have a provision for the users to express themselves in multiple forms of representations, including text, images, videos, and audio. This, however, makes it difficult for users to obtain all the key information about a topic, making the task of automatic multi modal summarization (MMS) essential. In this paper, we present a comprehensive survey of the existing research in the area of MMS.


Advancing High Resolution Video Language Representation with Large Scale Video Transcriptions. We study joint video and language (VL) pre training to enable cross modality learning and benefit plentiful downstream VL tasks. Existing works either extract low quality video features or learn limited text embedding, while neglecting that high resolution videos and diversified semantics can significantly improve cross modality learning. In this paper, we propose a novel High resolution and Diversified VIdeo LAnguage pre training model (HD VILA) for many visual tasks. In particular, we collect a large dataset with two distinct properties 1) the first high resolution dataset including 371.5k hours of 720p videos, and 2) the most diversified dataset covering 15 popular YouTube categories. To enable VL pre training, we jointly optimize the HD VILA model by a hybrid Transformer that learns rich spatiotemporal features, and a multimodal Transformer that enforces interactions of the learned video features with diversified texts. Our pre training model achieves new state of the art results in 10 VL understanding tasks and 2 more novel text to visual generation tasks. For example, we outperform SOTA models with relative increases of 38.5 R 1 in zero shot MSR VTT text to video retrieval task, and 53.6 in high resolution dataset LSMDC. The learned VL embedding is also effective in generating visually pleasing and semantically relevant results in text to visual manipulation and super resolution tasks.


Unifying Discourse Resources with Dependency Framework. For text level discourse analysis, there are various discourse schemes but relatively few labeled data, because discourse research is still immature and it is labor intensive to annotate the inner logic of a text. In this paper, we attempt to unify multiple Chinese discourse corpora under different annotation schemes with discourse dependency framework by designing semi automatic methods to convert them into dependency structures. We also implement several benchmark dependency parsers and research on how they can leverage the unified data to improve performance.


QA Align Representing Cross Text Content Overlap by Aligning Question Answer Propositions. Multi text applications, such as multi document summarization, are typically required to model redundancies across related texts. Current methods confronting consolidation struggle to fuse overlapping information. In order to explicitly represent content overlap, we propose to align predicate argument relations across texts, providing a potential scaffold for information consolidation. We go beyond clustering coreferring mentions, and instead model overlap with respect to redundancy at a propositional level, rather than merely detecting shared referents. Our setting exploits QA SRL, utilizing question answer pairs to capture predicate argument relations, facilitating laymen annotation of cross text alignments. We employ crowd workers for constructing a dataset of QA based alignments, and present a baseline QA alignment model trained over our dataset. Analyses show that our new task is semantically challenging, capturing content overlap beyond lexical similarity and complements cross document coreference with proposition level links, offering potential use for downstream tasks.


Indicators of Attack Failure Debugging and Improving Optimization of Adversarial Examples. Evaluating robustness of machine learning models to adversarial examples is a challenging problem. Many defenses have been shown to provide a false sense of security by causing gradient based attacks to fail, and they have been broken under more rigorous evaluations. Although guidelines and best practices have been suggested to improve current adversarial robustness evaluations, the lack of automatic testing and debugging tools makes it difficult to apply these recommendations in a systematic manner. In this work, we overcome these limitations by (i) defining a set of quantitative indicators which unveil common failures in the optimization of gradient based attacks, and (ii) proposing specific mitigation strategies within a systematic evaluation protocol. Our extensive experimental analysis shows that the proposed indicators of failure can be used to visualize, debug and improve current adversarial robustness evaluations, providing a first concrete step towards automatizing and systematizing current adversarial robustness evaluations. Our open source code is available at https github.com pralab IndicatorsOfAttackFailure.


Smart and Secure CAV Networks Empowered by AI Enabled Blockchain The Next Frontier for Intelligent Safe Driving Assessment. Securing safe driving for connected and autonomous vehicles (CAVs) continues to be a widespread concern, despite various sophisticated functions delivered by artificial intelligence for in vehicle devices. Diverse malicious network attacks are ubiquitous, along with the worldwide implementation of the Internet of Vehicles, which exposes a range of reliability and privacy threats for managing data in CAV networks. Combined with the fact that the capability of existing CAVs in handling intensive computation tasks is limited, this implies a need for designing an efficient assessment system to guarantee autonomous driving safety without compromising data security. In this article we propose a novel framework, namely Blockchain enabled intElligent Safe driving assessmenT (BEST), which offers a smart and reliable approach for conducting safe driving supervision while protecting vehicular information. Specifically, a promising solution that exploits a long short term memory model is introduced to assess the safety level of the moving CAVs. Then we investigate how a distributed blockchain obtains adequate trustworthiness and robustness for CAV data by adopting a byzantine fault tolerance based delegated proof of stake consensus mechanism. Simulation results demonstrate that our presented BEST gains better data credibility with a higher prediction accuracy for vehicular safety assessment when compared with existing schemes. Finally, we discuss several open challenges that need to be addressed in future CAV networks.


Discriminator Free Generative Adversarial Attack. The Deep Neural Networks are vulnerable toadversarial exam ples(Figure 1), making the DNNs based systems collapsed byadding the inconspicuous perturbations to the images. Most of the existing works for adversarial attack are gradient based and suf fer from the latency efficiencies and the load on GPU memory. Thegenerative based adversarial attacks can get rid of this limitation,and some relative works propose the approaches based on GAN.However, suffering from the difficulty of the convergence of train ing a GAN, the adversarial examples have either bad attack abilityor bad visual quality. In this work, we find that the discriminatorcould be not necessary for generative based adversarial attack, andpropose theSymmetric Saliency based Auto Encoder (SSAE)to generate the perturbations, which is composed of the saliencymap module and the angle norm disentanglement of the featuresmodule. The advantage of our proposed method lies in that it is notdepending on discriminator, and uses the generative saliency map to pay more attention to label relevant regions. The extensive exper iments among the various tasks, datasets, and models demonstratethat the adversarial examples generated by SSAE not only make thewidely used models collapse, but also achieves good visual quality.The code is available at https github.com BravoLu SSAE.


Multipliers and Unicentral Leibniz Algebras. This paper details the Leibniz generalization of Lie theoretic results from Peggy Batten's 1993 dissertation. We first show that the multiplier of a Leibniz algebra is characterized by its second cohomology group with coefficients in the field. We then establish criteria for when the center of a cover maps onto the center of the algebra. Along the way, we obtain a collection of exact sequences and a brief theory of unicentral Leibniz algebras.


Using mixup as regularization and tuning hyper parameters for ResNets. While novel computer vision architectures are gaining traction, the impact of model architectures is often related to changes or exploring in training methods. Identity mapping based architectures ResNets and DenseNets have promised path breaking results in the image classification task and are go to methods for even now if the data given is fairly limited. Considering the ease of training with limited resources this work revisits the ResNets and improves the ResNet50 cite resnets by using mixup data augmentation as regularization and tuning the hyper parameters.


BERT Beta A Proactive Probabilistic Approach to Text Moderation. Text moderation for user generated content, which helps to promote healthy interaction among users, has been widely studied and many machine learning models have been proposed. In this work, we explore an alternative perspective by augmenting reactive reviews with proactive forecasting. Specifically, we propose a new concept it text toxicity propensity to characterize the extent to which a text tends to attract toxic comments. Beta regression is then introduced to do the probabilistic modeling, which is demonstrated to function well in comprehensive experiments. We also propose an explanation method to communicate the model decision clearly. Both propensity scoring and interpretation benefit text moderation in a novel manner. Finally, the proposed scaling mechanism for the linear model offers useful insights beyond this work.


Thom's gradient conjecture for parabolic systems and the Yang Mills flow. In 8 , the gradient conjecture of R. Thom was proven for gradient flows of analytic functions on mathbb R n . This result means that the secant at a limit point converges, so that the flow cannot spiral forever. Once the trajectory becomes sufficiently close to a critical point, the flow becomes a simple scaling. Their paper is also significant in the number of auxiliary results they prove about the convergence behaviour of gradient flows, on the way to proving their main result. Many gradient flows of interest occur on infinite dimensional function spaces. And of considerable research interest today are geometric flows with a gauge or diffeomorphism symmetry. We show that the corresponding gradient conjecture holds also for parabolic flows on Hilbert spaces, and for the extensively studied Yang Mills flow.


Label informed Graph Structure Learning for Node Classification. Graph Neural Networks (GNNs) have achieved great success among various domains. Nevertheless, most GNN methods are sensitive to the quality of graph structures. To tackle this problem, some studies exploit different graph structure learning strategies to refine the original graph structure. However, these methods only consider feature information while ignoring available label information. In this paper, we propose a novel label informed graph structure learning framework which incorporates label information explicitly through a class transition matrix. We conduct extensive experiments on seven node classification benchmark datasets and the results show that our method outperforms or matches the state of the art baselines.


Disparate Impact Diminishes Consumer Trust Even for Advantaged Users. Systems aiming to aid consumers in their decision making (e.g., by implementing persuasive techniques) are more likely to be effective when consumers trust them. However, recent research has demonstrated that the machine learning algorithms that often underlie such technology can act unfairly towards specific groups (e.g., by making more favorable predictions for men than for women). An undesired disparate impact resulting from this kind of algorithmic unfairness could diminish consumer trust and thereby undermine the purpose of the system. We studied this effect by conducting a between subjects user study investigating how (gender related) disparate impact affected consumer trust in an app designed to improve consumers' financial decision making. Our results show that disparate impact decreased consumers' trust in the system and made them less likely to use it. Moreover, we find that trust was affected to the same degree across consumer groups (i.e., advantaged and disadvantaged users) despite both of these consumer groups recognizing their respective levels of personal benefit. Our findings highlight the importance of fairness in consumer oriented artificial intelligence systems.


On a Class of Polar Log Aesthetic Curves. Curves are essential concepts that enable compounded aesthetic curves, e.g., to assemble complex silhouettes, match a specific curvature profile in industrial design, and construct smooth, comfortable, and safe trajectories in vehicle robot navigation systems. New mechanisms able to encode, generate, evaluate, and deform aesthetic curves are expected to improve the throughput and the quality of industrial design. In recent years, the study of (log) aesthetic curves have attracted the community's attention due to its ubiquity in natural phenomena such as bird eggs, butterfly wings, falcon flights, and manufactured products such as Japanese swords and automobiles. A (log) aesthetic curve renders a logarithmic curvature graph approximated by a straight line, and polar aesthetic curves enable to mode user defined dynamics of the polar tangential angle in the polar coordinate system. As such, the curvature profile often becomes a by product of the tangential angle. In this paper, we extend the concept of polar aesthetic curves and establish the analytical formulations to construct aesthetic curves with user defined criteria. In particular, we propose the closed form analytic characterizations of polar log aesthetic curves meeting user defined criteria of curvature profiles and dynamics of polar tangential angles. We present numerical examples portraying the feasibility of rendering the logarithmic curvature graphs represented by a straight line. Our approach enables the seamless characterization of aesthetic curves in the polar coordinate system, which can model aesthetic shapes with desirable aesthetic curvature profiles.


Proving infinite index for a subgroup of matrices. We show how tools from computational group theory can be used to prove that a subgroup of matrices has infinite index.


Keeping up with the bits tracking physical layer latency in millimeter wave Wi Fi networks. The wireless communications landscape is anticipated to offer new service levels following the introduction of the millimeter wave (mmWave) spectrum to consumer electronics. With their broad bandwidths and corresponding multi Gbps data rates, these mmWaves are a perfect fit for data hungry applications, such as streaming video to extended reality devices. However, the latter are also bound by maximal latency constraints as low as 1 ms. Understanding where such minuscule time delays lurk requires a close up study of individual layers in the network stack. Starting from the bottom up, the present work describes an endeavor at uncloaking the origins of physical layer (PHY) latency in mmWave Wi Fi networks. It proposes a newly designed simulation framework and sheds light on how any conventional laboratory can be turned into a virtual experiment setting, speeding up computation. A case study based on the IEEE 802.11ad standard demonstrates the framework's ability to track packet latency at the PHY level and identify individual bottlenecks. In particular, it evaluates the impact of the number of LDPC decoding iterations on latency in short transmission sequences.


The C algebra of the variable Mautner group. Let M P times M be a variable Mautner group. We describe the C algebra C ( M) of M in terms of an algebra of operator fields defined over P times C 2 .


HAIR Head mounted AR Intention Recognition. Human teams exhibit both implicit and explicit intention sharing. To further development of human robot collaboration, intention recognition is crucial on both sides. Present approaches rely on a vast sensor suite on and around the robot to achieve intention recognition. This relegates intuitive human robot collaboration purely to such bulky systems, which are inadequate for large scale, real world scenarios due to their complexity and cost. In this paper we propose an intention recognition system that is based purely on a portable head mounted display. In addition robot intention visualisation is also supported. We present experiments to show the quality of our human goal estimation component and some basic interactions with an industrial robot. HAIR should raise the quality of interaction between robots and humans, instead of such interactions raising the hair on the necks of the human coworkers.


Fair Enough Searching for Sufficient Measures of Fairness. Testing machine learning software for ethical bias has become a pressing current concern. In response, recent research has proposed a plethora of new fairness metrics, for example, the dozens of fairness metrics in the IBM AIF360 toolkit. This raises the question How can any fairness tool satisfy such a diverse range of goals? While we cannot completely simplify the task of fairness testing, we can certainly reduce the problem. This paper shows that many of those fairness metrics effectively measure the same thing. Based on experiments using seven real world datasets, we find that (a) 26 classification metrics can be clustered into seven groups, and (b) four dataset metrics can be clustered into three groups. Further, each reduced set may actually predict different things. Hence, it is no longer necessary (or even possible) to satisfy all fairness metrics. In summary, to simplify the fairness testing problem, we recommend the following steps (1) determine what type of fairness is desirable (and we offer a handful of such types) then (2) lookup those types in our clusters then (3) just test for one item per cluster.


Hyperbolic models for transitive topological Anosov flows in dimension three. We prove that every transitive topological Anosov flow on a closed 3 manifold is orbitally equivalent to a smooth Anosov flow, preserving an ergodic smooth volume form.


Rigidity theorem of the Bergman kernel by analytic capacity. In 7 , Dong and I proved that the domains D subset mathbb C of finite volume whose on diagonal Bergman kernels K( cdot, cdot) satisfy K(z 0, z 0) Volume(D) 1 are disks minus closed polar sets. We utilized the solution of the Suita conjecture, a deep theorem of several complex variables. In this note, I present a significantly more elementary proof of this theorem that does not use several complex variables. As a corollary, a new lower bound for the on diagonal Bergman kernel is given. Finally, I show that the only real ellipsoid in Webster normal form which satisfies K(0, 0) Volume(D) 1 is the unit ball.


On multidimensional fixed point theorems and their applications. The purpose of this paper is to present some multidimensional fixed point theorems and their applications. For this, we provide a multidimensional fixed point theorem and then using this theorem we prove the existence and uniqueness of a solution of a nonlinear Hammerstein integral equation. Moreover, we provide an example to illustrate the hypotheses and the abstract result of this paper.


Interaction of radio frequency waves with cylindrical density filaments scattering and radiation pressure. The propagation of radio frequency (RF) waves in tokamaks can be affected by filamentary structures present in the edge plasma. The waves are reflected, refracted, and diffracted, leading to a decrease in efficiency of heating and or current generation. The scattering of RF waves (lower hybrid, helicon, and ion cyclotron waves) by a single cylindrical filament is studied using a full wave analytical theory. Analysis reveals a variety of common scattering features among the three different RF waves which can be inferred by examining the cold plasma dispersion relation. The physical intuition is useful in understanding experimental observations and results from complex numerical simulations. While a filament can affect the propagation of RF waves, the radiation force exerted by the waves can influence the filament. The force on a filament is determined using the Maxwell stress tensor. In 1905, Poynting was the first to evaluate and measure the radiation force on an interface separating two different dielectric media. For ordinary light propagating in vacuum and incident on a glass surface, Poynting noted that the surface is "pulled" towards the vacuum. In a magnetized cold plasma, there are two independent wave modes. Even if only one of these modes is excited by a RF antenna, a filament will couple power to the other mode, a consequence of boundary conditions. This facet of scattering has consequences on the radiation force that go beyond Poynting's seminal contribution. The direction of the force depends on the polarization of the incident wave and on the mode structure of the waves inside and in the vicinity of a filament. It can either pull a filament towards the RF source or push it away. For all three waves, the force is large enough to impact the motion of a filament and could be measured experimentally. It may be possible to modify edge turbulence using RF waves.


Unrefinable partitions into distinct parts in a normalizer chain. In a recent paper on a study of the Sylow 2 subgroups of the symmetric group with 2 n elements it has been show that the growth of the first (n 2) consecutive indices of a certain normalizer chain is linked to the sequence of partitions of integers into distinct parts. Unrefinable partitions into distinct parts are those in which no part x can be replaced with integers whose sum is x obtaining a new partition into distinct parts. We prove here that the (n 1) th index of the previously mentioned chain is related to the number of unrefinable partitions into distinct parts satisfying a condition on the minimal excludant.


A universal framework to efficiently share material and process resources in the DNA construction world. DNA constructs and their annotated sequence maps have been rapidly accumulating with the advancement of DNA cloning, synthesis, and assembly methods. Such a resource has the potential to be optimally utilized in an autonomous DNA building platform. However, most DNA design processes today remain manually operated with the assistance of graphical user interface (GUI) software. Furthermore, as seen commonly in the life sciences, reproducibility of DNA construction process descriptions is usually not guaranteed, and utilization of previously developed materials and protocols is not appropriately credited. Here, we developed an open source process description and resource sharing framework QUEEN (a framework to generate quinable and efficiently editable nucleotide sequence resources) to resolve these issues in building DNA. QUEEN enables the flexible design of new DNA by using existing DNA resource files and recoding the construction process in an output file (GenBank file format). The GenBank files generated by QUEEN are able to regenerate the process codes that perfectly clone themselves and bequeath the design history to successive DNA constructs that recycle their partial resources. QUEEN generated GenBank files are compatible with the existing DNA repository services and software. We propose QUEEN as a solution to start significantly advancing our material and protocol sharing of DNA resources.


Sampling Subgraph Network with Application to Graph Classification. Graphs are naturally used to describe the structures of various real world systems in biology, society, computer science etc., where subgraphs or motifs as basic blocks play an important role in function expression and information processing. However, existing research focuses on the basic statistics of certain motifs, largely ignoring the connection patterns among them. Recently, a subgraph network (SGN) model is proposed to study the potential structure among motifs, and it was found that the integration of SGN can enhance a series of graph classification methods. However, SGN model lacks diversity and is of quite high time complexity, making it difficult to widely apply in practice. In this paper, we introduce sampling strategies into SGN, and design a novel sampling subgraph network model, which is scale controllable and of higher diversity. We also present a hierarchical feature fusion framework to integrate the structural features of diverse sampling SGNs, so as to improve the performance of graph classification. Extensive experiments demonstrate that, by comparing with the SGN model, our new model indeed has much lower time complexity (reduced by two orders of magnitude) and can better enhance a series of graph classification methods (doubling the performance enhancement).


Stokes matrices for Airy equations. We compute Stokes matrices for generalised Airy equations and prove that they are regular unipotent (up to multiplication with the formal monodromy). This class of differential equations was defined by Katz and includes the classical Airy equation. In addition, it includes differential equations which are not rigid. Our approach is based on the topological computation of Stokes matrices of the enhanced Fourier Sato transform of a perverse sheaf due to D'Agnolo, Hien, Morando and Sabbah.


Toric Symplectic Geometry and Full Spark Frames. The collection of d times N complex matrices with prescribed column norms and prescribed (nonzero) singular values forms a compact algebraic variety, which we refer to as a frame space. Elements of frame spaces i.e., frames are used to give robust representations of complex valued signals, so that geometrical and measure theoretic properties of frame spaces are of interest to the signal processing community. This paper is concerned with the following question what is the probability that a frame drawn uniformly at random from a given frame space has the property that any subset of d of its columns gives a basis for mathbb C d ? We show that the probability is one, generalizing recent work of Cahill, Mixon and Strawn. To prove this, we first show that frame spaces are related to highly structured objects called toric symplectic manifolds. This relationship elucidates the geometric meaning of eigensteps certain spectral invariants of a frame and should be a more broadly applicable tool for studying probabilistic questions about the structure of frame spaces. As another application of our symplectic perspective, we completely characterize the norm and spectral data for which the corresponding frame space has singularities, answering some open questions in the frame theory literature.


Competitive Control. We consider control from the perspective of competitive analysis. Unlike much prior work on learning based control, which focuses on minimizing regret against the best controller selected in hindsight from some specific class, we focus on designing an online controller which competes against a clairvoyant offline optimal controller. A natural performance metric in this setting is competitive ratio, which is the ratio between the cost incurred by the online controller and the cost incurred by the offline optimal controller. Using operator theoretic techniques from robust control, we derive a computationally efficient state space description of the the controller with optimal competitive ratio in both finite horizon and infinite horizon settings. We extend competitive control to nonlinear systems using Model Predictive Control (MPC) and present numerical experiments which show that our competitive controller can significantly outperform standard H 2 and H infty controllers in the MPC setting.


Hierarchical Program Triggered Reinforcement Learning Agents For Automated Driving. Recent advances in Reinforcement Learning (RL) combined with Deep Learning (DL) have demonstrated impressive performance in complex tasks, including autonomous driving. The use of RL agents in autonomous driving leads to a smooth human like driving experience, but the limited interpretability of Deep Reinforcement Learning (DRL) creates a verification and certification bottleneck. Instead of relying on RL agents to learn complex tasks, we propose HPRL Hierarchical Program triggered Reinforcement Learning, which uses a hierarchy consisting of a structured program along with multiple RL agents, each trained to perform a relatively simple task. The focus of verification shifts to the master program under simple guarantees from the RL agents, leading to a significantly more interpretable and verifiable implementation as compared to a complex RL agent. The evaluation of the framework is demonstrated on different driving tasks, and NHTSA precrash scenarios using CARLA, an open source dynamic urban simulation environment.


Defense Against Explanation Manipulation. Explainable machine learning attracts increasing attention as it improves transparency of models, which is helpful for machine learning to be trusted in real applications. However, explanation methods have recently been demonstrated to be vulnerable to manipulation, where we can easily change a model's explanation while keeping its prediction constant. To tackle this problem, some efforts have been paid to use more stable explanation methods or to change model configurations. In this work, we tackle the problem from the training perspective, and propose a new training scheme called Adversarial Training on EXplanations (ATEX) to improve the internal explanation stability of a model regardless of the specific explanation method being applied. Instead of directly specifying explanation values over data instances, ATEX only puts requirement on model predictions which avoids involving second order derivatives in optimization. As a further discussion, we also find that explanation stability is closely related to another property of the model, i.e., the risk of being exposed to adversarial attack. Through experiments, besides showing that ATEX improves model robustness against manipulation targeting explanation, it also brings additional benefits including smoothing explanations and improving the efficacy of adversarial training if applied to the model.


Rank Based Norms, Capra Conjugacies and the Rank Function. We consider the space of matrices, with given number of rows and of columns, equipped with the classic trace scalar product. With any matrix (source) norm, we associate a coupling, called Capra, between the space of matrices and itself. Then, we compute the Capra conjugate and biconjugate of the rank function. They are expressed in function of a sequence of rank based norms, more precisely generalized r rank and dual r rank matrix norms associated with the matrix source norm. We deduce a lower bound of the rank function given by a variational formula which involves the generalized r rank norms. In the case of the Frobenius norm, we show that the rank function is equal to the variational formula.


Master Teapots and Entropy Algorithms for the Mandelbrot Set. We construct an analogue of W. Thurston's "Master teapot" for each principal vein in the Mandelbrot set, and generalize geometric properties known for the corresponding object for real maps. In particular, we show that eigenvalues outside the unit circle move continuously, while we show "persistence" for roots inside the unit circle. As an application, this shows that the outside part of the corresponding "Thurston set" is path connected. In order to do this, we define a version of kneading theory for principal veins, and we prove the equivalence of several algorithms that compute the core entropy.


Unknown Object Segmentation through Domain Adaptation. The ability to segment unknown objects in cluttered scenes has a profound impact on robot grasping. The rise of deep learning has greatly transformed the pipeline of robotic grasping from model based approach to data driven stream, which generally requires a large scale of grasping data either collected in simulation or from real world examples. In this paper, we proposed a sim to real framework to transfer the object segmentation model learned in simulation to the real world. First, data samples are collected in simulation, including RGB, 6D pose, and point cloud. Second, we also present a GAN based unknown object segmentation method through domain adaptation, which consists of an image translation module and an image segmentation module. The image translation module is used to shorten the reality gap and the segmentation module is responsible for the segmentation mask generation. We used the above method to perform segmentation experiments on unknown objects in a bin picking scenario. Finally, the experimental result shows that the segmentation model learned in simulation can be used for real world data segmentation.


CADDA Class wise Automatic Differentiable Data Augmentation for EEG Signals. Data augmentation is a key element of deep learning pipelines, as it informs the network during training about transformations of the input data that keep the label unchanged. Manually finding adequate augmentation methods and parameters for a given pipeline is however rapidly cumbersome. In particular, while intuition can guide this decision for images, the design and choice of augmentation policies remains unclear for more complex types of data, such as neuroscience signals. Besides, class dependent augmentation strategies have been surprisingly unexplored in the literature, although it is quite intuitive changing the color of a car image does not change the object class to be predicted, but doing the same to the picture of an orange does. This paper investigates gradient based automatic data augmentation algorithms amenable to class wise policies with exponentially larger search spaces. Motivated by supervised learning applications using EEG signals for which good augmentation policies are mostly unknown, we propose a new differentiable relaxation of the problem. In the class agnostic setting, results show that our new relaxation leads to optimal performance with faster training than competing gradient based methods, while also outperforming gradient free methods in the class wise setting. This work proposes also novel differentiable augmentation operations relevant for sleep stage classification.


The effects of random and seasonal environmental fluctuations on optimal harvesting and stocking. We analyze the harvesting and stocking of a population that is affected by random and seasonal environmental fluctuations. The main novelty comes from having three layers of environmental fluctuations. The first layer is due to the environment switching at random times between different environmental states. This is similar to having sudden environmental changes or catastrophes. The second layer is due to seasonal variation, where there is a significant change in the dynamics between seasons. Finally, the third layer is due to the constant presence of environmental stochasticity between the seasonal or random regime switches, the species is affected by fluctuations which can be modelled by white noise. This framework is more realistic because it can capture both significant random and deterministic environmental shifts as well as small and frequent fluctuations in abiotic factors. Our framework also allows for the price or cost of harvesting to change deterministically and stochastically, something that is more realistic from an economic point of view. The combined effects of seasonal and random fluctuations make it impossible to find the optimal harvesting stocking strategy analytically. We get around this roadblock by developing rigorous numerical approximations and proving that they converge to the optimal harvesting stocking strategy. We apply our methods to multiple population models and explore how prices, or costs, and environmental fluctuations influence the optimal harvesting stocking strategy. We show that in many situations the optimal way of harvesting and stocking is not of threshold type.


Recommending Researchers in Machine Learning based on Author Topic Model. The aim of this paper is to uncover the researchers in machine learning using the author topic model (ATM). We collect 16,855 scientific papers from six top journals in the field of machine learning published from 1997 to 2016 and analyze them using ATM. The dataset is broken down into 4 intervals to identify the top researchers and find similar researchers using their similarity score. The similarity score is calculated using Hellinger distance. The researchers are plotted using t SNE, which reduces the dimensionality of the data while keeping the same distance between the points. The analysis of our study helps the upcoming researchers to find the top researchers in their area of interest.


Fluorescence of pyrene doped polystyrene films from room temperature down to 4 K for wavelength shifting applications. In liquid argon based particle detectors, slow wavelength shifters (WLSs) could be used alongside the common, nanosecond scale, WLS tetraphenyl butadiene (TPB) for background mitigation purposes. At room temperature, pyrene has a moderate fluorescence light yield (LY) and a time constant of the order of hundreds of nanoseconds. In this work, four pyrene doped polystyrene films with various purities and concentrations were characterized in terms of LY and decay time constants in a range of temperature between 4 K and 300 K under ultraviolet excitation. These films were found to have a LY between 35 and 50 of that of evaporated TPB. All light yields increase when cooling down, while the decays slow down. At room temperature, we observed that pyrene purity is strongly correlated with emission lifetime highest obtainable purity samples were dominated by decays with emission time constants of sim 250 280 ns, and lower purity samples were dominated by an sim 80 ns component. One sample was investigated further to better understand the monomer and excimer emissions of pyrene. The excimer over monomer intensity ratio decreases when the temperature goes down, with the monomer emission dominating below sim 87 K.


Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems. Recurrent neural networks (RNNs) are powerful models for processing time series data, but it remains challenging to understand how they function. Improving this understanding is of substantial interest to both the machine learning and neuroscience communities. The framework of reverse engineering a trained RNN by linearizing around its fixed points has provided insight, but the approach has significant challenges. These include difficulty choosing which fixed point to expand around when studying RNN dynamics and error accumulation when reconstructing the nonlinear dynamics with the linearized dynamics. We present a new model that overcomes these limitations by co training an RNN with a novel switching linear dynamical system (SLDS) formulation. A first order Taylor series expansion of the co trained RNN and an auxiliary function trained to pick out the RNN's fixed points govern the SLDS dynamics. The results are a trained SLDS variant that closely approximates the RNN, an auxiliary function that can produce a fixed point for each point in state space, and a trained nonlinear RNN whose dynamics have been regularized such that its first order terms perform the computation, if possible. This model removes the post training fixed point optimization and allows us to unambiguously study the learned dynamics of the SLDS at any point in state space. It also generalizes SLDS models to continuous manifolds of switching points while sharing parameters across switches. We validate the utility of the model on two synthetic tasks relevant to previous work reverse engineering RNNs. We then show that our model can be used as a drop in in more complex architectures, such as LFADS, and apply this LFADS hybrid to analyze single trial spiking activity from the motor system of a non human primate.


Representation of probability distributions with implied volatility and biological rationale. Economic and financial theories and practice essentially deal with uncertain future. Humans encounter uncertainty in different kinds of activity, from sensory motor control to dynamics in financial markets, what has been subject of extensive studies. Representation of uncertainty with normal or lognormal distribution is a common feature of many of those studies. For example, proposed Bayessian integration of Gaussian multisensory input in the brain or log normal distribution of future asset price in renowned Black Scholes Merton (BSM) model for pricing contingent claims. Standard deviation of log(future asset price) scaled by square root of time in the BSM model is called implied volatility. Actually, log(future asset price) is not normally distributed and traders account for that to avoid losses. Nevertheless the BSM formula derived under the assumption of constant volatility remains a major uniform framework for pricing options in financial markets. I propose that one of the reasons for such a high popularity of the BSM formula could be its ability to translate uncertainty measured with implied volatility into price in a way that is compatible with human intuition for measuring uncertainty. The present study deals with mathematical relationship between uncertainty and the BSM implied volatility. Examples for a number of common probability distributions are presented. Overall, this work proposes that representation of various probability distributions in terms of the BSM implied volatility profile may be meaningful in both biological and financial worlds. Necessary background from financial mathematics is provided in the text.


Myopically Verifiable Probabilistic Certificate for Long term Safety. In this paper, we consider the use of barrier function based approaches for the safe control problem in stochastic systems. With the presence of stochastic uncertainties, a myopic controller that ensures safe probability in infinitesimal time intervals may allow the accumulation of unsafe probability over time and result in a small long term safe probability. Meanwhile, increasing the outlook time horizon may lead to significant computation burdens and delayed reactions, which also compromises safety. To tackle this challenge, we define a new notion of forward invariance on probability space as opposed to the safe regions on state space. This new notion allows the long term safe probability to be framed into a forward invariance condition, which can be efficiently evaluated. We build upon this safety condition to propose a controller that works myopically yet can guarantee long term safe probability or fast recovery probability. The proposed controller ensures the safe probability does not decrease over time and allows the designers to directly specify safe probability. The performance of the proposed controller is then evaluated in numerical simulations. Finally, we show that this framework can also be adapted to characterize the speed and probability of forward convergent behaviors, which can be of use to finite time Lyapunov analysis in stochastic systems.


Evidence for association of triatomic molecule in ultracold 23 Na 40 K and 40 K mixture. Ultracold assembly of diatomic molecules has enabled great advances in controlled chemistry, ultracold chemical physics, and quantum simulation with molecules. Extending the ultracold association to triatomic molecules will offer many new research opportunities and challenges in these fields. A possible approach is to form triatomic molecules in the ultracold atom and diatomic molecule mixture by employing the Feshbach resonance between them. Although the ultracold atom diatomic molecule Feshbach resonances have been observed recently, utilizing these resonances to form triatomic molecules remains challenging. Here we report on the evidence of the association of triatomic molecules near the Feshbach resonances between 23 Na 40 K molecules in the rovibrational ground state and 40 K atoms. We apply a radio frequency pulse to drive the free bound transition and monitor the loss of 23 Na 40 K molecules. The association of triatomic molecules manifests itself as an additional loss feature in the radio frequency spectra, which can be distinguished from the atomic loss feature.The binding energy of triatomic molecule is estimated from the measurement. Our work is helpful to understand the complex ultracold atom molecule Feshbach resonance and may open up an avenue towards the preparation and control of ultracold triatomic molecules.


Mask GVAE Blind Denoising Graphs via Partition. We present Mask GVAE, a variational generative model for blind denoising large discrete graphs, in which "blind denoising" means we don't require any supervision from clean graphs. We focus on recovering graph structures via deleting irrelevant edges and adding missing edges, which has many applications in real world scenarios, for example, enhancing the quality of connections in a co authorship network. Mask GVAE makes use of the robustness in low eigenvectors of graph Laplacian against random noise and decomposes the input graph into several stable clusters. It then harnesses the huge computations by decoding probabilistic smoothed subgraphs in a variational manner. On a wide variety of benchmarks, Mask GVAE outperforms competing approaches by a significant margin on PSNR and WL similarity.


Membership Inference Attacks From First Principles. A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dataset. These attacks are currently evaluated using average case "accuracy" metrics that fail to characterize whether the attack can confidently identify any members of the training set. We argue that attacks should instead be evaluated by computing their true positive rate at low (e.g., 0.1 ) false positive rates, and find most prior attacks perform poorly when evaluated in this way. To address this we develop a Likelihood Ratio Attack (LiRA) that carefully combines multiple ideas from the literature. Our attack is 10x more powerful at low false positive rates, and also strictly dominates prior attacks on existing metrics.


PAM Pose Attention Module for Pose Invariant Face Recognition. Pose variation is one of the key challenges in face recognition. Conventional techniques mainly focus on face frontalization or face augmentation in image space. However, transforming face images in image space is not guaranteed to preserve the lossless identity features of the original image. Moreover, these methods suffer from more computational costs and memory requirements due to the additional models. We argue that it is more desirable to perform feature transformation in hierarchical feature space rather than image space, which can take advantage of different feature levels and benefit from joint learning with representation learning. To this end, we propose a lightweight and easy to implement attention block, named Pose Attention Module (PAM), for pose invariant face recognition. Specifically, PAM performs frontal profile feature transformation in hierarchical feature space by learning residuals between pose variations with a soft gate mechanism. We validated the effectiveness of PAM block design through extensive ablation studies and verified the performance on several popular benchmarks, including LFW, CFP FP, AgeDB 30, CPLFW, and CALFW. Experimental results show that our method not only outperforms state of the art methods but also effectively reduces memory requirements by more than 75 times. It is noteworthy that our method is not limited to face recognition with large pose variations. By adjusting the soft gate mechanism of PAM to a specific coefficient, such semantic attention block can easily extend to address other intra class imbalance problems in face recognition, including large variations in age, illumination, expression, etc.


math.AG cs.IT math.AC math.CO math.IT math.NT

Rational points of lattice ideals on a toric variety and toric codes. We show that the number of rational points of a subgroup inside a toric variety over a finite field defined by a homogeneous lattice ideal can be computed via Smith normal form of the matrix whose columns constitute a basis of the lattice. This generalizes and yields a concise toric geometric proof of the same fact proven purely algebraically by Lopez and Villarreal for the case of a projective space and a standard homogeneous lattice ideal of dimension one. We also prove a Nullstellensatz type theorem over a finite field establishing a one to one correspondence between subgroups of the dense split torus and certain homogeneous lattice ideals. As application, we compute the main parameters of generalized toric codes on subgroups of the torus of Hirzebruch surfaces, generalizing the existing literature.


WAS VTON Warping Architecture Search for Virtual Try on Network. Despite recent progress on image based virtual try on, current methods are constraint by shared warping networks and thus fail to synthesize natural try on results when faced with clothing categories that require different warping operations. In this paper, we address this problem by finding clothing category specific warping networks for the virtual try on task via Neural Architecture Search (NAS). We introduce a NAS Warping Module and elaborately design a bilevel hierarchical search space to identify the optimal network level and operation level flow estimation architecture. Given the network level search space, containing different numbers of warping blocks, and the operation level search space with different convolution operations, we jointly learn a combination of repeatable warping cells and convolution operations specifically for the clothing person alignment. Moreover, a NAS Fusion Module is proposed to synthesize more natural final try on results, which is realized by leveraging particular skip connections to produce better fused features that are required for seamlessly fusing the warped clothing and the unchanged person part. We adopt an efficient and stable one shot searching strategy to search the above two modules. Extensive experiments demonstrate that our WAS VTON significantly outperforms the previous fixed architecture try on methods with more natural warping results and virtual try on results.


A local characterization for the Cuntz semigroup of AI algebras. We give a local characterization for the Cuntz semigroup of AI algebras building upon Shen's characterization of dimension groups. Using this result, we provide an abstract characterization for the Cuntz semigroup of AI algebras.


Unified Expression of Achievable Region in Privacy Constrained Source Coding. Privacy constrained source coding problems have become increasingly important recently, and the utility privacy trade off has been investigated for various systems. As pioneering work, Yamamoto (1983) found theoretical limits of the coding rate, privacy and utility in two cases (i) both public and private information is encoded and (ii) only public information is encoded. However, the theoretical limit has not been characterized in a more general case (iii) encoded messages consist of public information and a part of private information. Then in this paper, we characterize the trade off relation in case (iii). The obtained expression of the achievable region is a "unified expression" because it includes the ones in case (i) and (ii) as special cases. Through the numerical results, we clarify the significance of the choice of the encoded set.


Propagation invariant high dimensional orbital angular momentum states. Photonic states encoded in spatial modes of paraxial light fields provide a promising platform for high dimensional quantum information protocols and related studies, where several pioneering theoretical and experimental demonstrations have paved the path for future technologies. Crucially, critical issues encountered in free space propagation still represent a major challenge. This is the case of asynchronous diffraction between spatial modes with different modal orders, which experience variations in their transverse structure upon free space propagation. Here we address this issue by proposing an encoding method based on the use of Laguerre Gaussian (LG) modes of the same modal order N to define a N 1 dimensional space. Noteworthy, such modes endowed with orbital angular momentum (OAM) experience the same propagation aberrations featuring an identical Gouy phase and wavefront curvature. We demonstrate our proposal experimentally by using time correlated single photon imaging combined with a digital propagation technique. Importantly, our technique allows to eliminate, without the use of imaging systems, all issues related to asynchronous diffraction, providing an accessible way to generate propagation invariant OAM qudits for quantum optical protocols.


Rate of convergence for particle approximation of PDEs in Wasserstein space. We prove a rate of convergence for the N particle approximation of a second order partial differential equation in the space of probability measures, like the Master equation or Bellman equation of mean field control problem under common noise. The rate is of order 1 N for the pathwise error on the solution v and of order 1 sqrt N for the L 2 error on its L derivative partial mu v . The proof relies on backward stochastic differential equations techniques.


Co optimising Robot Morphology and Controller in a Simulated Open Ended Environment. Designing robots by hand can be costly and time consuming, especially if the robots have to be created with novel materials, or be robust to internal or external changes. In order to create robots automatically, without the need for human intervention, it is necessary to optimise both the behaviour and the body design of the robot. However, when co optimising the morphology and controller of a locomoting agent the morphology tends to converge prematurely, reaching a local optimum. Approaches such as explicit protection of morphological innovation have been used to reduce this problem, but it might also be possible to increase exploration of morphologies using a more indirect approach. We explore how changing the environment, where the agent locomotes, affects the convergence of morphologies. The agents' morphologies and controllers are co optimised, while the environments the agents locomote in are evolved open endedly with the Paired Open Ended Trailblazer (POET). We compare the diversity, fitness and robustness of agents evolving in environments generated by POET to agents evolved in handcrafted curricula of environments. Our agents each contain of a population of individuals being evolved with a genetic algorithm. This population is called the agent population. We show that agent populations evolving in open endedly evolving environments exhibit larger morphological diversity than agent populations evolving in hand crafted curricula of environments. POET proved capable of creating a curriculum of environments which encouraged both diversity and quality in the populations. This suggests that POET may be capable of reducing premature convergence in co optimisation of morphology and controllers.


Sequential Competitive Facility Location Exact and Approximate Algorithms. We study a competitive facility location problem (CFLP), in which two firms sequentially select locations of new facilities, in order to maximize their market shares of customer demand that follows a probabilistic choice model. This process is a Stackelberg game and admits a bilevel mixed integer nonlinear program (MINLP) formulation. Through integer programming methods, we derive an equivalent, single level MINLP reformulation. In addition, we exploit the problem structures and derive two classes of valid inequalities, one based on submodularity and the other based on concave overestimation. We apply these inequalities in a branch and cut algorithm to find a globally optimal solution to CFLP. Furthermore, we propose an approximation algorithm for solving CFLP that is computationally more effective. Notably, this algorithm admits a constant approximation guarantee. Extensive numerical studies demonstrate that the exact algorithm can significantly accelerate the solving of CFLP on problem instances that have not been solved to optimality by existing methods. The approximation algorithm can find near optimal solutions even more quickly.


A Spiking Neural Network for Image Segmentation. We seek to investigate the scalability of neuromorphic computing for computer vision, with the objective of replicating non neuromorphic performance on computer vision tasks while reducing power consumption. We convert the deep Artificial Neural Network (ANN) architecture U Net to a Spiking Neural Network (SNN) architecture using the Nengo framework. Both rate based and spike based models are trained and optimized for benchmarking performance and power, using a modified version of the ISBI 2D EM Segmentation dataset consisting of microscope images of cells. We propose a partitioning method to optimize inter chip communication to improve speed and energy efficiency when deploying multi chip networks on the Loihi neuromorphic chip. We explore the advantages of regularizing firing rates of Loihi neurons for converting ANN to SNN with minimum accuracy loss and optimized energy consumption. We propose a percentile based regularization loss function to limit the spiking rate of the neuron between a desired range. The SNN is converted directly from the corresponding ANN, and demonstrates similar semantic segmentation as the ANN using the same number of neurons and weights. However, the neuromorphic implementation on the Intel Loihi neuromorphic chip is over 2x more energy efficient than conventional hardware (CPU, GPU) when running online (one image at a time). These power improvements are achieved without sacrificing the task performance accuracy of the network, and when all weights (Loihi, CPU, and GPU networks) are quantized to 8 bits.


Learning Selective Communication for Multi Agent Path Finding. Learning communication via deep reinforcement learning (RL) or imitation learning (IL) has recently been shown to be an effective way to solve Multi Agent Path Finding (MAPF). However, existing communication based MAPF solvers focus on broadcast communication, where an agent broadcasts its message to all other or predefined agents. It is not only impractical but also leads to redundant information that could even impair the multi agent cooperation. A succinct communication scheme should learn which information is relevant and influential to each agent's decision making process. To address this problem, we consider a request reply scenario and propose Decision Causal Communication (DCC), a simple yet efficient model to enable agents to select neighbors to conduct communication during both training and execution. Specifically, a neighbor is determined as relevant and influential only when the presence of this neighbor causes the decision adjustment on the central agent. This judgment is learned only based on agent's local observation and thus suitable for decentralized execution to handle large scale problems. Empirical evaluation in obstacle rich environment indicates the high success rate with low communication overhead of our method.


cs.DC cs.CE cs.LG physics.bio-ph q-bio.QM

Pandemic Drugs at Pandemic Speed Infrastructure for Accelerating COVID 19 Drug Discovery with Hybrid Machine Learning and Physics based Simulations on High Performance Computers. The race to meet the challenges of the global pandemic has served as a reminder that the existing drug discovery process is expensive, inefficient and slow. There is a major bottleneck screening the vast number of potential small molecules to shortlist lead compounds for antiviral drug development. New opportunities to accelerate drug discovery lie at the interface between machine learning methods, in this case developed for linear accelerators, and physics based methods. The two in silico methods, each have their own advantages and limitations which, interestingly, complement each other. Here, we present an innovative infrastructural development that combines both approaches to accelerate drug discovery. The scale of the potential resulting workflow is such that it is dependent on supercomputing to achieve extremely high throughput. We have demonstrated the viability of this workflow for the study of inhibitors for four COVID 19 target proteins and our ability to perform the required large scale calculations to identify lead antiviral compounds through repurposing on a variety of supercomputers.