Individual and pair based models of epidemic spreading master equations and analysis of their forecasting capabilities. Mathematical modeling of disease spreading plays a crucial role in understanding, controlling and preventing epidemic outbreaks. In a microscopic description of the propagation of a disease over the complex network of human contacts, the probability that an individual is in a given state (susceptible, infectious, recovered etc) depends on the state of its neighbors in the network. Thus it depends on the state of pairs of nodes, which in turns depends on triples, in a hierarchy of dynamical dependencies. In order to produce models that are at the same time reliable and manageable, one has to understand how to truncate such a hierarchy, and how the chosen order of approximation affects the ability of the model to forecast the real temporal evolution of an epidemics. In this paper we provide a systematic analysis of the reliability (under different hypotheses on the quantity and quality of available data) of the predictions obtained by truncating the hierarchy either at the level of individuals or at the level of pairs. We find that pair based models are reliable tools both for estimating the epidemiological parameters and for forecasting the temporal evolution of the epidemics, under all conditions taken into account in our work. However, a pair based approach provides a much better prediction of an individual based one, only if better data, namely information on the state of node pairs, are available. Overall, our results suggest that more refined mathematical models need to be informed by improved contact tracing techniques to better support decision on policies and containment measures to adopt.


Statistical Privacy Guarantees of Machine Learning Preprocessing Techniques. Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning pipeline, in particular during the preprocessing phase. Our contributions are twofold we adapt a privacy violation detection framework based on statistical methods to empirically measure privacy levels of machine learning pipelines, and apply the newly created framework to show that resampling techniques used when dealing with imbalanced datasets cause the resultant model to leak more privacy. These results highlight the need for developing private preprocessing techniques.


On the infinitary van der Waerden Theorem. We give a purely combinatorial proof for the infinitary van der Waerden theorem.


Red Blood Cell Sphericity Index Obtained by Defocusing Microscopy and Retinopathy Severity in Sickle Cell Disease. Proliferative sickle cell retinopathy (PSCR) is the most important ocular manifestation of sickle cell disease (SCD), but understanding of its pathophysiology remains incomplete. Red blood cell (RBC) deformability has been identified as a critical factor in SCD and is intrinsically related with cell sphericity index (SI). The aim of this study was to develop an algorithm that automatically analyzes defocusing microscopy (DM) images, providing biomechanical parameters of individual RBCs, including cellular SI. Furthermore, association of RBC SI with severity of PSCR in individuals with HbSC SCD was also investigated. We determined the SI of 255 RBCs from 17 individuals using DM. Nine individuals (53 ) were healthy and eight (47 ) had HbSC SCD. Mean SI was significantly lower in SCD than in control group (0.69 versus 0.73), and also in severe than in mild PSCR (0.67 versus 0.70). Lower SI was also associated with more severe retinopathy (ROC AUC 0.85) and the proportion of participants with SI 0.69 was significantly greater in severe than in mild PSCR (100 versus 25 ). In conclusion, lower RBC SI determined by DM was associated not only with the presence of SCD, but also with more severe PSCR, possibly being a surrogate biomarker of disease severity.


Recognizing and Embedding Simple Optimal 2 Planar Graphs. In the area of beyond planar graphs, i.e. graphs that can be drawn with some local restrictions on the edge crossings, the recognition problem is prominent next to the density question for the different graph classes. For 1 planar graphs, the recognition problem has been settled, namely it is NP complete for the general case, while optimal 1 planar graphs, i.e. those with maximum density, can be recognized in linear time. For 2 planar graphs, the picture is less complete. As expected, the recognition problem has been found to be NP complete in general. In this paper, we consider the recognition of simple optimal 2 planar graphs. We exploit a combinatorial characterization of such graphs and present a linear time algorithm for recognition and embedding.


Hierarchical growing grid networks for skeleton based action recognition. In this paper, a novel cognitive architecture for action recognition is developed by applying layers of growing grid neural networks.Using these layers makes the system capable of automatically arranging its representational structure. In addition to the expansion of the neural map during the growth phase, the system is provided with a prior knowledge of the input space, which increases the processing speed of the learning phase. Apart from two layers of growing grid networks the architecture is composed of a preprocessing layer, an ordered vector representation layer and a one layer supervised neural network. These layers are designed to solve the action recognition problem. The first layer growing grid receives the input data of human actions and the neural map generates an action pattern vector representing each action sequence by connecting the elicited activation of the trained map. The pattern vectors are then sent to the ordered vector representation layer to build the time invariant input vectors of key activations for the second layer growing grid. The second layer growing grid categorizes the input vectors to the corresponding action clusters sub clusters and finally the one layer supervised neural network labels the shaped clusters with action labels. Three experiments using different datasets of actions show that the system is capable of learning to categorize the actions quickly and efficiently. The performance of the growing grid architecture is com pared with the results from a system based on Self Organizing Maps, showing that the growing grid architecture performs significantly superior on the action recognition tasks.


Selective Knowledge Distillation for Neural Machine Translation. Neural Machine Translation (NMT) models achieve state of the art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely applied to enhance the model's performance by transferring teacher model's knowledge on each training sample. However, previous work rarely discusses the different impacts and connections among these samples, which serve as the medium for transferring teacher knowledge. In this paper, we design a novel protocol that can effectively analyze the different impacts of samples by comparing various samples' partitions. Based on above protocol, we conduct extensive experiments and find that the teacher's knowledge is not the more, the better. Knowledge over specific samples may even hurt the whole performance of knowledge distillation. Finally, to address these issues, we propose two simple yet effective strategies, i.e., batch level and global level selections, to pick suitable samples for distillation. We evaluate our approaches on two large scale machine translation tasks, WMT'14 English German and WMT'19 Chinese English. Experimental results show that our approaches yield up to 1.28 and 0.89 BLEU points improvements over the Transformer baseline, respectively.


Minimal Surface Entropy and Average Area Ratio. On any closed hyperbolizable 3 manifold, we find a sharp relation between the minimal surface entropy (introduced by Calegari Marques Neves) and the average area ratio (introduced by Gromov), and we show that, among metrics g with scalar curvature greater than or equal to 6, the former is maximized by the hyperbolic metric. One corollary is to solve a conjecture of Gromov regarding the average area ratio. Our proofs use Ricci flow with surgery and laminar measures invariant under a PSL(2,R) action.


Energy Efficient Multi Orchestrator Mobile Edge Learning. Mobile Edge Learning (MEL) is a collaborative learning paradigm that features distributed training of Machine Learning (ML) models over edge devices (e.g., IoT devices). In MEL, possible coexistence of multiple learning tasks with different datasets may arise. The heterogeneity in edge devices' capabilities will require the joint optimization of the learners orchestrator association and task allocation. To this end, we aim to develop an energy efficient framework for learners orchestrator association and learning task allocation, in which each orchestrator gets associated with a group of learners with the same learning task based on their communication channel qualities and computational resources, and allocate the tasks accordingly. Therein, a multi objective optimization problem is formulated to minimize the total energy consumption and maximize the learning tasks' accuracy. However, solving such optimization problem requires centralization and the presence of the whole environment information at a single entity, which becomes impractical in large scale systems. To reduce the solution complexity and to enable solution decentralization, we propose lightweight heuristic algorithms that can achieve near optimal performance and facilitate the trade offs between energy consumption, accuracy, and solution complexity. Simulation results show that the proposed approaches reduce the energy consumption significantly while executing multiple learning tasks compared to recent state of the art methods.


DEUX An Attribute Guided Framework for Sociable Recommendation Dialog Systems. It is important for sociable recommendation dialog systems to perform as both on task content and social content to engage users and gain their favor. In addition to understand the user preferences and provide a satisfying recommendation, such systems must be able to generate coherent and natural social conversations to the user. Traditional dialog state tracking cannot be applied to such systems because it does not track the attributes in the social content. To address this challenge, we propose DEUX, a novel attribute guided framework to create better user experiences while accomplishing a movie recommendation task. DEUX has a module that keeps track of the movie attributes (e.g., favorite genres, actors,etc.) in both user utterances and system responses. This allows the system to introduce new movie attributes in its social content. Then, DEUX has multiple values for the same attribute type which suits the recommendation task since a user may like multiple genres, for instance. Experiments suggest that DEUX outperforms all the baselines on being more consistent, fitting the user preferences better, and providing a more engaging chat experience. Our approach can be used for any similar problems of sociable task oriented dialog system.


Two partitions of a flag manifold. We point out similarities between two partitions of a flag manifold with pieces indexed by Weyl group elements. One partition is defined using the action of a Frobenius map, the other partition is defined using conjugation by a regular semisimple element.


Implementing Dimer Metadynamics using GROMACS. We develop a Gromacs implementation of Dimer Metadynamics JCTC 13, 425 (2017) for enhanced sampling through artificial delocalization effects. This implementation is based entirely on a Plumed collective variable developed for this purpose, the fine tuning of Gromacs input parameters, modified forcefields and custom non bonded interactions. We demonstrate this implementation on Alanine Dipeptide in vacuum and in water, and on the 12 residue Alanine Polypeptide in water and compare the results with a standard multiple replica technique such as Parallel Tempering. In all the considered cases this comparison is consistent and the results with Dimer Metadynamics are smoother and require shorter simulations, thus proving the consistency and effectiveness of this Gromacs implementation.


Many Agent Reinforcement Learning Under Partial Observability. Recent renewed interest in multi agent reinforcement learning (MARL) has generated an impressive array of techniques that leverage deep reinforcement learning, primarily actor critic architectures, and can be applied to a limited range of settings in terms of observability and communication. However, a continuing limitation of much of this work is the curse of dimensionality when it comes to representations based on joint actions, which grow exponentially with the number of agents. In this paper, we squarely focus on this challenge of scalability. We apply the key insight of action anonymity, which leads to permutation invariance of joint actions, to two recently presented deep MARL algorithms, MADDPG and IA2C, and compare these instantiations to another recent technique that leverages action anonymity, viz., mean field MARL. We show that our instantiations can learn the optimal behavior in a broader class of agent networks than the mean field method, using a recently introduced pragmatic domain.


Motion Augmented Self Training for Video Recognition at Smaller Scale. The goal of this paper is to self train a 3D convolutional neural network on an unlabeled video collection for deployment on small scale video collections. As smaller video datasets benefit more from motion than appearance, we strive to train our network using optical flow, but avoid its computation during inference. We propose the first motion augmented self training regime, we call MotionFit. We start with supervised training of a motion model on a small, and labeled, video collection. With the motion model we generate pseudo labels for a large unlabeled video collection, which enables us to transfer knowledge by learning to predict these pseudo labels with an appearance model. Moreover, we introduce a multi clip loss as a simple yet efficient way to improve the quality of the pseudo labeling, even without additional auxiliary tasks. We also take into consideration the temporal granularity of videos during self training of the appearance model, which was missed in previous works. As a result we obtain a strong motion augmented representation model suited for video downstream tasks like action recognition and clip retrieval. On small scale video datasets, MotionFit outperforms alternatives for knowledge transfer by 5 8 , video only self supervision by 1 7 and semi supervised learning by 9 18 using the same amount of class labels.


Multilingual Medical Question Answering and Information Retrieval for Rural Health Intelligence Access. In rural regions of several developing countries, access to quality healthcare, medical infrastructure, and professional diagnosis is largely unavailable. Many of these regions are gradually gaining access to internet infrastructure, although not with a strong enough connection to allow for sustained communication with a medical practitioner. Several deaths resulting from this lack of medical access, absence of patient's previous health records, and the unavailability of information in indigenous languages can be easily prevented. In this paper, we describe an approach leveraging the phenomenal progress in Machine Learning and NLP (Natural Language Processing) techniques to design a model that is low resource, multilingual, and a preliminary first point of contact medical assistant. Our contribution includes defining the NLP pipeline required for named entity recognition, language agnostic sentence embedding, natural language translation, information retrieval, question answering, and generative pre training for final query processing. We obtain promising results for this pipeline and preliminary results for EHR (Electronic Health Record) analysis with text summarization for medical practitioners to peruse for their diagnosis. Through this NLP pipeline, we aim to provide preliminary medical information to the user and do not claim to supplant diagnosis from qualified medical practitioners. Using the input from subject matter experts, we have compiled a large corpus to pre train and fine tune our BioBERT based NLP model for the specific tasks. We expect recent advances in NLP architectures, several of which are efficient and privacy preserving models, to further the impact of our solution and improve on individual task performance.


On Predicting Generalization using GANs. Research on generalization bounds for deep networks seeks to give ways to predict test error using just the training dataset and the network parameters. While generalization bounds can give many insights about architecture design, training algorithms, etc., what they do not currently do is yield good predictions for actual test error. A recently introduced Predicting Generalization in Deep Learning competition citep jiang2020neurips aims to encourage discovery of methods to better predict test error. The current paper investigates a simple idea can test error be predicted using em synthetic data, produced using a Generative Adversarial Network (GAN) that was trained on the same training dataset? Upon investigating several GAN models and architectures, we find that this turns out to be the case. In fact, using GANs pre trained on standard datasets, the test error can be predicted without requiring any additional hyper parameter tuning. This result is surprising because GANs have well known limitations (e.g. mode collapse) and are known to not learn the data distribution accurately. Yet the generated samples are good enough to substitute for test data. Several additional experiments are presented to explore reasons why GANs do well at this task. In addition to a new approach for predicting generalization, the counter intuitive phenomena presented in our work may also call for a better understanding of GANs' strengths and limitations.


Conditional Synthetic Data Generation for Robust Machine Learning Applications with Limited Pandemic Data. textbf Background At the onset of a pandemic, such as COVID 19, data with proper labeling attributes corresponding to the new disease might be unavailable or sparse. Machine Learning (ML) models trained with the available data, which is limited in quantity and poor in diversity, will often be biased and inaccurate. At the same time, ML algorithms designed to fight pandemics must have good performance and be developed in a time sensitive manner. To tackle the challenges of limited data, and label scarcity in the available data, we propose generating conditional synthetic data, to be used alongside real data for developing robust ML models. textbf Methods We present a hybrid model consisting of a conditional generative flow and a classifier for conditional synthetic data generation. The classifier decouples the feature representation for the condition, which is fed to the flow to extract the local noise. We generate synthetic data by manipulating the local noise with fixed conditional feature representation. We also propose a semi supervised approach to generate synthetic samples in the absence of labels for a majority of the available data. textbf Results We performed conditional synthetic generation for chest computed tomography (CT) scans corresponding to normal, COVID 19, and pneumonia afflicted patients. We show that our method significantly outperforms existing models both on qualitative and quantitative performance, and our semi supervised approach can efficiently synthesize conditional samples under label scarcity. As an example of downstream use of synthetic data, we show improvement in COVID 19 detection from CT scans with conditional synthetic data augmentation.


Systematic Enumeration and Identification of Unique Spatial Topologies of 3D Systems Using Spatial Graph Representations. Systematic enumeration and identification of unique 3D spatial topologies of complex engineering systems such as automotive cooling layouts, hybrid electric power trains, and aero engines are essential to search their exhaustive design spaces to identify spatial topologies that can satisfy challenging system requirements. However, efficient navigation through discrete 3D spatial topology options is a very challenging problem due to its combinatorial nature and can quickly exceed human cognitive abilities at even moderate complexity levels. Here we present a new, efficient, and generic design framework that utilizes mathematical spatial graph theory to represent, enumerate, and identify distinctive 3D topological classes for an abstract engineering system, given its system architecture (SA) its components and interconnections. Spatial graph diagrams (SGDs) are generated for a given SA from zero to a specified maximum crossing number. Corresponding Yamada polynomials for all the planar SGDs are then generated. SGDs are categorized into topological classes, each of which shares a unique Yamada polynomial. Finally, for each topological class, one 3D geometric model is generated for an SGD with the fewest interconnect crossings. Several case studies are shown to illustrate the different features of our proposed framework. Design guidelines are also provided for practicing engineers to aid the utilization of this framework for application to different types of real world problems.


Towards Understanding and Evaluating Structural Node Embeddings. While most network embedding techniques model the proximity between nodes in a network, recently there has been significant interest in structural embeddings that are based on node equivalences, a notion rooted in sociology equivalences or positions are collections of nodes that have similar roles i.e., similar functions, ties or interactions with nodes in other positions irrespective of their distance or reachability in the network. Unlike the proximity based methods that are rigorously evaluated in the literature, the evaluation of structural embeddings is less mature. It relies on small synthetic or real networks with labels that are not perfectly defined, and its connection to sociological equivalences has hitherto been vague and tenuous. With new node embedding methods being developed at a breakneck pace, proper evaluation and systematic characterization of existing approaches will be essential to progress. To fill in this gap, we set out to understand what types of equivalences structural embeddings capture. We are the first to contribute rigorous intrinsic and extrinsic evaluation methodology for structural embeddings, along with carefully designed, diverse datasets of varying sizes. We observe a number of different evaluation variables that can lead to different results (e.g., choice of similarity measure, classifier, label definitions). We find that degree distributions within nodes' local neighborhoods can lead to simple yet effective baselines in their own right and guide the future development of structural embedding. We hope that our findings can influence the design of further node embedding methods and also pave the way for more comprehensive and fair evaluation of structural embedding methods.


Robot Learning of 6 DoF Grasping using Model based Adaptive Primitives. Robot learning is often simplified to planar manipulation due to its data consumption. Then, a common approach is to use a fully convolutional neural network to estimate the reward of grasp primitives. In this work, we extend this approach by parametrizing the two remaining, lateral Degrees of Freedom (DoFs) of the primitives. We apply this principle to the task of 6 DoF bin picking We introduce a model based controller to calculate angles that avoid collisions, maximize the grasp quality while keeping the uncertainty small. As the controller is integrated into the training, our hybrid approach is able to learn about and exploit the model based controller. After real world training of 27000 grasp attempts, the robot is able to grasp known objects with a success rate of over 92 in dense clutter. Grasp inference takes less than 50ms. In further real world experiments, we evaluate grasp rates in a range of scenarios including its ability to generalize to unknown objects. We show that the system is able to avoid collisions, enabling grasps that would not be possible without primitive adaption.


3D Adversarial Attacks Beyond Point Cloud. Recently, 3D deep learning models have been shown to be susceptible to adversarial attacks like their 2D counterparts. Most of the state of the art (SOTA) 3D adversarial attacks perform perturbation to 3D point clouds. To reproduce these attacks in the physical scenario, a generated adversarial 3D point cloud need to be reconstructed to mesh, which leads to a significant drop in its adversarial effect. In this paper, we propose a strong 3D adversarial attack named Mesh Attack to address this problem by directly performing perturbation on mesh of a 3D object. In order to take advantage of the most effective gradient based attack, a differentiable sample module that back propagate the gradient of point cloud to mesh is introduced. To further ensure the adversarial mesh examples without outlier and 3D printable, three mesh losses are adopted. Extensive experiments demonstrate that the proposed scheme outperforms SOTA 3D attacks by a significant margin. We also achieved SOTA performance under various defenses. Our code is available at https github.com cuge1995 Mesh Attack.


Outage Common Randomness Capacity Characterization of Multiple Antenna Slow Fading Channels. We investigate the problem of common randomness (CR) generation from discrete correlated sources aided by one way communication over single user multiple input multiple output (MIMO) slow fading channels with additive white Gaussian noise (AWGN), arbitrary state distribution and with channel state information available at the receiver side (CSIR). We completely solve the problem by first characterizing the channel outage capacity of MIMO slow fading channels for arbitrary state distribution. For this purpose, we also provide an achievable rate for a specific compound MIMO Gaussian channel. Second, we define the outage CR capacity of the MIMO slow fading channel and establish a single letter characterization of it using our result on its outage transmission capacity.


SIDE State Inference for Partially Observable Cooperative Multi Agent Reinforcement Learning. As one of the solutions to the decentralized partially observable Markov decision process (Dec POMDP) problems, the value decomposition method has achieved significant results recently. However, most value decomposition methods require the fully observable state of the environment during training, but this is not feasible in some scenarios where only incomplete and noisy observations can be obtained. Therefore, we propose a novel value decomposition framework, named State Inference for value DEcomposition (SIDE), which eliminates the need to know the global state by simultaneously seeking solutions to the two problems of optimal control and state inference. SIDE can be extended to any value decomposition method to tackle partially observable problems. By comparing with the performance of different algorithms in StarCraft II micromanagement tasks, we verified that though without accessible states, SIDE can infer the current state that contributes to the reinforcement learning process based on past local observations and even achieve superior results to many baselines in some complex scenarios.


Diameter rigidity for Kahler manifolds with positive bisectional curvature. We prove that a Kahler manifold with positive bisectional curvature and maximal diameter is isometric to the complex projective space with the Fubini Study metric.


The case for the Humanities Citation Index (HuCI) a citation index by the humanities, for the humanities. Citation indexes are by now part of the research infrastructure in use by most scientists a necessary tool in order to cope with the increasing amounts of scientific literature being published. Commercial citation indexes are designed for the sciences and have uneven coverage and unsatisfactory characteristics for humanities scholars, while no comprehensive citation index is published by a public organization. We argue that an open citation index for the humanities is desirable, for four reasons it would greatly improve and accelerate the retrieval of sources, it would offer a way to interlink collections across repositories (such as archives and libraries), it would foster the adoption of metadata standards and best practices by all stakeholders (including publishers) and it would contribute research data to fields such as bibliometrics and science studies. We also suggest that the citation index should be informed by a set of requirements relevant to the humanities. We discuss four source coverage must be comprehensive, including books and citations to primary sources there needs to be chronological depth, as scholarship in the humanities remains relevant over time the index should be collection driven, leveraging the accumulated thematic collections of specialized research libraries and it should be rich in context in order to allow for the qualification of each citation, for example by providing citation excerpts. We detail the fit for purpose research infrastructure which can make the humanities citation index a reality. Ultimately, we argue that a citation index for the humanities can be created by humanists, via a collaborative, distributed and open effort.


Height pairings for algebraic cycles on the product of a curve and a surface. For the product X C times S of a curve and a surface over a number field, we construct unconditionally a Beilinson Bloch type height pairing for homologically trivial algebraic cycles on X . Then for an embedding f C to S , we define an arithmetic diagonal cycle modified from the graph of f . This work extends previous work of Gross and Schoen when S is the product of two curves, and is based on our recent work which relates the height pairings and the standard conjectures.


Attacking Deep Reinforcement Learning Based Traffic Signal Control Systems with Colluding Vehicles. The rapid advancements of Internet of Things (IoT) and artificial intelligence (AI) have catalyzed the development of adaptive traffic signal control systems (ATCS) for smart cities. In particular, deep reinforcement learning (DRL) methods produce the state of the art performance and have great potentials for practical applications. In the existing DRL based ATCS, the controlled signals collect traffic state information from nearby vehicles, and then optimal actions (e.g., switching phases) can be determined based on the collected information. The DRL models fully "trust" that vehicles are sending the true information to the signals, making the ATCS vulnerable to adversarial attacks with falsified information. In view of this, this paper first time formulates a novel task in which a group of vehicles can cooperatively send falsified information to "cheat" DRL based ATCS in order to save their total travel time. To solve the proposed task, we develop CollusionVeh, a generic and effective vehicle colluding framework composed of a road situation encoder, a vehicle interpreter, and a communication mechanism. We employ our method to attack established DRL based ATCS and demonstrate that the total travel time for the colluding vehicles can be significantly reduced with a reasonable number of learning episodes, and the colluding effect will decrease if the number of colluding vehicles increases. Additionally, insights and suggestions for the real world deployment of DRL based ATCS are provided. The research outcomes could help improve the reliability and robustness of the ATCS and better protect the smart mobility systems.


Cardinality Estimation in DBMS A Comprehensive Benchmark Evaluation. Cardinality estimation (CardEst) plays a significant role in generating high quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML based) have been proposed with outstanding estimation accuracy and inference latency. However, there exists no study that systematically evaluates the quality of these methods and answer the fundamental problem to what extent can these methods improve the performance of query optimizer in real world settings, which is the ultimate goal of a CardEst method. In this paper, we comprehensively and systematically compare the effectiveness of CardEst methods in a real DBMS. We establish a new benchmark for CardEst, which contains a new complex real world dataset STATS and a diverse query workload STATS CEB. We integrate multiple most representative CardEst methods into an open source database system PostgreSQL, and comprehensively evaluate their true effectiveness in improving query plan quality, and other important aspects affecting their applicability, ranging from inference latency, model size, and training time, to update efficiency and accuracy. We obtain a number of key findings for the CardEst methods, under different data and query settings. Furthermore, we find that the widely used estimation accuracy metric(Q Error) cannot distinguish the importance of different sub plan queries during query optimization and thus cannot truly reflect the query plan quality generated by CardEst methods. Therefore, we propose a new metric P Error to evaluate the performance of CardEst methods, which overcomes the limitation of Q Error and is able to reflect the overall end to end performance of CardEst methods. We have made all of the benchmark data and evaluation code publicly available at https github.com Nathaniel Han End to End CardEst Benchmark.


On 1 absorbing delta primary ideals. Let R be a commutative ring with nonzero identity. Let mathcal I (R) be the set of all ideals of R and let delta mathcal I (R) longrightarrow mathcal I (R) be a function. Then delta is called an expansion function of ideals of R if whenever L, I, J are ideals of R with J subseteq I , we have L subseteq delta( L) and delta(J) subseteq delta(I) . Let delta be an expansion function of ideals of R . In this paper, we introduce and investigate a new class of ideals that is closely related to the class of delta primary ideals. A proper ideal I of R is said to be a 1 absorbing delta primary ideal if whenever nonunit elements a,b,c in R and abc in I , then ab in I or c in delta(I). Moreover, we give some basic properties of this class of ideals and we study the 1 absorbing delta primary ideals of the localization of rings, the direct product of rings and the trivial ring extensions.


The Simultaneous Assignment Problem. This paper introduces the emph Simultaneous Assignment Problem . Here, we are given an assignment problem on some of the subgraphs of a given graph, and we are looking for a heaviest assignment which is feasible when restricted to any of the assignment problems. More precisely, we are given a graph with a weight and a capacity function on its edges and a set of its subgraphs H 1, dots,H k along with a degree upper bound function for each of them. In addition, we are also given a laminar system on the node set with an upper bound on the degree sum of the nodes in each set in the system. We want to assign each edge a non negative integer below its capacity such that the total weight is maximized, the degrees in each subgraph are below the degree upper bound associated with the subgraph, and the degree sum bound is respected in each set of the laminar system. The problem is shown to be APX hard in the unweighted case even if the graph is a forest and k 2 . This also implies that the Distance matching problem is APX hard in the weighted case and that the Cyclic distance matching problem is APX hard in the unweighted case. We identify multiple special cases when the problem can be solved in strongly polynomial time. One of these cases, the so called locally laminar case, is a common generalization of the Hierarchical b matching problem and the Laminar matchoid problem, and it implies that both of these problems can be solved efficiently in the weighted, capacitated case improving upon the most general polynomial time algorithms for these problems. The problem can be constant approximated when k is a constant, and we show that the approximation factor matches the integrality gap of a strengthened LP relaxation for small k . We give improved approximation algorithms for special cases, for example, when the degree bounds are uniform or the graph is sparse.


Maximizing Nash Social Welfare in 2 Value Instances. We consider the problem of maximizing the Nash social welfare when allocating a set mathcal G of indivisible goods to a set mathcal N of agents. We study instances, in which all agents have 2 value additive valuations The value of every agent i in mathcal N for every good j in mathcal G is v ij in p,q , for p,q in mathbb N , p le q . Maybe surprisingly, we design an algorithm to compute an optimal allocation in polynomial time if p divides q , i.e., when p 1 and q in mathbb N after appropriate scaling. The problem is classNP hard whenever p and q are coprime and p ge 3 . In terms of approximation, we present positive and negative results for general p and q . We show that our algorithm obtains an approximation ratio of at most 1.0345. Moreover, we prove that the problem is classAPX hard, with a lower bound of 1.000015 achieved at p q 4 5 .


Conformal blocks and the cohomology of configuration spaces of curves. We realize any space of conformal blocks attached to a punctured curve inside the cohomology of a configuration space of that curve and compare the WZW connection with the Gauss Manin connection.


Non local boundary value problem for a mixed type equation involving the bi ordinal Hilfer fractional differential operators. In this paper, we consider a nonlocal boundary value problem for a mixed type equation involving the bi ordinal Hilfer fractional derivative in a rectangular domain. The main target of this work is to analyze the uniqueness and the existence of the solution of the considered problem by means of eigenfunctions. Moreover, we construct the solution of the ordinary fractional differential equation with the right sided bi ordinal Hilfer derivative by the method of reduction to the Volterra integral equation. Then, we present sufficient conditions for given data in order to show the existence of the solution.


Post discovery Analysis of Anomalous Subsets. Analyzing the behaviour of a population in response to disease and interventions is critical to unearth variability in healthcare as well as understand sub populations that require specialized attention, but also to assist in designing future interventions. Two aspects become very essential in such analysis namely i) Discovery of differentiating patterns exhibited by sub populations, and ii) Characterization of the identified subpopulations. For the discovery phase, an array of approaches in the anomalous pattern detection literature have been employed to reveal differentiating patterns, especially to identify anomalous subgroups. However, these techniques are limited to describing the anomalous subgroups and offer little in form of insightful characterization, thereby limiting interpretability and understanding of these data driven techniques in clinical practices. In this work, we propose an analysis of differentiated output (rather than discovery) and quantify anomalousness similarly to the counter factual setting. To this end we design an approach to perform post discovery analysis of anomalous subsets, in which we initially identify the most important features on the anomalousness of the subsets, then by perturbation, the approach seeks to identify the least number of changes necessary to lose anomalousness. Our approach is presented and the evaluation results on the 2019 MarketScan Commercial Claims and Medicare data, show that extra insights can be obtained by extrapolated examination of the identified subgroups.


Role of wave particle resonance in turbulent transport in toroidal plasmas. Wave particle interaction in toroidal plasmas is an essential transport mechanism in drift wave instability driven microturbulence. In tokamkas, different wave particle resonance conditions have been found important for the energy and particle transport of multiple species in various drift wave turbulences. To confirm the transport mechanism for electrons and ions in tokamak drift wave instabilities, the effect of wave particle resonance on turbulent transport is studied using global gyrokinetic particle simulations of the plasma core ion temperature gradient (ITG) and collisionless trapped electron mode (CTEM) turbulence. Simulation results show that in CTEM and ITG turbulence, electron transport is primarily regulated by wave particle linear resonance, and the ion transport is regulated by nonlinear wave particle decorrelation.


A graph complexity measure based on the spectral analysis of the Laplace operator. In this work we introduce a concept of complexity for undirected graphs in terms of the spectral analysis of the Laplacian operator defined by the incidence matrix of the graph. Precisely, we compute the norm of the vector of eigenvalues of both the graph and its complement and take their product. Doing so, we obtain a quantity that satisfies two basic properties that are the expected for a measure of complexity. First,complexity of fully connected and fully disconnected graphs vanish. Second, complexity of complementary graphs coincide. This notion of complexity allows us to distinguish different kinds of graphs by placing them in a "croissant shaped" region of the plane link density complexity, highlighting some features like connectivity,concentration, uniformity or regularity and existence of clique like clusters. Indeed, considering graphs with a fixed number of nodes, by plotting the link density versus the complexity we find that graphs generated by different methods take place at different regions of the plane. We consider some generated graphs, in particular the Erd "os R 'enyi, the Watts Strogatz and the Barab 'asi Albert models. Also, we place some particular, let us say deterministic, to wit, lattices, stars, hyper concentrated and cliques containing graphs. It is worthy noticing that these deterministic classical models of graphs depict the boundary of the croissant shaped region. Finally, as an application to graphs generated by real measurements, we consider the brain connectivity graphs from two epileptic patients obtained from magnetoencephalography (MEG) recording, both in a baseline period and in ictal periods .In this case, our definition of complexity could be used as a tool for discerning between states, by the analysis of differences at distinct frequencies of the MEG recording.


Keeping data at the edge of smart irrigation networks A case study in strawberry greenhouses. Strawberries are widely appreciated for their aroma, bright red color, juicy texture, and sweetness. They are, however, among the most sensitive fruits when it comes to the quality of the end product. The recent commercial trends show a rising number of farmers who directly sell their products and are interested in using smart solutions for a continuous quality control of the product. Cloud based approaches for smart irrigation have been widely used in the recent years. However, the network traffic, security and regulatory challenges, which come hand in hand with sharing the crop data with third parties outside the edge of the network, lead strawberry farmers and data owners to rely on global clouds and potentially lose control over their data, which are usually transferred to third party data centers. In this paper, we follow a three step methodological approach in order to design, implement and validate a solution for smart strawberry irrigation in greenhouses, while keeping the corresponding data at the edge of the network (i) We develop a small scale smart irrigation prototype solution with off the shelf hardware and software equipment, which we test and evaluate on different kinds of plants in order to gain useful insights for larger scale deployments, (ii) we introduce a reference network architecture, specifically targeting smart irrigation and edge data distribution for strawberry greenhouses, and (iii) adopting the proposed reference architecture, we implement a full scale system in an actual strawberry greenhouse environment in Greece, and we compare its performance against that of conventional strawberries irrigation. We show that our design significantly outperforms the conventional approach, both in terms of soil moisture variation and in terms of water consumption, and conclude by critically appraising the costs and benefits of our approach in the agricultural industry.


Bambara Language Dataset for Sentiment Analysis. For easier communication, posting, or commenting on each others posts, people use their dialects. In Africa, various languages and dialects exist. However, they are still underrepresented and not fully exploited for analytical studies and research purposes. In order to perform approaches like Machine Learning and Deep Learning, datasets are required. One of the African languages is Bambara, used by citizens in different countries. However, no previous work on datasets for this language was performed for Sentiment Analysis. In this paper, we present the first common crawl based Bambara dialectal dataset dedicated for Sentiment Analysis, available freely for Natural Language Processing research purposes.


Data Science for Engineers A Teaching Ecosystem. We describe an ecosystem for teaching data science (DS) to engineers which blends theory, methods, and applications, developed at the Faculty of Physical and Mathematical Sciences, Universidad de Chile, over the last three years. This initiative has been motivated by the increasing demand for DS qualifications both from academic and professional environments. The ecosystem is distributed in a collaborative fashion across three departments in the above Faculty and includes postgraduate programmes, courses, professional diplomas, data repositories, laboratories, trainee programmes, and internships. By sharing our teaching principles and the innovative components of our approach to teaching DS, we hope our experience can be useful to those developing their own DS programmes and ecosystems. The open challenges and future plans for our ecosystem are also discussed at the end of the article.


Lyapunov Net A Deep Neural Network Architecture for Lyapunov Function Approximation. We develop a versatile deep neural network architecture, called Lyapunov Net, to approximate Lyapunov functions of dynamical systems in high dimensions. Lyapunov Net guarantees positive definiteness, and thus it can be easily trained to satisfy the negative orbital derivative condition, which only renders a single term in the empirical risk function in practice. This significantly reduces the number of hyper parameters compared to existing methods. We also provide theoretical justifications on the approximation power of Lyapunov Net and its complexity bounds. We demonstrate the efficiency of the proposed method on nonlinear dynamical systems involving up to 30 dimensional state spaces, and show that the proposed approach significantly outperforms the state of the art methods.


Performance and Energy Aware Bi objective Tasks Scheduling for Cloud Data Centers. Cloud computing enables remote execution of users tasks. The pervasive adoption of cloud computing in smart cities services and applications requires timely execution of tasks adhering to Quality of Services (QoS). However, the increasing use of computing servers exacerbates the issues of high energy consumption, operating costs, and environmental pollution. Maximizing the performance and minimizing the energy in a cloud data center is challenging. In this paper, we propose a performance and energy optimization bi objective algorithm to tradeoff the contradicting performance and energy objectives. An evolutionary algorithm based multi objective optimization is for the first time proposed using system performance counters. The performance of the proposed model is evaluated using a realistic cloud dataset in a cloud computing environment. Our experimental results achieve higher performance and lower energy consumption compared to a state of the art algorithm.


TS Reconfiguration of Dominating Sets in circle and circular arc graphs. We study the dominating set reconfiguration problem with the token sliding rule. It consists, given a graph G (V,E) and two dominating sets D s and D t of G, in determining if there exists a sequence S D 1 D s,...,D l D t of dominating sets of G such that for any two consecutive dominating sets D r and D r 1 with r t, D r 1 (D r u) U v, where uv is an edge of G. In a recent paper, Bonamy et al studied this problem and raised the following questions what is the complexity of this problem on circular arc graphs? On circle graphs? In this paper, we answer both questions by proving that the problem is polynomial on circular arc graphs and PSPACE complete on circle graphs.


Dimming Down LED An Open source Threshold Implementation on Light Encryption Device (LED) Block Cipher. Lightweight block ciphers have been widely used in applications such as RFID tags, IoTs, and network sensors. Among them, with comparable parameters, the Light Encryption Device (LED) block cipher achieves the smallest area. However, implementation of encryption algorithms manifest side channel leakage, therefore, it is crucial to protect their design against side channel analyses. In this paper, we present a threshold implementation of the LED cipher which has 64 bit data input and 128 bit key. The presented design splits secret information among multiple shares to achieve a higher security level. We demonstrate that our implementation can protect against first order power side channel attacks. As a cost, the design area is almost doubled and the maximum operating frequency is degraded by 30 . To make our design verifiable, we have also open sourced our design online.


Binary interaction methods for high dimensional global optimization and machine learning. In this work we introduce a new class of gradient free global optimization methods based on a binary interaction dynamics governed by a Boltzmann type equation. In each interaction the particles act taking into account both the best microscopic binary position and the best macroscopic collective position. In the mean field limit we show that the resulting Fokker Planck partial differential equations generalize the current class of consensus based optimization (CBO) methods. For the latter methods, convergence to the global minimizer can be shown for a large class of functions. Algorithmic implementations inspired by the well known direct simulation Monte Carlo methods in kinetic theory are derived and discussed. Several examples on prototype test functions for global optimization are reported including applications to machine learning.


An efficient nonlinear solver and convergence analysis for a viscoplastic flow model. This paper studies a finite element discretization of the regularized Bingham equations that describe viscoplastic flow. Convergence analysis is provided, as we prove optimal convergence with respect to the spatial mesh width but depending inversely on the regularization parameter varepsilon , and also suboptimal (by one order) convergence that is independent of the regularization parameter. An efficient nonlinear solver for the discrete model is then proposed and analyzed. The solver is based on Anderson acceleration (AA) applied to a Picard iteration, and we prove accelerated convergence of the method by applying AA theory (recently developed by authors) to the iteration, after showing sufficient smoothness properties of the associated fixed point operator. Numerical tests of spatial convergence are provided, as are results of the model for 2D and 3D driven cavity simulations. For each numerical test, the proposed nonlinear solver is also tested and shown to be very effective and robust with respect to the regularization parameter as it goes to zero.


QPPAL A two phase proximal augmented Lagrangian method for high dimensional convex quadratic programming problems. In this paper, we aim to solve high dimensional convex quadratic programming (QP) problems with a large number of quadratic terms, linear equality and inequality constraints. In order to solve the targeted bf QP problems to a desired accuracy efficiently, we develop a two phase bf P roximal bf A ugmented bf L agrangian method (QPPAL) , with Phase I to generate a reasonably good initial point to warm start Phase II to obtain an accurate solution efficiently. More specifically, in Phase I, based on the recently developed symmetric Gauss Seidel (sGS) decomposition technique, we design a novel sGS based semi proximal augmented Lagrangian method for the purpose of finding a solution of low to medium accuracy. Then, in Phase II, a proximal augmented Lagrangian algorithm is proposed to obtain a more accurate solution efficiently. Extensive numerical results evaluating the performance of QPPAL against existing state of the art solvers Gurobi, OSQP and QPALM are presented to demonstrate the high efficiency and robustness of our proposed algorithm for solving various classes of large scale convex QP problems. The MATLAB implementation of the software package QPPAL is available at url https blog.nus.edu.sg mattohkc softwares qppal .


Self Tuning for Data Efficient Deep Learning. Deep learning has made revolutionary advances to diverse applications in the presence of large scale labeled datasets. However, it is prohibitively time costly and labor expensive to collect sufficient labeled data in most realistic scenarios. To mitigate the requirement for labeled data, semi supervised learning (SSL) focuses on simultaneously exploring both labeled and unlabeled data, while transfer learning (TL) popularizes a favorable practice of fine tuning a pre trained model to the target data. A dilemma is thus encountered Without a decent pre trained model to provide an implicit regularization, SSL through self training from scratch will be easily misled by inaccurate pseudo labels, especially in large sized label space Without exploring the intrinsic structure of unlabeled data, TL through fine tuning from limited labeled data is at risk of under transfer caused by model shift. To escape from this dilemma, we present Self Tuning to enable data efficient deep learning by unifying the exploration of labeled and unlabeled data and the transfer of a pre trained model, as well as a Pseudo Group Contrast (PGC) mechanism to mitigate the reliance on pseudo labels and boost the tolerance to false labels. Self Tuning outperforms its SSL and TL counterparts on five tasks by sharp margins, e.g. it doubles the accuracy of fine tuning on Cars with 15 labels.


Reinforcement Learning of Implicit and Explicit Control Flow in Instructions. Learning to flexibly follow task instructions in dynamic environments poses interesting challenges for reinforcement learning agents. We focus here on the problem of learning control flow that deviates from a strict step by step execution of instructions that is, control flow that may skip forward over parts of the instructions or return backward to previously completed or skipped steps. Demand for such flexible control arises in two fundamental ways explicitly when control is specified in the instructions themselves (such as conditional branching and looping) and implicitly when stochastic environment dynamics require re completion of instructions whose effects have been perturbed, or opportunistic skipping of instructions whose effects are already present. We formulate an attention based architecture that meets these challenges by learning, from task reward only, to flexibly attend to and condition behavior on an internal encoding of the instructions. We test the architecture's ability to learn both explicit and implicit control in two illustrative domains one inspired by Minecraft and the other by StarCraft and show that the architecture exhibits zero shot generalization to novel instructions of length greater than those in a training set, at a performance level unmatched by two baseline recurrent architectures and one ablation architecture.


Reinforcement Learning for Robot Navigation with Adaptive ExecutionDuration (AED) in a Semi Markov Model. Deep reinforcement learning (DRL) algorithms have proven effective in robot navigation, especially in unknown environments, through directly mapping perception inputs into robot control commands. Most existing methods adopt uniform execution duration with robots taking commands at fixed intervals. As such, the length of execution duration becomes a crucial parameter to the navigation algorithm. In particular, if the duration is too short, then the navigation policy would be executed at a high frequency, with increased training difficulty and high computational cost. Meanwhile, if the duration is too long, then the policy becomes unable to handle complex situations, like those with crowded obstacles. It is thus tricky to find the "sweet" duration range some duration values may render a DRL model to fail to find a navigation path. In this paper, we propose to employ adaptive execution duration to overcome this problem. Specifically, we formulate the navigation task as a Semi Markov Decision Process (SMDP) problem to handle adaptive execution duration. We also improve the distributed proximal policy optimization (DPPO) algorithm and provide its theoretical guarantee for the specified SMDP problem. We evaluate our approach both in the simulator and on an actual robot. The results show that our approach outperforms the other DRL based method (with fixed execution duration) by 10.3 in terms of the navigation success rate.


Global Existence of Strong and Weak Solutions to 2D Compressible Navier Stokes System in Bounded Domains with Large Data and Vacuum. We study the barotropic compressible Navier Stokes system where the shear viscosity is a positive constant and the bulk one proportional to a power of the density with the power bigger than one and a third. The system is subject to the Navier slip boundary conditions in a general two dimensional bounded simply connected domain. For initial density allowed to vanish, we establish the global existence of strong and weak solutions without any restrictions on the size of initial value. To get over the difficulties brought by boundary, on the one hand, we apply Riemann mapping theorem and the pull back Green's function method to get a pointwise representation of the effective viscous flux. On the other hand, observing that the orthogonality is preserved under conformal mapping due to its preservation on the angle, we use the slip boundary conditions to reduce the integral representation to the desired commutator form whose singularities can be cancelled out by using the estimates on the spatial gradient of the velocity.


Graph based Thermal Inertial SLAM with Probabilistic Neural Networks. Simultaneous Localization and Mapping (SLAM) system typically employ vision based sensors to observe the surrounding environment. However, the performance of such systems highly depends on the ambient illumination conditions. In scenarios with adverse visibility or in the presence of airborne particulates (e.g. smoke, dust, etc.), alternative modalities such as those based on thermal imaging and inertial sensors are more promising. In this paper, we propose the first complete thermal inertial SLAM system which combines neural abstraction in the SLAM front end with robust pose graph optimization in the SLAM back end. We model the sensor abstraction in the front end by employing probabilistic deep learning parameterized by Mixture Density Networks (MDN). Our key strategies to successfully model this encoding from thermal imagery are the usage of normalized 14 bit radiometric data, the incorporation of hallucinated visual (RGB) features, and the inclusion of feature selection to estimate the MDN parameters. To enable a full SLAM system, we also design an efficient global image descriptor which is able to detect loop closures from thermal embedding vectors. We performed extensive experiments and analysis using three datasets, namely self collected ground robot and handheld data taken in indoor environment, and one public dataset (SubT tunnel) collected in underground tunnel. Finally, we demonstrate that an accurate thermal inertial SLAM system can be realized in conditions of both benign and adverse visibility.


Dynamic Multi scale Convolution for Dialect Identification. Time Delay Neural Networks (TDNN) based methods are widely used in dialect identification. However, in previous work with TDNN application, subtle variant is being neglected in different feature scales. To address this issue, we propose a new architecture, named dynamic multi scale convolution, which consists of dynamic kernel convolution, local multi scale learning, and global multi scale pooling. Dynamic kernel convolution captures features between short term and long term context adaptively. Local multi scale learning, which represents multi scale features at a granular level, is able to increase the range of receptive fields for convolution operation. Besides, global multi scale pooling is applied to aggregate features from different bottleneck layers in order to collect information from multiple aspects. The proposed architecture significantly outperforms state of the art system on the AP20 OLR dialect task of oriental language recognition (OLR) challenge 2020, with the best average cost performance (Cavg) of 0.067 and the best equal error rate (EER) of 6.52 . Compared with the known best results, our method achieves 9 of Cavg and 45 of EER relative improvement, respectively. Furthermore, the parameters of proposed model are 91 fewer than the best known model.


Boundary Layer Expansions for the Stationary Navier Stokes Equations. This is the first part of a two paper sequence in which we prove the global in x stability of the classical Prandtl boundary layer for the 2D, stationary Navier Stokes equations. In this part, we provide a construction of an approximate Navier Stokes solution, obtained by a classical Euler Prandtl asymptotic expansion. We develop here sharp decay estimates on these quantities. Of independent interest, we establish textit without using the classical von Mise change of coordinates, proofs of global in x regularity of the Prandtl system. The results of this paper are used in the second part of this sequence, IM20 (arXiv 2008.12347), to prove the asymptotic stability of the boundary layer as eps rightarrow 0 and x rightarrow infty .


Signaling Design for Cooperative Resource Allocation and its Impact to Reliability. Decentralized cooperative resource allocation schemes for robotic swarms are essential to enable high reliability in high throughput data exchanges. These cooperative schemes require control signaling with the aim to avoid half duplex problems at the receiver and mitigate interference. We propose two cooperative resource allocation schemes, device sequential and group scheduling, and introduce a control signaling design. We observe that failure in the reception of these control signals leads to non cooperative behavior and to significant performance degradation. The cause of these failures are identified and specific countermeasures are proposed and evaluated. We compare the proposed resource allocation schemes against the NR sidelink mode 2 resource allocation and show that even though signaling has an important impact on the resource allocation performance, our proposed device sequential and group scheduling resource allocation schemes improve reliability by an order of magnitude compared to sidelink mode 2.


Bilinear optimal stabilization of a non homogeneous Fokker Planck equation. In this work, we study the bilinear optimal stabilization of a non homogeneous Fokker Planck equation. We first study the problem of optimal control in a finite time interval and then focus on the case of the infinite time horizon. We further show that the obtained optimal control guarantees the strong stability of the system at hand. An illustrating numerical example is given.


Morphology of small snarks. The aim of this paper is to classify all snarks up to order 36 and explain the reasons of their uncolourability. The crucial part of our approach is a computer assisted structural analysis of cyclically 5 connected critical snarks, which is justified by the fact that every other snark can be constructed from them by a series of simple operations while preserving uncolourability. Our results reveal that most of the analysed snarks are built up from pieces of the Petersen graph and can be naturally distributed into a small number of classes having the same reason for uncolourability. This sheds new light on the structure of all small snarks. Based on our analysis, we generalise certain individual snarks to infinite families and identify a rich family of cyclically 5 connected critical snarks.


Episodic Learning for Safe Bipedal Locomotion with Control Barrier Functions and Projection to State Safety. This paper combines episodic learning and control barrier functions in the setting of bipedal locomotion. The safety guarantees that control barrier functions provide are only valid with perfect model knowledge however, this assumption cannot be met on hardware platforms. To address this, we utilize the notion of projection to state safety paired with a machine learning framework in an attempt to learn the model uncertainty as it affects the barrier functions. The proposed approach is demonstrated both in simulation and on hardware for the AMBER 3M bipedal robot in the context of the stepping stone problem, which requires precise foot placement while walking dynamically.


Neural network guided adjoint computations in dual weighted residual error estimation. In this work, we are concerned with neural network guided goal oriented a posteriori error estimation and adaptivity using the dual weighted residual method. The primal problem is solved using classical Galerkin finite elements. The adjoint problem is solved in strong form with a feedforward neural network using two or three hidden layers. The main objective of our approach is to explore alternatives for solving the adjoint problem with greater potential of a numerical cost reduction. The proposed algorithm is based on the general goal oriented error estimation theorem including both linear and nonlinear stationary partial differential equations and goal functionals. Our developments are substantiated with some numerical experiments that include comparisons of neural network computed adjoints and classical finite element solutions of the adjoints. In the programming software, the open source library deal.II is successfully coupled with LibTorch, the PyTorch C application programming interface.


Learning from Pixel Level Label Noise A New Perspective for Semi Supervised Semantic Segmentation. This paper addresses semi supervised semantic segmentation by exploiting a small set of images with pixel level annotations (strong supervisions) and a large set of images with only image level annotations (weak supervisions). Most existing approaches aim to generate accurate pixel level labels from weak supervisions. However, we observe that those generated labels still inevitably contain noisy labels. Motivated by this observation, we present a novel perspective and formulate this task as a problem of learning with pixel level label noise. Existing noisy label methods, nevertheless, mainly aim at image level tasks, which can not capture the relationship between neighboring labels in one image. Therefore, we propose a graph based label noise detection and correction framework to deal with pixel level noisy labels. In particular, for the generated pixel level noisy labels from weak supervisions by Class Activation Map (CAM), we train a clean segmentation model with strong supervisions to detect the clean labels from these noisy labels according to the cross entropy loss. Then, we adopt a superpixel based graph to represent the relations of spatial adjacency and semantic similarity between pixels in one image. Finally we correct the noisy labels using a Graph Attention Network (GAT) supervised by detected clean labels. We comprehensively conduct experiments on PASCAL VOC 2012, PASCAL Context and MS COCO datasets. The experimental results show that our proposed semi supervised method achieves the state of the art performances and even outperforms the fully supervised models on PASCAL VOC 2012 and MS COCO datasets in some cases.


Stochastic Polyak Stepsize with a Moving Target. We propose a new stochastic gradient method called MOTAPS (Moving Targetted Polyak Stepsize) that uses recorded past loss values to compute adaptive stepsizes. MOTAPS can be seen as a variant of the Stochastic Polyak (SP) which is also a method that also uses loss values to adjust the stepsize. The downside to the SP method is that it only converges when the interpolation condition holds. MOTAPS is an extension of SP that does not rely on the interpolation condition. The MOTAPS method uses n auxiliary variables, one for each data point, that track the loss value for each data point. We provide a global convergence theory for SP, an intermediary method TAPS, and MOTAPS by showing that they all can be interpreted as a special variant of online SGD. We also perform several numerical experiments on convex learning problems, and deep learning models for image classification and language translation. In all of our tasks we show that MOTAPS is competitive with the relevant baseline method.


Equivalence of Fell bundles is an equivalence relation. We introduce the notion of groupoid pre equivalences and prove that they give rise to groupoid equivalences by taking certain quotients. Then, given an equivalence of Fell bundles mathscr B and mathscr C and another equivalence between mathscr C and mathscr D , we construct an equivalence between mathscr B and mathscr D out of the tensor product bundle. As a consequence, we obtain that Fell bundle equivalence is indeed an equivalence relation.


Learning from Imperfect Demonstrations from Agents with Varying Dynamics. Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real world applications, this assumption is limiting. Most collected demonstrations are not optimal or are produced by an agent with slightly different dynamics. We therefore address the problem of imitation learning when the demonstrations can be sub optimal or be drawn from agents with varying dynamics. We develop a metric composed of a feasibility score and an optimality score to measure how useful a demonstration is for imitation learning. The proposed score enables learning from more informative demonstrations, and disregarding the less relevant demonstrations. Our experiments on four environments in simulation and on a real robot show improved learned policies with higher expected return.


O(n) invariant Riemannian metrics on SPD matrices. Symmetric Positive Definite (SPD) matrices are ubiquitous in data analysis under the form of covariance matrices or correlation matrices. Several O(n) invariant Riemannian metrics were defined on the SPD cone, in particular the kernel metrics introduced by Hiai and Petz. The class of kernel metrics interpolates between many classical O(n) invariant metrics and it satisfies key results of stability and completeness. However, it does not contain all the classical O(n) invariant metrics. Therefore in this work, we investigate super classes of kernel metrics and we study which key results remain true. We also introduce an additional key result called cometric stability, a crucial property to implement geodesics with a Hamiltonian formulation. Our method to build intermediate embedded classes between O(n) invariant metrics and kernel metrics is to give a characterization of the whole class of O(n) invariant metrics on SPD matrices and to specify requirements on metrics one by one until we reach kernel metrics. As a secondary contribution, we synthesize the literature on the main O(n) invariant metrics, we provide the complete formula of the sectional curvature of the affine invariant metric and the formula of the geodesic parallel transport between commuting matrices for the Bures Wasserstein metric.


Semiclassical states for a magnetic nonlinear Schr " o dinger equation with exponential critical growth in mathbb R 2 . This paper is devoted to the magnetic nonlinear Schr " o dinger equation Big( frac varepsilon i nabla A(x) Big) 2 u V(x)u f( u 2 )u text in mathbb R 2 , where varepsilon 0 is a parameter, V mathbb R 2 rightarrow mathbb R and A mathbb R 2 rightarrow mathbb R 2 are continuous functions and f mathbb R rightarrow mathbb R is a C 1 function having exponential critical growth. Under a global assumption on the potential V , we use variational methods and Ljusternick Schnirelmann theory to prove existence, multiplicity, concentration, and decay of nontrivial solutions for varepsilon 0 small.


Exploring Water Governing System Fit Through a Statistical Mechanics Approach. Water governing systems are twisted with complex interplays among levels and scales which embody their structures. Typically, the mismatch between human generated and natural systems produces externalities and inefficiencies reflectable in spatial scales. The largely known problem of fit in water governance is investigated to detect the issues of fit between administrative institutional scales and the hydrological one in a lake basin. To implement the idea, constraining the level of analysis interlinked to the concentrated levels of administration in spatial scales, the fit of the governing system was analyzed by means of statistical mechanics. Modeling the structure of water demand supply governing system in a given region through the Curie Weiss Mean Field approximation, the system cost in relation to its structure and fit was appraised and compared with two other conceptual structures in the Urmia Lake Basin in Iran. The methodology articulated an analysis framework for exploring the effectiveness of the formulated water demand supply governing system and its fit to the relevant hydrological system. The findings of this study may help developing strategies to encourage adaptations, rescaling reforms for effective watershed management.


On multivariate quasi infinitely divisible distributions. A quasi infinitely divisible distribution on mathbb R d is a probability distribution mu on mathbb R d whose characteristic function can be written as the quotient of the characteristic functions of two infinitely divisible distributions on mathbb R d . Equivalently, it can be characterised as a probability distribution whose characteristic function has a L 'evy Khintchine type representation with a "signed L 'evy measure", a so called quasi L 'evy measure, rather than a L 'evy measure. A systematic study of such distributions in the univariate case has been carried out in Lindner, Pan and Sato cite lindner . The goal of the present paper is to collect some known results on multivariate quasi infinitely divisible distributions and to extend some of the univariate results to the multivariate setting. In particular, conditions for weak convergence, moment and support properties are considered. A special emphasis is put on examples of such distributions and in particular on mathbb Z d valued quasi infinitely divisible distributions.


Weak limits of consecutive projections and of greedy steps. Let H be a Hilbert space. We investigate the properties of weak limit points of iterates of random projections onto K geq 2 closed convex sets in H and the parallel properties of weak limit points of residuals of random greedy approximation with respect to K dictionaries. In the case of convex sets these properties imply weak convergence in all the cases known so far. In particular, we give a short proof of the theorem of Amemiya and Ando on weak convergence when the convex sets are subspaces. The question of the weak convergence in general remains open.


Influencing Reinforcement Learning through Natural Language Guidance. Interactive reinforcement learning agents use human feedback or instruction to help them learn in complex environments. Often, this feedback comes in the form of a discrete signal that is either positive or negative. While informative, this information can be difficult to generalize on its own. In this work, we explore how natural language advice can be used to provide a richer feedback signal to a reinforcement learning agent by extending policy shaping, a well known Interactive reinforcement learning technique. Usually policy shaping employs a human feedback policy to help an agent to learn more about how to achieve its goal. In our case, we replace this human feedback policy with policy generated based on natural language advice. We aim to inspect if the generated natural language reasoning provides support to a deep reinforcement learning agent to decide its actions successfully in any given environment. So, we design our model with three networks first one is the experience driven, next is the advice generator and third one is the advice driven. While the experience driven reinforcement learning agent chooses its actions being influenced by the environmental reward, the advice driven neural network with generated feedback by the advice generator for any new state selects its actions to assist the reinforcement learning agent to better policy shaping.


TENET Temporal CNN with Attention for Anomaly Detection in Automotive Cyber Physical Systems. Modern vehicles have multiple electronic control units (ECUs) that are connected together as part of a complex distributed cyber physical system (CPS). The ever increasing communication between ECUs and external electronic systems has made these vehicles particularly susceptible to a variety of cyber attacks. In this work, we present a novel anomaly detection framework called TENET to detect anomalies induced by cyber attacks on vehicles. TENET uses temporal convolutional neural networks with an integrated attention mechanism to detect anomalous attack patterns. TENET is able to achieve an improvement of 32.70 in False Negative Rate, 19.14 in the Mathews Correlation Coefficient, and 17.25 in the ROC AUC metric, with 94.62 fewer model parameters, 86.95 decrease in memory footprint, and 48.14 lower inference time when compared to the best performing prior work on automotive anomaly detection.


On the 16 rank of class groups of mathbb Q ( sqrt 3p ) for primes p congruent to 1 modulo 4 . For fixed q in 3,7,11,19, 43,67,163 , we consider the density of primes p congruent to 1 modulo 4 such that the class group of the number field mathbb Q ( sqrt qp ) has order divisible by 16 . We show that this density is equal to 1 8 , in line with a more general conjecture of Gerth. Vinogradov's method is the key analytic tool for our work.


Improving Model Robustness by Adaptively Correcting Perturbation Levels with Active Queries. In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise perturbations. Most existing studies assume a fixed perturbation level for all training examples, which however hardly holds in real tasks. In fact, excessive perturbations may destroy the discriminative content of an example, while deficient perturbations may fail to provide helpful information for improving the robustness. Motivated by this observation, we propose to adaptively adjust the perturbation levels for each example in the training process. Specifically, a novel active learning framework is proposed to allow the model to interactively query the correct perturbation level from human experts. By designing a cost effective sampling strategy along with a new query type, the robustness can be significantly improved with a few queries. Both theoretical analysis and experimental studies validate the effectiveness of the proposed approach.


Membership Inference Attacks are Easier on Difficult Problems. Membership inference attacks (MIA) try to detect if data samples were used to train a neural network model, e.g. to detect copyright abuses. We show that models with higher dimensional input and output are more vulnerable to MIA, and address in more detail models for image translation and semantic segmentation, including medical image segmentation. We show that reconstruction errors can lead to very effective MIA attacks as they are indicative of memorization. Unfortunately, reconstruction error alone is less effective at discriminating between non predictable images used in training and easy to predict images that were never seen before. To overcome this, we propose using a novel predictability error that can be computed for each sample, and its computation does not require a training set. Our membership error, obtained by subtracting the predictability error from the reconstruction error, is shown to achieve high MIA accuracy on an extensive number of benchmarks.


Historic and physical wandering domains for wild blender horseshoes. We give a contribution to Takens' last problem Tak08 in the C 1 topology (note that solutions have been already given in the smooth category of more than or equal to C 2 , see KS17,BB ). To be specific, we present a one parameter family mathscr A of C 1 diffeomorphisms having wild blender horseshoes such that every C 1 neighbourhood of any element of mathscr A contains two types of diffeomorphisms, one of which has a historic contracting wandering domain, and the other has a non trivial Dirac physical measure associated with a contracting wandering domain. It is a non trivial extension of Colli Vargas' model CV01 to the higher dimensional dynamics with the use of wild blender horseshoes.


Bounds on complexity of matrix multiplication away from CW tensors. We present three families of minimal border rank tensors they come from highest weight vectors, smoothable algebras, or monomial algebras. We analyse them using Strassen's laser method and obtain an upper bound 2.431 on omega . We also explain how in certain monomial cases using the laser method directly is less profitable than first degenerating. Our results form possible paths in the search for valuable tensors for the laser method away from Coppersmith Winograd tensors.


KGBoost A Classification based Knowledge Base Completion Method with Negative Sampling. Knowledge base completion is formulated as a binary classification problem in this work, where an XGBoost binary classifier is trained for each relation using relevant links in knowledge graphs (KGs). The new method, named KGBoost, adopts a modularized design and attempts to find hard negative samples so as to train a powerful classifier for missing link prediction. We conduct experiments on multiple benchmark datasets, and demonstrate that KGBoost outperforms state of the art methods across most datasets. Furthermore, as compared with models trained by end to end optimization, KGBoost works well under the low dimensional setting so as to allow a smaller model size.


Physics informed Dyna Style Model Based Deep Reinforcement Learning for Dynamic Control. Model based reinforcement learning (MBRL) is believed to have much higher sample efficiency compared to model free algorithms by learning a predictive model of the environment. However, the performance of MBRL highly relies on the quality of the learned model, which is usually built in a black box manner and may have poor predictive accuracy outside of the data distribution. The deficiencies of the learned model may prevent the policy from being fully optimized. Although some uncertainty analysis based remedies have been proposed to alleviate this issue, model bias still poses a great challenge for MBRL. In this work, we propose to leverage the prior knowledge of underlying physics of the environment, where the governing laws are (partially) known. In particular, we developed a physics informed MBRL framework, where governing equations and physical constraints are utilized to inform the model learning and policy search. By incorporating the prior information of the environment, the quality of the learned model can be notably improved, while the required interactions with the environment are significantly reduced, leading to better sample efficiency and learning performance. The effectiveness and merit have been demonstrated over a handful of classic control problems, where the environments are governed by canonical ordinary partial differential equations.


Practical sufficient conditions for convergence of distributed optimisation algorithms over communication networks with interference. Information exchange over networks can be affected by various forms of delay. This causes challenges for using the network by a multi agent system to solve a distributed optimisation problem. Distributed optimisation schemes, however, typically do not assume network models that are representative for real world communication networks, since communication links are most of the time abstracted as lossless. Our objective is therefore to formulate a representative network model and provide practically verifiable network conditions that ensure convergence of distributed algorithms in the presence of interference and possibly unbounded delay. Our network is modelled by a sequence of directed graphs, where to each network link we associate a process for the instantaneous signal to interference plus noise ratio. We then formulate practical conditions that can be verified locally and show that the age of information (AoI) associated with data communicated over the network is in mathcal O ( sqrt n ) . Under these conditions we show that a penalty based gradient descent algorithm can be used to solve a rich class of stochastic, constrained, distributed optimisation problems. The strength of our result lies in the bridge between practical verifiable network conditions and an abstract optimisation theory. We illustrate numerically that our algorithm converges in an extreme scenario where the average AoI diverges.


From polytopes to operads and back. For a directed polytope, we construct a colored operad whose Poincare Hilbert series encodes certain operations on the cellular complex of the polytope. We conjecture that for a class of short polytopes the constructed operads are Koszul and self dual. We verify the conjecture for simplices, polygons, and products thereof.


Root Finding With Interval Arithmetic. We consider the solution of nonlinear equations in one real variable, the problem usually called by root finding. Although this is an old problem, we believe that some aspects of its solution using interval arithmetic are not well understood, and we present our views on this subject. We argue that problems with just one variable are much simpler than problems with more variables, and we should use specific methods for them. We provide an implementation of our ideas in C , and make this code available under the Mozilla Public License 2.0.


Interpretable Multi Modal Hate Speech Detection. With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious manifestations, including social polarization and hate crimes. While prior works have proposed automated techniques to detect hate speech online, these techniques primarily fail to look beyond the textual content. Moreover, few attempts have been made to focus on the aspects of interpretability of such models given the social and legal implications of incorrect predictions. In this work, we propose a deep neural multi modal model that can (a) detect hate speech by effectively capturing the semantics of the text along with socio cultural context in which a particular hate expression is made, and (b) provide interpretable insights into decisions of our model. By performing a thorough evaluation of different modeling techniques, we demonstrate that our model is able to outperform the existing state of the art hate speech classification approaches. Finally, we show the importance of social and cultural context features towards unearthing clusters associated with different categories of hate.


Momentum Doesn't Change the Implicit Bias. The momentum acceleration technique is widely adopted in many optimization algorithms. However, the theoretical understanding of how the momentum affects the generalization performance of the optimization algorithms is still unknown. In this paper, we answer this question through analyzing the implicit bias of momentum based optimization. We prove that both SGD with momentum and Adam converge to the L 2 max margin solution for exponential tailed loss, which is the same as vanilla gradient descent. That means, these optimizers with momentum acceleration still converge to a model with low complexity, which provides guarantees on their generalization. Technically, to overcome the difficulty brought by the error accumulation in analyzing the momentum, we construct new Lyapunov functions as a tool to analyze the gap between the model parameter and the max margin solution.


Seeing Differently, Acting Similarly Imitation Learning with Heterogeneous Observations. In many real world imitation learning tasks, the demonstrator and the learner have to act under different but full observation spaces. This situation generates significant obstacles for existing imitation learning approaches to work. Previous related works need to assume the coexistence of two observation spaces in the demonstrations or that all along the learning process. While in reality, the expert usually provides the demonstration with their observations only, and the observation coexistence will be limited due to the high cost. So in this work, we model the observation mismatch in the imitation learning problem with the above two challenges as a two phase learning process, namely Heterogeneously Observable Imitation Learning (HOIL). We analyze the underlying learning issues with these challenges, i.e., the dynamics mismatch and the support mismatch, and further propose the Importance Weighting with REjection (IWRE) algorithm based on the techniques of importance weighting and learning with rejection for querying to solve these issues across the observation spaces. Experimental results show that IWRE can successfully solve the difficult HOIL tasks, including the challenging task of transforming the vision based demonstrations to random access memory (RAM) based policies under the Atari domain.


HAT Hierarchical Aggregation Transformers for Person Re identification. Recently, with the advance of deep Convolutional Neural Networks (CNNs), person Re Identification (Re ID) has witnessed great success in various applications. However, with limited receptive fields of CNNs, it is still challenging to extract discriminative representations in a global view for persons under non overlapped cameras. Meanwhile, Transformers demonstrate strong abilities of modeling long range dependencies for spatial and sequential data. In this work, we take advantages of both CNNs and Transformers, and propose a novel learning framework named Hierarchical Aggregation Transformer (HAT) for image based person Re ID with high performance. To achieve this goal, we first propose a Deeply Supervised Aggregation (DSA) to recurrently aggregate hierarchical features from CNN backbones. With multi granularity supervisions, the DSA can enhance multi scale features for person retrieval, which is very different from previous methods. Then, we introduce a Transformer based Feature Calibration (TFC) to integrate low level detail information as the global prior for high level semantic information. The proposed TFC is inserted to each level of hierarchical features, resulting in great performance improvements. To our best knowledge, this work is the first to take advantages of both CNNs and Transformers for image based person Re ID. Comprehensive experiments on four large scale Re ID benchmarks demonstrate that our method shows better results than several state of the art methods. The code is released at https github.com AI Zhpp HAT.


Notes on Explicit Constructions of Arithmetically Equivalent Global Function Fields via Torsion Points On Drinfeld Modules. In this short note we provide a few examples of non isomorphic arithmetically equivalent global function fields. These examples are obtained via well known technique of adjoining the torsion points of various Drinfeld Modules to realise the Gl n( mathbb F q) as a Galois group of extensions of global function fields. Furthermore we afford the code of the Magma scripts to verify the results and construct more examples in similar fashion.


Introducing a Central African Primate Vocalisation Dataset for Automated Species Classification. Automated classification of animal vocalisations is a potentially powerful wildlife monitoring tool. Training robust classifiers requires sizable annotated datasets, which are not easily recorded in the wild. To circumvent this problem, we recorded four primate species under semi natural conditions in a wildlife sanctuary in Cameroon with the objective to train a classifier capable of detecting species in the wild. Here, we introduce the collected dataset, describe our approach and initial results of classifier development. To increase the efficiency of the annotation process, we condensed the recordings with an energy change based automatic vocalisation detection. Segmenting the annotated chunks into training, validation and test sets, initial results reveal up to 82 unweighted average recall (UAR) test set performance in four class primate species classification.


Efficient Intrusion Detection Using Evidence Theory. Intrusion Detection Systems (IDS) are now an essential element when it comes to securing computers and networks. Despite the huge research efforts done in the field, handling sources' reliability remains an open issue. To address this problem, this paper proposes a novel contextual discounting method based on sources' reliability and their distinguishing ability between normal and abnormal behavior. Dempster Shafer theory, a general framework for reasoning under uncertainty, is used to construct an evidential classifier. The NSL KDD dataset, a significantly revised and improved version of the existing KDDCUP'99 dataset, provides the basis for assessing the performance of our new detection approach. While giving comparable results on the KDDTest dataset, our approach outperformed some other state of the art methods on the KDDTest 21 dataset which is more challenging.


Neural 3D Scene Compression via Model Compression. Rendering 3D scenes requires access to arbitrary viewpoints from the scene. Storage of such a 3D scene can be done in two ways (1) storing 2D images taken from the 3D scene that can reconstruct the scene back through interpolations, or (2) storing a representation of the 3D scene itself that already encodes views from all directions. So far, traditional 3D compression methods have focused on the first type of storage and compressed the original 2D images with image compression techniques. With this approach, the user first decodes the stored 2D images and then renders the 3D scene. However, this separated procedure is inefficient since a large amount of 2D images have to be stored. In this work, we take a different approach and compress a functional representation of 3D scenes. In particular, we introduce a method to compress 3D scenes by compressing the neural networks that represent the scenes as neural radiance fields. Our method provides more efficient storage of 3D scenes since it does not store 2D images which are redundant when we render the scene from the neural functional representation.


The f Divergence Reinforcement Learning Framework. The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision making. This paper present a novel DRL framework, termed emph f Divergence Reinforcement Learning (FRL) . In FRL, the policy evaluation and policy improvement phases are simultaneously performed by minimizing the f divergence between the learning policy and sampling policy, which is distinct from conventional DRL algorithms that aim to maximize the expected cumulative rewards. We theoretically prove that minimizing such f divergence can make the learning policy converge to the optimal policy. Besides, we convert the process of training agents in FRL framework to a saddle point optimization problem with a specific f function through Fenchel conjugate, which forms new methods for policy evaluation and policy improvement. Through mathematical proofs and empirical evaluation, we demonstrate that the FRL framework has two advantages (1) policy evaluation and policy improvement processes are performed simultaneously and (2) the issues of overestimating value function are naturally alleviated. To evaluate the effectiveness of the FRL framework, we conduct experiments on Atari 2600 video games and show that agents trained in the FRL framework match or surpass the baseline DRL algorithms.