Micro Analysis of Natural Forking in Blockchain Based on Large Deviation Theory. Natural forking in blockchain refers to a phenomenon that there are a set of blocks at one block height at the same time, implying that various nodes have different perspectives of the main chain. Natural forking might give rise to multiple adverse impacts on blockchain, jeopardizing the performance and security of the system consequently. However, the ongoing literature in analyzing natural forking is mainly from the macro point of view, which is not sufficient to incisively understand this phenomenon. In this paper, we fill this gap through leveraging the large deviation theory to conduct a microscopic study of natural forking, which resorts to investigating the instantaneous difference between block generation and dissemination in blockchain. Our work is derived comprehensively and complementarily via a three step process, where both the natural forking probability and its decay rate are presented. Through solid theoretical derivation and extensive numerical simulations, we find 1) the probability of the mismatch between block generation and dissemination exceeding a given threshold dwindles exponentially with the increase of natural forking robustness related parameter or the difference between the block dissemination rate and block creation rate 2) the natural forking robustness related parameter may emphasize a more dominant effect on accelerating the abortion of natural forking in some cases 3) when the self correlated block generation rate is depicted as the stationary autoregressive process with a scaling parameter, it is found that setting a lower scaling parameter may speed up the failure of natural forking. These findings are valuable since they offer a fresh theoretical basis to engineer optimal countermeasures for thwarting natural forking and thereby enlivening the blockchain network.


Enhancing the SVD Compression. Orthonormality is the foundation of matrix decomposition. For example, Singular Value Decomposition (SVD) implements the compression by factoring a matrix with orthonormal parts and is pervasively utilized in various fields. Orthonormality, however, inherently includes constraints that would induce redundant degrees of freedom, preventing SVD from deeper compression and even making it frustrated as the data fidelity is strictly required. In this paper, we theoretically prove that these redundancies resulted by orthonormality can be completely eliminated in a lossless manner. An enhanced version of SVD, namely E SVD, is accordingly established to losslessly and quickly release constraints and recover the orthonormal parts in SVD by avoiding multiple matrix multiplications. According to the theory, advantages of E SVD over SVD become increasingly evident with the rising requirement of data fidelity. In particular, E SVD will reduce 25 storage units as SVD reaches its limitation and fails to compress data. Empirical evidences from typical scenarios of remote sensing and Internet of things further justify our theory and consistently demonstrate the superiority of E SVD in compression. The presented theory sheds insightful lights on the constraint solution in orthonormal matrices and E SVD, guaranteed by which will profoundly enhance the SVD based compression in the context of explosive growth in both data acquisition and fidelity levels.


Finetuned Language Models Are Zero Shot Learners. This paper explores a simple method for improving the zero shot learning abilities of language models. We show that instruction tuning finetuning language models on a collection of tasks described via instructions substantially improves zero shot performance on unseen tasks. We take a 137B parameter pretrained language model and instruction tune it on over 60 NLP tasks verbalized via natural language instruction templates. We evaluate this instruction tuned model, which we call FLAN, on unseen task types. FLAN substantially improves the performance of its unmodified counterpart and surpasses zero shot 175B GPT 3 on 20 of 25 tasks that we evaluate. FLAN even outperforms few shot GPT 3 by a large margin on ANLI, RTE, BoolQ, AI2 ARC, OpenbookQA, and StoryCloze. Ablation studies reveal that number of finetuning datasets, model scale, and natural language instructions are key to the success of instruction tuning.


Remarks and problems about algorithmic descriptions of groups. We make the case that the so called "global decision problems" should not be investigated solely for groups described by finite presentations. We propose to use descriptions that be algorithms that perform some given tasks, and that encode the considered groups. We motivate this by establishing undecidability results for groups described by recursive presentations, strong enough to prevent an interesting theory of decision problems based on generic recursive presentations to be developed. More importantly, we give an algorithmic characterization of finitely presented groups, in terms of existence of a "marked quotient algorithm" which recognizes the quotients of the considered group. This new point of view leads us to proposing several open questions and directions of research, and much of this paper consists in exposing problems that arise from our first results. Finally, note that we set our study in the category of marked groups, we explain why this is beneficial, and give open questions that arise from the study of decision problems for marked groups.


Self Adaptive Swarm System (SASS). Distributed artificial intelligence (DAI) studies artificial intelligence entities working together to reason, plan, solve problems, organize behaviors and strategies, make collective decisions and learn. This Ph.D. research proposes a principled Multi Agent Systems (MAS) cooperation framework Self Adaptive Swarm System (SASS) to bridge the fourth level automation gap between perception, communication, planning, execution, decision making, and learning.


Sample and Threshold Differential Privacy Histograms and applications. Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong ( epsilon, delta) Differential Privacy (DP) guarantee can be achieved for the fundamental problem of histogram generation in a federated setting, via a highly practical sampling based procedure that does not add noise to disclosed data. Given the ubiquity of sampling in practice, we thus obtain a DP guarantee almost for free, avoid over estimating histogram counts, and allow easy reasoning about how privacy guarantees may obscure minorities and outliers. Using such histograms, related problems such as heavy hitters and quantiles can be answered with provable error and privacy guarantees. Experimental results show that our sample and threshold approach is accurate and scalable.


Sorting by shuffling methods and a queue. We consider sorting by a queue that can apply a permutation from a given set over its content. This gives us a sorting device mathbb Q Sigma corresponding to any shuffling method Sigma since every such method is associated with a set of permutations. Two variations of these devices are considered mathbb Q Sigma prime and mathbb Q Sigma text pop . These require the entire content of the device to be unloaded after a permutation is applied or unloaded by each pop operation, respectively. First, we show that sorting by a deque is equivalent to sorting by a queue that can reverse its content. Next, we focus on sorting by cuts. We prove that the set of permutations that one can sort by using mathbb Q text cuts prime is the set of the 321 avoiding separable permutations. We give lower and upper bounds to the maximum number of times the device must be used to sort a permutation. Furthermore, we give a formula for the number of n permutations, p n ( mathbb Q Sigma prime ) , that one can sort by using mathbb Q Sigma prime , for any shuffling method Sigma , such that the permutations associated with it are irreducible. Next, we prove a generalization of the fact that mathbb Q text cuts text pop can sort all permutations. We also show that p n ( mathbb Q Sigma text pop ) is given by the odd indexed Fibonacci numbers F 2n 1 , for any shuffling method Sigma having a specific back front property. The rest of the work is dedicated to a surprising conjecture inspired by Diaconis and Graham which states that one can sort the same number of permutations of any given size by using the devices mathbb Q text In sh text pop and mathbb Q text Monge text pop , corresponding to the popular In shuffle and Monge shuffling methods.


Impact of fluctuations in social contacts on the spread of epidemics. The mathematical model of the spread of the epidemic is developed, which considers fluctuations in the number of human social contacts. The model is based on the logistic equation. The oscillation in the number of social contacts within one week is considered as the main source of fluctuations. The time fluctuating variable of the number of contacts is represented as the sum of the first two terms of the Fourier series expansion of number of contacts. It is shown that the largest fluctuation amplitudes occur near the maximum rate of the epidemic spread. After that, the effect of fluctuations decreases until the end of the epidemic.


Learning Discriminative Shrinkage Deep Networks for Image Deconvolution. Non blind deconvolution is an ill posed problem. Most existing methods usually formulate this problem into a maximum a posteriori framework and address it by designing kinds of regularization terms and data terms of the latent clear images. In this paper, we propose an effective non blind deconvolution approach by learning discriminative shrinkage functions to implicitly model these terms. In contrast to most existing methods that use deep convolutional neural networks (CNNs) or radial basis functions to simply learn the regularization term, we formulate both the data term and regularization term and split the deconvolution model into data related and regularization related sub problems according to the alternating direction method of multipliers. We explore the properties of the Maxout function and develop a deep CNN model with a Maxout layer to learn discriminative shrinkage functions to directly approximate the solutions of these two sub problems. Moreover, given the fast Fourier transform based image restoration usually leads to ringing artifacts while conjugate gradient based image restoration is time consuming, we develop the conjugate gradient network to restore the latent clear images effectively and efficiently. Experimental results show that the proposed method performs favorably against the state of the art ones in terms of efficiency and accuracy.


Unsupervised Learning for Identifying High Eigenvector Centrality Nodes A Graph Neural Network Approach. The existing methods to calculate the Eigenvector Centrality(EC) tend to not be robust enough for determination of EC in low time complexity or not well scalable for large networks, hence rendering them practically unreliable computationally expensive. So, it is of the essence to develop a method that is scalable in low computational time. Hence, we propose a deep learning model for the identification of nodes with high Eigenvector Centrality. There have been a few previous works in identifying the high ranked nodes with supervised learning methods, but in real world cases, the graphs are not labelled and hence deployment of supervised learning methods becomes a hazard and its usage becomes impractical. So, we devise CUL(Centrality with Unsupervised Learning) method to learn the relative EC scores in a network in an unsupervised manner. To achieve this, we develop an Encoder Decoder based framework that maps the nodes to their respective estimated EC scores. Extensive experiments were conducted on different synthetic and real world networks. We compared CUL against a baseline supervised method for EC estimation similar to some of the past works. It was observed that even with training on a minuscule number of training datasets, CUL delivers a relatively better accuracy score when identifying the higher ranked nodes than its supervised counterpart. We also show that CUL is much faster and has a smaller runtime than the conventional baseline method for EC computation. The code is available at https github.com codexhammer CUL.


Learning a State Representation and Navigation in Cluttered and Dynamic Environments. In this work, we present a learning based pipeline to realise local navigation with a quadrupedal robot in cluttered environments with static and dynamic obstacles. Given high level navigation commands, the robot is able to safely locomote to a target location based on frames from a depth camera without any explicit mapping of the environment. First, the sequence of images and the current trajectory of the camera are fused to form a model of the world using state representation learning. The output of this lightweight module is then directly fed into a target reaching and obstacle avoiding policy trained with reinforcement learning. We show that decoupling the pipeline into these components results in a sample efficient policy learning stage that can be fully trained in simulation in just a dozen minutes. The key part is the state representation, which is trained to not only estimate the hidden state of the world in an unsupervised fashion, but also helps bridging the reality gap, enabling successful sim to real transfer. In our experiments with the quadrupedal robot ANYmal in simulation and in reality, we show that our system can handle noisy depth images, avoid dynamic obstacles unseen during training, and is endowed with local spatial awareness.


Groups definable in partial differential fields with an automorphism. In this paper we study groups definable in existentially closed partial differential fields of characteristic 0 with an automorphism which commutes with the derivations. In particular, we study Zariski dense definable subgroups of simple algebraic groups, and show an analogue of Phyllis Cassidy's result for partial differential fields. We also show that these groups have a smallest definable subgroup of finite index.


Every Tetrahedron has a 3 vertex Quasigeodesic. We prove that every tetrahedron T has a simple, closed quasigeodesic that passes through three vertices of T. Equivalently, every T has a face whose "exterior angles" are at most pi.


One point statistics for turbulent pipe flow up to Re tau approx 6000 . We study turbulent flows in a smooth straight pipe of circular cross section up to Re tau approx 6000 using direct numerical simulation (DNS) of the Navier Stokes equations. The DNS results highlight systematic deviations from Prandtl friction law, amounting to about 2 , which would extrapolate to about 4 at extreme Reynolds numbers. Data fitting of the DNS friction coefficient yields an estimated von K 'arm 'an constant k approx 0.387 , which nicely fits the mean velocity profile, and which supports universality of canonical wall bounded flows. The same constant also applies to the pipe centerline velocity, thus providing support for the claim that the asymptotic state of pipe flow at extreme Reynolds numbers should be plug flow. At the Reynolds numbers under scrutiny, no evidence for saturation of the logarithmic growth of the inner peak of the axial velocity variance is found. Although no outer peak of the velocity variance directly emerges in our DNS, we provide strong evidence that it should appear at Re tau gtrsim 10 4 , as a result of turbulence production exceeding dissipation over a large part of the outer wall layer, thus invalidating the classical equilibrium hypothesis.


Stroke recovery phenotyping through network trajectory approaches and graph neural networks. Stroke is a leading cause of neurological injury characterized by impairments in multiple neurological domains including cognition, language, sensory and motor functions. Clinical recovery in these domains is tracked using a wide range of measures that may be continuous, ordinal, interval or categorical in nature, which presents challenges for standard multivariate regression approaches. This has hindered stroke researchers' ability to achieve an integrated picture of the complex time evolving interactions amongst symptoms. Here we use tools from network science and machine learning that are particularly well suited to extracting underlying patterns in such data, and may assist in prediction of recovery patterns. To demonstrate the utility of this approach, we analyzed data from the NINDS tPA trial using the Trajectory Profile Clustering (TPC) method to identify distinct stroke recovery patterns for 11 different neurological domains at 5 discrete time points. Our analysis identified 3 distinct stroke trajectory profiles that align with clinically relevant stroke syndromes, characterized both by distinct clusters of symptoms, as well as differing degrees of symptom severity. We then validated our approach using graph neural networks to determine how well our model performed predictively for stratifying patients into these trajectory profiles at early vs. later time points post stroke. We demonstrate that trajectory profile clustering is an effective method for identifying clinically relevant recovery subtypes in multidimensional longitudinal datasets, and for early prediction of symptom progression subtypes in individual patients. This paper is the first work introducing network trajectory approaches for stroke recovery phenotyping, and is aimed at enhancing the translation of such novel computational approaches for practical clinical application.


Experiences with the Introduction of AI based Tools for Moderation Automation of Voice based Participatory Media Forums. Voice based discussion forums where users can record audio messages which are then published for other users to listen and comment, are often moderated to ensure that the published audios are of good quality, relevant, and adhere to editorial guidelines of the forum. There is room for the introduction of AI based tools in the moderation process, such as to identify and filter out blank or noisy audios, use speech recognition to transcribe the voice messages in text, and use natural language processing techniques to extract relevant metadata from the audio transcripts. We design such tools and deploy them within a social enterprise working in India that runs several voice based discussion forums. We present our findings in terms of the time and cost savings made through the introduction of these tools, and describe the feedback of the moderators towards the acceptability of AI based automation in their workflow. Our work forms a case study in the use of AI for automation of several routine tasks, and can be especially relevant for other researchers and practitioners involved with the use of voice based technologies in developing regions of the world.


Design of a 200 MHz Continuous Wave Radio Frequency Quadrupole Accelerator for Boron Neutron Capture Therapy. A high intensity continuous wave (CW) radio frequency quadrupole (RFQ) accelerator is designed for boron neutron capture therapy (BNCT). The transmission efficiency of a 20 mA proton beam accelerated from 30 keV to 2.5 MeV can reach 98.7 at an operating frequency of 200 MHz. The beam dynamics has good tolerance to errors. By comparing the high frequency parameters of quadrilateral and octagonal RFQ cross sections, the quadrilateral structure of the four vane cavity is selected owing to its multiple advantages, such as a smaller cross section at the same frequency and easy processing. In addition, tuners and undercuts are designed to tune the frequency of the cavity and achieve a flat electric field distribution along the cavity. In this paper, the beam dynamics simulation and electromagnetic design are presented in detail.


Backdoor Pre trained Models Can Transfer to All. Pre trained general purpose language models have been a dominating component in enabling real world natural language processing (NLP) applications. However, a pre trained model with backdoor can be a severe threat to the applications. Most existing backdoor attacks in NLP are conducted in the fine tuning phase by introducing malicious triggers in the targeted class, thus relying greatly on the prior knowledge of the fine tuning task. In this paper, we propose a new approach to map the inputs containing triggers directly to a predefined output representation of the pre trained NLP models, e.g., a predefined output representation for the classification token in BERT, instead of a target label. It can thus introduce backdoor to a wide range of downstream tasks without any prior knowledge. Additionally, in light of the unique properties of triggers in NLP, we propose two new metrics to measure the performance of backdoor attacks in terms of both effectiveness and stealthiness. Our experiments with various types of triggers show that our method is widely applicable to different fine tuning tasks (classification and named entity recognition) and to different models (such as BERT, XLNet, BART), which poses a severe threat. Furthermore, by collaborating with the popular online model repository Hugging Face, the threat brought by our method has been confirmed. Finally, we analyze the factors that may affect the attack performance and share insights on the causes of the success of our backdoor attack.


Learning to Ask Appropriate Questions in Conversational Recommendation. Conversational recommender systems (CRSs) have revolutionized the conventional recommendation paradigm by embracing dialogue agents to dynamically capture the fine grained user preference. In a typical conversational recommendation scenario, a CRS firstly generates questions to let the user clarify her his demands and then makes suitable recommendations. Hence, the ability to generate suitable clarifying questions is the key to timely tracing users' dynamic preferences and achieving successful recommendations. However, existing CRSs fall short in asking high quality questions because (1) system generated responses heavily depends on the performance of the dialogue policy agent, which has to be trained with huge conversation corpus to cover all circumstances and (2) current CRSs cannot fully utilize the learned latent user profiles for generating appropriate and personalized responses. To mitigate these issues, we propose the Knowledge Based Question Generation System (KBQG), a novel framework for conversational recommendation. Distinct from previous conversational recommender systems, KBQG models a user's preference in a finer granularity by identifying the most relevant relations from a structured knowledge graph (KG). Conditioned on the varied importance of different relations, the generated clarifying questions could perform better in impelling users to provide more details on their preferences. Finially, accurate recommendations can be generated in fewer conversational turns. Furthermore, the proposed KBQG outperforms all baselines in our experiments on two real world datasets.


Uncovering the Benefits and Challenges of Continuous Integration Practices. In 2006, Fowler and Foemmel defined ten core Continuous Integration (CI) practices that could increase the speed of software development feedback cycles and improve software quality. Since then, these practices have been widely adopted by industry and subsequent research has shown they improve software quality. However, there is poor understanding of how organizations implement these practices, of the benefits developers perceive they bring, and of the challenges developers and organizations experience in implementing them. In this paper, we discuss a multiple case study of three small to medium sized companies using the recommended suite of ten CI practices. Using interviews and activity log mining, we learned that these practices are broadly implemented but how they are implemented varies depending on their perceived benefits, the context of the project, and the CI tools used by the organization. We also discovered that CI practices can create new constraints on the software process that hurt feedback cycle time. For researchers, we show that how CI is implemented varies, and thus studying CI (for example, using data mining) requires understanding these differences as important context for research studies. For practitioners, our findings reveal in depth insights on the possible benefits and challenges from using the ten practices, and how project context matters.


RansomClave Ransomware Key Management using SGX. Modern ransomware often generate and manage cryptographic keys on the victim's machine, giving defenders an opportunity to capture exposed keys and recover encrypted data without paying the ransom. However, recent work has raised the possibility of future enclave enhanced malware that could avoid such mitigations using emerging support for hardware enforced secure enclaves in commodity CPUs. Nonetheless, the practicality of such enclave enhanced malware and its potential impact on all phases of the ransomware lifecyle remain unclear. Given the demonstrated capacity of ransomware authors to innovate in order to better extort their victims (e.g. through the adoption of untraceable virtual currencies and anonymity networks), it is important to better understand the risks involved and identify potential mitigations. As a basis for comprehensive security and performance analysis of enclave enhanced ransomware, we present RansomClave, a family of ransomware that securely manage their cryptographic keys using an enclave. We use RansomClave to explore the implications of enclave enhanced ransomware for the key generation, encryption and key release phases of the ransomware lifecycle, and to identify potential limitations and mitigations. We propose two plausible victim models and analyse, from an attacker's perspective, how RansomClave can protect cryptographic keys from each type of victim. We find that some existing mitigations are likely to be effective during the key generation and encryption phases, but that RansomClave enables new trustless key release schemes that could potentially improve attacker's profitability and, by extension, make enclaves an attractive target for future attackers.


Second order accurate normal reconstruction from volume fractions on unstructured meshes with arbitrary polyhedral cells. This paper introduces a novel method for the efficient second order accurate computation of normal fields from volume fractions on unstructured polyhedral meshes. Locally, i.e. in each mesh cell, an averaged normal is reconstructed by fitting a plane in a least squares sense to the volume fraction data of neighboring cells while implicitly accounting for volume conservation in the cell at hand. The resulting minimization problem is solved approximately by employing a Newton type method. Moreover, applying the Reynolds transport theorem allows to assess the regularity of the derivatives. Since the divergence theorem implies that the volume fraction can be cast as a sum of face based quantities, our method considerably simplifies the numerical procedure for applications in three spatial dimensions while demonstrating an inherent ability to robustly deal with unstructured meshes. We discuss the theoretical foundations, regularity and appropriate error measures, along with the details of the numerical algorithm. Finally, numerical results for convex and non convex hypersurfaces embedded in cuboidal and tetrahedral meshes are presented, where we obtain second order convergence for the normal alignment and symmetric volume difference. Moreover, the findings are substantiated by completely new deep insights into the minimization procedure.


Untargeted Poisoning Attack Detection in Federated Learning via Behavior Attestation. Federated Learning (FL) is a paradigm in Machine Learning (ML) that addresses data privacy, security, access rights and access to heterogeneous information issues by training a global model using distributed nodes. Despite its advantages, there is an increased potential for cyberattacks on FL based ML techniques that can undermine the benefits. Model poisoning attacks on FL target the availability of the model. The adversarial objective is to disrupt the training. We propose attestedFL, a defense mechanism that monitors the training of individual nodes through state persistence in order to detect a malicious worker. A fine grained assessment of the history of the worker permits the evaluation of its behavior in time and results in innovative detection strategies. We present three lines of defense that aim at assessing if the worker is reliable by observing if the node is really training, advancing towards a goal. Our defense exposes an attacker's malicious behavior and removes unreliable nodes from the aggregation process so that the FL process converge faster. Through extensive evaluations and against various adversarial settings, attestedFL increased the accuracy of the model between 12 to 58 under different scenarios such as attacks performed at different stages of convergence, attackers colluding and continuous attacks.


Graphical Gaussian Process Regression Model for Aqueous Solvation Free Energy Prediction of Organic Molecules in Redox Flow Battery. The solvation free energy of organic molecules is a critical parameter in determining emergent properties such as solubility, liquid phase equilibrium constants, and pKa and redox potentials in an organic redox flow battery. In this work, we present a machine learning (ML) model that can learn and predict the aqueous solvation free energy of an organic molecule using Gaussian process regression method based on a new molecular graph kernel. To investigate the performance of the ML model on electrostatic interaction, the nonpolar interaction contribution of solvent and the conformational entropy of solute in solvation free energy, three data sets with implicit or explicit water solvent models, and contribution of conformational entropy of solute are tested. We demonstrate that our ML model can predict the solvation free energy of molecules at chemical accuracy with a mean absolute error of less than 1 kcal mol for subsets of the QM9 dataset and the Freesolv database. To solve the general data scarcity problem for a graph based ML model, we propose a dimension reduction algorithm based on the distance between molecular graphs, which can be used to examine the diversity of the molecular data set. It provides a promising way to build a minimum training set to improve prediction for certain test sets where the space of molecular structures is predetermined.


Iterative Rule Extension for Logic Analysis of Data an MILP based heuristic to derive interpretable binary classification from large datasets. Data driven decision making is rapidly gaining popularity, fueled by the ever increasing amounts of available data and encouraged by the development of models that can identify beyond linear input output relationships. Simultaneously the need for interpretable prediction and classification methods is increasing, as this improves both our trust in these models and the amount of information we can abstract from data. An important aspect of this interpretability is to obtain insight in the sensitivity specificity trade off constituted by multiple plausible input output relationships. These are often shown in a receiver operating characteristic (ROC) curve. These developments combined lead to the need for a method that can abstract complex yet interpretable input output relationships from large data, i.e. data containing large numbers of samples and sample features. Boolean phrases in disjunctive normal form (DNF) are highly suitable for explaining non linear input output relationships in a comprehensible way. Mixed integer linear programming (MILP) can be used to abstract these Boolean phrases from binary data, though its computational complexity prohibits the analysis of large datasets. This work presents IRELAND, an algorithm that allows for abstracting Boolean phrases in DNF from data with up to 10,000 samples and sample characteristics. The results show that for large datasets IRELAND outperforms the current state of the art and can find solutions for datasets where current models run out of memory or need excessive runtimes. Additionally, by construction IRELAND allows for an efficient computation of the sensitivity specificity trade off curve, allowing for further understanding of the underlying input output relationship.


Gaussian Belief Space Path Planning for Minimum Sensing Navigation. We propose a path planning methodology for a mobile robot navigating through an obstacle filled environment to generate a reference path that is traceable with moderate sensing efforts. The desired reference path is characterized as the shortest path in an obstacle filled Gaussian belief manifold equipped with a novel information geometric distance function. The distance function we introduce is shown to be an asymmetric quasi pseudometric and can be interpreted as the minimum information gain required to steer the Gaussian belief. An RRT based numerical solution algorithm is presented to solve the formulated shortest path problem. To gain insight into the asymptotic optimality of the proposed algorithm, we show that the considered path length function is continuous with respect to the topology of total variation. Simulation results demonstrate that the proposed method is effective in various robot navigation scenarios to reduce sensing costs, such as the required frequency of sensor measurements and the number of sensors that must be operated simultaneously.


Partially congested propagation fronts in one dimensional Navier Stokes equations. These notes are dedicated to the analysis of the one dimensional free congested Navier Stokes equations. After a brief synthesis of the results obtained in 4 related to the existence and the asymptotic stability of partially congested profiles associated to the soft congestion Navier Stokes system, we present a first local well posedness result for the one dimensional free congested Navier Stokes equations.


Undecidability of Learnability. Machine learning researchers and practitioners steadily enlarge the multitude of successful learning models. They achieve this through in depth theoretical analyses and experiential heuristics. However, there is no known general purpose procedure for rigorously evaluating whether newly proposed models indeed successfully learn from data. We show that such a procedure cannot exist. For PAC binary classification, uniform and universal online learning, and exact learning through teacher learner interactions, learnability is in general undecidable, both in the sense of independence of the axioms in a formal system and in the sense of uncomputability. Our proofs proceed via computable constructions of function classes that encode the consistency problem for formal systems and the halting problem for Turing machines into complexity measures that characterize learnability. Our work shows that undecidability appears in the theoretical foundations of machine learning There is no one size fits all algorithm for deciding whether a machine learning model can be successful. We cannot in general automatize the process of assessing new learning models.


Source Free Domain Adaptation for Image Segmentation. Domain adaptation (DA) has drawn high interest for its capacity to adapt a model trained on labeled source data to perform well on unlabeled or weakly labeled target data from a different domain. Most common DA techniques require concurrent access to the input images of both the source and target domains. However, in practice, privacy concerns often impede the availability of source images in the adaptation phase. This is a very frequent DA scenario in medical imaging, where, for instance, the source and target images could come from different clinical sites. We introduce a source free domain adaptation for image segmentation. Our formulation is based on minimizing a label free entropy loss defined over target domain data, which we further guide with a domain invariant prior on the segmentation regions. Many priors can be derived from anatomical information. Here, a class ratio prior is estimated from anatomical knowledge and integrated in the form of a Kullback Leibler (KL) divergence in our overall loss function. Furthermore, we motivate our overall loss with an interesting link to maximizing the mutual information between the target images and their label predictions. We show the effectiveness of our prior aware entropy minimization in a variety of domain adaptation scenarios, with different modalities and applications, including spine, prostate, and cardiac segmentation. Our method yields comparable results to several state of the art adaptation techniques, despite having access to much less information, as the source images are entirely absent in our adaptation phase. Our straightforward adaptation strategy uses only one network, contrary to popular adversarial techniques, which are not applicable to a source free DA setting. Our framework can be readily used in a breadth of segmentation problems, and our code is publicly available https github.com mathilde b SFDA


Geometric Satake equivalence in mixed characteristic and Springer correspondence. The geometric Satake equivalence and the Springer correspondence are closely related when restricting to small representations of the Langlands dual group. We prove this result for 'etale sheaves, including the case of the mixed characteristic affine Grassmannian, assuming a sufficient ramification. In this process, we construct a monoidal structure on the restriction functor of Satake categories. We construct also a canonical isomorphism between a mixed characteristic affine Grassmannian under a sufficient ramification and an equal characteristic one.


C 0 gap between entropy zero Hamiltonians and autonomous diffeomorphisms of surfaces. Let Sigma be a surface equipped with an area form. There is an long standing open question by Katok, which, in particular, asks whether every entropy zero Hamiltonian diffeomorphism of a surface lies in the C 0 closure of the set of integrable diffeomorphisms. A slightly weaker version of this question asks Does every entropy zero Hamiltonian diffeomorphism of a surface lie in the C 0 closure of the set of autonomous diffeomorphisms?'' In this paper we answer in negative the later question. In particular, we show that on a surface Sigma the set of autonomous Hamiltonian diffeomorphisms is not C 0 dense in the set of entropy zero Hamiltonians. We explicitly construct examples of such Hamiltonians which cannot be approximated by autonomous diffeomorphisms.


A Classification of Genus 0 Modular Curves with Rational Points. Let E be a non CM elliptic curve defined over mathbb Q . Fix an algebraic closure overline mathbb Q of mathbb Q . We get a Galois representation rho E colon Gal( overline mathbb Q mathbb Q ) to GL 2( hat mathbb Z ) associated to E by choosing a compatible bases for the N torsion subgroups of E( overline mathbb Q ). Associated to an open subgroup G of GL 2( hat mathbb Z ) satisfying I in G and det(G) hat mathbb Z times , we have the modular curve (X G, pi G) over mathbb Q which loosely parametrises elliptic curves E such that the image of rho E is conjugate to a subgroup of G t. In this article we give a complete classification of all such genus 0 modular curves that have a rational point. This classification is given in finitely many families. Moreover, each such modular curve can be explicitly computed.


MmWave Radar and Vision Fusion for Object Detection in Autonomous Driving A Review. With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is a mainstream solution for accurate obstacle detection. This article presents a detailed survey on mmWave radar and vision fusion based obstacle detection methods. First, we introduce the tasks, evaluation criteria, and datasets of object detection for autonomous driving. The process of mmWave radar and vision fusion is then divided into three parts sensor deployment, sensor calibration, and sensor fusion, which are reviewed comprehensively. Specifically, we classify the fusion methods into data level, decision level, and feature level fusion methods. In addition, we introduce three dimensional(3D) object detection, the fusion of lidar and vision in autonomous driving and multimodal information fusion, which are promising for the future. Finally, we summarize this article.


H "older regularity for stochastic processes with bounded and measurable increments. We obtain an asymptotic H "older estimate for expectations of a quite general class of discrete stochastic processes. Such expectations can also be described as solutions to a dynamic programming principle or as solutions to discretized PDEs. The result, which is also generalized to functions satisfying Pucci type inequalities for discrete extremal operators, is a counterpart to the Krylov Safonov regularity result in PDEs. However, the discrete step size varepsilon has some crucial effects compared to the PDE setting. The proof combines analytic and probabilistic arguments.


Frequency specific segregation and integration of human cerebral cortex an intrinsic functional atlas. The frequency specific coupling mechanism of the functional human brain networks underpins its complex cognitive and behavioral functions. Nevertheless, it is not well unveiled what are the frequency specific subdivisions and network topologies of the human brain. In this study, we estimated functional connectivity of the human cerebral cortex using spectral connection, and conducted frequency specific parcellation using eigen clustering and gradient based methods, and then explored their topological structures. 7T fMRI data of 184 subjects in the HCP dataset were used for parcellation and exploring the topological properties of the functional networks, and 3T fMRI data of another 890 subjects were used to confirm the stability of the frequency specific topologies. Seven to ten functional networks were stably integrated by two to four dissociable hub categories at specific frequencies, and we proposed an intrinsic functional atlas containing 456 parcels according to the parcellations across frequencies. The results revealed that the functional networks contained stable frequency specific topologies, which may imply more abundant roles of the functional units and more complex interactions among them.


Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network. We developed a novel, interpretable multimodal classification method to identify symptoms of mood disorders viz. depression, anxiety and anhedonia using audio, video and text collected from a smartphone application. We used CNN based unimodal encoders to learn dynamic embeddings for each modality and then combined these through a transformer encoder. We applied these methods to a novel dataset collected by a smartphone application on 3002 participants across up to three recording sessions. Our method demonstrated better multimodal classification performance compared to existing methods that employed static embeddings. Lastly, we used SHapley Additive exPlanations (SHAP) to prioritize important features in our model that could serve as potential digital markers.


MLOps Challenges in Multi Organization Setup Experiences from Two Real World Cases. The emerging age of connected, digital world means that there are tons of data, distributed to various organizations and their databases. Since this data can be confidential in nature, it cannot always be openly shared in seek of artificial intelligence (AI) and machine learning (ML) solutions. Instead, we need integration mechanisms, analogous to integration patterns in information systems, to create multi organization AI ML systems. In this paper, we present two real world cases. First, we study integration between two organizations in detail. Second, we address scaling of AI ML to multi organization context. The setup we assume is that of continuous deployment, often referred to DevOps in software development. When also ML components are deployed in a similar fashion, term MLOps is used. Towards the end of the paper, we list the main observations and draw some final conclusions. Finally, we propose some directions for future work.


An Exploration of the Mentorship Needs of Research Software Engineers. As a newly designated professional title, research software engineers (RSEs) link the two worlds of software engineering and research science. They lack clear development and training opportunities, particularly in the realm of mentoring. In this paper, we discuss mentorship as it pertains to the unique needs of RSEs and propose ways in which organizations and institutions can support mentor mentee relationships for RSEs


On Complexity of 1 Center in Various Metrics. We consider the classic 1 center problem Given a set P of n points in a metric space find the point in P that minimizes the maximum distance to the other points of P. We study the complexity of this problem in d dimensional ell p metrics and in edit and Ulam metrics over strings of length d. Our results for the 1 center problem may be classified based on d as follows. bullet Small d We provide the first linear time algorithm for 1 center problem in fixed dimensional ell 1 metrics. On the other hand, assuming the hitting set conjecture (HSC), we show that when d omega( log n) , no subquadratic algorithm can solve 1 center problem in any of the ell p metrics, or in edit or Ulam metrics. bullet Large d. When d Omega(n) , we extend our conditional lower bound to rule out sub quartic algorithms for 1 center problem in edit metric (assuming Quantified SETH). On the other hand, we give a (1 epsilon) approximation for 1 center in Ulam metric with running time tilde O epsilon (nd n 2 sqrt d ) . We also strengthen some of the above lower bounds by allowing approximations or by reducing the dimension d, but only against a weaker class of algorithms which list all requisite solutions. Moreover, we extend one of our hardness results to rule out subquartic algorithms for the well studied 1 median problem in the edit metric, where given a set of n strings each of length n, the goal is to find a string in the set that minimizes the sum of the edit distances to the rest of the strings in the set.


On the global approximate controllability in small time of semiclassical 1 D Schr "odinger equations between two states with positive quantum densities. In this paper, we study, in the semiclassical sense, the global approximate controllability in small time of the quantum density and quantum momentum of the 1 D semiclassical cubic Schr "odinger equation with two controls between two states with positive quantum densities. We first control the asymptotic expansions of the zeroth and first order of the physical observables via Agrachev Sarychev's method. Then we conclude the proof through techniques of semiclassical approximation of the nonlinear Schr "odinger equation.


A posteriori superlinear convergence bounds for block conjugate gradient. In this paper, we extend to the block case, the a posteriori bound showing superlinear convergence of Conjugate Gradients developed in J. Comput. Applied Math., 48 (1993), pp. 327 341 , that is, we obtain similar bounds, but now for block Conjugate Gradients. We also present a series of computational experiments, illustrating the validity of the bound developed here, as well as the bound from SIAM Review, 47 (2005), pp. 247 272 using angles between subspaces. Using these bounds, we make some observations on the onset of superlinearity, and how this onset depends on the eigenvalue distribution and the block size.


A Spatio temporal Attention based Model for Infant Movement Assessment from Videos. The absence or abnormality of fidgety movements of joints or limbs is strongly indicative of cerebral palsy in infants. Developing computer based methods for assessing infant movements in videos is pivotal for improved cerebral palsy screening. Most existing methods use appearance based features and are thus sensitive to strong but irrelevant signals caused by background clutter or a moving camera. Moreover, these features are computed over the whole frame, thus they measure gross whole body movements rather than specific joint limb motion. Addressing these challenges, we develop and validate a new method for fidgety movement assessment from consumer grade videos using human poses extracted from short clips. Human poses capture only relevant motion profiles of joints and limbs and are thus free from irrelevant appearance artifacts. The dynamics and coordination between joints are modeled using spatio temporal graph convolutional networks. Frames and body parts that contain discriminative information about fidgety movements are selected through a spatio temporal attention mechanism. We validate the proposed model on the cerebral palsy screening task using a real life consumer grade video dataset collected at an Australian hospital through the Cerebral Palsy Alliance, Australia. Our experiments show that the proposed method achieves the ROC AUC score of 81.87 , significantly outperforming existing competing methods with better interpretability.


Threshold based Network Structural Dynamics. The interest in dynamic processes on networks is steadily rising in recent years. In this paper, we consider the ( alpha, beta) Thresholded Network Dynamics ( ( alpha, beta) Dynamics), where alpha leq beta , in which only structural dynamics (dynamics of the network) are allowed, guided by local thresholding rules executed in each node. In particular, in each discrete round t , each pair of nodes u and v that are allowed to communicate by the scheduler, computes a value mathcal E (u,v) (the potential of the pair) as a function of the local structure of the network at round t around the two nodes. If mathcal E (u,v) alpha then the link (if it exists) between u and v is removed if alpha leq mathcal E (u,v) beta then an existing link among u and v is maintained if beta leq mathcal E (u,v) then a link between u and v is established if not already present. The microscopic structure of ( alpha, beta) Dynamics appears to be simple, so that we are able to rigorously argue about it, but still flexible, so that we are able to design meaningful microscopic local rules that give rise to interesting macroscopic behaviors. Our goals are the following a) to investigate the properties of the ( alpha, beta) Thresholded Network Dynamics and b) to show that ( alpha, beta) Dynamics is expressive enough to solve complex problems on networks. Our contribution in these directions is twofold. We rigorously exhibit the claim about the expressiveness of ( alpha, beta) Dynamics, both by designing a simple protocol that provably computes the k core of the network as well as by showing that ( alpha, beta) Dynamics is in fact Turing Complete. Second and most important, we construct general tools for proving stabilization that work for a subclass of ( alpha, beta) Dynamics and prove speed of convergence in a restricted setting.


Hiding Signal Strength Interference from Outside Adversaries. The presence of people can be detected by passively observing the signal strength of Wifi and related forms of communication. This paper tackles the question of how and when can this be prevented by adjustments to the transmitted signal strength, and other similar measures. The main contribution of this paper is a formal framework to analyze this problem, and the identification of several scenarios and corresponding protocols which can prevent or limit the inference from passive signal strength snooping.


Contrast reconstruction Representation Learning for Self supervised Skeleton based Action Recognition. Skeleton based action recognition is widely used in varied areas, e.g., surveillance and human machine interaction. Existing models are mainly learned in a supervised manner, thus heavily depending on large scale labeled data which could be infeasible when labels are prohibitively expensive. In this paper, we propose a novel Contrast Reconstruction Representation Learning network (CRRL) that simultaneously captures postures and motion dynamics for unsupervised skeleton based action recognition. It mainly consists of three parts Sequence Reconstructor, Contrastive Motion Learner, and Information Fuser. The Sequence Reconstructor learns representation from skeleton coordinate sequence via reconstruction, thus the learned representation tends to focus on trivial postural coordinates and be hesitant in motion learning. To enhance the learning of motions, the Contrastive Motion Learner performs contrastive learning between the representations learned from coordinate sequence and additional velocity sequence, respectively. Finally, in the Information Fuser, we explore varied strategies to combine the Sequence Reconstructor and Contrastive Motion Learner, and propose to capture postures and motions simultaneously via a knowledge distillation based fusion strategy that transfers the motion learning from the Contrastive Motion Learner to the Sequence Reconstructor. Experimental results on several benchmarks, i.e., NTU RGB D 60, NTU RGB D 120, CMU mocap, and NW UCLA, demonstrate the promise of the proposed CRRL method by far outperforming state of the art approaches.


Adversarial Attack Framework on Graph Embedding Models with Limited Knowledge. With the success of the graph embedding model in both academic and industry areas, the robustness of graph embedding against adversarial attack inevitably becomes a crucial problem in graph learning. Existing works usually perform the attack in a white box fashion they need to access the predictions labels to construct their adversarial loss. However, the inaccessibility of predictions labels makes the white box attack impractical to a real graph learning system. This paper promotes current frameworks in a more general and flexible sense we demand to attack various kinds of graph embedding models with black box driven. We investigate the theoretical connections between graph signal processing and graph embedding models and formulate the graph embedding model as a general graph signal process with a corresponding graph filter. Therefore, we design a generalized adversarial attacker GF Attack. Without accessing any labels and model predictions, GF Attack can perform the attack directly on the graph filter in a black box fashion. We further prove that GF Attack can perform an effective attack without knowing the number of layers of graph embedding models. To validate the generalization of GF Attack, we construct the attacker on four popular graph embedding models. Extensive experiments validate the effectiveness of GF Attack on several benchmark datasets.


RevCore Review augmented Conversational Recommendation. Existing conversational recommendation (CR) systems usually suffer from insufficient item information when conducted on short dialogue history and unfamiliar items. Incorporating external information (e.g., reviews) is a potential solution to alleviate this problem. Given that reviews often provide a rich and detailed user experience on different interests, they are potential ideal resources for providing high quality recommendations within an informative conversation. In this paper, we design a novel end to end framework, namely, Review augmented Conversational Recommender (RevCore), where reviews are seamlessly incorporated to enrich item information and assist in generating both coherent and informative responses. In detail, we extract sentiment consistent reviews, perform review enriched and entity based recommendations for item suggestions, as well as use a review attentive encoder decoder for response generation. Experimental results demonstrate the superiority of our approach in yielding better performance on both recommendation and conversation responding.


Extremal digraphs avoiding distinct walks of length 3 with the same endpoints. In this paper, we determine the maximum size of digraphs on n vertices in which there are no two distinct walks of length 3 with the same initial vertex and the same terminal vertex. The digraphs attaining this maximum size are also characterized. Combining this with previous results, we obtain a full solution to a problem proposed by X. Zhan in 2007.


Training Larger Networks for Deep Reinforcement Learning. The success of deep learning in the computer vision and natural language processing communities can be attributed to training of very deep neural networks with millions or billions of parameters which can then be trained with massive amounts of data. However, similar trend has largely eluded training of deep reinforcement learning (RL) algorithms where larger networks do not lead to performance improvement. Previous work has shown that this is mostly due to instability during training of deep RL agents when using larger networks. In this paper, we make an attempt to understand and address training of larger networks for deep RL. We first show that naively increasing network capacity does not improve performance. Then, we propose a novel method that consists of 1) wider networks with DenseNet connection, 2) decoupling representation learning from training of RL, 3) a distributed training method to mitigate overfitting problems. Using this three fold technique, we show that we can train very large networks that result in significant performance gains. We present several ablation studies to demonstrate the efficacy of the proposed method and some intuitive understanding of the reasons for performance gain. We show that our proposed method outperforms other baseline algorithms on several challenging locomotion tasks.


On irreducible meanders growth rate. In this article, we provide upper and lower bounds for the growth rate of irreducible meanders. The obtained upper bound implies that the proportion of irreducible meanders among all of the prime meanders of order n approaches 0 as n approaches infinity.


Accelerated Polynomial Evaluation and Differentiation at Power Series in Multiple Double Precision. The problem is to evaluate a polynomial in several variables and its gradient at a power series truncated to some finite degree with multiple double precision arithmetic. To compensate for the cost overhead of multiple double precision and power series arithmetic, data parallel algorithms for general purpose graphics processing units are presented. The reverse mode of algorithmic differentiation is organized into a massively parallel computation of many convolutions and additions of truncated power series. Experimental results demonstrate that teraflop performance is obtained in deca double precision with power series truncated at degree 152. The algorithms scale well for increasing precision and increasing degrees.


Dependency Learning for Legal Judgment Prediction with a Unified Text to Text Transformer. Given the fact of a case, Legal Judgment Prediction (LJP) involves a series of sub tasks such as predicting violated law articles, charges and term of penalty. We propose leveraging a unified text to text Transformer for LJP, where the dependencies among sub tasks can be naturally established within the auto regressive decoder. Compared with previous works, it has three advantages (1) it fits in the pretraining pattern of masked language models, and thereby can benefit from the semantic prompts of each sub task rather than treating them as atomic labels, (2) it utilizes a single unified architecture, enabling full parameter sharing across all sub tasks, and (3) it can incorporate both classification and generative sub tasks. We show that this unified transformer, albeit pretrained on general domain text, outperforms pretrained models tailored specifically for the legal domain. Through an extensive set of experiments, we find that the best order to capture dependencies is different from human intuitions, and the most reasonable logical order for humans can be sub optimal for the model. We further include two more auxiliary tasks court view generation and article content prediction, showing they can not only improve the prediction accuracy, but also provide interpretable explanations for model outputs even when an error is made. With the best configuration, our model outperforms both previous SOTA and a single tasked version of the unified transformer by a large margin.


A new approach to proper orthogonal decomposition with difference quotients. In a recent work B. Koc et al., arXiv 2010.03750, SIAM J. Numer. Anal., to appear , the authors showed that including difference quotients (DQs) is necessary in order to prove optimal pointwise in time error bounds for proper orthogonal decomposition (POD) reduced order models of the heat equation. In this work, we introduce a new approach to including DQs in the POD procedure. Instead of computing the POD modes using all of the snapshot data and DQs, we only use the first snapshot along with all of the DQs and special POD weights. We show that this approach retains all of the numerical analysis benefits of the standard POD DQ approach, while using a POD data set that has half the number of snapshots as the standard POD DQ approach, i.e., the new approach is more computationally efficient. We illustrate our theoretical results with numerical experiments.


Topological categories related to Fredholm operators I. Classifying spaces. In 1970s Segal outlined proofs of two theorems relating spaces of Fredholm and self adjoint Fredholm operators with Quillen's constructions used to define higher algebraic K theory. In the present paper we provide detailed proofs of these theorems of Segal (different from the ones outlined by Segal) and then transplant some further ideas of Quillen to the real of Fredholm and self adjoint Fredholm operators. The main results may be considered as partial analogues of the equivalence of Quillen's two definition of higher algebraic K theory. Along the way we relate spaces of Fredholm and self adjoint Fredholm operators with more concrete classifying spaces. These results are partially motivated by applications to the index theory in a related paper.


SolType Refinement Types for Arithmetic Overflow in Solidity. As smart contracts gain adoption in financial transactions, it becomes increasingly important to ensure that they are free of bugs and security vulnerabilities. Of particular relevance in this context are arithmetic overflow bugs, as integers are often used to represent financial assets like account balances. Motivated by this observation, this paper presents SolType, a refinement type system for Solidity that can be used to prevent arithmetic over and under flows in smart contracts. SolType allows developers to add refinement type annotations and uses them to prove that arithmetic operations do not lead to over and under flows. SolType incorporates a rich vocabulary of refinement terms that allow expressing relationships between integer values and aggregate properties of complex data structures. Furthermore, our implementation, called Solid, incorporates a type inference engine and can automatically infer useful type annotations, including non trivial contract invariants. To evaluate the usefulness of our type system, we use Solid to prove arithmetic safety of a total of 120 smart contracts. When used in its fully automated mode (i.e., using Solid's type inference capabilities), Solid is able to eliminate 86.3 of redundant runtime checks used to guard against overflows. We also compare Solid against a state of the art arithmetic safety verifier called VeriSmart and show that Solid has a significantly lower false positive rate, while being significantly faster in terms of verification time.


NewtonNet A Newtonian message passing network for deep learning of interatomic potentials and forces. We report a new deep learning message passing network that takes inspiration from Newton's equations of motion to learn interatomic potentials and forces. With the advantage of directional information from trainable latent force vectors, and physics infused operators that are inspired by the Newtonian physics, the entire model remains rotationally equivariant, and many body interactions are inferred by more interpretable physical features. We test NewtonNet on the prediction of several reactive and non reactive high quality ab initio data sets including single small molecule dynamics, a large set of chemically diverse molecules, and methane and hydrogen combustion reactions, achieving state of the art test performance on energies and forces with far greater data and computational efficiency than other deep learning models.


Electro optically controlled divided pulse amplification. A novel technique for divided pulse amplification is presented in a proof of principle experiment. A pulse burst, cut out of the pulse train of a mode locked oscillator, is amplified and temporally combined into a single pulse. High combination efficiency and excellent pulse contrast are demonstrated. The system is mostly fiber coupled, enabling a high interferometric stability. This approach provides access to the amplitude and phase of the individual pulses in the burst to be amplified, potentially allowing the compensation of gain saturation and nonlinear phase mismatches within the burst. Therefore, this technique enables the scaling of the peak power and pulse energy of pulsed laser systems beyond currently prevailing limitations.


The Simpson's Paradox in the Offline Evaluation of Recommendation Systems. Recommendation systems are often evaluated based on user's interactions that were collected from an existing, already deployed recommendation system. In this situation, users only provide feedback on the exposed items and they may not leave feedback on other items since they have not been exposed to them by the deployed system. As a result, the collected feedback dataset that is used to evaluate a new model is influenced by the deployed system, as a form of closed loop feedback. In this paper, we show that the typical offline evaluation of recommender systems suffers from the so called Simpson's paradox. Simpson's paradox is the name given to a phenomenon observed when a significant trend appears in several different sub populations of observational data but disappears or is even reversed when these sub populations are combined together. Our in depth experiments based on stratified sampling reveal that a very small minority of items that are frequently exposed by the deployed system plays a confounding factor in the offline evaluation of recommendation systems. In addition, we propose a novel evaluation methodology that takes into account the confounder, i.e the deployed system's characteristics. Using the relative comparison of many recommendation models as in the typical offline evaluation of recommender systems, and based on the Kendall rank correlation coefficient, we show that our proposed evaluation methodology exhibits statistically significant improvements of 14 and 40 on the examined open loop datasets (Yahoo! and Coat), respectively, in reflecting the true ranking of systems with an open loop (randomised) evaluation in comparison to the standard evaluation.


Polymorphic dynamic programming by algebraic shortcut fusion. Dynamic programming (DP) is a broadly applicable algorithmic design paradigm for the efficient, exact solution of otherwise intractable, combinatorial problems. However, the design of such algorithms is often presented informally in an ad hoc manner, and as a result is often difficult to apply correctly. In this paper, we present a rigorous algebraic formalism for systematically deriving novel DP algorithms, either from existing DP algorithms or from simple functional recurrences. These derivations lead to algorithms which are provably correct and polymorphic over any semiring, which means that they can be applied to the full scope of combinatorial problems expressible in terms of semirings. This includes, for example optimization, optimal probability and Viterbi decoding, probabilistic marginalization, logical inference, fuzzy sets, differentiable softmax, and relational and provenance queries. The approach, building on many ideas from the existing literature on constructive algorithmics, exploits generic properties of (semiring) polymorphic functions, tupling and formal sums (lifting), and algebraic simplifications arising from constraint algebras. We demonstrate the effectiveness of this formalism for some example applications arising in signal processing, bioinformatics and reliability engineering.


Rational points near self similar sets. In this paper, we consider a problem of counting rational points near self similar sets. Let n geq 1 be an integer. We shall show that for some self similar measures on mathbb R n , the set of rational points mathbb Q n is 'equidistributed' in a sense that will be introduced in this paper. This implies that an inhomogeneous Khinchine convergence type result can be proved for those measures. In particular, for n 1 and large enough integers p, the above holds for the middle p th Cantor measure, i.e. the natural Hausdorff measure on the set of numbers whose base p expansions do not have digit (p 1) 2 . Furthermore, we partially proved a conjecture of Bugeaud and Durand for the middle p th Cantor set and this also answers a question posed by Levesley, Salp and Velani. Our method includes a fine analysis of the Fourier coefficients of self similar measures together with an Erd H o s Kahane type argument. We will also provide a numerical argument to show that p 10 7 is sufficient for the above conclusions. In fact, p geq 15 is already enough for most of the above conclusions.


Coarse geometry of Hecke pairs and the Baum Connes conjecture. We study Hecke pairs using the coarse geometry of their coset space and their Schlichting completion. We prove new stability results for the Baum Connes and the Novikov conjectures in the case where the pair is co Haagerup. This allows to generalize previous results, while providing new examples of groups satisfying the Baum Connes conjecture with coefficients. For instance, we show that for some S arithmetic subgroups of Sp(5,1) and Sp(3,1) the conjecture with coefficients holds.


How to construct harmonic maps to the hyperbolic plane. We study harmonic maps between Riemann surfaces, when the curvature in the target is a negative constant. In cite FotDask , harmonic maps are related to the sinh Gordon equation and a B "acklund transformation is introduced, which connects solutions of the sinh Gordon and sine Gordon equation. We develop this machinery in order to construct new harmonic maps to the hyperbolic plane.


Be Considerate Objectives, Side Effects, and Deciding How to Act. Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable outcomes. We contend that to learn to act safely, a reinforcement learning (RL) agent should include contemplation of the impact of its actions on the wellbeing and agency of others in the environment, including other acting agents and reactive processes. We endow RL agents with the ability to contemplate such impact by augmenting their reward based on expectation of future return by others in the environment, providing different criteria for characterizing impact. We further endow these agents with the ability to differentially factor this impact into their decision making, manifesting behavior that ranges from self centred to self less, as demonstrated by experiments in gridworld environments.


Quasi connected reductive groups. We introduce the notion of a quasi connected reductive group over an arbitrary field to be an almost direct product of a connected semisimple group and a quasi torus (a smooth group of multiplicative type). We show that a linear algebraic group is quasi connected reductive if and only if it is isomorphic to a smooth normal subgroup of a connected reductive group.


Online adaptive algorithm for Constraint Energy Minimizing Generalized Multiscale Discontinuous Galerkin Method. In this research, we propose an online basis enrichment strategy within the framework of a recently developed constraint energy minimizing generalized multiscale discontinuous Galerkin method (CEM GMsDGM). Combining the technique of oversampling, one makes use of the information of the current residuals to adaptively construct basis functions in the online stage to reduce the error of multiscale approximation. A complete analysis of the method is presented, which shows the proposed online enrichment leads to a fast convergence from multiscale approximation to the fine scale solution. The error reduction can be made sufficiently large by suitably selecting oversampling regions and the number of oversampling layers. Further, the convergence rate of the enrichment algorithm depends on a factor of exponential decay regarding the number of oversampling layers and a user defined parameter. Numerical results are provided to demonstrate the effectiveness and efficiency of the proposed online adaptive algorithm.


A limit theorem for Bernoulli convolutions and the Phi variation of functions in the Takagi class. We consider a probabilistic approach to compute the Wiener Young Phi variation of fractal functions in the Takagi class. Here, the Phi variation is understood as a generalization of the quadratic variation or, more generally, the p text th variation of a trajectory computed along the sequence of dyadic partitions of the unit interval. The functions Phi we consider form a very wide class of functions that are regularly varying at zero. Moreover, for each such function Phi , our results provide in a straightforward manner a large and tractable class of functions that have nontrivial and linear Phi variation. As a corollary, we also construct stochastic processes whose sample paths have nontrivial, deterministic, and linear Phi variation for each function Phi from our class. The proof of our main result relies on a limit theorem for certain sums of Bernoulli random variables that converge to an infinite Bernoulli convolution.


Do I Get the Privacy I Need? Benchmarking Utility in Differential Privacy Libraries. An increasing number of open source libraries promise to bring differential privacy to practice, even for non experts. This paper studies five libraries that offer differentially private analytics Google DP, SmartNoise, diffprivlib, diffpriv, and Chorus. We compare these libraries qualitatively (capabilities, features, and maturity) and quantitatively (utility and scalability) across four analytics queries (count, sum, mean, and variance) executed on synthetic and real world datasets. We conclude that these libraries provide similar utility (except in some notable scenarios). However, there are significant differences in the features provided, and we find that no single library excels in all areas. Based on our results, we provide guidance for practitioners to help in choosing a suitable library, guidance for library designers to enhance their software, and guidance for researchers on open challenges in differential privacy tools for non experts.


Syzygies of string modules for special biserial algebras. We present discrete models of special biserial (SB) algebras and their string modules, drawing inspiration from cellular automata, and cast new light on patterns among syzygies. We explore applications of our models to open questions in homological algebra regarding certain triangulated subcategories of derived categories, with implications for the finitistic dimension conjectures. More pertinently, our models provide the inner workings for a new, original GAP package called SBStrips, written and implemented by the author. Its source code is freely available online and its documentation is included as an appendix. The package calculates syzygies of string modules (and much more besides) using specialised methods much more efficient than the general methods currently employed by the QPA package.


Optimisation of the total population size for logistic diffusive equations bang bang property and fragmentation rate. In this article, we give an in depth analysis of the problem of optimising the total population size for a standard logistic diffusive model. This optimisation problem stems from the study of spatial ecology and amounts to the following question assuming a species evolves in a domain, what is the best way to spread resources in order to ensure a maximal population size at equilibrium? In recent years, many authors contributed to this topic. We settle here the proof of two fundamental properties of optimisers the bang bang one which had so far only been proved under several strong assumptions, and the other one is the fragmentation of maximisers. Here, we prove the bang bang property in all generality using a new spectral method. The technique introduced to demonstrate the bang bang character of optimizers can be adapted and generalized to many optimization problems with other classes of bilinear optimal control problems where the state equation is semilinear and elliptic. We comment on it in a conclusion section.Regarding the geometry of maximisers, we exhibit a blow up rate for the BV norm of maximisers as the diffusivity gets smaller if O is an orthotope and if m mu is an optimal control, then Vert m mu Vert BV gtrsim sqrt mu . The proof of this results relies on a very fine energy argument.


Toric ideals which are determinantal. Given any equigenerated monomial ideal I with the property that the defining ideal J of the fiber cone F(I) of I is generated by quadratic binomials, we introduce a matrix such that the set of its binomial 2 minors is a generating set of J . In this way, we characterize the fiber cone of sortable and Freiman ideals.


Hierarchical Cross Modal Agent for Robotics Vision and Language Navigation. Deep Learning has revolutionized our ability to solve complex problems such as Vision and Language Navigation (VLN). This task requires the agent to navigate to a goal purely based on visual sensory inputs given natural language instructions. However, prior works formulate the problem as a navigation graph with a discrete action space. In this work, we lift the agent off the navigation graph and propose a more complex VLN setting in continuous 3D reconstructed environments. Our proposed setting, Robo VLN, more closely mimics the challenges of real world navigation. Robo VLN tasks have longer trajectory lengths, continuous action spaces, and challenges such as obstacles. We provide a suite of baselines inspired by state of the art works in discrete VLN and show that they are less effective at this task. We further propose that decomposing the task into specialized high and low level policies can more effectively tackle this task. With extensive experiments, we show that by using layered decision making, modularized training, and decoupling reasoning and imitation, our proposed Hierarchical Cross Modal (HCM) agent outperforms existing baselines in all key metrics and sets a new benchmark for Robo VLN.


Integrals of incomplete beta functions, with applications to order statistics, random walks and string enumeration. We study the probability that one beta distributed random variable exceeds the maximum of two others, allowing all three to have general parameters. This amounts to studying Euler transforms of products of two incomplete beta functions. We provide a closed form for the general problem in terms of Kamp 'e de F 'eriet functions and a variety of simpler closed forms in special cases. The results are applied to derive the moments of the maximum of two independent beta distributed random variables and to find inner products of incomplete beta functions. Restricted to positive integer parameters, our results are applied to determine an expected exit time for a conditioned random walk and also to a combinatorial problem of enumerating strings comprised of three different letters, subject to constraints.


Symbolic Security Predicates Hunt Program Weaknesses. Dynamic symbolic execution (DSE) is a powerful method for path exploration during hybrid fuzzing and automatic bug detection. We propose security predicates to effectively detect undefined behavior and memory access violation errors. Initially, we symbolically execute program on paths that don't trigger any errors (hybrid fuzzing may explore these paths). Then we construct a symbolic security predicate to verify some error condition. Thus, we may change the program data flow to entail null pointer dereference, division by zero, out of bounds access, or integer overflow weaknesses. Unlike static analysis, dynamic symbolic execution does not only report errors but also generates new input data to reproduce them. Furthermore, we introduce function semantics modeling for common C C standard library functions. We aim to model the control flow inside a function with a single symbolic formula. This assists bug detection, speeds up path exploration, and overcomes overconstraints in path predicate. We implement the proposed techniques in our dynamic symbolic execution tool Sydr. Thus, we utilize powerful methods from Sydr such as path predicate slicing that eliminates irrelevant constraints. We present Juliet Dynamic to measure dynamic bug detection tools accuracy. The testing system also verifies that generated inputs trigger sanitizers. We evaluate Sydr accuracy for 11 CWEs from Juliet test suite. Sydr shows 95.59 overall accuracy. We make Sydr evaluation artifacts publicly available to facilitate results reproducibility.


Soundness in Object centric Workflow Petri Nets. Recently introduced Petri net based formalisms advocate the importance of proper representation and management of case objects as well as their co evolution. In this work we build on top of one of such formalisms and introduce the notion of soundness for it. We demonstrate that for nets with non deterministic synchronization between case objects, the soundness problem is decidable.


IASelect Finding Best fit Agent Practices in Industrial CPS Using Graph Databases. The ongoing fourth Industrial Revolution depends mainly on robust Industrial Cyber Physical Systems (ICPS). ICPS includes computing (software and hardware) abilities to control complex physical processes in distributed industrial environments. Industrial agents, originating from the well established multi agent systems field, provide complex and cooperative control mechanisms at the software level, allowing us to develop larger and more feature rich ICPS. The IEEE P2660.1 standardisation project, "Recommended Practices on Industrial Agents Integration of Software Agents and Low Level Automation Functions" focuses on identifying Industrial Agent practices that can benefit ICPS systems of the future. A key problem within this project is identifying the best fit industrial agent practices for a given ICPS. This paper reports on the design and development of a tool to address this challenge. This tool, called IASelect, is built using graph databases and provides the ability to flexibly and visually query a growing repository of industrial agent practices relevant to ICPS. IASelect includes a front end that allows industry practitioners to interactively identify best fit practices without having to write manual queries.


Fast algorithms for interpolation with L splines for differential operators L of order 4 with constant coefficients. In the classical theory of cubic interpolation splines there exists an algorithm which works with only O left( n right) arithmetic operations. Also, the smoothing cubic splines may be computed via the algorithm of Reinsch which reduces their computation to interpolation cubic splines and also performs with O left( n right) arithmetic operations. In this paper it is shown that many features of the polynomial cubic spline setting carry over to the larger class of L splines where L is a linear differential operator of order 4 with constant coefficients. Criteria are given such that the associated matrix R is strictly diagonally dominant which implies the existence of a fast algorithm for interpolation.


Introducing pre impact air cushioning effects into the Wagner model of impact theory. In this analysis, we consider the effects of non quiescent initial conditions driven by pre impact air water interactions on the classical Wagner model of impact theory. We consider the problem of a rigid, solid impactor moving vertically towards a liquid pool. Prior to impact, viscous forces in the air act to deform the liquid free surface, inducing a flow in the pool. These interactions are then incorporated as initial conditions in the post impact analysis. We derive expressions for the size of the effective contact set, the leading order pressure and force on the impactor, and the speed and thickness of the jet at its base. In all cases, we show that the effect of the pre impact behaviour is to cushion the impactor, reducing the size of the effective contact set and, hence, the force on the impactor. Small and large time asymptotic solutions are derived for general power law impactors, and we show that the effects of the air die away as the impact progresses, so that we approach the classical Wagner solution.


CETransformer Casual Effect Estimation via Transformer Based Representation Learning. Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. As present, data driven causal effect estimation faces two main challenges, i.e., selection bias and the missing of counterfactual. To address these two issues, most of the existing approaches tend to reduce the selection bias by learning a balanced representation, and then to estimate the counterfactual through the representation. However, they heavily rely on the finely hand crafted metric functions when learning balanced representations, which generally doesn't work well for the situations where the original distribution is complicated. In this paper, we propose a CETransformer model for casual effect estimation via transformer based representation learning. To learn the representation of covariates(features) robustly, a self supervised transformer is proposed, by which the correlation between covariates can be well exploited through self attention mechanism. In addition, an adversarial network is adopted to balance the distribution of the treated and control groups in the representation space. Experimental results on three real world datasets demonstrate the advantages of the proposed CETransformer, compared with the state of the art treatment effect estimation methods.


Membership Inference Attack and Defense for Wireless Signal Classifiers with Deep Learning. An over the air membership inference attack (MIA) is presented to leak private information from a wireless signal classifier. Machine learning (ML) provides powerful means to classify wireless signals, e.g., for PHY layer authentication. As an adversarial machine learning attack, the MIA infers whether a signal of interest has been used in the training data of a target classifier. This private information incorporates waveform, channel, and device characteristics, and if leaked, can be exploited by an adversary to identify vulnerabilities of the underlying ML model (e.g., to infiltrate the PHY layer authentication). One challenge for the over the air MIA is that the received signals and consequently the RF fingerprints at the adversary and the intended receiver differ due to the discrepancy in channel conditions. Therefore, the adversary first builds a surrogate classifier by observing the spectrum and then launches the black box MIA on this classifier. The MIA results show that the adversary can reliably infer signals (and potentially the radio and channel information) used to build the target classifier. Therefore, a proactive defense is developed against the MIA by building a shadow MIA model and fooling the adversary. This defense can successfully reduce the MIA accuracy and prevent information leakage from the wireless signal classifier.


Zero Shot Cross Lingual Machine Reading Comprehension via Inter sentence Dependency Graph. We target the task of cross lingual Machine Reading Comprehension (MRC) in the direct zero shot setting, by incorporating syntactic features from Universal Dependencies (UD), and the key features we use are the syntactic relations within each sentence. While previous work has demonstrated effective syntax guided MRC models, we propose to adopt the inter sentence syntactic relations, in addition to the rudimentary intra sentence relations, to further utilize the syntactic dependencies in the multi sentence input of the MRC task. In our approach, we build the Inter Sentence Dependency Graph (ISDG) connecting dependency trees to form global syntactic relations across sentences. We then propose the ISDG encoder that encodes the global dependency graph, addressing the inter sentence relations via both one hop and multi hop dependency paths explicitly. Experiments on three multilingual MRC datasets (XQuAD, MLQA, TyDiQA GoldP) show that our encoder that is only trained on English is able to improve the zero shot performance on all 14 test sets covering 8 languages, with up to 3.8 F1 5.2 EM improvement on average, and 5.2 F1 11.2 EM on certain languages. Further analysis shows the improvement can be attributed to the attention on the cross linguistically consistent syntactic path.


3 Lie Algebras, Ternary Nambu Lie algebras and the Yang Baxter equation. We construct ternary self distributive (TSD) objects from compositions of binary Lie algebras, 3 Lie algebras and, in particular, ternary Nambu Lie algebras. We show that the structures obtained satisfy an invertibility property resembling that of racks. We prove that these structures give rise to Yang Baxter operators in the tensor product of the base vector space and, upon defining suitable twisting isomorphisms, we obtain representations of the infinite (framed) braid group. We consider examples for low dimensional Lie algebras, where the ternary bracket is defined by composition of the binary ones, along with simple 3 Lie algebras. We show that the Yang Baxter operators obtained are not gauge equivalent to the transposition operator, and we consider the problem of deforming the operators to obtain new solutions to the Yang Baxter equation. We discuss the applications of this deformation procedure to the construction of (framed) link invariants.


Quantitative Performance Assessment of CNN Units via Topological Entropy Calculation. Identifying the status of individual network units is critical for understanding the mechanism of convolutional neural networks (CNNs). However, it is still challenging to reliably give a general indication of unit status, especially for units in different network models. To this end, we propose a novel method for quantitatively clarifying the status of single unit in CNN using algebraic topological tools. Unit status is indicated via the calculation of a defined topological based entropy, called feature entropy, which measures the degree of chaos of the global spatial pattern hidden in the unit for a category. In this way, feature entropy could provide an accurate indication of status for units in different networks with diverse situations like weight rescaling operation. Further, we show that feature entropy decreases as the layer goes deeper and shares almost simultaneous trend with loss during training. We show that by investigating the feature entropy of units on only training data, it could give discrimination between networks with different generalization ability from the view of the effectiveness of feature representations.


Lagrangian combinatorics of matroids. The Lagrangian geometry of matroids was introduced in ADH20 through the construction of the conormal fan of a matroid M. We used the conormal fan to give a Lagrangian geometric interpretation of the h vector of the broken circuit complex of M its entries are the degrees of the mixed intersections of certain convex piecewise linear functions gamma and delta on the conormal fan of M. By showing that the conormal fan satisfies the Hodge Riemann relations, we proved Brylawski's conjecture that this h vector is a log concave sequence. This sequel explores the Lagrangian combinatorics of matroids, further developing the combinatorics of biflats and biflags of a matroid, and relating them to the theory of basis activities developed by Tutte, Crapo, and Las Vergnas. Our main result is a combinatorial strengthening of the h vector computation we write the k th mixed intersection of gamma and delta explicitly as a sum of biflags corresponding to the nbc bases of internal activity k 1.


On the existence of Auslander Reiten n exangles in n exangulated categories. Let mathscr C be an n exangulated category. In this note, we show that if mathscr C is locally finite, then mathscr C has Auslander Reiten n exangles. This unifies and extends results of Xiao Zhu, Zhu Zhuang, Zhou and Xie Lu Wang for triangulated, extriangulated, (n 2) angulated and n abelian categories, respectively.


Nested block self attention for robust radiotherapy planning segmentation. Although deep convolutional networks have been widely studied for head and neck (HN) organs at risk (OAR) segmentation, their use for routine clinical treatment planning is limited by a lack of robustness to imaging artifacts, low soft tissue contrast on CT, and the presence of abnormal anatomy. In order to address these challenges, we developed a computationally efficient nested block self attention (NBSA) method that can be combined with any convolutional network. Our method achieves computational efficiency by performing non local calculations within memory blocks of fixed spatial extent. Contextual dependencies are captured by passing information in a raster scan order between blocks, as well as through a second attention layer that causes bi directional attention flow. We implemented our approach on three different networks to demonstrate feasibility. Following training using 200 cases, we performed comprehensive evaluations using conventional and clinical metrics on a separate set of 172 test scans sourced from external and internal institution datasets without any exclusion criteria. NBSA required a similar number of computations (15.7 gflops) as the most efficient criss cross attention (CCA) method and generated significantly more accurate segmentations for brain stem (Dice of 0.89 vs. 0.86) and parotid glands (0.86 vs. 0.84) than CCA. NBSA's segmentations were less variable than multiple 3D methods, including for small organs with low soft tissue contrast such as the submandibular glands (surface Dice of 0.90).


Influence of the electron spill out and nonlocality on gap plasmons in the limit of vanishing gaps. We study the effect of electron spill out and of nonlocality on the propagation of light inside a gap between two semi infinite metallic regions. We compare the predictions of a local response model taking into account only the spill out, to the predictions of a quantum hydrodynamic model able to take both phenomena into account. We show that only the latter is able to correctly retrieve the correct limit when the gap closes, while the local model suffers from undesirable features (divergence of the fields, overestimation of the losses). Finally, we show that, to a certain extent, the correct results can be retrieved using a simple local approach without spill out or conventional Thomas Fermi approximation, but considering an effective gap width.


Learnable Hypergraph Laplacian for Hypergraph Learning. Hypergraph Convolutional Neural Networks (HGCNNs) have demonstrated their potential in modeling high order relations preserved in graph structured data. However, most existing convolution filters are localized and determined by the pre defined initial hypergraph topology, neglecting to explore implicit and long range relations in real world data. In this paper, we propose the first learning based method tailored for constructing adaptive hypergraph structure, termed HypERgrAph Laplacian aDaptor (HERALD), which serves as a generic plug and play module for improving the representational power of HGCNNs.Specifically, HERALD adaptively optimizes the adjacency relationship between vertices and hyperedges in an end to end manner and thus the task aware hypergraph is learned. Furthermore, HERALD employs the self attention mechanism to capture the non local paired nodes relation. Extensive experiments on various popular hypergraph datasets for node classification and graph classification tasks demonstrate that our approach obtains consistent and considerable performance enhancement, proving its effectiveness and generalization ability.


Groups whose Chermak Delgado lattice is a subgroup lattice of an elementary abelian p group. The Chermak Delgado lattice of a finite group G is a self dual sublattice of the subgroup lattice of G . In this paper, we focus on finite groups whose Chermak Delgado lattice is a subgroup lattice of an elementary abelian p group. We prove that such groups are nilpotent of class 2 . We also prove that, for any elementary abelian p group E , there exists a finite group G such that the Chermak Delgado lattice of G is a subgroup lattice of E .


A Slightly Supercritical Condition of Regularity of Axisymmetric Solutions to the Navier Stokes Equations. In the note, a new regularity condition for axisymmetric solutions to the non stationary 3D Navier Stokes equations is proven. It is slightly supercritical.