Radiation damage on SiPMs for Space Applications. Silicon Photo multipliers (SiPMs) are very sensitive photo detectors that experienced a big development in the last years in several applications, like LIDAR, astrophysics, medical imaging and high energy physics (HEP) experiments. In HEP experiments, in particular, they are often exposed to significant radiation doses. The main purpose of this manuscript is the characterization of several FBK SiPM technologies when exposed to 74 MeV protons with a total fluence comparable to the one that they would experience in space along circular Low Earth Orbits (LEO), Polar, during a five years mission. In this work, we estimated the expected proton fluences along the selected orbit, by means of the SPENVIS software. Several fluence steps were chosen to consider dense fluence intervals and have a more accurate sight on the whole damage process. We estimated a maximum fluence achieved during the tests of 6.4 times 10 11 n eq cm 2 . Based on such simulations, we irradiated several SiPM technologies. We developed a custom experimental setup, which was used to perform online reverse voltage current, right after each irradiation step, to minimize the effect of the annealing on the measurement. The results are then displayed, in particular the currents, the noise and the Photon Detection Efficiency. Also a 30 days study on the annealing of the devices was performed. Lastly, the conclusions are drawn on the basis of the Signal to Noise Ratio (SNR), taking into account the standard parameters of famous satellites using similar orbits as the ones considered into this work.


A Software Architecture Teacher's Dilemmas. An instructor teaching a course on Software Architecture needs to be more reflective to engage students productively in the learning activities. In this reflective essay, the author identifies a few decisive moments referred to as instructional dilemmas at which a teacher reflects upon choices and their consequences so that meaningful learning happens. These situations are referred to as dilemmas because they offer two options to instructors. Some of these dilemmas arise from the inherent nature of Software Architecture as a discipline, while the source of others is the background knowledge of learners. The paper suggests a set of principles and small teaching methods to make teaching and learning more effective in such situations.


Limiting Betti distributions of Hilbert schemes on n points. Hausel and Rodriguez Villegas recently observed that work of G "ottsche, combined with a classical result of Erd H o s and Lehner on integer partitions, implies that the limiting Betti distribution for the Hilbert schemes ( mathbb C 2) n on n points, as n rightarrow infty, is a textit Gumbel distribution . In view of this example, they ask for further such Betti distributions. We answer this question for the quasihomogeneous Hilbert schemes (( mathbb C 2) n ) T alpha, beta that are cut out by torus actions. We prove that their limiting distributions are also of Gumbel type. To obtain this result, we combine work of Buryak, Feigin, and Nakajima on these Hilbert schemes with our generalization of the result of Erd H o s and Lehner, which gives the distribution of the number of parts in partitions that are multiples of a fixed integer A geq 2. Furthermore, if p k(A n) denotes the number of partitions of n with exactly k parts that are multiples of A , then we obtain the asymptotic p k(A,n) sim frac 24 frac k2 frac14 (n Ak) frac k2 frac34 sqrt2 left(1 frac1A right) frac k2 frac14 k!A k frac12 (2 pi) k e 2 pi sqrt frac1 6 left(1 frac1A right)(n Ak) , a result which is of independent interest.


Existence and regularity for global solutions including breaking waves from Camassa Holm and Novikov equations to lambda family equations. In this paper, we prove the global existence of H "older continuous solutions for the Cauchy problem of a family of partial differential equations, named as lambda family equations, where lambda is the power of nonlinear wave speed. The lambda family equations include Camassa Holm equation ( lambda 1 ) and Novikov equation ( lambda 2 ) modelling water waves, where solutions generically form finite time cusp singularities, or in another word, show wave breaking phenomenon. The global energy conservative solution we construct is H "older continuous with exponent 1 frac 1 2 lambda . The existence result also paves the way for the future study on uniqueness and Lipschitz continuous dependence.


ZEN 2.0 Continue Training and Adaption for N gram Enhanced Text Encoders. Pre trained text encoders have drawn sustaining attention in natural language processing (NLP) and shown their capability in obtaining promising results in different tasks. Recent studies illustrated that external self supervised signals (or knowledge extracted by unsupervised learning, such as n grams) are beneficial to provide useful semantic evidence for understanding languages such as Chinese, so as to improve the performance on various downstream tasks accordingly. To further enhance the encoders, in this paper, we propose to pre train n gram enhanced encoders with a large volume of data and advanced techniques for training. Moreover, we try to extend the encoder to different languages as well as different domains, where it is confirmed that the same architecture is applicable to these varying circumstances and new state of the art performance is observed from a long list of NLP tasks across languages and domains.


Weakly supervised High resolution Segmentation of Mammography Images for Breast Cancer Diagnosis. In the last few years, deep learning classifiers have shown promising results in image based medical diagnosis. However, interpreting the outputs of these models remains a challenge. In cancer diagnosis, interpretability can be achieved by localizing the region of the input image responsible for the output, i.e. the location of a lesion. Alternatively, segmentation or detection models can be trained with pixel wise annotations indicating the locations of malignant lesions. Unfortunately, acquiring such labels is labor intensive and requires medical expertise. To overcome this difficulty, weakly supervised localization can be utilized. These methods allow neural network classifiers to output saliency maps highlighting the regions of the input most relevant to the classification task (e.g. malignant lesions in mammograms) using only image level labels (e.g. whether the patient has cancer or not) during training. When applied to high resolution images, existing methods produce low resolution saliency maps. This is problematic in applications in which suspicious lesions are small in relation to the image size. In this work, we introduce a novel neural network architecture to perform weakly supervised segmentation of high resolution images. The proposed model selects regions of interest via coarse level localization, and then performs fine grained segmentation of those regions. We apply this model to breast cancer diagnosis with screening mammography, and validate it on a large clinically realistic dataset. Measured by Dice similarity score, our approach outperforms existing methods by a large margin in terms of localization performance of benign and malignant lesions, relatively improving the performance by 39.6 and 20.0 , respectively. Code and the weights of some of the models are available at https github.com nyukat GLAM


TESSERACT Gradient Flip Score to Secure Federated Learning Against Model Poisoning Attacks. Federated learning multi party, distributed learning in a decentralized environment is vulnerable to model poisoning attacks, even more so than centralized learning approaches. This is because malicious clients can collude and send in carefully tailored model updates to make the global model inaccurate. This motivated the development of Byzantine resilient federated learning algorithms, such as Krum, Bulyan, FABA, and FoolsGold. However, a recently developed untargeted model poisoning attack showed that all prior defenses can be bypassed. The attack uses the intuition that simply by changing the sign of the gradient updates that the optimizer is computing, for a set of malicious clients, a model can be diverted from the optima to increase the test error rate. In this work, we develop TESSERACT a defense against this directed deviation attack, a state of the art model poisoning attack. TESSERACT is based on a simple intuition that in a federated learning setting, certain patterns of gradient flips are indicative of an attack. This intuition is remarkably stable across different learning algorithms, models, and datasets. TESSERACT assigns reputation scores to the participating clients based on their behavior during the training phase and then takes a weighted contribution of the clients. We show that TESSERACT provides robustness against even a white box version of the attack.


On a conjecture of Debs and Saint Raymond. Borel separation rank of an analytic ideal mathcal I on omega is the minimal ordinal alpha omega 1 such that there is mathcal S in bf Sigma 0 1 alpha with mathcal I subseteq mathcal S and mathcal I star cap mathcal S emptyset , where mathcal I star is the filter dual to the ideal mathcal I . Answering in negative a question of G. Debs and J. Saint Raymond Fund. Math. 204 (2009), no. 3 , we construct a Borel ideal of rank 2 which does not contain an isomorphic copy of the ideal text Fin 3 .


A distributed, plug n play algorithm for multi robot applications with a priori non computable objective functions. This paper presents a distributed algorithm applicable to a wide range of practical multi robot applications. In such multi robot applications, the user defined objectives of the mission can be cast as a general optimization problem, without explicit guidelines of the subtasks per different robot. Owing to the unknown environment, unknown robot dynamics, sensor nonlinearities, etc., the analytic form of the optimization cost function is not available a priori. Therefore, standard gradient descent like algorithms are not applicable to these problems. To tackle this, we introduce a new algorithm that carefully designs each robot's subcost function, the optimization of which can accomplish the overall team objective. Upon this transformation, we propose a distributed methodology based on the cognitive based adaptive optimization (CAO) algorithm, that is able to approximate the evolution of each robot's cost function and to adequately optimize its decision variables (robot actions). The latter can be achieved by online learning only the problem specific characteristics that affect the accomplishment of mission objectives. The overall, low complexity algorithm can straightforwardly incorporate any kind of operational constraint, is fault tolerant, and can appropriately tackle time varying cost functions. A cornerstone of this approach is that it shares the same convergence characteristics as those of block coordinate descent algorithms. The proposed algorithm is evaluated in three heterogeneous simulation set ups under multiple scenarios, against both general purpose and problem specific algorithms. Source code is available at https github.com athakapo A distributed plug n play algorithm for multi robot applications.


Equivariant Kirchberg Phillips type absorption for the Razak Jacelon algebra. Let A and B be simple separable nuclear monotracial C algebras, and let alpha and beta be strongly outer actions of a countable discrete amenable group Gamma on A and B , respectively. In this paper, we show that alpha otimes mathrm id mathcal W on A otimes mathcal W and beta otimes mathrm id mathcal W on B otimes mathcal W are cocycle conjugate where mathcal W is the Razak Jacelon algebra. Also, we characterize such actions by using the fixed point subalgebras of Kirchberg's central sequence C algebras.


A novel method for object detection using deep learning and CAD models. Object Detection (OD) is an important computer vision problem for industry, which can be used for quality control in the production lines, among other applications. Recently, Deep Learning (DL) methods have enabled practitioners to train OD models performing well on complex real world images. However, the adoption of these models in industry is still limited by the difficulty and the significant cost of collecting high quality training datasets. On the other hand, when applying OD to the context of production lines, CAD models of the objects to be detected are often available. In this paper, we introduce a fully automated method that uses a CAD model of an object and returns a fully trained OD model for detecting this object. To do this, we created a Blender script that generates realistic labeled datasets of images containing the object, which are then used for training the OD model. The method is validated experimentally on two practical examples, showing that this approach can generate OD models performing well on real images, while being trained only on synthetic images. The proposed method has potential to facilitate the adoption of object detection models in industry as it is easy to adapt for new objects and highly flexible. Hence, it can result in significant costs reduction, gains in productivity and improved products quality.


GaitPrivacyON Privacy Preserving Mobile Gait Biometrics using Unsupervised Learning. Numerous studies in the literature have already shown the potential of biometrics on mobile devices for authentication purposes. However, it has been shown that, the learning processes associated to biometric systems might expose sensitive personal information about the subjects. This study proposes GaitPrivacyON, a novel mobile gait biometrics verification approach that provides accurate authentication results while preserving the sensitive information of the subject. It comprises two modules i) a convolutional Autoencoder that transforms attributes of the biometric raw data, such as the gender or the activity being performed, into a new privacy preserving representation and ii) a mobile gait verification system based on the combination of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) with a Siamese architecture. The main advantage of GaitPrivacyON is that the first module (convolutional Autoencoder) is trained in an unsupervised way, without specifying the sensitive attributes of the subject to protect. The experimental results achieved using two popular databases (MotionSense and MobiAct) suggest the potential of GaitPrivacyON to significantly improve the privacy of the subject while keeping user authentication results higher than 99 Area Under the Curve (AUC). To the best of our knowledge, this is the first mobile gait verification approach that considers privacy preserving methods trained in an unsupervised way.


Robust Training of Social Media Image Classification Models for Rapid Disaster Response. Images shared on social media help crisis managers gain situational awareness and assess incurred damages, among other response tasks. As the volume and velocity of such content are typically high, real time image classification has become an urgent need for a faster disaster response. Recent advances in computer vision and deep neural networks have enabled the development of models for real time image classification for a number of tasks, including detecting crisis incidents, filtering irrelevant images, classifying images into specific humanitarian categories, and assessing the severity of the damage. To develop robust real time models, it is necessary to understand the capability of the publicly available pre trained models for these tasks, which remains to be under explored in the crisis informatics literature. In this study, we address such limitations by investigating ten different network architectures for four different tasks using the largest publicly available datasets for these tasks. We also explore various data augmentation strategies, semi supervised techniques, and a multitask learning setup. In our extensive experiments, we achieve promising results.


On Specialization of a Program Model of Naive Pattern Matching in Strings (Extended Abstract). We have proved that for any pattern p the tail recursive program model of naive pattern matching may be automatically specialized w.r.t. the pattern p to a specialized version of the so called KMP algorithm, using the Higman Kruskal relation that controls the unfolding folding. Given an input string, the corresponding residual program finds the first occurrence of p in the string in linear time on the string length. The current state of the automated program specialization art based on unfolding folding is too weak in order to be able to reproduce the proof, done by hands, of the uniform property above, while it known before that program specialization is sometimes able to produce the KMP algorithm for a few concrete static patterns.


DP Image Differential Privacy for Image Data in Feature Space. The excessive use of images in social networks, government databases, and industrial applications has posed great privacy risks and raised serious concerns from the public. Even though differential privacy (DP) is a widely accepted criterion that can provide a provable privacy guarantee, the application of DP on unstructured data such as images is not trivial due to the lack of a clear qualification on the meaningful difference between any two images. In this paper, for the first time, we introduce a novel notion of image aware differential privacy, referred to as DP image, that can protect user's personal information in images, from both human and AI adversaries. The DP Image definition is formulated as an extended version of traditional differential privacy, considering the distance measurements between feature space vectors of images. Then we propose a mechanism to achieve DP Image by adding noise to an image feature vector. Finally, we conduct experiments with a case study on face image privacy. Our results show that the proposed DP Image method provides excellent DP protection on images, with a controllable distortion to faces.


SignBERT Pre Training of Hand Model Aware Representation for Sign Language Recognition. Hand gesture serves as a critical role in sign language. Current deep learning based sign language recognition (SLR) methods may suffer insufficient interpretability and overfitting due to limited sign data sources. In this paper, we introduce the first self supervised pre trainable SignBERT with incorporated hand prior for SLR. SignBERT views the hand pose as a visual token, which is derived from an off the shelf pose extractor. The visual tokens are then embedded with gesture state, temporal and hand chirality information. To take full advantage of available sign data sources, SignBERT first performs self supervised pre training by masking and reconstructing visual tokens. Jointly with several mask modeling strategies, we attempt to incorporate hand prior in a model aware method to better model hierarchical context over the hand sequence. Then with the prediction head added, SignBERT is fine tuned to perform the downstream SLR task. To validate the effectiveness of our method on SLR, we perform extensive experiments on four public benchmark datasets, i.e., NMFs CSL, SLR500, MSASL and WLASL. Experiment results demonstrate the effectiveness of both self supervised learning and imported hand prior. Furthermore, we achieve state of the art performance on all benchmarks with a notable gain.


Learning to Detect Few Shot Few Clue Misinformation. The quality of digital information on the web has been disquieting due to the lack of careful manual review. Consequently, a large volume of false textual information has been disseminating for a long time since the prevalence of social media. The potential negative influence of misinformation on the public is a growing concern. Therefore, it is strongly motivated to detect online misinformation as early as possible. Few shot few clue learning applies in this misinformation detection task when the number of annotated statements is quite few (called few shots) and the corresponding evidence is also quite limited in each shot (called few clues). Within the few shot few clue framework, we propose a Bayesian meta learning algorithm to extract the shared patterns among different topics (i.e.different tasks) of misinformation. Moreover, we derive a scalable method, i.e., amortized variational inference, to optimize the Bayesian meta learning algorithm. Empirical results on three benchmark datasets demonstrate the superiority of our algorithm. This work focuses more on optimizing parameters than designing detection models, and will generate fresh insights into data efficient detection of online misinformation at early stages.


Embedding Information onto a Dynamical System. The celebrated Takens' embedding theorem concerns embedding an attractor of a dynamical system in a Euclidean space of appropriate dimension through a generic delay observation map. The embedding also establishes a topological conjugacy. In this paper, we show how an arbitrary sequence can be mapped into another space as an attractive solution of a nonautonomous dynamical system. Such mapping also entails a topological conjugacy and an embedding between the sequence and the attractive solution spaces. This result is not a generalization of Takens embedding theorem but helps us understand what exactly is required by discrete time state space models widely used in applications to embed an external stimulus onto its solution space. Our results settle another basic problem concerning the perturbation of an autonomous dynamical system. We describe what exactly happens to the dynamics when exogenous noise perturbs continuously a local irreducible attracting set (such as a stable fixed point) of a discrete time autonomous dynamical system.


Pale Transformer A General Vision Transformer Backbone with Pale Shaped Attention. Recently, Transformers have shown promising performance in various vision tasks. To reduce the quadratic computation complexity caused by the global self attention, various methods constrain the range of attention within a local region to improve its efficiency. Consequently, their receptive fields in a single attention layer are not large enough, resulting in insufficient context modeling. To address this issue, we propose a Pale Shaped self Attention (PS Attention), which performs self attention within a pale shaped region. Compared to the global self attention, PS Attention can reduce the computation and memory costs significantly. Meanwhile, it can capture richer contextual information under the similar computation complexity with previous local self attention mechanisms. Based on the PS Attention, we develop a general Vision Transformer backbone with a hierarchical architecture, named Pale Transformer, which achieves 83.4 , 84.3 , and 84.9 Top 1 accuracy with the model size of 22M, 48M, and 85M respectively for 224 ImageNet 1K classification, outperforming the previous Vision Transformer backbones. For downstream tasks, our Pale Transformer backbone performs better than the recent state of the art CSWin Transformer by a large margin on ADE20K semantic segmentation and COCO object detection instance segmentation. The code will be released on https github.com BR IDL PaddleViT.


Collaborative Filtering Approach to Link Prediction. Link prediction is a fundamental challenge in network science. Among various methods, local similarity indices are widely used for their high cost performance. However, the performance is less robust for some networks local indices are highly competitive to state of the art algorithms while for some other networks they are very poor. Inspired by techniques developed for recommender systems, we propose an enhancement framework for local indices based on collaborative filtering (CF). Considering the delicate but important difference between personalized recommendation and link prediction, we further propose an improved framework named as self included collaborative filtering (SCF). The SCF framework significantly improved the accuracy and robustness of well known local indices. The combination of SCF framework and a simple local index can produce an index with competitive performance and much lower complexity compared with elaborately designed state of the art algorithms.


Explainable Deep Learning in Healthcare A Methodological Survey from an Attribution View. The increasing availability of large collections of electronic health record (EHR) data and unprecedented technical advances in deep learning (DL) have sparked a surge of research interest in developing DL based clinical decision support systems for diagnosis, prognosis, and treatment. Despite the recognition of the value of deep learning in healthcare, impediments to further adoption in real healthcare settings remain due to the black box nature of DL. Therefore, there is an emerging need for interpretable DL, which allows end users to evaluate the model decision making to know whether to accept or reject predictions and recommendations before an action is taken. In this review, we focus on the interpretability of the DL models in healthcare. We start by introducing the methods for interpretability in depth and comprehensively as a methodological reference for future researchers or clinical practitioners in this field. Besides the methods' details, we also include a discussion of advantages and disadvantages of these methods and which scenarios each of them is suitable for, so that interested readers can know how to compare and choose among them for use. Moreover, we discuss how these methods, originally developed for solving general domain problems, have been adapted and applied to healthcare problems and how they can help physicians better understand these data driven technologies. Overall, we hope this survey can help researchers and practitioners in both artificial intelligence (AI) and clinical fields understand what methods we have for enhancing the interpretability of their DL models and choose the optimal one accordingly.


Learning General Optimal Policies with Graph Neural Networks Expressive Power, Transparency, and Limits. It has been recently shown that general policies for many classical planning domains can be expressed and learned in terms of a pool of features defined from the domain predicates using a description logic grammar. At the same time, most description logics correspond to a fragment of k variable counting logic ( C k ) for k 2 , that has been shown to provide a tight characterization of the expressive power of graph neural networks. In this work, we make use of these results to understand the power and limits of using graph neural networks (GNNs) for learning optimal general policies over a number of tractable planning domains where such policies are known to exist. For this, we train a simple GNN in a supervised manner to approximate the optimal value function V (s) of a number of sample states s . As predicted by the theory, it is observed that general optimal policies are obtained in domains where general optimal value functions can be defined with C 2 features but not in those requiring more expressive C 3 features. In addition, it is observed that the features learned are in close correspondence with the features needed to express V in closed form. The theory and the analysis of the domains let us understand the features that are actually learned as well as those that cannot be learned in this way, and let us move in a principled manner from a combinatorial optimization approach to learning general policies to a potentially, more robust and scalable approach based on deep learning.


Hirschman Widder densities. Hirschman and Widder introduced a class of P 'olya frequency functions given by linear combinations of one sided exponential functions. The members of this class are probability densities, and the class is closed under convolution but not under pointwise multiplication. We show that, generically, a polynomial function of such a density is a P 'olya frequency function only if the polynomial is a homothety, and also identify a subclass for which each positive integer power is a P 'olya frequency function. We further demonstrate connections between the Maclaurin coefficients, the moments of these densities, and the recovery of the density from finitely many moments, via Schur polynomials.


Self Boosted Automated Program Repair. Program repair is an integral part of every software system's life cycle but can be extremely challenging. To date, researchers have proposed various automated program repair (APR) techniques to reduce efforts of manual debugging. However, given a real world buggy program, a typical APR technique usually generates a large number of patches, each of which needs to be validated against the original test suite which incurs extremely high computation costs. Although existing APR techniques have already leveraged various static and or dynamic information to find the desired patches faster, they are still rather costly. In a recent work, researchers proposed unified debugging to leverage the patch execution information during APR to help boost fault localization in this way,the application scope of APR techniques can be extended to all possible bugs, e.g., the patch execution information during APR can help with manual repair of the bugs that cannot be automatically fixed. Inspired by unified debugging, this work proposes SeAPR (Self Boosted Automated Program Repair), the first technique to leverage the earlier patch execution information during APR to help boost automated repair itself on the fly. Our basic intuition is that patches similar to earlier high quality low quality patches should be promoted degraded to speed up the detection of the desired patches. This experimental study on 12 state of the art APR systems demonstrates that, overall, SeAPR can substantially reduce the number of patch executions with negligible overhead. Our study also investigates the impact of various configurations on SeAPR. Lastly, our study demonstrates that SeAPR can even leverage the patch execution information from other APR tools from the same buggy program to further boost APR.


Multi Label Learning from Single Positive Labels. Predicting all applicable labels for a given image is known as multi label classification. Compared to the standard multi class case (where each image has only one label), it is considerably more challenging to annotate training data for multi label classification. When the number of potential labels is large, human annotators find it difficult to mention all applicable labels for each training image. Furthermore, in some settings detection is intrinsically difficult e.g. finding small object instances in high resolution images. As a result, multi label training data is often plagued by false negatives. We consider the hardest version of this problem, where annotators provide only one relevant label for each image. As a result, training sets will have only one positive label per image and no confirmed negatives. We explore this special case of learning from missing labels across four different multi label image classification datasets for both linear classifiers and end to end fine tuned deep networks. We extend existing multi label losses to this setting and propose novel variants that constrain the number of expected positive labels during training. Surprisingly, we show that in some cases it is possible to approach the performance of fully labeled classifiers despite training with significantly fewer confirmed labels.


A Survey of RDF Stores SPARQL Engines for Querying Knowledge Graphs. RDF has seen increased adoption in recent years, prompting the standardization of the SPARQL query language for RDF, and the development of local and distributed engines for processing SPARQL queries. This survey paper provides a comprehensive review of techniques and systems for querying RDF knowledge graphs. While other reviews on this topic tend to focus on the distributed setting, the main focus of the work is on providing a comprehensive survey of state of the art storage, indexing and query processing techniques for efficiently evaluating SPARQL queries in a local setting (on one machine). To keep the survey self contained, we also provide a short discussion on graph partitioning techniques used in the distributed setting. We conclude by discussing contemporary research challenges for further improving SPARQL query engines. This extended version also provides a survey of over one hundred SPARQL query engines and the techniques they use, along with twelve benchmarks and their features.


Fractional powers of higher order vector operators on bounded and unbounded domains. Using the H infty functional calculus for quaternionic operators, we show how to generate the fractional powers of some densely defined differential quaternionic operators of order m geq 1 , acting on the right linear quaternionic Hilbert space L 2( Omega, mathbb C otimes mathbb H) . The operators that we consider are of the type T i m 1 left(a 1(x) e 1 partial x 1 m a 2(x) e 2 partial x 2 m a 3(x) e 3 partial x 3 m right), x (x 1, , x 2, , x 3) in overline Omega , where overline Omega is the closure of either a bounded domain Omega with C 1 boundary, or an unbounded domain Omega in mathbb R 3 with a sufficiently regular boundary which satisfy the so called property (R) , e 1, , e 2, , e 3 is an orthonormal basis for the imaginary units of mathbb H , a 1, ,a 2, , a 3 overline Omega subset mathbb R 3 to mathbb R are the coefficients of T . In particular it will be given sufficient conditions on the coefficients of T in order to generate the fractional powers of T , denoted by P alpha (T) for alpha in(0,1) , when the components of T , i.e. the operators T l a l partial x l m , do not commute among themselves.


SASG Sparsification with Adaptive Stochastic Gradients for Communication efficient Distributed Learning. Stochastic optimization algorithms implemented on distributed computing architectures are increasingly used to tackle large scale machine learning applications. A key bottleneck in such distributed systems is the communication overhead for exchanging information such as stochastic gradients between different workers. Sparse communication with memory and the adaptive aggregation methodology are two successful frameworks among the various techniques proposed to address this issue. In this paper, we exploit the advantages of Sparse communication and Adaptive aggregated Stochastic Gradients to design a communication efficient distributed algorithm named SASG. Specifically, we determine the workers who need to communicate with the parameter server based on the adaptive aggregation rule and then sparsify the transmitted information. Therefore, our algorithm reduces both the overhead of communication rounds and the number of communication bits in the distributed system. We define an auxiliary sequence and provide convergence results of the algorithm with the help of Lyapunov function analysis. Experiments on training deep neural networks show that our algorithm can significantly reduce the communication overhead compared to the previous methods, with little impact on training and testing accuracy.


The Volatility of Returns and Variable Strategies. This paper examines the relationship between casino rules, players' gambling strategies, and their expected returns, and derives the formula about the players' expected return.


Are We There Yet? Learning to Localize in Embodied Instruction Following. Embodied instruction following is a challenging problem requiring an agent to infer a sequence of primitive actions to achieve a goal environment state from complex language and visual inputs. Action Learning From Realistic Environments and Directives (ALFRED) is a recently proposed benchmark for this problem consisting of step by step natural language instructions to achieve subgoals which compose to an ultimate high level goal. Key challenges for this task include localizing target locations and navigating to them through visual inputs, and grounding language instructions to visual appearance of objects. To address these challenges, in this study, we augment the agent's field of view during navigation subgoals with multiple viewing angles, and train the agent to predict its relative spatial relation to the target location at each timestep. We also improve language grounding by introducing a pre trained object detection module to the model pipeline. Empirical studies show that our approach exceeds the baseline model performance.


Group based Motion Prediction for Navigation in Crowded Environments. We focus on the problem of planning the motion of a robot in a dynamic multiagent environment such as a pedestrian scene. Enabling the robot to navigate safely and in a socially compliant fashion in such scenes requires a representation that accounts for the unfolding multiagent dynamics. Existing approaches to this problem tend to employ microscopic models of motion prediction that reason about the individual behavior of other agents. While such models may achieve high tracking accuracy in trajectory prediction benchmarks, they often lack an understanding of the group structures unfolding in crowded scenes. Inspired by the Gestalt theory from psychology, we build a Model Predictive Control framework (G MPC) that leverages group based prediction for robot motion planning. We conduct an extensive simulation study involving a series of challenging navigation tasks in scenes extracted from two real world pedestrian datasets. We illustrate that G MPC enables a robot to achieve statistically significantly higher safety and lower number of group intrusions than a series of baselines featuring individual pedestrian motion prediction models. Finally, we show that G MPC can handle noisy lidar scan estimates without significant performance losses.


Adversarial Training is Not Ready for Robot Learning. Adversarial training is an effective method to train deep learning models that are resilient to norm bounded perturbations, with the cost of nominal performance drop. While adversarial training appears to enhance the robustness and safety of a deep model deployed in open world decision critical applications, counterintuitively, it induces undesired behaviors in robot learning settings. In this paper, we show theoretically and experimentally that neural controllers obtained via adversarial training are subjected to three types of defects, namely transient, systematic, and conditional errors. We first generalize adversarial training to a safety domain optimization scheme allowing for more generic specifications. We then prove that such a learning process tends to cause certain error profiles. We support our theoretical results by a thorough experimental safety analysis in a robot learning task. Our results suggest that adversarial training is not yet ready for robot learning.


On Bridging Generic and Personalized Federated Learning. Federated learning is promising for its ability to collaboratively train models with multiple clients without accessing their data, but vulnerable when clients' data distributions diverge from each other. This divergence further leads to a dilemma "Should we prioritize the learned model's generic performance (for future use at the server) or its personalized performance (for each client)?" These two, seemingly competing goals have divided the community to focus on one or the other, yet in this paper we show that it is possible to approach both at the same time. Concretely, we propose a novel federated learning framework that explicitly decouples a model's dual duties with two prediction tasks. On the one hand, we introduce a family of losses that are robust to non identical class distributions, enabling clients to train a generic predictor with a consistent objective across them. On the other hand, we formulate the personalized predictor as a lightweight adaptive module that is learned to minimize each client's empirical risk on top of the generic predictor. With this two loss, two predictor framework which we name Federated Robust Decoupling Fed RoD, the learned model can simultaneously achieve state of the art generic and personalized performance, essentially bridging the two tasks.


Characterizing The Limits of Linear Modeling of Non Linear Swarm Behaviors. We study the limits of linear modeling of swarm behavior by characterizing the inflection point beyond which linear models of swarm collective behavior break down. The problem we consider is a central place object gathering task. We design a linear model which strives to capture the underlying dynamics of object gathering in robot swarms from first principles, rather than extensively relying on post hoc model fitting. We evaluate our model with swarms of up to 8,000 robots in simulation, demonstrating that it accurately captures underlying swarm behavioral dynamics when the swarm can be approximated using the mean field model, and when it cannot, and finite size effects are present. We further apply our model to swarms exhibiting non linear behaviors, and show that it still provides accurate predictions in some scenarios, thereby establishing better practical limits on linear modeling of swarm behaviors.


Taming Wild Price Fluctuations Monotone Stochastic Convex Optimization with Bandit Feedback. Prices generated by automated price experimentation algorithms often display wild fluctuations, leading to unfavorable customer perceptions and violations of individual fairness e.g., the price seen by a customer can be significantly higher than what was seen by her predecessors, only to fall once again later. To address this concern, we propose demand learning under a monotonicity constraint on the sequence of prices, within the framework of stochastic convex optimization with bandit feedback. Our main contribution is the design of the first sublinear regret algorithms for monotonic price experimentation for smooth and strongly concave revenue functions under noisy as well as noiseless bandit feedback. The monotonicity constraint presents a unique challenge since any increase (or decrease) in the decision levels is final, an algorithm needs to be cautious in its exploration to avoid over shooting the optimum. At the same time, minimizing regret requires that progress be made towards the optimum at a sufficient pace. Balancing these two goals is particularly challenging under noisy feedback, where obtaining sufficiently accurate gradient estimates is expensive. Our key innovation is to utilize conservative gradient estimates to adaptively tailor the degree of caution to local gradient information, being aggressive far from the optimum and being increasingly cautious as the prices approach the optimum. Importantly, we show that our algorithms guarantee the same regret rates (up to logarithmic factors) as the best achievable rates of regret without the monotonicity requirement.


OpenHumidistat Humidity controlled experiments for everyone. Humidity control is a crucial element for a wide variety of experiments. Yet, often naive methods are used that do not yield stable regulation of the humidity, are slow, or are inflexible. PID based electropneumatic humidistats solve these problems, but commercial devices are not widespread, typically proprietary and or prohibitively expensive. Here we describe OpenHumidistat a free and open source humidistat for laboratory scale humidity control that is affordable ( 500 EUR) and easy to build. The design is based around mixing a humid and dry air flow in varying proportions, using proportional solenoid valves and flow sensors to control flow rates. The mixed flow is led into a measurement chamber, which contains a humidity sensor to provide feedback to the controller, to achieve closed loop humidity control.


Identifying and Mitigating Gender Bias in Hyperbolic Word Embeddings. Euclidean word embedding models such as GloVe and Word2Vec have been shown to reflect human like gender biases. In this paper, we extend the study of gender bias to the recently popularized hyperbolic word embeddings. We propose gyrocosine bias, a novel measure for quantifying gender bias in hyperbolic word representations and observe a significant presence of gender bias. To address this problem, we propose Poincar 'e Gender Debias (PGD), a novel debiasing procedure for hyperbolic word representations. Experiments on a suit of evaluation tests show that PGD effectively reduces bias while adding a minimal semantic offset.


On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons. Given a dense shallow neural network, we focus on iteratively creating, training, and combining randomly selected subnetworks (surrogate functions), towards training the full model. By carefully analyzing i) the subnetworks' neural tangent kernel, ii) the surrogate functions' gradient, and iii) how we sample and combine the surrogate functions, we prove linear convergence rate of the training error within an error region for an overparameterized single hidden layer perceptron with ReLU activations for a regression task. Our result implies that, for fixed neuron selection probability, the error term decreases as we increase the number of surrogate models, and increases as we increase the number of local training steps for each selected subnetwork. The considered framework generalizes and provides new insights on dropout training, multi sample dropout training, as well as Independent Subnet Training for each case, we provide corresponding convergence results, as corollaries of our main theorem.


Learning, Computing, and Trustworthiness in Intelligent IoT Environments Performance Energy Tradeoffs. An Intelligent IoT Environment (iIoTe) is comprised of heterogeneous devices that can collaboratively execute semi autonomous IoT applications, examples of which include highly automated manufacturing cells or autonomously interacting harvesting machines. Energy efficiency is key in such edge environments, since they are often based on an infrastructure that consists of wireless and battery run devices, e.g., e tractors, drones, Automated Guided Vehicle (AGV)s and robots. The total energy consumption draws contributions from multipleiIoTe technologies that enable edge computing and communication, distributed learning, as well as distributed ledgers and smart contracts. This paper provides a state of the art overview of these technologies and illustrates their functionality and performance, with special attention to the tradeoff among resources, latency, privacy and energy consumption. Finally, the paper provides a vision for integrating these enabling technologies in energy efficient iIoTe and a roadmap to address the open research challenges


Long Time Behaviour of Shape Design Solutions for the Navier Stokes Equations. We investigate the behavior of dynamic shape design problems for fluid flow at large time horizon. In particular, we shall compare the shape solutions of a dynamic shape optimization problem with that of a stationary problem and show that the solution of the former approaches a neighborhood of that of the latter. The convergence of domains is based on the L infty topology of their corresponding characteristic functions which is closed under the set of domains satisfying the cone property. As a consequence, we show that the asymptotic convergence of shape solutions for parabolic elliptic problems is a particular case of our analysis. Lastly, a numerical example is provided to show the occurrence of the convergence of shape design solutions of time dependent problems with different values of the terminal time T to a shape design solution of the stationary problem.


Periodic orbits in R "ossler system. We prove the existence of n periodic orbits for almost all n in mathbb N in the R "ossler system with attracting periodic orbit, for two sets of parameters. The proofs are computer assisted.


Improving Building Segmentation for Off Nadir Satellite Imagery. Automatic building segmentation is an important task for satellite imagery analysis and scene understanding. Most existing segmentation methods focus on the case where the images are taken from directly overhead (i.e., low off nadir viewing angle). These methods often fail to provide accurate results on satellite images with larger off nadir angles due to the higher noise level and lower spatial resolution. In this paper, we propose a method that is able to provide accurate building segmentation for satellite imagery captured from a large range of off nadir angles. Based on Bayesian deep learning, we explicitly design our method to learn the data noise via aleatoric and epistemic uncertainty modeling. Satellite image metadata (e.g., off nadir angle and ground sample distance) is also used in our model to further improve the result. We show that with uncertainty modeling and metadata injection, our method achieves better performance than the baseline method, especially for noisy images taken from large off nadir angles.


Multi level Random Walk. We consider two multi level discrete random walks. In the first one a particle can move at two levels and jump from one level to another level. At each level also absorption can happen in any state. In the second random walk we have an infinite number of levels and the particle can move on any level and jump to a higher level. In this case also absorption can happen at any level in any state. We obtain absorption probabilities and the value of the random walk.


Semi Supervised Video Deraining with Dynamical Rain Generator. While deep learning (DL) based video deraining methods have achieved significant success recently, they still exist two major drawbacks. Firstly, most of them do not sufficiently model the characteristics of rain layers of rainy videos. In fact, the rain layers exhibit strong physical properties (e.g., direction, scale and thickness) in spatial dimension and natural continuities in temporal dimension, and thus can be generally modelled by the spatial temporal process in statistics. Secondly, current DL based methods seriously depend on the labeled synthetic training data, whose rain types are always deviated from those in unlabeled real data. Such gap between synthetic and real data sets leads to poor performance when applying them in real scenarios. Against these issues, this paper proposes a new semi supervised video deraining method, in which a dynamic rain generator is employed to fit the rain layer, expecting to better depict its insightful characteristics. Specifically, such dynamic generator consists of one emission model and one transition model to simultaneously encode the spatially physical structure and temporally continuous changes of rain streaks, respectively, which both are parameterized as deep neural networks (DNNs). Further more, different prior formats are designed for the labeled synthetic and unlabeled real data, so as to fully exploit the common knowledge underlying them. Last but not least, we also design a Monte Carlo EM algorithm to solve this model. Extensive experiments are conducted to verify the superiorities of the proposed semi supervised deraining model.


SenseRT A Streaming Architecture for Smart Building Sensors. Building Management Systems (BMSs) have evolved in recent years, in ways that require changes to existing network architectures that follow the store then analyse approach. The primary cause is the increasing deployment of a diverse range of cost effective sensors and actuators in smart buildings that generate real time streaming data. Any in building system with a large number of sensors needs a framework for real time data collection and concurrent stream processing from sensors connected using a range of networks. We present SenseRT, a system for managing and analysing in building real time streams of sensor data. SenseRT collects streams of real time data from sensors connected using a range of network protocols. It supports concurrent modules simultaneously performing stream processing over real time data, asynchronously and non blocking, with results made available with minimal latency. We describe a prototype implementation deployed in two University department buildings, demonstrating its effectiveness.


Smooth Fields of Operators and Some Examples Coming from Canonical Quantization. We introduce a notion of smooth fields of operators following the notion of smooth fields of Hilbert spaces recently defined by L. Lempert and R. Sz H o oke arXiv 1004.4863(2) . Formally, if nabla is the connection of a smooth field of Hilbert spaces we show that hat nabla nabla, cdot defines a connection on a suitable space of fields of operators. In order to provide examples we prove that, if u is a suitable constant of motion of h(q,p) q 2 (i.e. u,h 0 ), then mathfrak Op (u) is a smooth field of operators over the open interval (0, infty) , where mathfrak Op denotes the canonical quantization (Weyl calculus). Moreover, in such case we show that we can compute derivatives using the formula hat nabla X 0 ( mathfrak Op (u)) mathfrak Op ( tilde nabla X 0 (u)) , where tilde nabla is a Poisson connection on the Poisson algebra of constants of motion and X 0 2 lambda frac partial partial lambda . We also introduce a notion of smooth field of C algebras and we give an example using Hilbert modules theory.


Testing Probabilistic Circuits. Probabilistic circuits (PCs) are a powerful modeling framework for representing tractable probability distributions over combinatorial spaces. In machine learning and probabilistic programming, one is often interested in understanding whether the distributions learned using PCs are close to the desired distribution. Thus, given two probabilistic circuits, a fundamental problem of interest is to determine whether their distributions are close to each other. The primary contribution of this paper is a closeness test for PCs with respect to the total variation distance metric. Our algorithm utilizes two common PC queries, counting and sampling. In particular, we provide a poly time probabilistic algorithm to check the closeness of two PCs when the PCs support tractable approximate counting and sampling. We demonstrate the practical efficiency of our algorithmic framework via a detailed experimental evaluation of a prototype implementation against a set of 475 PC benchmarks. We find that our test correctly decides the closeness of all 475 PCs within 3600 seconds.


Domain Specific Pretraining for Vertical Search Case Study on Biomedical Literature. Information overload is a prevalent challenge in many high value domains. A prominent case in point is the explosion of the biomedical literature on COVID 19, which swelled to hundreds of thousands of papers in a matter of months. In general, biomedical literature expands by two papers every minute, totalling over a million new papers every year. Search in the biomedical realm, and many other vertical domains is challenging due to the scarcity of direct supervision from click logs. Self supervised learning has emerged as a promising direction to overcome the annotation bottleneck. We propose a general approach for vertical search based on domain specific pretraining and present a case study for the biomedical domain. Despite being substantially simpler and not using any relevance labels for training or development, our method performs comparably or better than the best systems in the official TREC COVID evaluation, a COVID related biomedical search competition. Using distributed computing in modern cloud infrastructure, our system can scale to tens of millions of articles on PubMed and has been deployed as Microsoft Biomedical Search, a new search experience for biomedical literature https aka.ms biomedsearch.


Dynamics of flags over wide ranges of mass and bending stiffness. There have been many studies of the instability of a flexible plate or flag to flapping motions, and of large amplitude flapping. Here we use inviscid simulations and a linearized model to study more generally how key quantities mode number (or wavenumber), frequency, and amplitude depend on the two dimensionless parameters, flag mass and bending stiffness. In the limit of small flag mass, flags perform traveling wave motions that move at nearly the speed of the oncoming flow. The flag mode number scales as the 1 4 power of bending stiffness. The flapping frequency has the same scaling, with an additional slight increase with flag mass in the small mass regime. The flapping amplitude scales approximately as flag mass to the 1 2 power. For large flag mass, the dominant mode number is low (0 or 1), the flapping frequency tends to zero, and the amplitude saturates in the neighborhood of its upper limit (the flag length). In a linearized model, the fastest growing modes have somewhat different power law scalings for wavenumber and frequency. We discuss how the numerical scalings are consistent with a weakly nonlinear model.


Memory efficient Transformers via Top k Attention. Following the success of dot product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input length. While these variants are memory and compute efficient, it is not possible to directly use them with popular pre trained language models trained using vanilla attention, without an expensive corrective pre training stage. In this work, we propose a simple yet highly accurate approximation for vanilla attention. We process the queries in chunks, and for each query, compute the top k scores with respect to the keys. Our approach offers several advantages (a) its memory usage is linear in the input size, similar to linear attention variants, such as Performer and RFA (b) it is a drop in replacement for vanilla attention that does not require any corrective pre training, and (c) it can also lead to significant memory savings in the feed forward layers after casting them into the familiar query key value framework. We evaluate the quality of top k approximation for multi head attention layers on the Long Range Arena Benchmark, and for feed forward layers of T5 and UnifiedQA on multiple QA datasets. We show our approach leads to accuracy that is nearly identical to vanilla attention in multiple setups including training from scratch, fine tuning, and zero shot inference.


Leveraging Team Dynamics to Predict Open source Software Projects' Susceptibility to Social Engineering Attacks. Open source software (OSS) is a critical part of the software supply chain. Recent social engineering attacks against OSS development teams have enabled attackers to become code contributors and later inject malicious code or vulnerabilities into the project with the goal of compromising dependent software. The attackers have exploited interactions among development team members and the social dynamics of team behavior to enable their attacks. We introduce a security approach that leverages signatures and patterns of team dynamics to predict the susceptibility of a software development team to social engineering attacks that enable access to the OSS project code. The proposed approach is programming language , platform , and vulnerability agnostic because it assesses the artifacts of OSS team interactions, rather than OSS code.


Private Linear Transformation The Individual Privacy Case. This paper considers the single server Private Linear Transformation (PLT) problem when individual privacy is required. In this problem, there is a user that wishes to obtain L linear combinations of a D subset of messages belonging to a dataset of K messages stored on a single server. The goal is to minimize the download cost while keeping the identity of every message required for the computation individually private. The individual privacy requirement implies that, from the perspective of the server, every message is equally likely to belong to the D subset of messages that constitute the support set of the required linear combinations. We focus on the setting in which the matrix of coefficients pertaining to the required linear combinations is the generator matrix of a Maximum Distance Separable code. We establish lower and upper bounds on the capacity of PLT with individual privacy, where the capacity is defined as the supremum of all achievable download rates. We show that our bounds are tight under certain divisibility conditions. In addition, we present lower bounds on the capacity of the settings in which the user has a prior side information about a subset of messages.


On rate of convergence to the Poisson law of the number of cycles in the generalized random graphs. Convergence of order O(1 sqrt n ) is obtained for the distance in total variation between the Poisson distribution and the distribution of the number of fixed size cycles in generalized random graphs with random vertex weights. The weights are assumed to be independent identically distributed random variables which have a power law distribution. The proof is based on the Chen Stein approach and on the derived properties of the ratio of the sum of squares of random variables and the sum of these variables. These properties can be applied to other asymptotic problems related to generalized random graphs.


Crofton formulas in pseudo Riemannian space forms. Crofton formulas on simply connected Riemannian space forms allow to compute the volumes, or more generally the Lipschitz Killing curvature integrals of a submanifold with corners, by integrating the Euler characteristic of its intersection with all geodesic submanifolds. We develop a framework of Crofton formulas with distributions replacing measures, which has in its core Alesker's Radon transform on valuations. We then apply this framework, and our recent Hadwiger type classification, to compute explicit Crofton formulas for all isometry invariant valuations on all pseudospheres, pseudo Euclidean and pseudohyperbolic spaces. We find that, in essence, a single measure which depends analytically on the metric, gives rise to all those Crofton formulas through its distributional boundary values at parts of the boundary corresponding to the different indefinite signatures. In particular, the Crofton formulas we obtain are formally independent of signature.


Real Space Inversion and Super Resolution of Ultrafast X ray Scattering using Natural Scattering Kernels. Directly resolving in real space multiple atomic motions using ultrafast x ray scattering is generally limited by the finite detector range. As a result, signal interpretation mostly relies on modeling and simulations of specific excitation pathways. Here, we demonstrate an approach to resolve ultrafast diffuse x ray scattering signals in real space and recover multiple atomic motions de novo. We introduce a scattering basis representation that is composed of the measurement parameters and constraints, and the subsequent inversion analysis. We then leverage signal priors, such as smoothness and sparsity to deconvolve and super resolve the spatially transformed signals using convex optimization. We validate the approach on simulated data with detection limits similar to X ray free electron laser experiments and discuss the resolution limits and noise dependence on the accuracy of the recovery.


Harmonic Centrality in Some Graph Families. One of the more recent measures of centrality in social network analysis is the normalized harmonic centrality. A variant of the closeness centrality, harmonic centrality sums the inverse of the geodesic distances of each node to other nodes where it is 0 if there is no path from one node to another. It is then normalized by dividing it by m 1, where m is the number of nodes of the graph. In this paper, we present notions regarding the harmonic centrality of some important classes of graphs.


Stability and Generalization for Randomized Coordinate Descent. Randomized coordinate descent (RCD) is a popular optimization algorithm with wide applications in solving various machine learning problems, which motivates a lot of theoretical analysis on its convergence behavior. As a comparison, there is no work studying how the models trained by RCD would generalize to test examples. In this paper, we initialize the generalization analysis of RCD by leveraging the powerful tool of algorithmic stability. We establish argument stability bounds of RCD for both convex and strongly convex objectives, from which we develop optimal generalization bounds by showing how to early stop the algorithm to tradeoff the estimation and optimization. Our analysis shows that RCD enjoys better stability as compared to stochastic gradient descent.


The Power of Selecting Key Blocks with Local Pre ranking for Long Document Information Retrieval. On a wide range of natural language processing and information retrieval tasks, transformer based models, particularly pre trained language models like BERT, have demonstrated tremendous effectiveness. Due to the quadratic complexity of the self attention mechanism, however, such models have difficulties processing long documents. Recent works dealing with this issue include truncating long documents, in which case one loses potential relevant information, segmenting them into several passages, which may lead to miss some information and high computational complexity when the number of passages is important, or modifying the self attention mechanism to make it sparser as in sparse attention models, at the risk again of missing some information. We follow here a slightly different approach in which one first selects key blocks of a long document by local query block pre ranking, and then few blocks are aggregated to form a short document that can be processed by a model such as BERT. Experiments conducted on standard Information Retrieval datasets demonstrate the effectiveness of the proposed approach.


A finiteness theorem for abelian varieties with totally bad reduction. We show that up to potential isogeny, there are only finitely many abelian varieties of dimension d defined over a number field K , such that for any finite place v outside a fixed finite set S of places of K containing the archimedean places, it has either good reduction at v , or totally bad reduction at v and good reduction over a quadratic extension of the completion of K at v .


A Lightweight Approach to Computing Message Races with an Application to Causal Consistent Reversible Debugging. This paper presents a lightweight formalism (a trace) to model message passing concurrent executions where some common common problems can be identified, like lost or delayed messages, some forms of deadlock, etc. In particular, we consider (potential) message races that can be useful to analyze alternative executions. We consider a particular application for our developments in the context of a causal consistent reversible debugging framework for Erlang programs


Boundaries of graphs of relatively hyperbolic groups with cyclic edge groups. We prove that the fundamental group of a finite graph of convergence groups with parabolic edge groups is a convergence group. Using this result, under some mild assumptions, we prove a combination theorem for a graph of convergence groups with dynamically quasi convex edge groups (Theorem 1.3). To prove these results, we use a modification of Dahmani's technique Dah03 . Then we show that the fundamental group of a graph of relatively hyperbolic groups with edge groups either parabolic or infinite cyclic is relatively hyperbolic and construct Bowditch boundary. Finally, we show that the homeomorphism type of Bowditch boundary of the fundamental group of a graph of relatively hyperbolic groups with parabolic edge groups is determined by the homeomorphism type of the Bowditch boundaries of vertex groups (under some additional hypotheses)(Theorem 7.1). In the last section of the paper, we give some applications and examples.


DILF EN framework for Class Incremental Learning. Deep learning models suffer from catastrophic forgetting of the classes in the older phases as they get trained on the classes introduced in the new phase in the class incremental learning setting. In this work, we show that the effect of catastrophic forgetting on the model prediction varies with the change in orientation of the same image, which is a novel finding. Based on this, we propose a novel data ensemble approach that combines the predictions for the different orientations of the image to help the model retain further information regarding the previously seen classes and thereby reduce the effect of forgetting on the model predictions. However, we cannot directly use the data ensemble approach if the model is trained using traditional techniques. Therefore, we also propose a novel dual incremental learning framework that involves jointly training the network with two incremental learning objectives, i.e., the class incremental learning objective and our proposed data incremental learning objective. In the dual incremental learning framework, each image belongs to two classes, i.e., the image class (for class incremental learning) and the orientation class (for data incremental learning). In class incremental learning, each new phase introduces a new set of classes, and the model cannot access the complete training data from the older phases. In our proposed data incremental learning, the orientation classes remain the same across all the phases, and the data introduced by the new phase in class incremental learning acts as new training data for these orientation classes. We empirically demonstrate that the dual incremental learning framework is vital to the data ensemble approach. We apply our proposed approach to state of the art class incremental learning methods and empirically show that our framework significantly improves the performance of these methods.


Embedding obstructions in mathbb R d from the Goodwillie Weiss calculus and Whitney disks. Given an m dimensional CW complex K , we use a version of the Goodwillie Weiss tower to formulate an obstruction theory for embeddings into a Euclidean space mathbb R d . For 2 complexes in mathbb R 4 a geometric analogue is also introduced, based on intersections of Whitney disks and more generally on the intersection theory of Whitney towers developed by Schneiderman and Teichner. The focus in this paper is on the first obstruction beyond the classical embedding obstruction of van Kampen. In this case we show the two approaches give the same result, and also relate it to the Arnold class in the cohomology of configuration spaces. The obstructions are shown to be realized in a family of examples. Conjectures are formulated, relating higher versions of these homotopy theoretic, geometric and cohomological theories.


Query Evaluation in DatalogMTL Taming Infinite Query Results. In this paper, we investigate finite representations of DatalogMTL models. First, we discuss sufficient conditions for detecting programs that have finite models. Then, we study infinite models that eventually become constant and introduce sufficient criteria for programs that allow for such representation. We proceed by considering infinite models that are eventually periodic and show that such representation encompasses all DatalogMTL FP programs, a widely discussed fragment. Finally, we provide a novel algorithm for reasoning over such finite representable programs.


Coupling of IGA and Peridynamics for Air Blast Fluid Structure Interaction Using an Immersed Approach. We present a novel formulation based on an immersed coupling of Isogeometric Analysis (IGA) and Peridynamics (PD) for the simulation of fluid structure interaction (FSI) phenomena for air blast. We aim to develop a practical computational framework that is capable of capturing the mechanics of air blast coupled to solids and structures that undergo large, inelastic deformations with extreme damage and fragmentation. An immersed technique is used, which involves an a priori monolithic FSI formulation with the implicit detection of the fluid structure interface and without limitations on the solid domain motion. The coupled weak forms of the fluid and structural mechanics equations are solved on the background mesh. Correspondence based PD is used to model the meshfree solid in the foreground domain. We employ the Non Uniform Rational B Splines (NURBS) IGA functions in the background and the Reproducing Kernel Particle Method (RKPM) functions for the PD solid in the foreground. We feel that the combination of these numerical tools is particularly attractive for the problem class of interest due to the higher order accuracy and smoothness of IGA and RKPM, the benefits of using immersed methodology in handling the fluid structure coupling, and the capabilities of PD in simulating fracture and fragmentation scenarios. Numerical examples are provided to illustrate the performance of the proposed air blast FSI framework.


Superpixels and Graph Convolutional Neural Networks for Efficient Detection of Nutrient Deficiency Stress from Aerial Imagery. Advances in remote sensing technology have led to the capture of massive amounts of data. Increased image resolution, more frequent revisit times, and additional spectral channels have created an explosion in the amount of data that is available to provide analyses and intelligence across domains, including agriculture. However, the processing of this data comes with a cost in terms of computation time and money, both of which must be considered when the goal of an algorithm is to provide real time intelligence to improve efficiencies. Specifically, we seek to identify nutrient deficient areas from remotely sensed data to alert farmers to regions that require attention detection of nutrient deficient areas is a key task in precision agriculture as farmers must quickly respond to struggling areas to protect their harvests. Past methods have focused on pixel level classification (i.e. semantic segmentation) of the field to achieve these tasks, often using deep learning models with tens of millions of parameters. In contrast, we propose a much lighter graph based method to perform node based classification. We first use Simple Linear Iterative Cluster (SLIC) to produce superpixels across the field. Then, to perform segmentation across the non Euclidean domain of superpixels, we leverage a Graph Convolutional Neural Network (GCN). This model has 4 orders of magnitude fewer parameters than a CNN model and trains in a matter of minutes.


Illegible Semantics Exploring the Design Space of Metal Logos. The logos of metal bands can be by turns gaudy, uncouth, or nearly illegible. Yet, these logos work they communicate sophisticated notions of genre and emotional affect. In this paper we use the design considerations of metal logos to explore the space of "illegible semantics" the ways that text can communicate information at the cost of readability, which is not always the most important objective. In this work, drawing on formative visualization theory, professional design expertise, and empirical assessments of a corpus of metal band logos, we describe a design space of metal logos and present a tool through which logo characteristics can be explored through visualization. We investigate ways in which logo designers imbue their text with meaning and consider opportunities and implications for visualization more widely.


Assessing Fairness in the Presence of Missing Data. Missing data are prevalent and present daunting challenges in real data analysis. While there is a growing body of literature on fairness in analysis of fully observed data, there has been little theoretical work on investigating fairness in analysis of incomplete data. In practice, a popular analytical approach for dealing with missing data is to use only the set of complete cases, i.e., observations with all features fully observed to train a prediction algorithm. However, depending on the missing data mechanism, the distribution of complete cases and the distribution of the complete data may be substantially different. When the goal is to develop a fair algorithm in the complete data domain where there are no missing values, an algorithm that is fair in the complete case domain may show disproportionate bias towards some marginalized groups in the complete data domain. To fill this significant gap, we study the problem of estimating fairness in the complete data domain for an arbitrary model evaluated merely using complete cases. We provide upper and lower bounds on the fairness estimation error and conduct numerical experiments to assess our theoretical results. Our work provides the first known theoretical results on fairness guarantee in analysis of incomplete data.


Emergency braking Distance Prediction using Deep Learning. Predicting emergency braking distance is important for the collision avoidance related features, which are the most essential and popular safety features for vehicles. In this study, we first gathered a large data set including a three dimensional acceleration data and the corresponding emergency braking distance. Using this data set, we propose a deep learning model to predict emergency braking distance, which only requires 0.25 seconds three dimensional vehicle acceleration data before the break as input. We consider two road surfaces, our deep learning approach is robust to both road surfaces and have accuracy within 3 feet.


Symmetric Generation of J 2 on 32 Letters. We give a computer free proof that J 2 is isomorphic to the progenitor 2 star 32 (2 1 4 A 5) factored by two relations, one of length 3 and and one of length 6, in the symmetric generators.


A model structure for locally constant factorization algebras. Several model structures related to the homotopy theory of locally constant factorization algebras are constructed. This answers a question raised by D. Calaque in his habilitation thesis. Our methods also solve a problem related to cosheafification and factorization algebras identified by O. Gwilliam K. Rejzner in the locally constant case.


QuPeD Quantized Personalization via Distillation with Applications to Federated Learning. Traditionally, federated learning (FL) aims to train a single global model while collaboratively using multiple clients and a server. Two natural challenges that FL algorithms face are heterogeneity in data across clients and collaboration of clients with em diverse resources . In this work, we introduce a textit quantized and textit personalized FL algorithm QuPeD that facilitates collective (personalized model compression) training via textit knowledge distillation (KD) among clients who have access to heterogeneous data and resources. For personalization, we allow clients to learn textit compressed personalized models with different quantization parameters and model dimensions structures. Towards this, first we propose an algorithm for learning quantized models through a relaxed optimization problem, where quantization values are also optimized over. When each client participating in the (federated) learning process has different requirements for the compressed model (both in model dimension and precision), we formulate a compressed personalization framework by introducing knowledge distillation loss for local client objectives collaborating through a global model. We develop an alternating proximal gradient update for solving this compressed personalization problem, and analyze its convergence properties. Numerically, we validate that QuPeD outperforms competing personalized FL methods, FedAvg, and local training of clients in various heterogeneous settings.


Inertia of retracts in Demushkin groups. Exploring inequalities regarding the rank and relation gradients of pro p modules and building upon recent results of Y. Antol 'in, A. Jaikin Zapiran and M. Shusterman, we prove that every retract of a Demushkin group is inert in the sense of the Dicks Ventura Inertia Conjecture.


Coordinated Reinforcement Learning for Optimizing Mobile Networks. Mobile networks are composed of many base stations and for each of them many parameters must be optimized to provide good services. Automatically and dynamically optimizing all these entities is challenging as they are sensitive to variations in the environment and can affect each other through interferences. Reinforcement learning (RL) algorithms are good candidates to automatically learn base station configuration strategies from incoming data but they are often hard to scale to many agents. In this work, we demonstrate how to use coordination graphs and reinforcement learning in a complex application involving hundreds of cooperating agents. We show how mobile networks can be modeled using coordination graphs and how network optimization problems can be solved efficiently using multi agent reinforcement learning. The graph structure occurs naturally from expert knowledge about the network and allows to explicitly learn coordinating behaviors between the antennas through edge value functions represented by neural networks. We show empirically that coordinated reinforcement learning outperforms other methods. The use of local RL updates and parameter sharing can handle a large number of agents without sacrificing coordination which makes it well suited to optimize the ever denser networks brought by 5G and beyond.


Energy Dissipation in Turbulent Reconnection. We study the nature of pressure strain interaction at reconnection sites, detected by NASA's Magnetospheric Multiscale (MMS) Mission. We employ data from a series of published case studies, including a large scale reconnection event at the magnetopause, three small scale reconnection events at the magnetosheath current sheets, and one example of the recently discovered electron only reconnection. In all instances, we find that the pressure strain shows signature of conversion into (or from) internal energy at the reconnection site. The electron heating rate is larger than the ion heating rate and the compressive heating is dominant over the incompressive heating rate in all cases considered. The magnitude of thermal energy conversion rate is close to the electromagnetic energy conversion rate in the reconnection region. Although in most cases the pressure strain interaction indicates that the particle internal energy is increasing, in one case the internal energy is decreasing. These observations indicate that the pressure strain interaction can be used as an independent measure of energy conversion and dynamics in reconnection regions, in particular independent of measures based on the electromagnetic work. Finally, we explore a selected reconnection site in a turbulent Particle in Cell (PIC) simulation which further supports the observational results.


Misinformation detection in Luganda English code mixed social media text. The increasing occurrence, forms, and negative effects of misinformation on social media platforms has necessitated more misinformation detection tools. Currently, work is being done addressing COVID 19 misinformation however, there are no misinformation detection tools for any of the 40 distinct indigenous Ugandan languages. This paper addresses this gap by presenting basic language resources and a misinformation detection data set based on code mixed Luganda English messages sourced from the Facebook and Twitter social media platforms. Several machine learning methods are applied on the misinformation detection data set to develop classification models for detecting whether a code mixed Luganda English message contains misinformation or not. A 10 fold cross validation evaluation of the classification methods in an experimental misinformation detection task shows that a Discriminative Multinomial Naive Bayes (DMNB) method achieves the highest accuracy and F measure of 78.19 and 77.90 respectively. Also, Support Vector Machine and Bagging ensemble classification models achieve comparable results. These results are promising since the machine learning models are based on n gram features from only the misinformation detection dataset.


Prismatic cohomology and p adic homotopy theory. This short note regards an observation about the recent theory of prismatic cohomology developed by Bhatt and Scholze. In particular, by applying a functor of Mandell, we see that the 'etale comparison theorem in the prismatic theory reproduces the p adic homotopy type for a smooth proper complex variety with good reduction mod p .


NuPS A Parameter Server for Machine Learning with Non Uniform Parameter Access. Parameter servers (PSs) facilitate the implementation of distributed training for large machine learning tasks. In this paper, we argue that existing PSs are inefficient for tasks that exhibit non uniform parameter access their performance may even fall behind that of single node baselines. We identify two major sources of such non uniform access skew and sampling. Existing PSs are ill suited for managing skew because they uniformly apply the same parameter management technique to all parameters. They are inefficient for sampling because the PS is oblivious to the associated randomized accesses and cannot exploit locality. To overcome these performance limitations, we introduce NuPS, a novel PS architecture that (i) integrates multiple management techniques and employs a suitable technique for each parameter and (ii) supports sampling directly via suitable sampling primitives and sampling schemes that allow for a controlled quality efficiency trade off. In our experimental study, NuPS outperformed existing PSs by up to one order of magnitude and provided up to linear scalability across multiple machine learning tasks.


An Extensive Study of User Identification via Eye Movements across Multiple Datasets. Several studies have reported that biometric identification based on eye movement characteristics can be used for authentication. This paper provides an extensive study of user identification via eye movements across multiple datasets based on an improved version of method originally proposed by George and Routray. We analyzed our method with respect to several factors that affect the identification accuracy, such as the type of stimulus, the IVT parameters (used for segmenting the trajectories into fixation and saccades), adding new features such as higher order derivatives of eye movements, the inclusion of blink information, template aging, age and gender.We find that three methods namely selecting optimal IVT parameters, adding higher order derivatives features and including an additional blink classifier have a positive impact on the identification accuracy. The improvements range from a few percentage points, up to an impressive 9 increase on one of the datasets.


ATISS Autoregressive Transformers for Indoor Scene Synthesis. The ability to synthesize realistic and diverse indoor furniture layouts automatically or based on partial input, unlocks many applications, from better interactive 3D tools to data synthesis for training and simulation. In this paper, we present ATISS, a novel autoregressive transformer architecture for creating diverse and plausible synthetic indoor environments, given only the room type and its floor plan. In contrast to prior work, which poses scene synthesis as sequence generation, our model generates rooms as unordered sets of objects. We argue that this formulation is more natural, as it makes ATISS generally useful beyond fully automatic room layout synthesis. For example, the same trained model can be used in interactive applications for general scene completion, partial room re arrangement with any objects specified by the user, as well as object suggestions for any partial room. To enable this, our model leverages the permutation equivariance of the transformer when conditioning on the partial scene, and is trained to be permutation invariant across object orderings. Our model is trained end to end as an autoregressive generative model using only labeled 3D bounding boxes as supervision. Evaluations on four room types in the 3D FRONT dataset demonstrate that our model consistently generates plausible room layouts that are more realistic than existing methods. In addition, it has fewer parameters, is simpler to implement and train and runs up to 8 times faster than existing methods.


Inducing Causal Structure for Interpretable Neural Networks. In many areas, we have well founded insights about causal structure that would be useful to bring into our trained models while still allowing them to learn in a data driven fashion. To achieve this, we present the new method of interchange intervention training(IIT). In IIT, we (1)align variables in the causal model with representations in the neural model and (2) train a neural model to match the counterfactual behavior of the causal model on a base input when aligned representations in both models are set to be the value they would be for a second source input. IIT is fully differentiable, flexibly combines with other objectives, and guarantees that the target causal model is acausal abstraction of the neural model when its loss is minimized. We evaluate IIT on a structured vision task (MNIST PVR) and a navigational instruction task (ReaSCAN). We compare IIT against multi task training objectives and data augmentation. In all our experiments, IIT achieves the best results and produces neural models that are more interpretable in the sense that they realize the target causal model.


Spatial Temporal Differentiations. Let (X, mathcal B , mu, T) be a dynamical system where X is a compact metric space with Borel sigma algebra mathcal B , and mu is a probability measure that's ergodic with respect to the homeomorphism T X to X . We study the following differentiation problem Given f in C(X) and F k in mathcal B , where mu(F k) 0 and mu(F k) to 0 , when can we say that lim k to infty frac int F k left( frac 1 k sum i 0 k 1 T i f right) mathrm d mu mu(F k) int f mathrm d mu ?


A principle of large deviations for birth death processes with a linear rate of downward jumps. Birth death processes form a natural class where ideas and results on Large deviations can be tested. In this paper, we derive the Large deviation principle under an assumption that the rate of a downward jump (death) is growing asymptotically linearly with the population size, while the rate of an upward jump (birth) is growing sub linearly. We consider various forms of scaling the original process and normalizing the logarithm of the Large deviation probabilities. The results show interesting features of dependence of the Large deviation functional on the parameters of the underlying process.


Quasi isometry invariance of relative filling functions. For a finitely generated group G and collection of subgroups mathcal P we prove that the relative Dehn function of a pair (G, mathcal P ) is invariant under quasi isometry of pairs. Along the way we show quasi isometries of pairs preserve almost malnormality of the collection and fineness of the associated coned off Cayley graphs. We also prove that for a cocompact simply connected combinatorial G 2 complex X with finite edge stabilisers, the combinatorial Dehn function is well defined if and only if the 1 skeleton of X is fine. We also show that if H is a hyperbolically embedded subgroup of a finitely presented group G , then the relative Dehn function of the pair (G, H) is well defined. In the appendix, it is shown that show that the Baumslag Solitar group mathrm BS (k,l) has a well defined Dehn function with respect to the cyclic subgroup generated by the stable letter if and only if neither k divides l nor l divides k .


RAPTOR End to end Risk Aware MDP Planning and Policy Learning by Backpropagation. Planning provides a framework for optimizing sequential decisions in complex environments. Recent advances in efficient planning in deterministic or stochastic high dimensional domains with continuous action spaces leverage backpropagation through a model of the environment to directly optimize actions. However, existing methods typically not take risk into account when optimizing in stochastic domains, which can be incorporated efficiently in MDPs by optimizing the entropic utility of returns. We bridge this gap by introducing Risk Aware Planning using PyTorch (RAPTOR), a novel framework for risk sensitive planning through end to end optimization of the entropic utility objective. A key technical difficulty of our approach lies in that direct optimization of the entropic utility by backpropagation is impossible due to the presence of environment stochasticity. The novelty of RAPTOR lies in the reparameterization of the state distribution, which makes it possible to apply stochastic backpropagatation through sufficient statistics of the entropic utility computed from forward sampled trajectories. The direct optimization of this empirical objective in an end to end manner is called the risk averse straight line plan, which commits to a sequence of actions in advance and can be sub optimal in highly stochastic domains. We address this shortcoming by optimizing for risk aware Deep Reactive Policies (RaDRP) in our framework. We evaluate and compare these two forms of RAPTOR on three highly stochastic do mains, including nonlinear navigation, HVAC control, and linear reservoir control, demonstrating the ability to manage risk in complex MDPs.


Corner Cases for Visual Perception in Automated Driving Some Guidance on Detection Approaches. Automated driving has become a major topic of interest not only in the active research community but also in mainstream media reports. Visual perception of such intelligent vehicles has experienced large progress in the last decade thanks to advances in deep learning techniques but some challenges still remain. One such challenge is the detection of corner cases. They are unexpected and unknown situations that occur while driving. Conventional visual perception methods are often not able to detect them because corner cases have not been witnessed during training. Hence, their detection is highly safety critical, and detection methods can be applied to vast amounts of collected data to select suitable training data. A reliable detection of corner cases will not only further automate the data selection procedure and increase safety in autonomous driving but can thereby also affect the public acceptance of the new technology in a positive manner. In this work, we continue a previous systematization of corner cases on different levels by an extended set of examples for each level. Moreover, we group detection approaches into different categories and link them with the corner case levels. Hence, we give directions to showcase specific corner cases and basic guidelines on how to technically detect them.


Solving ESL Sentence Completion Questions via Pre trained Neural Language Models. Sentence completion (SC) questions present a sentence with one or more blanks that need to be filled in, three to five possible words or phrases as options. SC questions are widely used for students learning English as a Second Language (ESL) and building computational approaches to automatically solve such questions is beneficial to language learners. In this work, we propose a neural framework to solve SC questions in English examinations by utilizing pre trained language models. We conduct extensive experiments on a real world K 12 ESL SC question dataset and the results demonstrate the superiority of our model in terms of prediction accuracy. Furthermore, we run precision recall trade off analysis to discuss the practical issues when deploying it in real life scenarios. To encourage reproducible results, we make our code publicly available at url https github.com AIED2021 ESL SentenceCompletion .


Reconstruction from the Fourier transform on the ball via prolate spheroidal wave functions. We give new formulas for finding a compactly supported function v on mathbb R d , d geq 1 , from its Fourier transform mathcal F v given within the ball B r . For the one dimensional case, these formulas are based on the theory of prolate spheroidal wave functions (PSWFs). In multidimensions, well known results of the Radon transform theory reduce the problem to the one dimensional case. Related results on stability and convergence rates are also given.


Burrows Wheeler Transform on a Large Scale Algorithms Implemented in Apache Spark. With the rapid growth of Next Generation Sequencing (NGS) technologies, large amounts of "omics" data are daily collected and need to be processed. Indexing and compressing large sequences datasets are some of the most important tasks in this context. Here we propose algorithms for the computation of Burrows Wheeler transform relying on Big Data technologies, i.e., Apache Spark and Hadoop. Our algorithms are the first ones that distribute the index computation and not only the input dataset, allowing to fully benefit of the available cloud resources.


Multi scale semi Lagrangian lattice Boltzmann method. We present a multi scale lattice Boltzmann scheme, which adaptively refines particles' velocity space. Different velocity sets, i.e., higher and lower order lattices, are consistently and efficiently coupled, allowing us to use the higher order lattice only when and where needed. This includes regions of either high Mach number or high Knudsen number. The coupling procedure of different lattices consists of either projection of the moments of the higher order lattice onto the lower order lattice or lifting of the lower order lattice to the higher order velocity space. Both lifting and projection are local operations, which enable a flexible adaptive velocity set. The proposed scheme can be formulated both in a static and an optimal, co moving reference frame, in the spirit of the recently introduced Particles on Demand method. The multi scale scheme is first validated through a convected athermal vortex and also studied in a jet flow setup. The performance of the proposed scheme is further investigated through the shock structure problem and a high Knudsen Couette flow, typical examples of highly non equilibrium flows in which the order of the velocity set plays a decisive role. The results demonstrate that the proposed multi scale scheme can operate accurately, with flexibility in terms of the underlying models and with reduced computational requirements.


Solution Method For Higher Order System. Consider a higher order state space system and the aim of this paper is to linearize the system preserving system characteristics. That is, linearization preserving system characteristics(e.g, controllability, observability, various zeros and transfer function) for analysis of higher order systems gives the solution for higher order system. We study recovery of zero directions of higher order state space system from those of the linearizations. That is, the zero directions of the transfer functions associated to higher order state space system are recovered from the eigenvectors of the Fiedler pencils without performing any arithmetic operations