Sample Recycling Method A New Approach to Efficient Nested Monte Carlo Simulations. Nested stochastic modeling has been on the rise in many fields of the financial industry. Such modeling arises whenever certain components of a stochastic model are stochastically determined by other models. There are at least two main areas of applications, including (1) portfolio risk management in the banking sector and (2) principle based reserving and capital requirements in the insurance sector. As financial instrument values often change with economic fundamentals, the risk management of a portfolio (outer loop) often requires the assessment of financial positions subject to changes in risk factors in the immediate future. The valuation of financial position (inner loop) is based on projections of cashflows and risk factors into the distant future. The nesting of such stochastic modeling can be computationally challenging. Most of existing techniques to speed up nested simulations are based on curve fitting. The main idea is to establish a functional relationship between inner loop estimator and risk factors by running a limited set of economic scenarios, and, instead of running inner loop simulations, inner loop estimations are made by feeding other scenarios into the fitted curve. This paper presents a non conventional approach based on the concept of sample recycling. Its essence is to run inner loop estimation for a small set of outer loop scenarios and to find inner loop estimates under other outer loop scenarios by recycling those known inner loop paths. This new approach can be much more efficient when traditional techniques are difficult to implement in practice.


Quantile Based Random Kaczmarz for corrupted linear systems of equations. We consider linear systems Ax b where A in mathbb R m times n consists of normalized rows, a i ell 2 1 , and where up to beta m entries of b have been corrupted (possibly by arbitrarily large numbers). Haddock, Needell, Rebrova and Swartworth propose a quantile based Random Kaczmarz method and show that for certain random matrices A it converges with high likelihood to the true solution. We prove a deterministic version by constructing, for any matrix A , a number beta A such that there is convergence for all perturbations with beta beta A . Assuming a random matrix heuristic, this proves convergence for tall Gaussian matrices with up to sim 0.5 corruption (a number that can likely be improved).


An M M c queue with queueing time dependent service rates. Recent studies indicate that in many situations service times are affected by the experienced queueing delay of the particular customer. This effect has been detected in different areas, such as health care, call centers and telecommunication networks. In this paper we present a methodology to analyze a model having this property. The specific model is an M M c queue in which any customer may be tagged at her arrival time if her queueing time will be above a certain fixed threshold. All tagged customers are then served at a given rate that may differ from the rate used for the non tagged customers. We show how it is possible to model the virtual queueing time of this queueing system by a specific Markov chain. Then, solving the corresponding balance equations, we give a recursive solution to compute the stationary distribution, which involves a mixture of exponential terms. Using numerical experiments, we demonstrate that the differences in service rates can have a crucial impact on queueing time performance.


Breaking the Computational Bottleneck Design of Near Optimal High Memory Spatially Coupled Codes. Spatially coupled (SC) codes, known for their threshold saturation phenomenon and low latency windowed decoding algorithms, are ideal for streaming applications and data storage systems. SC codes are constructed by partitioning an underlying block code, followed by rearranging and concatenating the partitioned components in a convolutional manner. The number of partitioned components determines the memory of SC codes. In this paper, we investigate the relation between the performance of SC codes and the density distribution of partitioning matrices. While adopting higher memories results in improved SC code performance, obtaining finite length, high performance SC codes with high memory is known to be computationally challenging. We break this computational bottleneck by developing a novel probabilistic framework that obtains (locally) optimal density distributions via gradient descent. Starting from random partitioning matrices abiding by the obtained distribution, we perform low complexity optimization algorithms that minimize the number of detrimental objects to construct high memory, high performance quasi cyclic SC codes. We apply our framework to various objects of interests, from the simplest short cycles, to more sophisticated objects such as concatenated cycles aiming at finer grained optimization. Simulation results show that codes obtained through our proposed method notably outperform state of the art SC codes with the same constraint length and optimized SC codes with uniform partitioning. The performance gain is shown to be universal over a variety of channels, from canonical channels such as additive white Gaussian noise and binary symmetric channels, to practical channels underlying flash memory and magnetic recording systems.


Container Context Aggregation Network. Convolutional neural networks (CNNs) are ubiquitous in computer vision, with a myriad of effective and efficient variations. Recently, Transformers originally introduced in natural language processing have been increasingly adopted in computer vision. While early adopters continue to employ CNN backbones, the latest networks are end to end CNN free Transformer solutions. A recent surprising finding shows that a simple MLP based solution without any traditional convolutional or Transformer components can produce effective visual representations. While CNNs, Transformers and MLP Mixers may be considered as completely disparate architectures, we provide a unified view showing that they are in fact special cases of a more general method to aggregate spatial context in a neural network stack. We present the model (CONText AggregatIon NEtwoRk), a general purpose building block for multi head context aggregation that can exploit long range interactions emph a la Transformers while still exploiting the inductive bias of the local convolution operation leading to faster convergence speeds, often seen in CNNs. In contrast to Transformer based methods that do not scale well to downstream tasks that rely on larger input image resolutions, our efficient network, named modellight, can be employed in object detection and instance segmentation networks such as DETR, RetinaNet and Mask RCNN to obtain an impressive detection mAP of 38.9, 43.8, 45.1 and mask mAP of 41.3, providing large improvements of 6.6, 7.3, 6.9 and 6.6 pts respectively, compared to a ResNet 50 backbone with a comparable compute and parameter size. Our method also achieves promising results on self supervised learning compared to DeiT on the DINO framework. Code is released at url https github.com allenai container .


Unsupervised Corpus Aware Language Model Pre training for Dense Passage Retrieval. Recent research demonstrates the effectiveness of using fine tuned language models (LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine tuning pipelines to realize their full potential. In this paper, we identify and address two underlying problems of dense retrievers i) fragility to training data noise and ii) requiring large batches to robustly learn the embedding space. We use the recently proposed Condenser pre training architecture, which learns to condense information into the dense vector through LM pre training. On top of it, we propose coCondenser, which adds an unsupervised corpus level contrastive loss to warm up the passage embedding space. Retrieval experiments on MS MARCO, Natural Question, and Trivia QA datasets show that coCondenser removes the need for heavy data engineering such as augmentation, synthesis, or filtering, as well as the need for large batch training. It shows comparable performance to RocketQA, a state of the art, heavily engineered system, using simple small batch fine tuning.


Flip Learning Erase to Segment. Nodule segmentation from breast ultrasound images is challenging yet essential for the diagnosis. Weakly supervised segmentation (WSS) can help reduce time consuming and cumbersome manual annotation. Unlike existing weakly supervised approaches, in this study, we propose a novel and general WSS framework called Flip Learning, which only needs the box annotation. Specifically, the target in the label box will be erased gradually to flip the classification tag, and the erased region will be considered as the segmentation result finally. Our contribution is three fold. First, our proposed approach erases on superpixel level using a Multi agent Reinforcement Learning framework to exploit the prior boundary knowledge and accelerate the learning process. Second, we design two rewards classification score and intensity distribution reward, to avoid under and over segmentation, respectively. Third, we adopt a coarse to fine learning strategy to reduce the residual errors and improve the segmentation performance. Extensively validated on a large dataset, our proposed approach achieves competitive performance and shows great potential to narrow the gap between fully supervised and weakly supervised learning.


COSMOS Catching Out of Context Misinformation with Self Supervised Learning. Despite the recent attention to DeepFakes, one of the most prevalent ways to mislead audiences on social media is the use of unaltered images in a new but false context. To address these challenges and support fact checkers, we propose a new method that automatically detects out of context image and text pairs. Our key insight is to leverage the grounding of image with text to distinguish out of context scenarios that cannot be disambiguated with language alone. We propose a self supervised training strategy where we only need a set of captioned images. At train time, our method learns to selectively align individual objects in an image with textual claims, without explicit supervision. At test time, we check if both captions correspond to the same object(s) in the image but are semantically different, which allows us to make fairly accurate out of context predictions. Our method achieves 85 out of context detection accuracy. To facilitate benchmarking of this task, we create a large scale dataset of 200K images with 450K textual captions from a variety of news websites, blogs, and social media posts. The dataset and source code is publicly available at https shivangi aneja.github.io projects cosmos .


Phase shifting, dispersion variation and defocusing suppression in wave breaking. We present an investigation of the fundamental physical processes involved in deep water wave breaking. Our motivation is to identify the underlying reason causing the deficiency of the eddy viscosity breaking model (EVBM) in predicting surface elevation for strongly nonlinear waves. Owing to the limitation of experimental methods in the provision of high resolution flow information, we propose a numerical methodology by developing an EVBM enclosed standalone fully nonlinear quasi potential (FNP) flow model and a coupled FNP plus Navier Stokes flow model. The numerical models were firstly verified with a wave train subject to modulational instability, then used to simulate a series of broad banded focusing wave trains under non , moderate and strong breaking conditions. A systematic analysis was carried out to investigate the discrepancies of numerical solutions produced by the two models in surface elevation and other important physical properties. It is found that EVBM predicts accurately the energy dissipated by breaking and the amplitude spectrum of free waves in terms of magnitude, but fails to capture accurately breaking induced phase shifting. The shift of phase grows with breaking intensity and is especially strong for high wavenumber components. This is identified as a cause of the upshift of wave dispersion relation, which increases the frequencies of large wavenumber components. Such a variation drives large wavenumber components to propagate at nearly the same speed, which is significantly higher than the linear dispersion levels. This suppresses the instant dispersive spreading of harmonics after the focal point, prolonging the lifespan of focused waves and expanding their propagation space.


Beyond traditional assumptions in fair machine learning. This thesis scrutinizes common assumptions underlying traditional machine learning approaches to fairness in consequential decision making. After challenging the validity of these assumptions in real world applications, we propose ways to move forward when they are violated. First, we show that group fairness criteria purely based on statistical properties of observed data are fundamentally limited. Revisiting this limitation from a causal viewpoint we develop a more versatile conceptual framework, causal fairness criteria, and first algorithms to achieve them. We also provide tools to analyze how sensitive a believed to be causally fair algorithm is to misspecifications of the causal graph. Second, we overcome the assumption that sensitive data is readily available in practice. To this end we devise protocols based on secure multi party computation to train, validate, and contest fair decision algorithms without requiring users to disclose their sensitive data or decision makers to disclose their models. Finally, we also accommodate the fact that outcome labels are often only observed when a certain decision has been made. We suggest a paradigm shift away from training predictive models towards directly learning decisions to relax the traditional assumption that labels can always be recorded. The main contribution of this thesis is the development of theoretically substantiated and practically feasible methods to move research on fair machine learning closer to real world applications.


Reconstruction along a geodesic from sphere data in Finsler geometry and anisotropic elasticity. Dix formulated the inverse problem of recovering an elastic body from the measurements of wave fronts of point scatterers. We geometrize this problem in the framework of linear elasticity, leading to the geometrical inverse problem of recovering a Finsler manifold from certain sphere data in a given open subset of the manifold. We solve this problem locally along any geodesic through the measurement set.


Formal ternary laws and Buchstaber's 2 groups. We develop the algebraic formalism of the formal ternary laws of C. Walter and we compare them to Buchstaber's 2 valued formal group laws. We also compute the "elementary" formal ternary laws (after inverting 2) using a computer program available online.


Toward a Consistent Taxonomy for Scenario Based Development and Test Approaches for Automated Vehicles A Proposal for a Structuring Framework, a Basic Vocabulary, and its Application. Ensuring and validating the safe operation of automated vehicles are key challenges for their market launch. Scenario based development and test approaches are currently being pursued as possible solutions. An essential prerequisite for researching, applying, and standardizing these approaches is a consistent and agreed upon taxonomy. This taxonomy must include relevant terms, their description, and the relationships between the respective terms. To the best of our knowledge, such a taxonomy does not yet exist, which often leads to misunderstandings, for example, in coordination processes and discussions. This publication contributes to this taxonomy. For this purpose, we propose a framework for structuring the taxonomy. Within this framework, we propose a basic vocabulary by identifying and describing terms that we consider particularly relevant for an overview of such scenario based development and test approaches. Additionally, we visualize the proposed terms and the relationships between these terms with UML diagrams and explain the application of the proposed basic vocabulary with an example.


Deep Transfer Learning A Novel Collaborative Learning Model for Cyberattack Detection Systems in IoT Networks. Federated Learning (FL) has recently become an effective approach for cyberattack detection systems, especially in Internet of Things (IoT) networks. By distributing the learning process across IoT gateways, FL can improve learning efficiency, reduce communication overheads and enhance privacy for cyberattack detection systems. Challenges in implementation of FL in such systems include unavailability of labeled data and dissimilarity of data features in different IoT networks. In this paper, we propose a novel collaborative learning framework that leverages Transfer Learning (TL) to overcome these challenges. Particularly, we develop a novel collaborative learning approach that enables a target network with unlabeled data to effectively and quickly learn knowledge from a source network that possesses abundant labeled data. It is important that the state of the art studies require the participated datasets of networks to have the same features, thus limiting the efficiency, flexibility as well as scalability of intrusion detection systems. However, our proposed framework can address these problems by exchanging the learning knowledge among various deep learning models, even when their datasets have different features. Extensive experiments on recent real world cybersecurity datasets show that the proposed framework can improve more than 40 as compared to the state of the art deep learning based approaches.


Masked Adversarial Generation for Neural Machine Translation. Attacking Neural Machine Translation models is an inherently combinatorial task on discrete sequences, solved with approximate heuristics. Most methods use the gradient to attack the model on each sample independently. Instead of mechanically applying the gradient, could we learn to produce meaningful adversarial attacks ? In contrast to existing approaches, we learn to attack a model by training an adversarial generator based on a language model. We propose the Masked Adversarial Generation (MAG) model, that learns to perturb the translation model throughout the training process. The experiments show that it improves the robustness of machine translation models, while being faster than competing methods.


Incorporating effects of surface roughness and probing molecule size for estimation of soil specific surface area. The pore solid interface and its characteristics play a key role in chemical interactions between minerals in the solid soil matrix and the liquid in pore space and, consequently, solute transport in soils. Specific surface area (SSA), typically measured to characterize the pore solid interface, depends not only on the particles size distribution, but also particle shapes and surface roughness. In this note, we investigate the effects of surface roughness and probing molecule size on SSA estimation, employ concepts from fractals, and theoretically estimate specific surface area from particle size distribution and water retention curve (WRC). The former is used to characterize the particle sizes and the latter to approximately quantify the pore solid interface roughness by determining the surface fractal dimension Ds. To evaluate our approach, we use five Washington and twenty one Arizona soils for which both particle size distributions and water retention curves were accurately measured over a wide range of particle sizes and matric potentials. Comparison with the experiments show that the proposed method estimates the SSA reasonably well with root mean square error RMSE 16.8 and 30.1 m2 g for the Washington and Arizona datasets, respectively.


On the stability of the compacton waves for the degenerate KdV and NLS models. In this paper, we consider the degenerate semi linear Schr "odinger and Korteweg deVries equations in one spatial dimension. We construct special solutions of the two models, namely standing wave solutions of NLS and traveling waves, which turn out to have compact support, compactons. We show that the compactons are unique bell shaped solutions of the corresponding PDE's and for appropriate variational problems as well. We provide a complete spectral characterization of such waves, for all values of p . Namely, we show that all waves are spectrally stable for 2 p leq 8 , while a single mode instability occurs for p 8 . This extends previous work of Germain, Harrop Griffits and Marzuola, who have established orbital stability for some specific waves, in the range p 8 .


Grid based calculation of Lagrangian mean. Lagrangian averaging has been shown to be more effective than Eulerian mean in separating waves from slow dynamics in two timescale flows. It also appears in many reduced models that capture the wave feedback on the slow flow. Its calculation, however, requires tracking particles in time, which imposes several difficulties in grid based numerical simulations or estimation from fixed point measurements. To circumvent these difficulties, we propose a grid based iterative method to calculate Lagrangian mean without tracking particles in time. We explain how this method reduces computation, memory footprint and communication between processors in parallelised numerical models. To assess the accuracy of this method several examples are examined and discussed. We also explore an application of this method in the context of shallow water equations by quantifying the validity of wave averaged geostrophic balance a modified form of geostrophic balance accounting for the effect of strong waves on slow dynamics.


On the modulus of continuity of solutions to complex Monge Amp ere equations. In this paper, we prove a uniform and sharp estimate for the modulus of continuity of solutions to complex Monge Amp ere equations, using the PDE based approach developed by the first three authors in their approach to supremum estimates for fully non linear equations in K "ahler geometry. As an application, we derive a uniform diameter bound for K "ahler metrics satisfying certain Monge Amp ere equations.


Multi scale simulation of COVID 19 epidemics. Over a year after the start of the COVID 19 epidemics, we are still facing the virus and it is hard to correctly predict its future spread over weeks to come, as well as the impacts of potential political interventions. Current epidemic models mainly fall in two approaches compartmental models, divide the population in epidemiological classes and rely on the mathematical resolution of differential equations to give a macroscopic view of the epidemical dynamics, allowing to evaluate its spread a posteriori agent based models are computer models that give a microscopic view of the situation, since each human is modelled as one autonomous agent, allowing to study the epidemical dynamics in relation to (heterogeneous) individual behaviours. In this work, we compared both methodologies and combined them to try and take advantage of the benefits of each, and to overcome their limits. In particular, agent based simulation can be used to refine the values of the parameters of a compartmental model, or to predict how these values evolve depending on sanitary policies applied. In this report we discuss the conditions of such a combination of approaches, and future improvements.


Deep Image Matting with Flexible Guidance Input. Image matting is an important computer vision problem. Many existing matting methods require a hand made trimap to provide auxiliary information, which is very expensive and limits the real world usage. Recently, some trimap free methods have been proposed, which completely get rid of any user input. However, their performance lag far behind trimap based methods due to the lack of guidance information. In this paper, we propose a matting method that use Flexible Guidance Input as user hint, which means our method can use trimap, scribblemap or clickmap as guidance information or even work without any guidance input. To achieve this, we propose Progressive Trimap Deformation(PTD) scheme that gradually shrink the area of the foreground and background of the trimap with the training step increases and finally become a scribblemap. To make our network robust to any user scribble and click, we randomly sample points on foreground and background and perform curve fitting. Moreover, we propose Semantic Fusion Module(SFM) which utilize the Feature Pyramid Enhancement Module(FPEM) and Joint Pyramid Upsampling(JPU) in matting task for the first time. The experiments show that our method can achieve state of the art results comparing with existing trimap based and trimap free methods.


Symbolic Computation in Software Science My Personal View. In this note, I develop my personal view on the scope and relevance of symbolic computation in software science. For this, I discuss the interaction and differences between symbolic computation, software science, automatic programming, mathematical knowledge management, artificial intelligence, algorithmic intelligence, numerical computation, and machine learning. In the discussion of these notions, I allow myself to refer also to papers (1982, 1985, 2001, 2003, 2013) of mine in which I expressed my views on these areas at early stages of some of these fields.


DeepTitle Leveraging BERT to generate Search Engine Optimized Headlines. Automated headline generation for online news articles is not a trivial task machine generated titles need to be grammatically correct, informative, capture attention and generate search traffic without being "click baits" or "fake news". In this paper we showcase how a pre trained language model can be leveraged to create an abstractive news headline generator for German language. We incorporate state of the art fine tuning techniques for abstractive text summarization, i.e. we use different optimizers for the encoder and decoder where the former is pre trained and the latter is trained from scratch. We modify the headline generation to incorporate frequently sought keywords relevant for search engine optimization. We conduct experiments on a German news data set and achieve a ROUGE L gram F score of 40.02. Furthermore, we address the limitations of ROUGE for measuring the quality of text summarization by introducing a sentence similarity metric and human evaluation.


Method Calls Frequency Based Tie Breaking Strategy For Software Fault Localization. In Spectrum Based Fault Localization (SBFL), a suspiciousness score is assigned to each code element based on test coverage and test outcomes. The scores are then used to rank the code elements relative to each other in order to aid the programmer during the debugging process when seeking the source of a fault. However, probably none of the known SBFL formulae are guaranteed to produce different scores for all the program elements, hence ties emerge between the code elements. Based on our experiments, ties in SBFL are prevalent in Defects4J, 54 56 of buggy methods are members of ties, i.e., there is at least one other method with the same score in these cases (but typically much more, on average 6), and this inevitably reduces the effectiveness of any SBFL approach. In this work, we present a technique to break ties in such cases based on the so called method calls frequencies. This counts the number of different contexts of method calls (both as callees and as callers) in failing test cases. The intuition is that if a method appears in many different calling contexts during a failing test case, it will be more suspicious and get a higher rank position compared to other methods with the same scores. This method can be applied to any underlying SBFL formula, and can favourably break the occurring ranks in the ties in many cases. The experimental results show that our novel tie breaking strategy achieved a significant reduction in both size and number of critical ties in our benchmark. In 72 73 of the cases, the ties were completely eliminated and the average reduction rate was more than 80 .


RandCrowns A Quantitative Metric for Imprecisely Labeled Tree Crown Delineation. Supervised methods for object delineation in remote sensing require labeled ground truth data. Gathering sufficient high quality ground truth data is difficult, especially when targets are of irregular shape or difficult to distinguish from background or neighboring objects. Tree crown delineation provides key information from remote sensing images for forestry, ecology, and management. However, tree crowns in remote sensing imagery are often difficult to label and annotate due to irregular shape, overlapping canopies, shadowing, and indistinct edges. There are also multiple approaches to annotation in this field (e.g., rectangular boxes vs. convex polygons) that further contribute to annotation imprecision. However, current evaluation methods do not account for this uncertainty in annotations, and quantitative metrics for evaluation can vary across multiple annotators. In this paper, we address these limitations by developing an adaptation of the Rand index for weakly labeled crown delineation that we call RandCrowns. Our new RandCrowns evaluation metric provides a method to appropriately evaluate delineated tree crowns while taking into account imprecision in the ground truth delineations. The RandCrowns metric reformulates the Rand index by adjusting the areas over which each term of the index is computed to account for uncertain and imprecise object delineation labels. Quantitative comparisons to the commonly used intersection over union method shows a decrease in the variance generated by differences among multiple annotators. Combined with qualitative examples, our results suggest that the RandCrowns metric is more robust for scoring target delineations in the presence of uncertainty and imprecision in annotations that are inherent to tree crown delineation.


Bifurcations of sleep patterns due to homeostatic and circadian variation in a sleep wake flip flop model. Differential equation based physiological models of sleep wake networks describe sleep wake regulation by simulating the activity of wake and sleep promoting neuronal populations and the modulation of these populations by homeostatic and circadian ( sim24 h) drives. Here, we consider a sleep wake flip flop network model consisting of mutually inhibitory interactions between wake and sleep promoting neuronal populations. Motivated by changes in sleep behavior during early childhood as babies transition from napping to non napping behavior, we vary homeostatic and circadian modulation and analyze effects on resulting sleep wake patterns. To identify the types and sequences of bifurcations leading to changes in stable sleep wake patterns in this piecewise smooth model, we employ multiple mathematical methods, including fast slow decomposition and numerical computation of circle maps. We find that the average daily number of sleeps exhibits a period adding sequence as the homeostatic time constants are reduced, and that the temporal circadian profile influences the number of observed solutions in the sequence. These solutions emerge through sequences of saddle node and border collision bifurcations, where the particular sequence depends on parameter values. When the temporal circadian profile is steep, as is observed with long day lengths, some sleep patterns are lost and bistability of other patterns may occur. We analyze a limiting case of the temporal circadian waveform, a circadian hard switch model, to understand this loss of solutions. Generally, our holistic analysis approach provides an alternative analysis method for model systems that defy conventional numerical bifurcation analysis techniques.


Bright betatron radiation from direct laser accelerated electrons at moderate relativistic laser intensity. Direct laser acceleration (DLA) of electrons in a plasma of near critical electron density (NCD) and associated synchrotron like radiation are discussed for moderate relativistic laser intensity (the normalized laser amplitude a 0 leq 4.3) and ps long pulse. This regime is typical for kJ PW class laser facilities designed for high energy density research. Currently, in experiments at the PHELX laser it was demonstrated that interaction of 10 19 W cm 2 sub ps laser pulse with sub mm long NCD plasma results in generation of high current well directed super ponderomotive electrons with effective temperature that is 10 times higher than the ponderomotive potential O. Rosmej et al., PPCF 62, 115024 (2020) . Three dimensional Particle In Cell simulations provided a good agreement with the measured electron energy distribution and were used in the current work to study synchrotron radiation of the DLA accelerated electrons. The resulting x ray spectrum with a critical energy of 5 keV reveals an ultra high photon number of 7 times 10 11 in the 1 30 keV photon energy range at the focused laser energy of 20 J. Numerical simulations of a betatron x ray phasecontrast imaging based on the DLA process for the parameters of a PHELIX laser is presented. The results are of interest for applications in high energy density (HED) experiments, which require a picosecond x ray pulse and a high photon flux.


Asymptotic Stability of a Compressible Oseen Structure Interaction via a Pointwise Resolvent Criterion. In this study, we consider a linearized compressible flow structure interaction PDE model for which the interaction interface is under the effect of material derivative term. While the linearization takes place around a constant pressure and density components in structure equation, the flow linearization is taken with respect to a non zero, fixed, variable ambient vector field. This process produces extra "convective derivative" and "material derivative" terms which causes the coupled system to be nondissipative. We analyze the long time dynamics in the sense of asymptotic (strong) stability in an invariant subspace (one dimensional less) of the entire state space where the continuous semigroup is " textit uniformly bounded ". For this, we appeal to the pointwise resolvent condition introduced in cite CT which avoids many technical complexity and provides a very clean, short and easy to follow proof.


Successor Feature Neural Episodic Control. A longstanding goal in reinforcement learning is to build intelligent agents that show fast learning and a flexible transfer of skills akin to humans and animals. This paper investigates the integration of two frameworks for tackling those goals episodic control and successor features. Episodic control is a cognitively inspired approach relying on episodic memory, an instance based memory model of an agent's experiences. Meanwhile, successor features and generalized policy improvement (SF GPI) is a meta and transfer learning framework allowing to learn policies for tasks that can be efficiently reused for later tasks which have a different reward function. Individually, these two techniques have shown impressive results in vastly improving sample efficiency and the elegant reuse of previously learned policies. Thus, we outline a combination of both approaches in a single reinforcement learning framework and empirically illustrate its benefits.


Tell Me Who Your Friends Are Using Content Sharing Behavior for News Source Veracity Detection. Stopping the malicious spread and production of false and misleading news has become a top priority for researchers. Due to this prevalence, many automated methods for detecting low quality information have been introduced. The majority of these methods have used article level features, such as their writing style, to detect veracity. While writing style models have been shown to work well in lab settings, there are concerns of generalizability and robustness. In this paper, we begin to address these concerns by proposing a novel and robust news veracity detection model that uses the content sharing behavior of news sources formulated as a network. We represent these content sharing networks (CSN) using a deep walk based method for embedding graphs that accounts for similarity in both the network space and the article text space. We show that state of the art writing style and CSN features make diverse mistakes when predicting, meaning that they both play different roles in the classification task. Moreover, we show that the addition of CSN features increases the accuracy of writing style models, boosting accuracy as much as 14 when using Random Forests. Similarly, we show that the combination of hand crafted article level features and CSN features is robust to concept drift, performing consistently well over a 10 month time frame.


Spatially Focused Attack against Spatiotemporal Graph Neural Networks. Spatiotemporal forecasting plays an essential role in various applications in intelligent transportation systems (ITS), such as route planning, navigation, and traffic control and management. Deep Spatiotemporal graph neural networks (GNNs), which capture both spatial and temporal patterns, have achieved great success in traffic forecasting applications. Understanding how GNNs based forecasting work and the vulnerability and robustness of these models becomes critical to real world applications. For example, if spatiotemporal GNNs are vulnerable in real world traffic prediction applications, a hacker can easily manipulate the results and cause serious traffic congestion and even a city scale breakdown. However, despite that recent studies have demonstrated that deep neural networks (DNNs) are vulnerable to carefully designed perturbations in multiple domains like objection classification and graph representation, current adversarial works cannot be directly applied to spatiotemporal forecasting due to the causal nature and spatiotemporal mechanisms in forecasting models. To fill this gap, in this paper we design Spatially Focused Attack (SFA) to break spatiotemporal GNNs by attacking a single vertex. To achieve this, we first propose the inverse estimation to address the causality issue then, we apply genetic algorithms with a universal attack method as the evaluation function to locate the weakest vertex finally, perturbations are generated by solving an inverse estimation based optimization problem. We conduct experiments on real world traffic data and our results show that perturbations in one vertex designed by SA can be diffused into a large part of the graph.


A branching process with deletions and mergers that matches the threshold for hypercube percolation. We define a graph process mathcal G (p,q) based on a discrete branching process with deletions and mergers, which is inspired by the 4 cycle structure of both the hypercube Q d and the lattice mathbb Z d for large d . Individuals have Poisson offspring distribution with mean 1 p and certain deletions and mergers occur with probability q these parameters correspond to the mean number of edges discovered from a given vertex in an exploration of a percolation cluster and to the probability that a non backtracking path of length four closes a cycle, respectively. We prove survival and extinction under certain conditions on p and q that heuristically match the known expansions of the critical probabilities for bond percolation on the lattice mathbb Z d and the hypercube Q d . These expansions have been rigorously established by Hara and Slade in 1995, and van der Hofstad and Slade in 2006, respectively. We stress that our method does not constitute a branching process proof for the percolation threshold. The analysis of the graph process survival is considerably more challenging than for branching processes in discrete time, due to the interdependence between the descendants of different individuals in the same generation. In fact, it is left open whether the survival probability of mathcal G (p,q) is monotone in p or q we discuss this and some other open problems regarding the new graph process.


Supporting Context Monotonicity Abstractions in Neural NLI Models. Natural language contexts display logical regularities with respect to substitutions of related concepts these are captured in a functional order theoretic property called monotonicity. For a certain class of NLI problems where the resulting entailment label depends only on the context monotonicity and the relation between the substituted concepts, we build on previous techniques that aim to improve the performance of NLI models for these problems, as consistent performance across both upward and downward monotone contexts still seems difficult to attain even for state of the art models. To this end, we reframe the problem of context monotonicity classification to make it compatible with transformer based pre trained NLI models and add this task to the training pipeline. Furthermore, we introduce a sound and complete simplified monotonicity logic formalism which describes our treatment of contexts as abstract units. Using the notions in our formalism, we adapt targeted challenge sets to investigate whether an intermediate context monotonicity classification task can aid NLI models' performance on examples exhibiting monotonicity reasoning.


Detecting Security Fixes in Open Source Repositories using Static Code Analyzers. The sources of reliable, code level information about vulnerabilities that affect open source software (OSS) are scarce, which hinders a broad adoption of advanced tools that provide code level detection and assessment of vulnerable OSS dependencies. In this paper, we study the extent to which the output of off the shelf static code analyzers can be used as a source of features to represent commits in Machine Learning (ML) applications. In particular, we investigate how such features can be used to construct embeddings and train ML models to automatically identify source code commits that contain vulnerability fixes. We analyze such embeddings for security relevant and non security relevant commits, and we show that, although in isolation they are not different in a statistically significant manner, it is possible to use them to construct a ML pipeline that achieves results comparable with the state of the art. We also found that the combination of our method with commit2vec represents a tangible improvement over the state of the art in the automatic identification of commits that fix vulnerabilities the ML models we construct and commit2vec are complementary, the former being more generally applicable, albeit not as accurate.


The quasi static plasmonic problem for polyhedra. We characterize the essential spectrum of the plasmonic problem for polyhedra in mathbb R 3 . The description is particularly simple for convex polyhedra and permittivities epsilon 1 . The plasmonic problem is interpreted as a spectral problem through a boundary integral operator, the direct value of the double layer potential, also known as the Neumann Poincar 'e operator. We therefore study the spectral structure of the the double layer potential for polyhedral cones and polyhedra.


Response of RAW 264.7 and J774A.1 macrophages to particles and nanoparticles of a mesoporous bioactive glass A comparative study". Mesoporous bioactive glasses (MBGs) are bioceramics designed to induce bone tissue regeneration and very useful materials with the ability to act as drug delivery systems. MBGs can be implanted in contact with bone tissue in different ways, as particulate material, in 3D scaffolds or as nanospheres. In this work, we assessed the effects of particles of mesoporous bioactive glass MBG 75S and mesoporous nanospheres NanoMBG 75S on RAW 264.7 and J774A.1 macrophages, which present different sensitivity and are considered as ideal models for the study of innate immune response. After evaluating several cellular parameters (morphology, size, complexity, proliferation, cell cycle and intracellular content of reactive oxygen species), the action of MBG 75S particles and NanoMBG 75S on the polarization of these macrophages towards the proinflammatory (M1) or reparative (M2) phenotype was determined by the expression of specific M1 (CD80) and M2 (CD206, CD163) markers. We previously measured the adsorption of albumin and fibrinogen on MBG 75S particles and the production of proinflammatory cytokines as TNF alpha and IL 6 by macrophages in response to these particles. This comparative study demonstrates that particles of mesoporous bioactive glass MBG 75S and mesoporous nanospheres NanoMBG 75S allow the appropriated development and function of RAW 264.7 and J774A.1 macrophages and do not induce polarization towards the M1 pro inflammatory phenotype. Therefore, considering that these mesoporous biomaterials offer the possibility of loading drugs into their pores, the results obtained indicate their high potential for use as drug delivery systems in bone repair and osteoporosis treatments without triggering an adverse inflammatory response.


Self supervision of Feature Transformation for Further Improving Supervised Learning. Self supervised learning, which benefits from automatically constructing labels through pre designed pretext task, has recently been applied for strengthen supervised learning. Since previous self supervised pretext tasks are based on input, they may incur huge additional training overhead. In this paper we find that features in CNNs can be also used for self supervision. Thus we creatively design the emph feature based pretext task which requires only a small amount of additional training overhead. In our task we discard different particular regions of features, and then train the model to distinguish these different features. In order to fully apply our feature based pretext task in supervised learning, we also propose a novel learning framework containing multi classifiers for further improvement. Original labels will be expanded to joint labels via self supervision of feature transformations. With more semantic information provided by our self supervised tasks, this approach can train CNNs more effectively. Extensive experiments on various supervised learning tasks demonstrate the accuracy improvement and wide applicability of our method.


Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models. Coherent discourse is distinguished from a mere collection of utterances by the satisfaction of a diverse set of constraints, for example choice of expression, logical relation between denoted events, and implicit compatibility with world knowledge. Do neural language models encode such constraints? We design an extendable set of test suites addressing different aspects of discourse and dialogue coherence. Unlike most previous coherence evaluation studies, we address specific linguistic devices beyond sentence order perturbations, allowing for a more fine grained analysis of what constitutes coherence and what neural models trained on a language modelling objective do encode. Extending the targeted evaluation paradigm for neural language models (Marvin and Linzen, 2018) to phenomena beyond syntax, we show that this paradigm is equally suited to evaluate linguistic qualities that contribute to the notion of coherence.


Sharpness Aware Minimization with Dynamic Reweighting. Deep neural networks are often overparameterized and may not easily achieve model generalization. Adversarial training has shown effectiveness in improving generalization by regularizing the change of loss on top of adversarially chosen perturbations. The recently proposed sharpness aware minimization (SAM) algorithm conducts adversarial weight perturbation, encouraging the model to converge to a flat minima. Unfortunately, due to increased computational cost, adversarial weight perturbation can only be efficiently estimated per batch instead of per instance by SAM, leading to degraded performance. In this paper, we tackle this efficiency bottleneck and propose the first instance based weight perturbation method sharpness aware minimization with dynamic reweighting ( delta SAM). delta SAM dynamically reweights perturbation within each batch by estimated guardedness (i.e. unguarded instances are up weighted), serving as a better approximation to per instance perturbation. Experiments on various tasks demonstrate the effectiveness of delta SAM.


A note on Matching Cut in P t free Graphs. A matching cut of a graph is an edge cut that is a matching. The problem Matching Cut is that of recognizing graphs with a matching cut and is NP complete, even if the graph belongs to one of a number of classes. We initiate the study of Matching Cut for graphs without a fixed path as an induced subgraph. We show that Matching Cut is in P for P 5 free graphs, but that there exists an integer t 0 for which it is NP complete for P t free graphs.


High Frequency Instabilities of the Kawahara Equation A Perturbative Approach. We analyze the spectral stability of small amplitude, periodic, traveling wave solutions of the Kawahara equation. These solutions exhibit high frequency instabilities when subject to bounded perturbations on the whole real line. We introduce a formal perturbation method to determine the asymptotic growth rates of these instabilities, among other properties. Explicit numerical computations are used to verify our asymptotic results.


Evaluating Linear Functions to Symmetric Monoidal Categories. A number of domain specific languages, such as circuits or data science workflows, are best expressed as diagrams of boxes connected by wires. Unfortunately, functional languages have traditionally been ill equipped to embed this sort of languages. The Arrow abstraction is an approximation, but we argue that it does not capture the right properties. A faithful abstraction is Symmetric Monoidal Categories (SMCs), but,so far,it hasn't been convenient to use. We show how the advent of linear typing in Haskell lets us bridge this gap. We provide a library which lets us program in SMCs with linear functions instead of SMC combinators. This considerably lowers the syntactic overhead of the EDSL to be on par with that of monadic DSLs. A remarkable feature of our library is that, contrary to previously known methods for categories, it does not use any metaprogramming.


Light beam carrying natural non integer orbital angular momentum in free space. Light beam with optical vortices can propagate in free space only with integer orbital angular momentum. Here, we invert this scientific consensus theoretically and experimentally by proposing light beams carrying natural non integer orbital angular momentum. These peculiar light beams are actually special solutions of wave function, which possess optical vortices with the topological charge l 0.5, where l is an integer. Owing to the interaction of phase and polarization singularity, these vortex beams with fractional topological charge can maintain their amplitude and vortex phase even when they propagate to an infinite distance. This work demonstrates another state of optical vortices in free space, which will fundamentally inject new vigor into optics, and other relate scientific fields.


Security Analysis of Vendor Implementations of the OPC UA Protocol for Industrial Control Systems. The OPC UA protocol is an upcoming de facto standard for building Industry 4.0 processes in Europe, and one of the few industrial protocols that promises security features to prevent attackers from manipulating and damaging critical infrastructures. Despite the importance of the protocol, challenges in the adoption of OPC UA's security features by product vendors, libraries implementing the standard, and end users were not investigated so far. In this work, we systematically investigate 48 publicly available artifacts consisting of products and libraries for OPC UA and show that 38 out of the 48 artifacts have one (or more) security issues. In particular, we show that 7 OPC UA artifacts do not support the security features of the protocol at all. In addition, 31 artifacts that partially feature OPC UA security rely on incomplete libraries and come with misleading instructions. Consequently, relying on those products and libraries will result in vulnerable implementations of OPC UA security features. To verify our analysis, we design, implement, and demonstrate attacks in which the attacker can steal credentials exchanged between victims, eavesdrop on process information, manipulate the physical process through sensor values and actuator commands, and prevent the detection of anomalies.


Can we infer player behavior tendencies from a player's decision making data? Integrating Theory of Mind to Player Modeling. Game AI systems need the theory of mind, which is the humanistic ability to infer others' mental models, preferences, and intent. Such systems would enable inferring players' behavior tendencies that contribute to the variations in their decision making behaviors. To that end, in this paper, we propose the use of inverse Bayesian inference to infer behavior tendencies given a descriptive cognitive model of a player's decision making. The model embeds behavior tendencies as weight parameters in a player's decision making. Inferences on such parameters provide intuitive interpretations about a player's cognition while making in game decisions. We illustrate the use of inverse Bayesian inference with synthetically generated data in a game called textit BoomTown developed by Gallup. We use the proposed model to infer a player's behavior tendencies for moving decisions on a game map. Our results indicate that our model is able to infer these parameters towards uncovering not only a player's decision making but also their behavior tendencies for making such decisions.


LRTuner A Learning Rate Tuner for Deep Neural Networks. One very important hyperparameter for training deep neural networks is the learning rate schedule of the optimizer. The choice of learning rate schedule determines the computational cost of getting close to a minima, how close you actually get to the minima, and most importantly the kind of local minima (wide narrow) attained. The kind of minima attained has a significant impact on the generalization accuracy of the network. Current systems employ hand tuned learning rate schedules, which are painstakingly tuned for each network and dataset. Given that the state space of schedules is huge, finding a satisfactory learning rate schedule can be very time consuming. In this paper, we present LRTuner, a method for tuning the learning rate as training proceeds. Our method works with any optimizer, and we demonstrate results on SGD with Momentum, and Adam optimizers. We extensively evaluate LRTuner on multiple datasets, models, and across optimizers. We compare favorably against standard learning rate schedules for the given dataset and models, including ImageNet on Resnet 50, Cifar 10 on Resnet 18, and SQuAD fine tuning on BERT. For example on ImageNet with Resnet 50, LRTuner shows up to 0.2 absolute gains in test accuracy compared to the hand tuned baseline schedule. Moreover, LRTuner can achieve the same accuracy as the baseline schedule in 29 less optimization steps.


Fine Grained Chemical Entity Typing with Multimodal Knowledge Representation. Automated knowledge discovery from trending chemical literature is essential for more efficient biomedical research. How to extract detailed knowledge about chemical reactions from the core chemistry literature is a new emerging challenge that has not been well studied. In this paper, we study the new problem of fine grained chemical entity typing, which poses interesting new challenges especially because of the complex name mentions frequently occurring in chemistry literature and graphic representation of entities. We introduce a new benchmark data set (CHEMET) to facilitate the study of the new task and propose a novel multi modal representation learning framework to solve the problem of fine grained chemical entity typing by leveraging external resources with chemical structures and using cross modal attention to learn effective representation of text in the chemistry domain. Experiment results show that the proposed framework outperforms multiple state of the art methods.


Towards Threshold Key Exchange Protocols. Threshold schemes exist for many cryptographic primitives like signatures, key derivation functions, and ciphers. At the same time, practical key exchange protocols based on Diffie Hellman (DH) or ECDSA primitives are not designed or implemented in a threshold setting. In this paper, we implement popular key exchange protocols in a threshold manner and show that this approach can be used in practice. First, we introduce two basic threshold DH key agreement schemes that provide enhanced security features in comparison with the classic DH primitive dealerless distributed key generation, threshold shared key computation, and private key shares refreshing. We implemented the proposed DH schemes within WireGuard protocol to demonstrate its effectiveness, efficiency, and usability in practice. The open question is the security of the proposed schemes and their instantiation from the elliptic curves used in key agreement protocols NIST curves, Russian GOST curves, and Curve25519. Second, we propose an idea of implementing TLS in a threshold setting that can be used instead of Keyless SSL TLS technology, and provide the measurements of TLS key exchanges based on threshold ECDSA. Even if we don't provide any formal definitions, security analysis, and mathematical proofs, we believe that the ideas and mechanisms suggested in this paper can be interesting and useful. The main intention of the paper is to start discussions and raise awareness of the challenges and problems arising when moving to threshold key exchange protocols.


Analyzing scientific data sharing patterns for in network data caching. The volume of data moving through a network increases with new scientific experiments and simulations. Network bandwidth requirements also increase proportionally to deliver data within a certain time frame. We observe that a significant portion of the popular dataset is transferred multiple times to different users as well as to the same user for various reasons. In network data caching for the shared data has shown to reduce the redundant data transfers and consequently save network traffic volume. In addition, overall application performance is expected to improve with in network caching because access to the locally cached data results in lower latency. This paper shows how much data was shared over the study period, how much network traffic volume was consequently saved, and how much the temporary in network caching increased the scientific application performance. It also analyzes data access patterns in applications and the impacts of caching nodes on the regional data repository. From the results, we observed that the network bandwidth demand was reduced by nearly a factor of 3 over the study period.


Closed billiard trajectories with prescribed bounces. We give the asymptotic growth of the number of primitive periodic trajectories of a two dimensional dispersive billiard, when we prescribe their number of bounces on one of the obstacles.


Transparency in Multi Human Multi Robot Interaction. Transparency is a key factor in improving the performance of human robot interaction. A transparent interface allows humans to be aware of the state of a robot and to assess the progress of the tasks at hand. When multi robot systems are involved, transparency is an even greater challenge, due to the larger number of variables affecting the behavior of the robots as a whole. Significant effort has been devoted to studying transparency when single operators interact with multiple robots. However, studies on transparency that focus on multiple human operators interacting with a multi robot systems are limited. This paper aims to fill this gap by presenting a human swarm interaction interface with graphical elements that can be enabled and disabled. Through this interface, we study which graphical elements are contribute to transparency by comparing four "transparency modes" (i) no transparency (no operator receives information from the robots), (ii) central transparency (the operators receive information only relevant to their personal task), (iii) peripheral transparency (the operators share information on each others' tasks), and (iv) mixed transparency (both central and peripheral). We report the results in terms of awareness, trust, and workload of a user study involving 18 participants engaged in a complex multi robot task.


Dados Abertos Governamentais no contexto de Pol 'iticas P 'ublicas de Sa 'ude e Sistemas Prisionais Realidade ou Utopia?. There are many initiatives of transparency reported in the access and use of government open data for different purposes. This practice reveals an important requirement to accomplish the participatory governance. The literature has reported a minimal set of criteria to categorize a specific data repository as open. This paper discusses to which extent specific national and international data repositories address these criteria. The analyzed repositories focus on public health and prison systems. The results show different levels of alignment to the criteria and provide evidence that the adoption of government open data practices are a reality. On the other hand, there is still a long way to achieve full alignment to the stated criteria.


The convergence of hulls of curves. It is shown that a simple closed curve in mathbb C n that is a uniform limit of rectifiable simple closed curves each of which has nontrivial polynomial hull has itself nontrivial polynomial hull. In case the limit curve is rectifiable, the hull of the limit is shown to be the limit of the hulls. It is also shown that every rectifiable simple closed curve in mathbb C n , n geq 2 , can be approximated in total variation norm by a polynomially convex, rectifiable simple closed curve that coincides with the original curve except on an arbitrarily small segment. As a corollary, it is shown that every rectifiable arc in mathbb C n , n geq 2 , is contained in a polynomially convex, rectifiable simple closed curve.


Shape optimization of light structures and the vanishing mass conjecture. This work proves rigorous results about the vanishing mass limit of the classical problem to find a shape with minimal elastic compliance. Contrary to all previous results in the mathematical literature, which utilize a soft mass constraint by introducing a Lagrange multiplier, we here consider the hard mass constraint. Our results are the first to establish the convergence of approximately optimal shapes of (exact) size varepsilon downarrow 0 to a limit generalized shape represented by a (possibly diffuse) probability measure. This limit generalized shape is a minimizer of the limit compliance, which involves a new integrand, namely the one conjectured by Bouchitt 'e in 2001 and predicted heuristically before in works of Allaire Kohn and Kohn Strang from the 1980s and 1990s. This integrand gives the energy of the limit generalized shape understood as a fine oscillation of (optimal) lower dimensional structures. Its appearance is surprising since the integrand in the original compliance is just a quadratic form and the non convexity of the problem is not immediately obvious. In fact, it is the interaction of the mass constraint with the requirement of attaining the loading (in the form of a divergence constraint) that gives rise to this new integrand. We also present connections to the theory of Michell trusses, first formulated in 1904, and show how our results can be interpreted as a rigorous justification of that theory on the level of functionals in both two and three dimensions, settling this open problem. Our proofs rest on compensated compactness arguments applied to an explicit family of (symmetric) mathrm div quasiconvex quadratic forms, computations involving the Hashin Shtrikman bounds for the Kohn Strang integrand, and the characterization of limit minimizers due to Bouchitt 'e Buttazzo.


Approximate Frank Wolfe Algorithms over Graph structured Support Sets. In this paper, we propose approximate Frank Wolfe (FW) algorithms to solve convex optimization problems over graph structured support sets where the textit linear minimization oracle (LMO) cannot be efficiently obtained in general. We first demonstrate that two popular approximation assumptions ( textit additive and textit multiplicative gap errors) , are not valid for our problem, in that no cheap gap approximate LMO oracle exists in general. Instead, a new textit approximate dual maximization oracle (DMO) is proposed, which approximates the inner product rather than the gap. When the objective is L smooth, we prove that the standard FW method using a delta approximate DMO converges as mathcal O (L delta t (1 delta)( delta 1 delta 2 )) in general, and as mathcal O (L ( delta 2(t 2))) over a delta relaxation of the constraint set. Additionally, when the objective is mu strongly convex and the solution is unique, a variant of FW converges to mathcal O (L 2 log(t) ( mu delta 6 t 2)) with the same per iteration complexity. Our empirical results suggest that even these improved bounds are pessimistic, with significant improvement in recovering real world images with graph structured sparsity.


Multi Server Verifiable Delegation of Computations Unconditional Security and Practical Efficiency. Outsourcing computation has gained significant popularity in recent years due to the prevalence of cloud computing. There are two main security concerns in outsourcing computation how to guarantee the cloud server performs the computation correctly and how to keep the client's data secret. The em single server verifiable computation (SSVC) of Gennaro, Gentry and Parno (Crypto'10) enables a client to delegate the computation of a function f on any input x with both concerns highly relieved, but only results in em computationally secure schemes that em lack practical efficiency . While the SSVC schemes use a single server, in this paper we develop a em multi server verifiable computation (MSVC) model where the client shares both f and x among multiple servers, each server performs a set of computations on its shares, and finally the client reconstructs f(x) from all servers' results. In this MSVC model we propose a generic construction for outsourcing computations of the form F bf x , where F is a matrix and bf x is a vector. Our generic construction achieves em information theoretic security, input privacy and em function privacy . By optimizing the parameters, we obtain both a 3 server scheme,which uses the least number of servers, and a 4 server scheme, which incurs the least workload. By decomposing many polynomial computations as a two stage computation, where the first stage has the form F bf x and the second stage is fast, and delegating the first stage computation, we obtain MSVC schemes for these polynomials. We implement our MSVC schemes and show that they are among the most em practical ones to date.


The cube axiom and resolutions in homotopy theory. We show that a version of the cube axiom holds in cosimplicial unstable coalgebras and cosimplicial spaces equipped with a resolution model structure. As an application, classical theorems in unstable homotopy theory are extended to this context.


Castelnuovo Mumford regularity of matrix Schubert varieties. Matrix Schubert varieties are affine varieties arising in the Schubert calculus of the complete flag variety. We give a formula for the Castelnuovo Mumford regularity of matrix Schubert varieties, answering a question of Jenna Rajchgot. We follow her proposed strategy of studying the highest degree homogeneous parts of Grothendieck polynomials, which we call Castelnuovo Mumford polynomials. In addition to the regularity formula, we obtain formulas for the degrees of all Castelnuovo Mumford polynomials and for their leading terms, as well as a complete description of when two Castelnuovo Mumford polynomials agree up to scalar multiple. The degree of the Grothendieck polynomial is a new permutation statistic which we call the Rajchgot index we develop the properties of Rajchgot index and relate it to major index and to weak order.


Prime power variations of higher Lie n modules. We define, for each subset S of the set mathcal P of primes, an S n module Lie n S with interesting properties. Lie n emptyset is the well known representation Lie n of S n afforded by the free Lie algebra, while Lie n mathcal P is the module C !onj n of the conjugacy action of S n on n cycles. For arbitrary S the module Lie n S interpolates between the representations Lie n and C !onj n. We consider the symmetric and exterior powers of Lie n S. These are the analogues of the higher Lie modules of Thrall. We show that the Frobenius characteristic of these higher Lie n S modules can be elegantly expressed as a multiplicity free sum of power sums. In particular this establishes the Schur positivity of new classes of sums of power sums. More generally, for each nonempty subset T of positive integers we define a sequence of symmetric functions f n T of homogeneous degree n. We show that the series sum lambda, lambda i in T p lambda can be expressed as symmetrised powers of the functions f n T , analogous to the higher Lie modules first defined by Thrall. This in turn allows us to unify previous results on the Schur positivity of multiplicity free sums of power sums, as well as investigate new ones. We also uncover some curious plethystic relationships between f n T , the conjugacy action and the Lie representation.


The Schwarz Milnor lemma for braids and area preserving diffeomorphisms. We prove a number of new results on the large scale geometry of the L p metrics on the group of area preserving diffeomorphisms of each orientable surface. Our proofs use in a key way the Fulton MacPherson type compactification of the configuration space of n points on the surface due to Axelrod Singer and Kontsevich. This allows us to apply the Schwarz Milnor lemma to configuration spaces, a natural approach which we carry out successfully for the first time. As sample results, we prove that all right angled Artin groups admit quasi isometric embeddings into the group of area preserving diffeomorphisms endowed with the L p metric, and that all Gambaudo Ghys quasi morphisms on this metric group coming from the braid group on n strands are Lipschitz. This was conjectured to hold, yet proven only for low values of n and the genus g of the surface.


On Classical Decidable Logics extended with Percentage Quantifiers and Arithmetics. During the last decades, a lot of effort was put into identifying decidable fragments of first order logic. Such efforts gave birth, among the others, to the two variable fragment and the guarded fragment, depending on the type of restriction imposed on formulae from the language. Despite the success of the mentioned logics in areas like formal verification and knowledge representation, such first order fragments are too weak to express even the simplest statistical constraints, required for modelling of influence networks or in statistical reasoning. In this work we investigate the extensions of these classical decidable logics with percentage quantifiers, specifying how frequently a formula is satisfied in the indented model. We show, surprisingly, that all the mentioned decidable fragments become undecidable under such extension, sharpening the existing results in the literature. Our negative results are supplemented by decidability of the two variable guarded fragment with even more expressive counting, namely Presburger constraints. Our results can be applied to infer decidability of various modal and description logics, e.g. Presburger Modal Logics with Converse or ALCI, with expressive cardinality constraints.


An Empirical Study of Partial Deduction for miniKanren. We study conjunctive partial deduction, an advanced specialization technique aimed at improving the performance of logic programs, in the context of relational programming language miniKanren. We identify a number of issues, caused by miniKanren peculiarities, and describe a novel approach to specialization based on partial deduction and supercompilation. The results of the evaluation demonstrate successful specialization of relational interpreters. Although the project is at an early stage, we consider it as the first step towards an efficient optimization framework for miniKanren.


Interacto A Modern User Interaction Processing Model. Since most software systems provide their users with interactive features, building user interfaces (UI) is one of the core software engineering tasks. It consists in designing, implementing and testing ever more sophisticated and versatile ways for users to interact with software systems, and safely connecting these interactions with commands querying or modifying their state. However, most UI frameworks still rely on a low level model, the bare bone UI event processing model. This model was suitable for the rather simple UIs of the early 80s (menus, buttons, keyboards, mouse clicks), but now exhibits major software engineering flaws for modern, highly interactive UIs. These flaws include lack of separation of concerns, weak modularity and thus low reusability of code for advanced interactions, as well as low testability. To mitigate these flaws, we propose Interacto as a high level user interaction processing model. By reifying the concept of user interaction, Interacto makes it easy to design, implement and test modular and reusable advanced user interactions, and to connect them to commands with built in undo redo support. To demonstrate its applicability and generality, we briefly present two open source implementations of Interacto for Java JavaFX and TypeScript Angular. We evaluate Interacto interest (1) on a real world case study, where it has been used since 2013, and with (2) a controlled experiment with 44 master students, comparing it with traditionnal UI frameworks.


Disjoint linear dynamical properties of elementary operators. We characterize disjoint hypercyclic sequences of elementary operators and also we give some sufficient conditions for a sequence of the dual elementary operators to be disjoint topologically transitive.


Image In painting Applied to Art Completing Escher's Print Gallery. This extended abstract presents the first stages of a research on in painting suited for art reconstruction. We introduce M.C Eschers Print Gallery lithography as a use case example. This artwork presents a void on its center and additionally, it follows a challenging mathematical structure that needs to be preserved by the in painting method. We present our work so far and our future line of research.


Continual Learning for Text Classification with Information Disentanglement Based Regularization. Continual learning has become increasingly important as it enables NLP models to constantly learn and gain knowledge over time. Previous continual learning methods are mainly designed to preserve knowledge from previous tasks, without much emphasis on how to well generalize models to new tasks. In this work, we propose an information disentanglement based regularization method for continual learning on text classification. Our proposed method first disentangles text hidden spaces into representations that are generic to all tasks and representations specific to each individual task, and further regularizes these representations differently to better constrain the knowledge required to generalize. We also introduce two simple auxiliary tasks next sentence prediction and task id prediction, for learning better generic and specific representation spaces. Experiments conducted on large scale benchmarks demonstrate the effectiveness of our method in continual text classification tasks with various sequences and lengths over state of the art baselines. We have publicly released our code at https github.com GT SALT IDBR.


The closure of the space of spectral curves of constant mean curvature tori in mathbb R 3 with spectral genus 2. Where mathcal H 2 is the space of spectral curves of real solutions of the sinh Gordon equation of spectral genus 2 , and mathcal S 2 is the closure in mathcal H 2 of the space of spectral curves of constant mean curvature tori in mathbb R 3 of spectral genus 2 , we study the boundary of mathcal S 2 at first in the space of polynomials of degree leq 4 , and then also the boundary where coefficients of the spectral polynomial go to infty . We also prove that the Wente family, i.e. the family of members of mathcal S 2 1 described by polynomials with real coefficients, is 1 dimensional, smooth and connected.


The Logic of Graph Neural Networks. Graph neural networks (GNNs) are deep learning architectures for machine learning problems on graphs. It has recently been shown that the expressiveness of GNNs can be characterised precisely by the combinatorial Weisfeiler Leman algorithms and by finite variable counting logics. The correspondence has even led to new, higher order GNNs corresponding to the WL algorithm in higher dimensions. The purpose of this paper is to explain these descriptive characterisations of GNNs.


ASPCNet A Deep Adaptive Spatial Pattern Capsule Network for Hyperspectral Image Classification. Previous studies have shown the great potential of capsule networks for the spatial contextual feature extraction from hyperspectral images (HSIs) . However, the sampling locations of the convolutional kernels of capsules are fixed and cannot be adaptively changed according to the inconsistent semantic information of HSIs. Based on this observation, this paper proposes an adaptive spatial pattern capsule network (ASPCNet) architecture by developing an adaptive spatial pattern (ASP) unit, that can rotate the sampling location of convolutional kernels on the basis of an enlarged receptive field. Note that this unit can learn more discriminative representations of HSIs with fewer parameters. Specifically, two cascaded ASP based convolution operations (ASPConvs) are applied to input images to learn relatively high level semantic features, transmitting hierarchical structures among capsules more accurately than the use of the most fundamental features. Furthermore, the semantic features are fed into ASP based conv capsule operations (ASPCaps) to explore the shapes of objects among the capsules in an adaptive manner, further exploring the potential of capsule networks. Finally, the class labels of image patches centered on test samples can be determined according to the fully connected capsule layer. Experiments on three public datasets demonstrate that ASPCNet can yield competitive performance with higher accuracies than state of the art methods.


Chaotic dynamics of small sized charged Yukawa Dust Clusters. In a recent work, 1 the equilibrium of a cluster of charged dust particles mutually interacting with screened Coulomb force and radially confined by an externally applied electric field in a 2 D configuration was studied. It was shown that the particles arranged themselves on discrete radial rings forming a lattice structure. In some cases with the specific number of particles, no static equilibrium was observed instead, angular rotation of particles positioned at various rings was observed. In a two ringed structure, it was shown that the direction of rotation was opposite. The direction of rotation was also observed to change apparently at random time intervals. A detailed characterization of the dynamics of small sized Yukawa clusters has been carried out in the present work. In particular, it has been shown that the dynamical time reversal of angular rotation exhibits chaotic behavior.


Self Supervised Real time Video Stabilization. Videos are a popular media form, where online video streaming has recently gathered much popularity. In this work, we propose a novel method of real time video stabilization transforming a shaky video to a stabilized video as if it were stabilized via gimbals in real time. Our framework is trainable in a self supervised manner, which does not require data captured with special hardware setups (i.e., two cameras on a stereo rig or additional motion sensors). Our framework consists of a transformation estimator between given frames for global stability adjustments, followed by scene parallax reduction module via spatially smoothed optical flow for further stability. Then, a margin inpainting module fills in the missing margin regions created during stabilization to reduce the amount of post cropping. These sequential steps reduce distortion and margin cropping to a minimum while enhancing stability. Hence, our approach outperforms state of the art real time video stabilization methods as well as offline methods that require camera trajectory optimization. Our method procedure takes approximately 24.3 ms yielding 41 fps regardless of resolution (e.g., 480p or 1080p).


Enabling a Social Robot to Process Social Cues to Detect when to Help a User. It is important for socially assistive robots to be able to recognize when a user needs and wants help. Such robots need to be able to recognize human needs in a real time manner so that they can provide timely assistance. We propose an architecture that uses social cues to determine when a robot should provide assistance. Based on a multimodal fusion approach upon eye gaze and language modalities, our architecture is trained and evaluated on data collected in a robot assisted Lego building task. By focusing on social cues, our architecture has minimal dependencies on the specifics of a given task, enabling it to be applied in many different contexts. Enabling a social robot to recognize a user's needs through social cues can help it to adapt to user behaviors and preferences, which in turn will lead to improved user experiences.


Norms on complex matrices induced by complete homogeneous symmetric polynomials. We introduce a remarkable new family of norms on the space of n times n complex matrices. These norms arise from the combinatorial properties of symmetric functions, and their construction and validation involve probability theory, partition combinatorics, and trace polynomials in noncommuting variables. Our norms enjoy many desirable analytic and algebraic properties, such as an elegant determinantal interpretation and the ability to distinguish certain graphs that other matrix norms cannot. Furthermore, they give rise to new dimension independent tracial inequalities. Their potential merits further investigation.


Hierarchical Hybrid Error Correction for Time Sensitive Devices at the Edge. Computational storage, known as a solution to significantly reduce the latency by moving data processing down to the data storage, has received wide attention because of its potential to accelerate data driven devices at the edge. To meet the insatiable appetite for complicated functionalities tailored for intelligent devices such as autonomous vehicles, properties including heterogeneity, scalability, and flexibility are becoming increasingly important. Based on our prior work on hierarchical erasure coding that enables scalability and flexibility in cloud storage, we develop an efficient decoding algorithm that corrects a mixture of errors and erasures simultaneously. We first extract the basic component code, the so called extended Cauchy (EC) codes, of the proposed coding solution. We prove that the class of EC codes is strictly larger than that of relevant codes with known explicit decoding algorithms. Motivated by this finding, we then develop an efficient decoding method for the general class of EC codes, based on which we propose the local and global decoding algorithms for the hierarchical codes. Our proposed hybrid error correction not only enables the usage of hierarchical codes in computational storage at the edge, but also applies to any Cauchy like codes and allows potentially wider applications of the EC codes.


Will it Crease or Cease? A study of Debulking of Air Pockets in Automated Prepreg Composite Layup. Automatic draping of carbon fiber prepreg plies for the aerospace industry is a promising technique for lowering the manufacturing costs and to this end, a thorough in process quality control is crucial. In this paper, out of plane defects in the layup are investigated. After draping, air pockets are occasionally encountered. The question is, if such apparent defects can be mitigated sufficiently during vacuum debulking. The 3D topology is measured by means of a structured light 3D scanner and air pockets are segmented. An approximate mass spring ply model is used to study the behavior of the air pockets during application of vacuum pressure. The model is computationally fast and will indicate online whether the air pocket will be removed or manual intervention is required. Upon comparing the model predictions with experimental data, it is shown that the system is capable of correctly predicting 13 out of 14 air pockets in a test layup.


Classifying Scientific Publications with BERT Is Self Attention a Feature Selection Method?. We investigate the self attention mechanism of BERT in a fine tuning scenario for the classification of scientific articles over a taxonomy of research disciplines. We observe how self attention focuses on words that are highly related to the domain of the article. Particularly, a small subset of vocabulary words tends to receive most of the attention. We compare and evaluate the subset of the most attended words with feature selection methods normally used for text classification in order to characterize self attention as a possible feature selection approach. Using ConceptNet as ground truth, we also find that attended words are more related to the research fields of the articles. However, conventional feature selection methods are still a better option to learn classifiers from scratch. This result suggests that, while self attention identifies domain relevant terms, the discriminatory information in BERT is encoded in the contextualized outputs and the classification layer. It also raises the question whether injecting feature selection methods in the self attention mechanism could further optimize single sequence classification using transformers.


Personal Devices for Contact Tracing Smartphones and Wearables to Fight Covid 19. Digital contact tracing has emerged as a viable tool supplementing manual contact tracing. To date, more than 100 contact tracing applications have been published to slow down the spread of highly contagious Covid 19. Despite subtle variabilities among these applications, all of them achieve contact tracing by manipulating the following three components a) use a personal device to identify the user while designing a secure protocol to anonymize the user's identity b) leverage networking technologies to analyze and store the data c) exploit rich sensing features on the user device to detect the interaction among users and thus estimate the exposure risk. This paper reviews the current digital contact tracing based on these three components. We focus on two personal devices that are intimate to the user smartphones and wearables. We discuss the centralized and decentralized networking approaches that use to facilitate the data flow. Lastly, we investigate the sensing feature available on smartphones and wearables to detect the proximity between any two users and present experiments comparing the proximity sensing performance between these two personal devices.


The academic wanderer structure of collaboration network and relation with research performance. Thanks to the widespread availability of large scale datasets on scholarly outputs, science itself has come under the microscope with the aim of capturing a quantitative understanding of its workings. In this study, we leverage well established cognitive models coming from anthropology in order to characterise the personal network of collaborations between scientists, i.e., the network considered from the standpoint of each individual researcher (referred to as ego network), in terms of the cognitive investment they devote to the different collaborations. Building upon these models, we study the interplay between the structure of academic collaborations, academic performance, and academic mobility at different career stages. We take into account both purely academic mobility (i.e., the number of affiliation changes) and geographical mobility (i.e., physical relocations to different countries). For our investigation, we rely on a dataset comprising the geo referenced publications of a group of 81,500 authors extracted from Scopus, one of the biggest repositories of academic knowledge. Our main finding is that there is a clear correlation between the structure of co authorship ego networks and academic performance indices the more one publishes and the higher their impact, the larger their collaboration network. However, we observe a capacity bound effect, whereby, beyond a certain point, higher performances become increasingly less correlated with large collaboration networks. We also find that international academic migrants are better at growing their networks than researchers that only migrate within the same country, but the latter seem to be better in exploiting their collaboration to achieve higher impact. High academic mobility does not appear to translate into better academic performance or larger collaboration networks.


Divides with cusps and Kirby diagrams for line arrangements. The complement of a complexified real line arrangement is an affine surface. It is classically known that such a space has a handle decomposition up to 2 handles. We will describe the handle decomposition induced from Lefschetz hyperplane section theorem for such a space. To describe the Kirby diagram, we introduce the notion of the divide with cusps which is a generalization of the divide introduced by A'Campo.


Arbitrary Length k Anonymous Dining Cryptographers Communication. Dining cryptographers networks (DCN) can achieve information theoretical privacy. Unfortunately, they are not well suited for peer to peer networks as they are used in blockchain applications to disseminate transactions and blocks among participants. In previous but preliminary work, we proposed a threephase approach with an initial phase based on a DCN with a group size of k while later phases take care of the actual broadcast within a peer to peer network. This paper describes our DCN protocol in detail and adds a performance evaluation powered by our proof of concept implementation. Our contributions are (i) an extension of the DCN protocol by von Ahn for fair delivery of arbitrarily long messages sent by potentially multiple senders, (ii) a privacy and security analysis of this extension, (iii) various performance optimisation especially for best case operation, and (iv) a performance evaluation. The latter uses a latency of 100 ms and a bandwidth limit of 50 Mbit s between participants. The interquartile range of the largest test of the highly secured version took 35s 1.25s for a full run. All tests of the optimized common case mode show the dissemination of a message within 0.5s 0.1s. These results compare favourably to previously established protocols for k anonymous transmission of fixed size messages, outperforming the original protocol for messages as small as 2 KiB.


Few Shot Learning with a Strong Teacher. Few shot learning (FSL) aims to train a strong classifier using limited labeled examples. Many existing works take the meta learning approach, sampling few shot tasks in turn and optimizing the few shot learner's performance on classifying the query examples. In this paper, we point out two potential weaknesses of this approach. First, the sampled query examples may not provide sufficient supervision for the few shot learner. Second, the effectiveness of meta learning diminishes sharply with increasing shots (i.e., the number of training examples per class). To resolve these issues, we propose a novel objective to directly train the few shot learner to perform like a strong classifier. Concretely, we associate each sampled few shot task with a strong classifier, which is learned with ample labeled examples. The strong classifier has a better generalization ability and we use it to supervise the few shot learner. We present an efficient way to construct the strong classifier, making our proposed objective an easily plug and play term to existing meta learning based FSL methods. We validate our approach in combinations with many representative meta learning methods. On several benchmark datasets including miniImageNet and tiredImageNet, our approach leads to a notable improvement across a variety of tasks. More importantly, with our approach, meta learning based FSL methods can consistently outperform non meta learning based ones, even in a many shot setting, greatly strengthening their applicability.


Dirac operators on foliations with invariant transverse measures. We extend the groundbreaking results of Gromov and Lawson on positive scalar curvature and the Dirac operator on complete Riemannian manifolds to Dirac operators defined along the leaves of foliations of non compact complete Riemannian manifolds which admit invariant transverse measures. We prove a relative measured index theorem for pairs of such manifolds, foliations and operators, which are identified off compact subsets of the manifolds. We assume that the spectral projections of the leafwise operators for some interval 0, epsilon , epsilon 0 , have finite dimensional images when paired with the invariant transverse measures. As a prime example, we show that if the zeroth order operators in the associated Bochner Identities are uniformly positive off compact subsets of the manifolds, then they satisfies the hypotheses of our relative measured index theorem. Using these results, we show that for a large collection of spin foliations, the space of positive scalar curvature metrics on each foliation has infinitely many path connected components.


Analytic quasi steady evolution of a marginally unstable wave in the presence of drag and scattering. The 1D bump on tail problem is studied in order to determine the influence of drag on quasi steady solutions near marginal stability ( 1 gamma d gamma L ll 1 ) when effective collisions are much larger than the instability growth rate ( nu gg gamma ). In this common tokamak regime, it is rigorously shown that the paradigmatic Berk Breizman cubic equation for the nonlinear mode evolution reduces to a much simpler differential equation, dubbed the time local cubic equation, which can be solved directly. It is found that in addition to increasing the saturation amplitude, drag introduces a shift in the apparent oscillation frequency by modulating the saturated wave envelope. Excellent agreement is found between the analytic solution for the mode evolution and both the numerically integrated Berk Breizman cubic equation and fully nonlinear 1D Vlasov simulations. Experimentally isolating the contribution of drag to the saturated mode amplitude for verification purposes is explored but complicated by the reality that the amount of drag can not be varied independently of other key parameters in realistic scenarios. While the effect of drag is modest when the ratio of drag to scattering alpha nu is very small, it can become substantial when alpha nu gtrsim 0.5 , suggesting that drag should be accounted for in quantitative models of fast ion driven instabilities in fusion plasmas.


Lethal DNA damages caused by ion induced shock waves in cells. The elucidation of fundamental mechanisms underlying ion induced radiation damage of biological systems is crucial for the advancement of radiotherapy with ion beams and for radiation protection in space. The study of ion induced biodamage using the phenomenon based MultiScale Approach to the physics of radiation damage with ions (MSA) has led to the prediction of nanoscale shock waves (SW) that are created by ions in the biological medium at the high linear energy transfer (LET). The high LET regime corresponding to energy losses higher than 1 keV nm is typical for ions heavier than carbon in biological media at the Bragg peak region. This paper reveals that the thermomechanical stress of the DNA molecule by the ion induced SW becomes the dominant mechanism of complex DNA damage at the high LET ion irradiation. Damage of the DNA molecule in water caused by the ion induced SW is studied by means of reactive molecular dynamics simulations. Five projectile ions (C, O, Si, Ar, and Fe) at the Bragg peak energies are considered. Simulations reveal that Ar and, especially, Fe ions induce multiple bond breakages in a DNA segment containing 20 base pairs. The DNA damage produced in segments of such size leads to complex irreparable lesions in a cell. This makes the SW induced thermomechanical stress the dominant mechanism of complex DNA damage at the high LET ion irradiation. A detailed theory for evaluating the DNA damage caused by ions at high LET is formulated and integrated into the MSA formalism. The theoretical analysis reveals that a single ion hitting a cell nucleus at high LET is sufficient to produce highly complex, lethal damages to a cell by the SW induced thermomechanical stress. A good agreement of the calculated cell survival probabilities with experimental data obtained for the cell irradiation with iron ions provides strong experimental evidence of the ion induced SW effect.