Using optical clock transitions in Cu II and Yb III for time keeping and search for new physics. We study the 1 S 0 3 D 2 and 1 S 0 3 D 3 transitions in Cu II and the 1 S 0 3 P rm o 2 transition in Yb III as possible candidates for the optical clock transitions. A recently developed version of the configuration (CI) method, designed for a large number of electrons above closed shell core, is used to carry out the calculation. We calculate excitation energies, transition rates, lifetimes, scalar static polarizabilities of the ground and clock states, and blackbody radiation shift. We demonstrate that the considered transitions have all features of the clock transition leading to prospects of highly accurate measurements. Search for new physics, such as time variation of the fine structure constant, is also investigated.


MUSIQ Multi scale Image Quality Transformer. Image quality assessment (IQA) is an important research topic for understanding and improving visual experience. The current state of the art IQA methods are based on convolutional neural networks (CNNs). The performance of CNN based models is often compromised by the fixed shape constraint in batch training. To accommodate this, the input images are usually resized and cropped to a fixed shape, causing image quality degradation. To address this, we design a multi scale image quality Transformer (MUSIQ) to process native resolution images with varying sizes and aspect ratios. With a multi scale image representation, our proposed method can capture image quality at different granularities. Furthermore, a novel hash based 2D spatial embedding and a scale embedding is proposed to support the positional embedding in the multi scale representation. Experimental results verify that our method can achieve state of the art performance on multiple large scale IQA datasets such as PaQ 2 PiQ, SPAQ and KonIQ 10k.


Exploration of Visual Features and their weighted additive fusion for Video Captioning. Video captioning is a popular task that challenges models to describe events in videos using natural language. In this work, we investigate the ability of various visual feature representations derived from state of the art convolutional neural networks to capture high level semantic context. We introduce the Weighted Additive Fusion Transformer with Memory Augmented Encoders (WAFTM), a captioning model that incorporates memory in a transformer encoder and uses a novel method, to fuse features, that ensures due importance is given to more significant representations. We illustrate a gain in performance realized by applying Word Piece Tokenization and a popular REINFORCE algorithm. Finally, we benchmark our model on two datasets and obtain a CIDEr of 92.4 on MSVD and a METEOR of 0.091 on the ActivityNet Captions Dataset.


Robust and Accurate Superquadric Recovery a Probabilistic Approach. Interpreting objects with basic geometric primitives has long been studied in computer vision. Among geometric primitives, superquadrics are well known for their ability to represent a wide range of shapes with few parameters. However, as the first and foremost step, recovering superquadrics accurately and robustly from 3D data still remains challenging. The existing methods are subject to local optima and sensitive to noise and outliers in real world scenarios, resulting in frequent failure in capturing geometric shapes. In this paper, we propose the first probabilistic method to recover superquadrics from point clouds. Our method builds a Gaussian uniform mixture model (GUM) on the parametric surface of a superquadric, which explicitly models the generation of outliers and noise. The superquadric recovery is formulated as a Maximum Likelihood Estimation (MLE) problem. We propose an algorithm, Expectation, Maximization, and Switching (EMS), to solve this problem, where (1) outliers are predicted from the posterior perspective (2) the superquadric parameter is optimized by the trust region reflective algorithm and (3) local optima are avoided by globally searching and switching among parameters encoding similar superquadrics. We show that our method can be extended to the multi superquadrics recovery for complex objects. The proposed method outperforms the state of the art in terms of accuracy, efficiency, and robustness on both synthetic and real world datasets. The code is at http github.com bmlklwx EMS superquadric fitting.git.


RoboCup Home Education 2020 Best Performance RoboBreizh, a modular approach. Every year, the Robocup Home competition challenges teams and robots' abilities. In 2020, the RoboCup Home Education challenge was organized online, altering the usual competition rules. In this paper, we present the latest developments that lead the RoboBreizh team to win the contest. These developments include several modules linked to each other allowing the Pepper robot to understand, act and adapt itself to a local environment. Up to date available technologies have been used for navigation and dialogue. First contribution includes combining object detection and pose estimation techniques to detect user's intention. Second contribution involves using Learning by Demonstrations to easily learn new movements that improve the Pepper robot's skills. This proposal won the best performance award of the 2020 RoboCup Home Education challenge.


Bagging, optimized dynamic mode decomposition (BOP DMD) for robust, stable forecasting with spatial and temporal uncertainty quantification. Dynamic mode decomposition (DMD) provides a regression framework for adaptively learning a best fit linear dynamics model over snapshots of temporal, or spatio temporal, data. A diversity of regression techniques have been developed for producing the linear model approximation whose solutions are exponentials in time. For spatio temporal data, DMD provides low rank and interpretable models in the form of dominant modal structures along with their exponential oscillatory behavior in time. The majority of DMD algorithms, however, are prone to bias errors from noisy measurements of the dynamics, leading to poor model fits and unstable forecasting capabilities. The optimized DMD algorithm minimizes the model bias with a variable projection optimization, thus leading to stabilized forecasting capabilities. Here, the optimized DMD algorithm is improved by using statistical bagging methods whereby a single set of snapshots is used to produce an ensemble of optimized DMD models. The outputs of these models are averaged to produce a bagging, optimized dynamic mode decomposition (BOP DMD). BOP DMD not only improves performance, it also robustifies the model and provides both spatial and temporal uncertainty quantification (UQ). Thus unlike currently available DMD algorithms, BOP DMD provides a stable and robust model for probabilistic, or Bayesian forecasting with comprehensive UQ metrics.


Design of a prototype laser plasma injector for the DESY II synchrotron. The present state of progress in laser wakefield acceleration encourages considering it as a practical alternative to conventional particle accelerators. A promising application would be to use a laser plasma accelerator as an injector for a synchrotron light source. Yet, the energy spread and jitter of the laser plasma beam pose a significant difficulty for an efficient injection. In this paper we propose a design of a prototype injector to deliver 500 MeV low intensity electron bunches to the DESY II electron synchrotron. The design utilizes presently available conventional accelerator technology, such as a chicane and an X band radio frequency cavity, to reduce the energy spread and jitter of the electron beam down to a sub per mille level.


On invariant linearization of Lie groupoids. The Linearization Theorem for proper Lie groupoids organizes and generalizes several results for classic geometries. Despite the various approaches and recent works on the subject, the problem of understanding invariant linearization remains somehow open. We address it here, by first giving a counter example to a previous conjecture, and then proving a sufficient criterion that uses compatible complete metrics and covers the case of proper group actions. We also show a partial converse that fixes and extends previous results in the literature.


Reverse Differentiation via Predictive Coding. Deep learning has redefined the field of artificial intelligence (AI) thanks to the rise of artificial neural networks, which are architectures inspired by their neurological counterpart in the brain. Through the years, this dualism between AI and neuroscience has brought immense benefits to both fields, allowing neural networks to be used in dozens of applications. These networks use an efficient implementation of reverse differentiation, called backpropagation (BP). This algorithm, however, is often criticized for its biological implausibility (e.g., lack of local update rules for the parameters). Therefore, biologically plausible learning methods that rely on predictive coding (PC), a framework for describing information processing in the brain, are increasingly studied. Recent works prove that these methods can approximate BP up to a certain margin on multilayer perceptrons (MLPs), and asymptotically on any other complex model, and that zero divergence inference learning (Z IL), a variant of PC, is able to exactly implement BP on MLPs. However, the recent literature shows also that there is no biologically plausible method yet that can exactly replicate the weight update of BP on complex models. To fill this gap, in this paper, we generalize (PC and) Z IL by directly defining them on computational graphs, and show that it can perform exact reverse differentiation. What results is the first biologically plausible algorithm that is equivalent to BP in the way of updating parameters on any neural network, providing a bridge between the interdisciplinary research of neuroscience and deep learning.


Iterative process of order 2 without inverting the derivative. We prove the sufficient conditions for convergence of a certain iterative process of order 2 for solving nonlinear functional equations, which does not require inverting the derivative. We translate and detail our results for a system of nonlinear equations, and apply it for some numerical example which illustrates our theorems.


Causal Bandits on General Graphs. We study the problem of determining the best intervention in a Causal Bayesian Network (CBN) specified only by its causal graph. We model this as a stochastic multi armed bandit (MAB) problem with side information, where the interventions correspond to the arms of the bandit instance. First, we propose a simple regret minimization algorithm that takes as input a semi Markovian causal graph with atomic interventions and possibly unobservable variables, and achieves tilde O ( sqrt M T ) expected simple regret, where M is dependent on the input CBN and could be very small compared to the number of arms. We also show that this is almost optimal for CBNs described by causal graphs having an n ary tree structure. Our simple regret minimization results, both upper and lower bound, subsume previous results in the literature, which assumed additional structural restrictions on the input causal graph. In particular, our results indicate that the simple regret guarantee of our proposed algorithm can only be improved by considering more nuanced structural restrictions on the causal graph. Next, we propose a cumulative regret minimization algorithm that takes as input a general causal graph with all observable nodes and atomic interventions and performs better than the optimal MAB algorithm that does not take causal side information into account. We also experimentally compare both our algorithms with the best known algorithms in the literature. To the best of our knowledge, this work gives the first simple and cumulative regret minimization algorithms for CBNs with general causal graphs under atomic interventions and having unobserved confounders.


A Note on Argumentative Topology Circularity and Syllogisms as Unsolved Problems. In the last couple of years there were a few attempts to apply topological data analysis to text, and in particular to natural language inference. A recent work by Tymochko et al. suggests the possibility of capturing the notion of logical shape in text,' using topological delay embeddings,' a technique derived from dynamical systems, applied to word embeddings. In this note we reconstruct their argument and show, using several old and new examples, that the problem of connecting logic, topology and text is still very much unsolved. We conclude that there is no clear answer to the question Can we find a circle in a circular argument?'' We point out some possible avenues of exploration. The code used in our experiment is also shown.


Remixing Functionally Graded Structures Data Driven Topology Optimization with Multiclass Shape Blending. To create heterogeneous, multiscale structures with unprecedented functionalities, recent topology optimization approaches design either fully aperiodic systems or functionally graded structures, which compete in terms of design freedom and efficiency. We propose to inherit the advantages of both through a data driven framework for multiclass functionally graded structures that mixes several families, i.e., classes, of microstructure topologies to create spatially varying designs with guaranteed feasibility. The key is a new multiclass shape blending scheme that generates smoothly graded microstructures without requiring compatible classes or connectivity and feasibility constraints. Moreover, it transforms the microscale problem into an efficient, low dimensional one without confining the design to predefined shapes. Compliance and shape matching examples using common truss geometries and diversity based freeform topologies demonstrate the versatility of our framework, while studies on the effect of the number and diversity of classes illustrate the effectiveness. The generality of the proposed methods supports future extensions beyond the linear applications presented.


The effect of rigid electron rotation on the Grad Shafranov equilibria of a class of FRC devices. Rigid electron rotation of a fully penetrated Rotamak FRC produces a pressure flux function that is more peaked than the Solov'ev flux function. This paper explores the implications of this peaked pressure flux function, including the isothermal case, which appear when the temperature profile is broader than the density profile, creating both benefits and challenges to a Rotamak FRC based fusion reactor. In this regime, the density distribution becomes very peaked, enhancing the fusion power. The separatrix has a tendency to become oblate, which can be mitigated by flux conserving current loops. Plasma extends outside the separatrix, notably in the open field line region. This model does not apply to very kinetic FRCs or FRCs in which there are significant ion flows, but it may have some applicability to their outer layers.


Dungeon and Platformer Level Blending and Generation using Conditional VAEs. Variational autoencoders (VAEs) have been used in prior works for generating and blending levels from different games. To add controllability to these models, conditional VAEs (CVAEs) were recently shown capable of generating output that can be modified using labels specifying desired content, albeit working with segments of levels and platformers exclusively. We expand these works by using CVAEs for generating whole platformer and dungeon levels, and blending levels across these genres. We show that CVAEs can reliably control door placement in dungeons and progression direction in platformer levels. Thus, by using appropriate labels, our approach can generate whole dungeons and platformer levels of interconnected rooms and segments respectively as well as levels that blend dungeons and platformers. We demonstrate our approach using The Legend of Zelda, Metroid, Mega Man and Lode Runner.


Virtually free groups are stable in permutations. We prove that finitely generated virtually free groups are stable in permutations. As an application, we show that almost periodic almost automorphisms of labelled graphs are close to periodic automorphisms.


Lagrangian Cobordisms between Enriched Knot Diagrams. In this paper, we use holomorphic curve techniques to define new obstructions to the existence of Lagrangian cobordisms in mathbb R 4 which depend only on the data of enriched knot diagrams of the boundaries. We provide example applications such as the growing and shrinking of boundary knots of Lagrangians depending on the signs of crossings.


What we are is more than what we do. If we take the subjective character of consciousness seriously, consciousness becomes a matter of "being" rather than "doing". Because "doing" can be dissociated from "being", functional criteria alone are insufficient to decide whether a system possesses the necessary requirements for being a physical substrate of consciousness. The dissociation between "being" and "doing" is most salient in artificial general intelligence, which may soon replicate any human capacity computers can perform complex functions (in the limit resembling human behavior) in the absence of consciousness. Complex behavior becomes meaningless if it is not performed by a conscious being.


Transfer Learning Based Model Protection With Secret Key. We propose a novel method for protecting trained models with a secret key so that unauthorized users without the correct key cannot get the correct inference. By taking advantage of transfer learning, the proposed method enables us to train a large protected model like a model trained with ImageNet by using a small subset of a training dataset. It utilizes a learnable encryption step with a secret key to generate learnable transformed images. Models with pre trained weights are fine tuned by using such transformed images. In experiments with the ImageNet dataset, it is shown that the performance of a protected model was close to that of a non protected model when the correct key was given, while the accuracy tremendously dropped when an incorrect key was used. The protected model was also demonstrated to be robust against key estimation attacks.


P Tuning v2 Prompt Tuning Can Be Comparable to Fine tuning Universally Across Scales and Tasks. Prompt tuning, which only tunes continuous prompts with a frozen language model, substantially reduces per task storage and memory usage at training. However, in the context of NLU, prior work reveals that prompt tuning does not perform well for normal sized pretrained models. We also find that existing methods of prompt tuning cannot handle hard sequence labeling tasks, indicating a lack of universality. We present a novel empirical finding that properly optimized prompt tuning can be universally effective across a wide range of model scales and NLU tasks. It matches the performance of finetuning while having only 0.1 3 tuned parameters. Our method P Tuning v2 is an implementation of Deep Prompt Tuning cite li2021prefix,qin2021learning optimized and adapted for NLU. Given the universality and simplicity of P Tuning v2, we believe it can serve as an alternative to finetuning and a strong baseline for future research.Our code and data are released at https github.com THUDM P tuning v2.


XVFI eXtreme Video Frame Interpolation. In this paper, we firstly present a dataset (X4K1000FPS) of 4K videos of 1000 fps with the extreme motion to the research community for video frame interpolation (VFI), and propose an extreme VFI network, called XVFI Net, that first handles the VFI for 4K videos with large motion. The XVFI Net is based on a recursive multi scale shared structure that consists of two cascaded modules for bidirectional optical flow learning between two input frames (BiOF I) and for bidirectional optical flow learning from target to input frames (BiOF T). The optical flows are stably approximated by a complementary flow reversal (CFR) proposed in BiOF T module. During inference, the BiOF I module can start at any scale of input while the BiOF T module only operates at the original input scale so that the inference can be accelerated while maintaining highly accurate VFI performance. Extensive experimental results show that our XVFI Net can successfully capture the essential information of objects with extremely large motions and complex textures while the state of the art methods exhibit poor performance. Furthermore, our XVFI Net framework also performs comparably on the previous lower resolution benchmark dataset, which shows a robustness of our algorithm as well. All source codes, pre trained models, and proposed X4K1000FPS datasets are publicly available at https github.com JihyongOh XVFI.


Finding stationary points on bounded rank matrices A geometric hurdle and a smooth remedy. We consider the problem of provably finding a stationary point of a smooth function to be minimized on the variety of bounded rank matrices. This turns out to be unexpectedly delicate. We trace the difficulty back to a geometric obstacle On a nonsmooth set, there may be sequences of points along which standard measures of stationarity tend to zero, but whose limit points are not stationary. We name such events apocalypses, as they can cause optimization algorithms to converge to non stationary points. We illustrate this explicitly for an existing optimization algorithm on bounded rank matrices. To provably find stationary points, we modify a trust region method on a standard smooth parameterization of the variety. The method relies on the known fact that second order stationary points on the parameter space map to stationary points on the variety. Our geometric observations and proposed algorithm generalize beyond bounded rank matrices. We give a geometric characterization of apocalypses on general constraint sets, which implies that Clarke regular sets do not admit apocalypses. Such sets include smooth manifolds, manifolds with boundaries, and convex sets. Our trust region method supports parameterization by any complete Riemannian manifold.


Reasoning Graph Networks for Kinship Verification from Star shaped to Hierarchical. In this paper, we investigate the problem of facial kinship verification by learning hierarchical reasoning graph networks. Conventional methods usually focus on learning discriminative features for each facial image of a paired sample and neglect how to fuse the obtained two facial image features and reason about the relations between them. To address this, we propose a Star shaped Reasoning Graph Network (S RGN). Our S RGN first constructs a star shaped graph where each surrounding node encodes the information of comparisons in a feature dimension and the central node is employed as the bridge for the interaction of surrounding nodes. Then we perform relational reasoning on this star graph with iterative message passing. The proposed S RGN uses only one central node to analyze and process information from all surrounding nodes, which limits its reasoning capacity. We further develop a Hierarchical Reasoning Graph Network (H RGN) to exploit more powerful and flexible capacity. More specifically, our H RGN introduces a set of latent reasoning nodes and constructs a hierarchical graph with them. Then bottom up comparative information abstraction and top down comprehensive signal propagation are iteratively performed on the hierarchical graph to update the node features. Extensive experimental results on four widely used kinship databases show that the proposed methods achieve very competitive results.


CoHaptics Development of Human Robot Collaborative System with Forearm worn Haptic Display to Increase Safety in Future Factories. Complex tasks require human collaboration since robots do not have enough dexterity. However, robots are still used as instruments and not as collaborative systems. We are introducing a framework to ensure safety in a human robot collaborative environment. The system is composed of a haptic feedback display, low cost wearable mocap, and a new collision avoidance algorithm based on the Artificial Potential Fields (APF). Wearable optical motion capturing system enables tracking the human hand position with high accuracy and low latency on large working areas. This study evaluates whether haptic feedback improves safety in human robot collaboration. Three experiments were carried out to evaluate the performance of the proposed system. The first one evaluated human responses to the haptic device during interaction with the Robot Tool Center Point (TCP). The second experiment analyzed human robot behavior during an imminent collision. The third experiment evaluated the system in a collaborative activity in a shared working environment. This study had shown that when haptic feedback in the control loop was included, the safe distance (minimum robot obstacle distance) increased by 4.1 cm from 12.39 cm to 16.55 cm, and the robot's path, when the collision avoidance algorithm was activated, was reduced by 81 .


Relating Neural Text Degeneration to Exposure Bias. This work focuses on relating two mysteries in neural based text generation exposure bias, and text degeneration. Despite the long time since exposure bias was mentioned and the numerous studies for its remedy, to our knowledge, its impact on text generation has not yet been verified. Text degeneration is a problem that the widely used pre trained language model GPT 2 was recently found to suffer from (Holtzman et al., 2020). Motivated by the unknown causation of the text degeneration, in this paper we attempt to relate these two mysteries. Specifically, we first qualitatively quantitatively identify mistakes made before text degeneration occurs. Then we investigate the significance of the mistakes by inspecting the hidden states in GPT 2. Our results show that text degeneration is likely to be partly caused by exposure bias. We also study the self reinforcing mechanism of text degeneration, explaining why the mistakes amplify. In sum, our study provides a more concrete foundation for further investigation on exposure bias and text degeneration problems.


Understanding the Scalability of Hyperledger Fabric. The rapid growth of blockchain systems leads to increasing interest in understanding and comparing blockchain performance at scale. In this paper, we focus on analyzing the performance of Hyperledger Fabric v1.1 one of the most popular permissioned blockchain systems. Prior works have analyzed Hyperledger Fabric v0.6 in depth, but newer versions of the system undergo significant changes that warrant new analysis. Existing works on benchmarking the system are limited in their scope some consider only small networks, others consider scalability of only parts of the system instead of the whole. We perform a comprehensive performance analysis of Hyperledger Fabric v1.1 at scale. We extend an existing benchmarking tool to conduct experiments over many servers while scaling all important components of the system. Our results demonstrate that Fabric v1.1's scalability bottlenecks lie in the communication overhead between the execution and ordering phase. Furthermore, we show that scaling the Kafka cluster that is used for the ordering phase does not affect the overall throughput.


Relational graph convolutional networks for predicting blood brain barrier penetration of drug molecules. Evaluating the blood brain barrier (BBB) permeability of drug molecules is a critical step in brain drug development. Traditional methods for the evaluation require complicated in vitro or in vivo testing. Alternatively, in silico predictions based on machine learning have proved to be a cost efficient way to complement the in vitro and in vivo methods. However, the performance of the established models has been limited by their incapability of dealing with the interactions between drugs and proteins, which play an important role in the mechanism behind the BBB penetrating behaviors. To address this limitation, we employed the relational graph convolutional network (RGCN) to handle the drug protein interactions as well as the properties of each individual drug. The RGCN model achieved an overall accuracy of 0.872, an AUROC of 0.919 and an AUPRC of 0.838 for the testing dataset with the drug protein interactions and the Mordred descriptors as the input. Introducing drug drug similarity to connect structurally similar drugs in the data graph further improved the testing results, giving an overall accuracy of 0.876, an AUROC of 0.926 and an AUPRC of 0.865. In particular, the RGCN model was found to greatly outperform the LightGBM base model when evaluated with the drugs whose BBB penetration was dependent on drug protein interactions. Our model is expected to provide high confidence predictions of BBB permeability for drug prioritization in the experimental screening of BBB penetrating drugs.


Probabilistic Model Checking and Autonomy. Design and control of autonomous systems that operate in uncertain or adversarial environments can be facilitated by formal modelling and analysis. Probabilistic model checking is a technique to automatically verify, for a given temporal logic specification, that a system model satisfies the specification, as well as to synthesise an optimal strategy for its control. This method has recently been extended to multi agent systems that exhibit competitive or cooperative behaviour modelled via stochastic games and synthesis of equilibria strategies. In this paper, we provide an overview of probabilistic model checking, focusing on models supported by the PRISM and PRISM games model checkers. This includes fully observable and partially observable Markov decision processes, as well as turn based and concurrent stochastic games, together with associated probabilistic temporal logics. We demonstrate the applicability of the framework through illustrative examples from autonomous systems. Finally, we highlight research challenges and suggest directions for future work in this area.


Liquidation, Leverage and Optimal Margin in Bitcoin Futures Markets. Using the generalized extreme value theory to characterize tail distributions, we address liquidation, leverage, and optimal margins for bitcoin long and short futures positions. The empirical analysis of perpetual bitcoin futures on BitMEX shows that (1) daily forced liquidations to out standing futures are substantial at 3.51 , and 1.89 for long and short (2) investors got forced liquidation do trade aggressively with average leverage of 60X and (3) exchanges should elevate current 1 margin requirement to 33 (3X leverage) for long and 20 (5X leverage) for short to reduce the daily margin call probability to 1 . Our results further suggest normality assumption on return significantly underestimates optimal margins. Policy implications are also discussed.


Rectangular, Range, and Restricted AONTs Three Generalizations of All or Nothing Transforms. All or nothing transforms (AONTs) were originally defined by Rivest as bijections from s input blocks to s output blocks such that no information can be obtained about any input block in the absence of any output block. Numerous generalizations and extensions of all or nothing transforms have been discussed in recent years, many of which are motivated by diverse applications in cryptography, information security, secure distributed storage, etc. In particular, t AONTs, in which no information can be obtained about any t input blocks in the absence of any t output blocks, have received considerable study. In this paper, we study three generalizations of AONTs that are motivated by applications due to Pham et al. and Oliveira et al. We term these generalizations rectangular, range, and restricted AONTs. Briefly, in a rectangular AONT, the number of outputs is greater than the number of inputs. A range AONT satisfies the t AONT property for a range of consecutive values of t . Finally, in a restricted AONT, the unknown outputs are assumed to occur within a specified set of "secure" output blocks. We study existence and non existence and provide examples and constructions for these generalizations. We also demonstrate interesting connections with combinatorial structures such as orthogonal arrays, split orthogonal arrays, MDS codes and difference matrices.


What About the Precedent An Information Theoretic Analysis of Common Law. In common law, the outcome of a new case is determined mostly by precedent cases, rather than by existing statutes. However, how exactly does the precedent influence the outcome of a new case? Answering this question is crucial for guaranteeing fair and consistent judicial decision making. We are the first to approach this question computationally by comparing two longstanding jurisprudential views Halsbury's, who believes that the arguments of the precedent are the main determinant of the outcome, and Goodhart's, who believes that what matters most is the precedent's facts. We base our study on the corpus of legal cases from the European Court of Human Rights (ECtHR), which allows us to access not only the case itself, but also cases cited in the judges' arguments (i.e. the precedent cases). Taking an information theoretic view, and modelling the question as a case outcome classification task, we find that the precedent's arguments share 0.38 nats of information with the case's outcome, whereas precedent's facts only share 0.18 nats of information (i.e., 58 less) suggesting Halsbury's view may be more accurate in this specific court. We found however in a qualitative analysis that there are specific statues where Goodhart's view dominates, and present some evidence these are the ones where the legal concept at hand is less straightforward.


Quenched local convergence of Boltzmann planar maps. Stephenson (2018) established annealed local convergence of Boltzmann planar maps conditioned to be large. The present work uses results on rerooted multi type branching trees to prove a quenched version of this limit.


The Box Size Confidence Bias Harms Your Object Detector. Countless applications depend on accurate predictions with reliable confidence estimates from modern object detectors. It is well known, however, that neural networks including object detectors produce miscalibrated confidence estimates. Recent work even suggests that detectors' confidence predictions are biased with respect to object size and position, but it is still unclear how this bias relates to the performance of the affected object detectors. We formally prove that the conditional confidence bias is harming the expected performance of object detectors and empirically validate these findings. Specifically, we demonstrate how to modify the histogram binning calibration to not only avoid performance impairment but also improve performance through conditional confidence calibration. We further find that the confidence bias is also present in detections generated on the training data of the detector, which we leverage to perform our de biasing without using additional data. Moreover, Test Time Augmentation magnifies this bias, which results in even larger performance gains from our calibration method. Finally, we validate our findings on a diverse set of object detection architectures and show improvements of up to 0.6 mAP and 0.8 mAP50 without extra data or training.


Structure preserving model order reduction of Hamiltonian systems. We discuss the recent developments of projection based model order reduction (MOR) techniques targeting Hamiltonian problems. Hamilton's principle completely characterizes many high dimensional models in mathematical physics, resulting in rich geometric structures, with examples in fluid dynamics, quantum mechanics, optical systems, and epidemiological models. MOR reduces the computational burden associated with the approximation of complex systems by introducing low dimensional surrogate models, enabling efficient multi query numerical simulations. However, standard reduction approaches do not guarantee the conservation of the delicate dynamics of Hamiltonian problems, resulting in reduced models plagued by instability or accuracy loss over time. By approaching the reduction process from the geometric perspective of symplectic manifolds, the resulting reduced models inherit stability and conservation properties of the high dimensional formulations. We first introduce the general principles of symplectic geometry, including symplectic vector spaces, Darboux' theorem, and Hamiltonian vector fields. These notions are then used as a starting point to develop different structure preserving reduced basis (RB) algorithms, including SVD based approaches and greedy techniques. We conclude the review by addressing the reduction of problems that are not linearly reducible or in a non canonical Hamiltonian form.


NaijaNER Comprehensive Named Entity Recognition for 5 Nigerian Languages. Most of the common applications of Named Entity Recognition (NER) is on English and other highly available languages. In this work, we present our findings on Named Entity Recognition for 5 Nigerian Languages (Nigerian English, Nigerian Pidgin English, Igbo, Yoruba and Hausa). These languages are considered low resourced, and very little openly available Natural Language Processing work has been done in most of them. In this work, individual NER models were trained and metrics recorded for each of the languages. We also worked on a combined model that can handle Named Entity Recognition (NER) for any of the five languages. The combined model works well for Named Entity Recognition(NER) on each of the languages and with better performance compared to individual NER models trained specifically on annotated data for the specific language. The aim of this work is to share our learning on how information extraction using Named Entity Recognition can be optimized for the listed Nigerian Languages for inclusion, ease of deployment in production and reusability of models. Models developed during this project are available on GitHub https git.io JY0kk and an interactive web app https nigner.herokuapp.com .


E ffective A Visual Analytic System for Exploring the Emotion and Effectiveness of Inspirational Speeches. What makes speeches effective has long been a subject for debate, and until today there is broad controversy among public speaking experts about what factors make a speech effective as well as the roles of these factors in speeches. Moreover, there is a lack of quantitative analysis methods to help understand effective speaking strategies. In this paper, we propose E ffective, a visual analytic system allowing speaking experts and novices to analyze both the role of speech factors and their contribution in effective speeches. From interviews with domain experts and investigating existing literature, we identified important factors to consider in inspirational speeches. We obtained the generated factors from multi modal data that were then related to effectiveness data. Our system supports rapid understanding of critical factors in inspirational speeches, including the influence of emotions by means of novel visualization methods and interaction. Two novel visualizations include E spiral (that shows the emotional shifts in speeches in a visually compact way) and E script (that connects speech content with key speech delivery information). In our evaluation we studied the influence of our system on experts' domain knowledge about speech factors. We further studied the usability of the system by speaking novices and experts on assisting analysis of inspirational speech effectiveness.


Specifying and achieving goals in open uncertain robot manipulation domains. This paper describes an integrated solution to the problem of describing and interpreting goals for robots in open uncertain domains. Given a formal specification of a desired situation, in which objects are described only by their properties, general purpose planning and reasoning tools are used to derive appropriate actions for a robot. These goals are carried out through an online combination of hierarchical planning, state estimation, and execution that operates robustly in real robot domains with substantial occlusion and sensing error.


Looking Beyond Corners Contrastive Learning of Visual Representations for Keypoint Detection and Description Extraction. Learnable keypoint detectors and descriptors are beginning to outperform classical hand crafted feature extraction methods. Recent studies on self supervised learning of visual representations have driven the increasing performance of learnable models based on deep networks. By leveraging traditional data augmentations and homography transformations, these networks learn to detect corners under adverse conditions such as extreme illumination changes. However, their generalization capabilities are limited to corner like features detected a priori by classical methods or synthetically generated data. In this paper, we propose the Correspondence Network (CorrNet) that learns to detect repeatable keypoints and to extract discriminative descriptions via unsupervised contrastive learning under spatial constraints. Our experiments show that CorrNet is not only able to detect low level features such as corners, but also high level features that represent similar objects present in a pair of input images through our proposed joint guided backpropagation of their latent space. Our approach obtains competitive results under viewpoint changes and achieves state of the art performance under illumination changes.


Improving Medical Image Classification with Label Noise Using Dual uncertainty Estimation. Deep neural networks are known to be data driven and label noise can have a marked impact on model performance. Recent studies have shown great robustness to classic image recognition even under a high noisy rate. In medical applications, learning from datasets with label noise is more challenging since medical imaging datasets tend to have asymmetric (class dependent) noise and suffer from high observer variability. In this paper, we systematically discuss and define the two common types of label noise in medical images disagreement label noise from inconsistency expert opinions and single target label noise from wrong diagnosis record. We then propose an uncertainty estimation based framework to handle these two label noise amid the medical image classification task. We design a dual uncertainty estimation approach to measure the disagreement label noise and single target label noise via Direct Uncertainty Prediction and Monte Carlo Dropout. A boosting based curriculum training procedure is later introduced for robust learning. We demonstrate the effectiveness of our method by conducting extensive experiments on three different diseases skin lesions, prostate cancer, and retinal diseases. We also release a large re engineered database that consists of annotations from more than ten ophthalmologists with an unbiased golden standard dataset for evaluation and benchmarking.


Experimental Investigation of Aortic Pressure Variations Following a Simulated Thoracic Impact. Blunt traumatic aortic rupture is a heart injury that can occur in falls, automobile accidents, and sporting injuries involving impact to the thorax. Despite its severity and high morbidity rate, the research still does not provide a consistent description of the mechanism of rupture. In this study, a crash testing dummy with an in vitro pumping heart, 3D printed ribcage, and ballistic gel damping layer was developed to reproduce a realistic response to thoracic impact. Testing was performed using a standardized pendulum used for calibration of crash test dummies, with the location of impact being the middle of the sternum. Different impact severities were tested by adjusting the kinetic energy at impact with the initial height of the pendulum. Measurements of the dummy include instantaneous aortic pressure waveforms prior, during and following the impact. The results of this experiment show that aortic pressure experiences significant changes in magnitude during simulated impact. This work could help contribute towards a better understanding of the mechanisms leading to blunt traumatic aortic rupture and the development of preventative measures.


Gi and Pal Scores Deep Neural Network Generalization Statistics. The field of Deep Learning is rich with empirical evidence of human like performance on a variety of regression, classification, and control tasks. However, despite these successes, the field lacks strong theoretical error bounds and consistent measures of network generalization and learned invariances. In this work, we introduce two new measures, the Gi score and Pal score, that capture a deep neural network's generalization capabilities. Inspired by the Gini coefficient and Palma ratio, measures of income inequality, our statistics are robust measures of a network's invariance to perturbations that accurately predict generalization gaps, i.e., the difference between accuracy on training and test sets.


The combinatorics of weight systems and characteristic polynomials of isolated quasihomogeneous singularities. A paper of the first author and Zilke proposed seven combinatorial problems around formulas for the characteristic polynomial and the exponents of an isolated quasihomogeneous singularity. The most important of them was a conjecture on the characteristic polynomial. Here the conjecture is proved, and some of the other problems are solved, too. In the cases where also an old conjecture of Orlik on the integral monodromy holds, this has implications on the automorphism group of the Milnor lattice. The combinatorics used in the proof of the conjecture consists of tuples of orders on sets 0,1,...,n with special properties and may be of independent interest.


What Distributed Systems Say A Study of Seven Spark Application Logs. Execution logs are a crucial medium as they record runtime information of software systems. Although extensive logs are helpful to provide valuable details to identify the root cause in postmortem analysis in case of a failure, this may also incur performance overhead and storage cost. Therefore, in this research, we present the result of our experimental study on seven Spark benchmarks to illustrate the impact of different logging verbosity levels on the execution time and storage cost of distributed software systems. We also evaluate the log effectiveness and the information gain values, and study the changes in performance and the generated logs for each benchmark with various types of distributed system failures. Our research draws insightful findings for developers and practitioners on how to set up and utilize their distributed systems to benefit from the execution logs.


Root of unity quantum cluster algebras and Cayley Hamilton algebras. We prove that large classes of algebras in the framework of root of unity quantum cluster algebras have the structures of maximal orders in central simple algebras and Cayley Hamilton algebras in the sense of Procesi. We show that every root of unity upper quantum cluster algebra is a maximal order and obtain an explicit formula for its reduced trace. Under mild assumptions, inside each such algebra we construct a canonical central subalgebra isomorphic to the underlying upper cluster algebra, such that the pair is a Cayley Hamilton algebra its fully Azumaya locus is shown to contain a copy of the underlying cluster mathcal A variety. Both results are proved in the wider generality of intersections of mixed quantum tori over subcollections of seeds. Furthermore, we prove that all monomial subalgebras of root of unity quantum tori are Cayley Hamilton algebras and classify those ones that are maximal orders. Arbitrary intersections of those over subsets of seeds are also proved to be Cayley Hamilton algebras. Previous approaches to constructing maximal orders relied on filtration and homological methods. We use new methods based on cluster algebras.


Homotopy Spectra and Diophantine Equations. Arguably, the first bridge between vast, ancient, but disjoint domains of mathematical knowledge, topology and number theory, was built only during the last fifty years. This bridge is the theory of spectra in stable homotopy theory. This connection poses the challenge discover new information in number theory using the independently developed machinery of homotopy theory. In this combined research survey paper we suggest to apply homotopy spectra to the problem of distribution of rational points upon algebraic manifolds.


The Curious Layperson Fine Grained Image Recognition without Expert Labels. Most of us are not experts in specific fields, such as ornithology. Nonetheless, we do have general image and language understanding capabilities that we use to match what we see to expert resources. This allows us to expand our knowledge and perform novel tasks without ad hoc external supervision. On the contrary, machines have a much harder time consulting expert curated knowledge bases unless trained specifically with that knowledge in mind. Thus, in this paper we consider a new problem fine grained image recognition without expert annotations, which we address by leveraging the vast knowledge available in web encyclopedias. First, we learn a model to describe the visual appearance of objects using non expert image descriptions. We then train a fine grained textual similarity model that matches image descriptions with documents on a sentence level basis. We evaluate the method on two datasets and compare with several strong baselines and the state of the art in cross modal retrieval. Code is available at https github.com subhc clever


PD Operads and Explicit Partition Lie Algebras. Infinitesimal deformations are governed by partition Lie algebras. In characteristic 0 , these higher categorical structures are modelled by differential graded Lie algebras, but in characteristic p , they are more subtle. We give explicit models for partition Lie algebras over general coherent rings, both in the setting of spectral and derived algebraic geometry. For the spectral case, we refine operadic Koszul duality to a functor from operads to divided power operads, by taking refined linear duals of Sigma n representations. The derived case requires a further refinement of Koszul duality to a more genuine setting.


Uniqueness of entire functions concerning differential difference polynomials sharing small functions. In this paper, we investigate the uniqueness problem of difference polynomials f n (z)P(f(z))L c(f) and g n (z)P(g(z))L c(g) , where L c(f) f(z c) c 0f(z) , P(z) is a polynomial with constant coefficients of degree m sharing a small function with the notions of weakly weighted sharing and relaxed weighted sharing and obtained the corresponding results, which improve and extend some recent results due to Sahoo and Biswas (Tamkang J. Math., textbf 49 (2), 85 97 (2018)).


Adversarial Segmentation Loss for Sketch Colorization. We introduce a new method for generating color images from sketches or edge maps. Current methods either require some form of additional user guidance or are limited to the "paired" translation approach. We argue that segmentation information could provide valuable guidance for sketch colorization. To this end, we propose to leverage semantic image segmentation, as provided by a general purpose panoptic segmentation network, to create an additional adversarial loss function. Our loss function can be integrated to any baseline GAN model. Our method is not limited to datasets that contain segmentation labels, and it can be trained for "unpaired" translation tasks. We show the effectiveness of our method on four different datasets spanning scene level indoor, outdoor, and children book illustration images using qualitative, quantitative and user study analysis. Our model improves its baseline up to 35 points on the FID metric. Our code and pretrained models can be found at https github.com giddyyupp AdvSegLoss.


Mixed Hodge structure on local cohomology with support in determinantal varieties. We employ the inductive structure of determinantal varieties to calculate the weight filtration on local cohomology modules with determinantal support. We show that the weight of a simple composition factor is uniquely determined by its support and cohomological degree. As a consequence, we obtain the equivariant structure of the Hodge filtration on each local cohomology module, and we provide a formula for its generation level. In the case of square matrices, we express the Hodge filtration in terms of the Hodge ideals for the determinant hypersurface. As an application, we describe a recipe for calculating the mixed Hodge module structure on any iteration of local cohomology functors with determinantal support.


Spatio Temporal Graph Convolutional Networks for Road Network Inundation Status Prediction during Urban Flooding. The objective of this study is to predict the near future flooding status of road segments based on their own and adjacent road segments current status through the use of deep learning framework on fine grained traffic data. Predictive flood monitoring for situational awareness of road network status plays a critical role to support crisis response activities such as evaluation of the loss of access to hospitals and shelters. Existing studies related to near future prediction of road network flooding status at road segment level are missing. Using fine grained traffic speed data related to road sections, this study designed and implemented three spatio temporal graph convolutional network (STGCN) models to predict road network status during flood events at the road segment level in the context of the 2017 Hurricane Harvey in Harris County (Texas, USA). Model 1 consists of two spatio temporal blocks considering the adjacency and distance between road segments, while Model 2 contains an additional elevation block to account for elevation difference between road segments. Model 3 includes three blocks for considering the adjacency and the product of distance and elevation difference between road segments. The analysis tested the STGCN models and evaluated their prediction performance. Our results indicated that Model 1 and Model 2 have reliable and accurate performance for predicting road network flooding status in near future (e.g., 2 4 hours) with model precision and recall values larger than 98 and 96 , respectively. With reliable road network status predictions in floods, the proposed model can benefit affected communities to avoid flooded roads and the emergency management agencies to implement evacuation and relief resource delivery plans.


WeChat AI ICT's Submission for DSTC9 Interactive Dialogue Evaluation Track. We participate in the DSTC9 Interactive Dialogue Evaluation Track (Gunasekara et al. 2020) sub task 1 (Knowledge Grounded Dialogue) and sub task 2 (Interactive Dialogue). In sub task 1, we employ a pre trained language model to generate topic related responses and propose a response ensemble method for response selection. In sub task2, we propose a novel Dialogue Planning Model (DPM) to capture conversation flow in the interaction with humans. We also design an integrated open domain dialogue system containing pre process, dialogue model, scoring model, and post process, which can generate fluent, coherent, consistent, and humanlike responses. We tie 1st on human ratings and also get the highest Meteor, and Bert score in sub task 1, and rank 3rd on interactive human evaluation in sub task 2.


Metric trees in the Gromov Hausdorff space. Using the wedge sum of metric spaces, for all compact metrizable spaces, we construct a topological embedding of the compact metrizable space into the set of all metric trees in the Gromov Hausdorff space with finite prescribed values. As its application, we show that the set of all metric trees is path connected and its all non empty open subsets have infinite topological dimension.


DTW Merge A Novel Data Augmentation Technique for Time Series Classification. In recent years, neural networks achieved much success in various applications. The main challenge in training deep neural networks is the lack of sufficient data to improve the model's generalization and avoid overfitting. One of the solutions is to generate new training samples. This paper proposes a novel data augmentation method for time series based on Dynamic Time Warping. This method is inspired by the concept that warped parts of two time series have similar temporal properties and therefore, exchanging them between the two series generates a new training sample. The proposed method selects an element of the optimal warping path randomly and then exchanges the segments that are aligned together. Exploiting the proposed approach with recently introduced ResNet reveals improved results on the 2018 UCR Time Series Classification Archive. By employing Gradient weighted Class Activation Mapping (Grad CAM) and Multidimensional Scaling (MDS), we manifest that our method extract more discriminant features out of time series.


A d dimensional Analyst's Travelling Salesman Theorem for subsets of Hilbert space. We are interested in quantitative rectifiability results for subsets of infinite dimensional Hilbert space H . We prove a version of Azzam and Schul's d dimensional Analyst's Travelling Salesman Theorem in this setting by showing for any lower d regular set E subseteq H that text diam (E) d beta d(E) sim mathscr H d(E) text Error , where beta d(E) give a measure of the curvature of E and the error term is related to the theory of uniform rectifiability (a quantitative version of rectifiability introduced by David and Semmes). To do this, we show how to modify the Reifenberg Parametrization Theorem of David and Toro so that it holds in Hilbert space. As a corollary, we show that a set E subseteq H is uniformly rectifiable if and only if it satisfies the so called Bilateral Weak Geometric Lemma, meaning that E is bi laterally well approximated by planes at most scales and locations.


An End to end Model for Entity level Relation Extraction using Multi instance Learning. We present a joint model for entity level relation extraction from documents. In contrast to other approaches which focus on local intra sentence mention pairs and thus require annotations on mention level our model operates on entity level. To do so, a multi task approach is followed that builds upon coreference resolution and gathers relevant signals via multi instance learning with multi level representations combining global entity and local mention information. We achieve state of the art relation extraction results on the DocRED dataset and report the first entity level end to end relation extraction results for future reference. Finally, our experimental results suggest that a joint approach is on par with task specific learning, though more efficient due to shared parameters and training steps.


Leaves decompositions in Euclidean spaces. We partly extend the localisation technique from convex geometry to the multiple constraints setting. For a given 1 Lipschitz map u colon mathbb R n to mathbb R m , m leq n , we define and prove the existence of a partition of mathbb R n , up to a set of Lebesgue measure zero, into maximal closed convex sets such that restriction of u is an isometry on these sets. We consider a disintegration, with respect to this partition, of a log concave measure. We prove that for almost every set of the partition of dimension m , the associated conditional measure is log concave. This result is proven also in the context of the curvature dimension condition for weighted Riemannian manifolds. This partially confirms a conjecture of Klartag.


Transformation formula for the reduced Bergman kernel and its application. In this article, we prove the transformation formula for the reduced Bergman kernels under proper holomorphic correspondences between bounded domains in the complex plane. As a corollary, we obtain the transformation formula for the reduced Bergman kernels under proper holomorphic maps. We also establish the transformation formula for the weighted reduced Bergman kernels under proper holomorphic maps. Finally, we provide an application of this transformation formula.


CheXseg Combining Expert Annotations with DNN generated Saliency Maps for X ray Segmentation. Medical image segmentation models are typically supervised by expert annotations at the pixel level, which can be expensive to acquire. In this work, we propose a method that combines the high quality of pixel level expert annotations with the scale of coarse DNN generated saliency maps for training multi label semantic segmentation models. We demonstrate the application of our semi supervised method, which we call CheXseg, on multi label chest X ray interpretation. We find that CheXseg improves upon the performance (mIoU) of fully supervised methods that use only pixel level expert annotations by 9.7 and weakly supervised methods that use only DNN generated saliency maps by 73.1 . Our best method is able to match radiologist agreement on three out of ten pathologies and reduces the overall performance gap by 57.2 as compared to weakly supervised methods.


A gradient based resolution strategy for a PDE constrained optimization approach for 3D 1D coupled problems. Coupled 3D 1D problems arise in many practical applications, in an attempt to reduce the computational burden in simulations where cylindrical inclusions with a small section are embedded in a much larger domain. Nonetheless the resolution of such problems can be non trivial, both from a mathematical and a geometrical standpoint. Indeed 3D 1D coupling requires to operate in non standard function spaces, and, also, simulation geometries can be complex for the presence of multiple intersecting domains. Recently, a PDE constrained optimization based formulation has been proposed for such problems, proving a well posed mathematical formulation and allowing for the use of non conforming meshes for the discrete problem. Here an unconstrained optimization formulation of the problem is derived and an efficient gradient based solver is proposed for such formulation. Some numerical tests on quite complex configurations are discussed to show the viability of the method.


Synthesized Trust Learning from Limited Human Feedback for Human Load Reduced Multi Robot Deployments. Human multi robot system (MRS) collaboration is demonstrating potentials in wide application scenarios due to the integration of human cognitive skills and a robot team's powerful capability introduced by its multi member structure. However, due to limited human cognitive capability, a human cannot simultaneously monitor multiple robots and identify the abnormal ones, largely limiting the efficiency of the human MRS collaboration. There is an urgent need to proactively reduce unnecessary human engagements and further reduce human cognitive loads. Human trust in human MRS collaboration reveals human expectations on robot performance. Based on trust estimation, the work between a human and MRS will be reallocated that an MRS will self monitor and only request human guidance in critical situations. Inspired by that, a novel Synthesized Trust Learning (STL) method was developed to model human trust in the collaboration. STL explores two aspects of human trust (trust level and trust preference), meanwhile accelerates the convergence speed by integrating active learning to reduce human workload. To validate the effectiveness of the method, tasks "searching victims in the context of city rescue" were designed in an open world simulation environment, and a user study with 10 volunteers was conducted to generate real human trust feedback. The results showed that by maximally utilizing human feedback, the STL achieved higher accuracy in trust modeling with a few human feedback, effectively reducing human interventions needed for modeling an accurate trust, therefore reducing human cognitive load in the collaboration.


In Network Volumetric DDoS Victim Identification Using Programmable Commodity Switches. Volumetric distributed Denial of Service (DDoS) attacks have become one of the most significant threats to modern telecommunication networks. However, most existing defense systems require that detection software operates from a centralized monitoring collector, leading to increased traffic load and delayed response. The recent advent of Data Plane Programmability (DPP) enables an alternative solution threshold based volumetric DDoS detection can be performed directly in programmable switches to skim only potentially hazardous traffic, to be analyzed in depth at the controller. In this paper, we first introduce the BACON data structure based on sketches, to estimate per destination flow cardinality, and theoretically analyze it. Then we employ it in a simple in network DDoS victim identification strategy, INDDoS, to detect the destination IPs for which the number of incoming connections exceeds a pre defined threshold. We describe its hardware implementation on a Tofino based programmable switch using the domain specific P4 language, proving that some limitations imposed by real hardware to safeguard processing speed can be overcome to implement relatively complex packet manipulations. Finally, we present some experimental performance measurements, showing that our programmable switch is able to keep processing packets at line rate while performing volumetric DDoS detection, and also achieves a high F1 score on DDoS victim identification.


Moduli spaces of semistable modules over Lie algebroids. We show a few basic results about moduli spaces of semistable modules over Lie algebroids. The first result shows that such moduli spaces exist for relative projective morphisms of noetherian schemes, removing some earlier constraints. The second result proves general separatedness Langton type theorem for such moduli spaces. More precisely, we prove S completness of some moduli stacks of semistable modules. In some special cases this result identifies closed points of the moduli space of Gieseker semistable sheaves on a projective scheme and of the Donaldson Uhlenbeck compactification of the moduli space of slope stable locally free sheaves on a smooth projective surface. The last result generalizes properness of Hitchin's morphism and it shows properness of so called Hodge Hitchin morphism defined in positive characteristic on the moduli space of Gieseker semistable integrable t connections in terms of the p curvature morphism. This last result was proven in the curve case by de Cataldo and Zhang using completely different methods.


Resolving Anomalies in the Behaviour of a Modularity Inducing Problem Domain with Distributional Fitness Evaluation. Discrete gene regulatory networks (GRNs) play a vital role in the study of robustness and modularity. A common method of evaluating the robustness of GRNs is to measure their ability to regulate a set of perturbed gene activation patterns back to their unperturbed forms. Usually, perturbations are obtained by collecting random samples produced by a predefined distribution of gene activation patterns. This sampling method introduces stochasticity, in turn inducing dynamicity. This dynamicity is imposed on top of an already complex fitness landscape. So where sampling is used, it is important to understand which effects arise from the structure of the fitness landscape, and which arise from the dynamicity imposed on it. Stochasticity of the fitness function also causes difficulties in reproducibility and in post experimental analyses. We develop a deterministic distributional fitness evaluation by considering the complete distribution of gene activity patterns, so as to avoid stochasticity in fitness assessment. This fitness evaluation facilitates repeatability. Its determinism permits us to ascertain theoretical bounds on the fitness, and thus to identify whether the algorithm has reached a global optimum. It enables us to differentiate the effects of the problem domain from those of the noisy fitness evaluation, and thus to resolve two remaining anomalies in the behaviour of the problem domain of citet espinosa2010specialization . We also reveal some properties of solution GRNs that lead them to be robust and modular, leading to a deeper understanding of the nature of the problem domain. We conclude by discussing potential directions toward simulating and understanding the emergence of modularity in larger, more complex domains, which is key both to generating more useful modular solutions, and to understanding the ubiquity of modularity in biological systems.


Implementation of a self developed model predictive control scheme for vehicle parking maneuvers. In this paper a self developed controller algorithm is presented with the goal of handling a basic parking maneuver. One of the biggest challenges of autonomous vehicle control is the right calibration and finding the right vehicle models for the given conditions. As a result of many other research, model predictive control (MPC) structures have started to become the most promising control technique. During our work we implemented an MPC function from white paper. Considering the low speed conditions of a parking maneuver we use a kinematic bicycle model as the basis of the controller. The algorithm has two main inputs a planned trajectory and the vehicle state feedback signals. The controller is realized as a Simulink model, and it is integrated into a complete autonomous control system using ROS framework. The results are validated through multiple steps using Simulink only with a pure kinematic bicycle plant model using LGSVL simulation framework containing a real vehicle model and the entire software chain the controller is prepared for real vehicle tests.


AUGVIC Exploiting BiText Vicinity for Low Resource NMT. The success of Neural Machine Translation (NMT) largely depends on the availability of large bitext training corpora. Due to the lack of such large corpora in low resource language pairs, NMT systems often exhibit poor performance. Extra relevant monolingual data often helps, but acquiring it could be quite expensive, especially for low resource languages. Moreover, domain mismatch between bitext (train test) and monolingual data might degrade the performance. To alleviate such issues, we propose AUGVIC, a novel data augmentation framework for low resource NMT which exploits the vicinal samples of the given bitext without using any extra monolingual data explicitly. It can diversify the in domain bitext data with finer level control. Through extensive experiments on four low resource language pairs comprising data from different domains, we have shown that our method is comparable to the traditional back translation that uses extra in domain monolingual data. When we combine the synthetic parallel data generated from AUGVIC with the ones from the extra monolingual data, we achieve further improvements. We show that AUGVIC helps to attenuate the discrepancies between relevant and distant domain monolingual data in traditional back translation. To understand the contributions of different components of AUGVIC, we perform an in depth framework analysis.


Round and Communication Balanced Protocols for Oblivious Evaluation of Finite State Machines. We propose protocols for obliviously evaluating finite state machines, i.e., the evaluation is shared between the provider of the finite state machine and the provider of the input string in such a manner that neither party learns the other's input, and the states being visited are hidden from both. For alphabet size Sigma , number of states Q , and input length n , previous solutions have either required a number of rounds linear in n or communication Omega(n Sigma Q log Q ) . Our solutions require 2 rounds with communication O(n( Sigma Q log Q )) . We present two different solutions to this problem, a two party one and a setting with an untrusted but non colluding helper.


A Schwartz Zippel Type Estimate for Homogenous Finite Field Polynomials. In this paper, we obtain a Schwartz Zippel type estimate for homogenous finite field polynomials. Specifically, we use a probabilistic recursion technique to find upper and lower bounds for the number of zeros of a homogenous polynomial and illustrate our result with two examples involving perfect matching in bipartite graphs and common zeros in a collection of polynomials, respectively.


Simultaneous measurements of deforming Hinze scale bubbles with surrounding turbulence. We experimentally investigate the breakup mechanisms and probability of Hinze scale bubbles in turbulence. The Hinze scale is defined as the critical bubble size based on the critical mean Weber number, across which the bubble breakup probability was believed to have an abrupt transition from being dominated by turbulence stresses to being suppressed completely by the surface tension. In this work, to quantify the breakup probability of bubbles with sizes close to the Hinze scale and to examine different breakup mechanisms, both bubbles and their surrounding tracer particles were simultaneously tracked. From the experimental results, two Weber numbers, one calculated from the slip velocity between the two phases and the other one acquired from local velocity gradients, are separated and fitted with models that can be linked back to turbulence characteristics. Moreover, we also provide an empirical model to link bubble deformation to the two Weber numbers by extending the relationship obtained from potential flow theory. The proposed relationship between bubble aspect ratio and the Weber numbers seems to work consistently well for a range of bubble sizes. Furthermore, the time traces of the bubble aspect ratio and the two Weber numbers are connected using the linear forced oscillator model. Finally, having access to the distributions of these two Weber numbers provides a unique way to extract the breakup probability of bubbles with sizes close to the Hinze scale.


Multi grounded partitions and character formulas. We introduce a new generalisation of partitions, multi grounded partitions, related to ground state paths indexed by dominant weights of Lie algebras. We use these to express characters of irreducible highest weight modules of Kac Moody algebras of affine type as generating functions for multi grounded partitions. This generalises the approach of our previous paper, where only irreducible highest weight modules with constant ground state paths were considered, to all ground state paths. As an application, we compute the characters of the level 1 modules of the affine Lie algebras A 2n (2) (n geq 2) , D n 1 (2) (n geq 2) , A 2n 1 (1) (n geq 3) , B n (1) (n geq 3) , and D n (1) (n geq 4) .


Sentiment based Candidate Selection for NMT. The explosion of user generated content (UGC) e.g. social media posts, comments, and reviews has motivated the development of NLP applications tailored to these types of informal texts. Prevalent among these applications have been sentiment analysis and machine translation (MT). Grounded in the observation that UGC features highly idiomatic, sentiment charged language, we propose a decoder side approach that incorporates automatic sentiment scoring into the MT candidate selection process. We train separate English and Spanish sentiment classifiers, then, using n best candidates generated by a baseline MT model with beam search, select the candidate that minimizes the absolute difference between the sentiment score of the source sentence and that of the translation, and perform a human evaluation to assess the produced translations. Unlike previous work, we select this minimally divergent translation by considering the sentiment scores of the source sentence and translation on a continuous interval, rather than using e.g. binary classification, allowing for more fine grained selection of translation candidates. The results of human evaluations show that, in comparison to the open source MT baseline model on top of which our sentiment based pipeline is built, our pipeline produces more accurate translations of colloquial, sentiment heavy source texts.


A corrected transport velocity formulation for fluid and structural mechanics with SPH. Particle shifting techniques (PST) have been used to improve the accuracy of the Smoothed Particle Hydrodynamics (SPH) method. Shifting ensures that the particles are distributed homogeneously in space. This may be performed by moving the particles using a transport velocity. In this paper, we propose an extension to the class of Transport Velocity Formulation (TVF) methods. We derive the equations in a consistent manner and show that there are additional terms that significantly improve the accuracy of the method. In particular, we apply this to the Entropically Damped Artificial Compressibility SPH method. We identify the free surface particles and their normals using a simple approach and thereby adapt the method for free surface problems. We show how the new method can be applied to the problem of elastic dynamics. We consider a suite of benchmark problems involving both fluid and solid mechanics to demonstrate the accuracy and applicability of the method. The implementation is open source, and the manuscript is fully reproducible.


Paschke duality and assembly maps. We construct a natural transformation between two versions of G equivariant K homology with coefficients in a G C category for a countable discrete group G . Its domain is a coarse geometric K homology and its target is the usual analytic K homology. Following classical terminology, we call this transformation the Paschke transformation. We show that under certain finiteness assumptions on a G space X , the Paschke transformation is an equivalence on X . As an application, we provide a direct comparison of the homotopy theoretic Davis L "uck assembly map with Kasparov's analytic assembly map appearing in the Baum Connes conjecture.


physics.plasm-ph cs.NA math.NA physics.comp-ph

Accelerating the estimation of energetic particle confinement statistics in stellarators using multifidelity Monte Carlo. In the design of stellarators, energetic particle confinement is a critical point of concern which remains challenging to study from a numerical point of view. Standard Monte Carlo analyses are highly expensive because a large number of particle trajectories need to be integrated over long time scales, and small time steps must be taken to accurately capture the features of the wide variety of trajectories. Even when they are based on guiding center trajectories, as opposed to full orbit trajectories, these standard Monte Carlo studies are too expensive to be included in most stellarator optimization codes. We present the first multifidelity Monte Carlo scheme for accelerating the estimation of energetic particle confinement in stellarators. Our approach relies on a two level hierarchy, in which a guiding center model serves as the high fidelity model, and a data driven linear interpolant is leveraged as the low fidelity surrogate model. We apply multifidelity Monte Carlo to the study of energetic particle confinement in a 4 period quasi helically symmetric stellarator, assessing various metrics of confinement. Stemming from the very high computational efficiency of our surrogate model as well as its sufficient correlation to the high fidelity model, we obtain speedups of up to 10 with multifidelity Monte Carlo compared to standard Monte Carlo.


AT ST Self Training Adaptation Strategy for OCR in Domains with Limited Transcriptions. This paper addresses text recognition for domains with limited manual annotations by a simple self training strategy. Our approach should reduce human annotation effort when target domain data is plentiful, such as when transcribing a collection of single person's correspondence or a large manuscript. We propose to train a seed system on large scale data from related domains mixed with available annotated data from the target domain. The seed system transcribes the unannotated data from the target domain which is then used to train a better system. We study several confidence measures and eventually decide to use the posterior probability of a transcription for data selection. Additionally, we propose to augment the data using an aggressive masking scheme. By self training, we achieve up to 55 reduction in character error rate for handwritten data and up to 38 on printed data. The masking augmentation itself reduces the error rate by about 10 and its effect is better pronounced in case of difficult handwritten data.


The stickiness property for antisymmetric nonlocal minimal graphs. We show that arbitrarily small antisymmetric perturbations of the zero function are sufficient to produce the stickiness phenomenon for planar nonlocal minimal graphs (with the same quantitative bounds obtained for the case of even symmetric perturbations, up to multiplicative constants). In proving this result, one also establishes an odd symmetric version of the maximum principle for nonlocal minimal graphs, according to which the odd symmetric minimizer is positive in the direction of the positive bump and negative in the direction of the negative bump.


Efficient Detection of Botnet Traffic by features selection and Decision Trees. Botnets are one of the online threats with the biggest presence, causing billionaire losses to global economies. Nowadays, the increasing number of devices connected to the Internet makes it necessary to analyze large amounts of network traffic data. In this work, we focus on increasing the performance on botnet traffic classification by selecting those features that further increase the detection rate. For this purpose we use two feature selection techniques, Information Gain and Gini Importance, which led to three pre selected subsets of five, six and seven features. Then, we evaluate the three feature subsets along with three models, Decision Tree, Random Forest and k Nearest Neighbors. To test the performance of the three feature vectors and the three models we generate two datasets based on the CTU 13 dataset, namely QB CTU13 and EQB CTU13. We measure the performance as the macro averaged F1 score over the computational time required to classify a sample. The results show that the highest performance is achieved by Decision Trees using a five feature set which obtained a mean F1 score of 85 classifying each sample in an average time of 0.78 microseconds.


Parameterized Algorithms for Kidney Exchange. In kidney exchange programs, multiple patient donor pairs each of whom are otherwise incompatible, exchange their donors to receive compatible kidneys. The Kidney Exchange problem is typically modelled as a directed graph where every vertex is either an altruistic donor or a pair of patient and donor directed edges are added from a donor to its compatible patients. The computational task is to find if there exists a collection of disjoint cycles and paths starting from altruistic donor vertices of length at most l c and l p respectively that covers at least some specific number t of non altruistic vertices (patients). We study parameterized algorithms for the kidney exchange problem in this paper. Specifically, we design FPT algorithms parameterized by each of the following parameters (1) the number of patients who receive kidney, (2) treewidth of the input graph max l p, l c , and (3) the number of vertex types in the input graph when l p l c. We also present interesting algorithmic and hardness results on the kernelization complexity of the problem. Finally, we present an approximation algorithm for an important special case of Kidney Exchange.


Technical Report Scalable Active Information Acquisition for Multi Robot Systems. This paper proposes a novel highly scalable non myopic planning algorithm for multi robot Active Information Acquisition (AIA) tasks. AIA scenarios include target localization and tracking, active SLAM, surveillance, environmental monitoring and others. The objective is to compute control policies for multiple robots which minimize the accumulated uncertainty of a static hidden state over an a priori unknown horizon. The majority of existing AIA approaches are centralized and, therefore, face scaling challenges. To mitigate this issue, we propose an online algorithm that relies on decomposing the AIA task into local tasks via a dynamic space partitioning method. The local subtasks are formulated online and require the robots to switch between exploration and active information gathering roles depending on their functionality in the environment. The switching process is tightly integrated with optimizing information gathering giving rise to a hybrid control approach. We show that the proposed decomposition based algorithm is probabilistically complete for homogeneous sensor teams and under linearity and Gaussian assumptions. We provide extensive simulation results that show that the proposed algorithm can address large scale estimation tasks that are computationally challenging to solve using existing centralized approaches.


Homological Dimensions Relative to Preresolving Subcategories II. Let mathscr A be an abelian category having enough projective and injective objects, and let mathscr T be an additive subcategory of mathscr A closed under direct summands. A known assertion is that in a short exact sequence in mathscr A , the mathscr T projective (respectively, mathscr T injective) dimensions of any two terms can sometimes induce an upper bound of that of the third term by using the same comparison expressions. We show that if mathscr T contains all projective (respectively, injective) objects of mathscr A , then the above assertion holds true if and only if mathscr T is resolving (respectively, coresolving). As applications, we get that a left and right Noetherian ring R is n Gorenstein if and only if the Gorenstein projective (respectively, injective, flat) dimension of any left R module is at most n . In addition, in several cases, for a subcategory mathscr C of mathscr T , we show that the finitistic mathscr C projective and mathscr T projective dimensions of mathscr A are identical.


The canonical wall structure and intrinsic mirror symmetry. As announced "Intrinsic mirror symmetry and punctured invariants" in 2016, we construct and prove consistency of the canonical wall structure. This construction starts with a log Calabi Yau pair (X,D) and produces a wall structure, as defined by Gross Hacking Siebert. Roughly put, the canonical wall structure is a data structure which encodes an algebro geometric analogue of counts of Maslov index zero disks. These enumerative invariants are defined in terms of the punctured invariants of Abramovich Chen Gross Siebert. There are then two main theorems of the paper. First, we prove consistency of the canonical wall structure, so that the canonical wall structure gives rise to a mirror family. Second, we prove that this mirror family coincides with the intrinsic mirror constructed in our paper "Intrinsic mirror symmetry". While the setup of this paper is narrower than that of the latter paper, it gives a more detailed description of the mirror.


Weak Fusion 2 Categories. We introduce a weakening of the notion of fusion 2 category given in arXiv 1812.11933. Then, we establish a number of properties of (multi)fusion 2 categories. Finally, we describe the fusion rule of the fusion 2 categories associated to certain pointed braided fusion categories.


A Contribution to COVID 19 Prevention through Crowd Collaboration using Conversational AI Social Platforms. COVID 19 Prevention, which combines the soft approaches and best practices for public health safety, is the only recommended solution from the health science and management society side considering the pandemic era. In an attempt to evaluate the validity of such claims in a conflict and COVID 19 affected country like Afghanistan, we conducted a large scale digital social experiment using conversational AI and social platforms from an info epidemiology and an infoveillance perspective. This served as a means to uncover an underling truth, give large scale facilitation support, extend the soft impact of discussion to multiple sites, collect, diverge, converge and evaluate a large amount of opinions and concerns from health experts, patients and local people, deliberate on the data collected and explore collective prevention approaches of COVID 19. Finally, this paper shows that deciding a prevention measure that maximizes the probability of finding the ground truth is intrinsically difficult without utilizing the support of an AI enabled discussion systems.


Very weak fragments of weak K H o nig's lemma. It is well known that any finite Pi 0 1 class of 2 mathbb N has a computable member. Then, how can we understand this in the context of reverse mathematics? In this note, we consider several very weak fragments of K H o nig's lemma to answer this qeustion.


The real Fourier Mukai transform of Cayley cycles. The real Fourier Mukai transform sends a section of a torus fibration to a connection over the total space of the dual torus fibration. By this method, Leung, Yau and Zaslow introduced deformed Hermitian Yang Mills (dHYM) connections for K "ahler manifolds and Lee and Leung introduced deformed Donaldson Thomas (dDT) connections for G 2 and rm Spin (7) manifolds. In this paper, we suggest an alternative definition of a dDT connection for a manifold with a rm Spin (7) structure which seems to be more appropriate by carefully computing the real Fourier Mukai transform again. We also post some evidences showing that the definition we suggest is compatible with dDT connections for a G 2 manifold and dHYM connections of a Calabi Yau 4 manifold. Another importance of this paper is that it motivates our study in our other papers. That is, based on the computations in this paper, we develop the theories of deformations of dDT connections for a manifold with a rm Spin (7) structure and the "mirror" of the volume functional, which is called the Dirac Born Infeld (DBI) action in physics.


Embeddings of the symmetric groups to the space Cremona group. We study embeddings of symmetric groups to the space Cremona group.


Emoji based Co attention Network for Microblog Sentiment Analysis. Emojis are widely used in online social networks to express emotions, attitudes, and opinions. As emotional oriented characters, emojis can be modeled as important features of emotions towards the recipient or subject for sentiment analysis. However, existing methods mainly take emojis as heuristic information that fails to resolve the problem of ambiguity noise. Recent researches have utilized emojis as an independent input to classify text sentiment but they ignore the emotional impact of the interaction between text and emojis. It results that the emotional semantics of emojis cannot be fully explored. In this paper, we propose an emoji based co attention network that learns the mutual emotional semantics between text and emojis on microblogs. Our model adopts the co attention mechanism based on bidirectional long short term memory incorporating the text and emojis, and integrates a squeeze and excitation block in a convolutional neural network classifier to increase its sensitivity to emotional semantic features. Experimental results show that the proposed method can significantly outperform several baselines for sentiment analysis on short texts of social media.


Manifold optimization for non linear optimal transport problems. Optimal transport (OT) has recently found widespread interest in machine learning. It allows to define novel distances between probability measures, which have shown promise in several applications. In this work, we discuss how to computationally approach general non linear OT problems within the framework of Riemannian manifold optimization. The basis of this is the manifold of doubly stochastic matrices (and their generalization). Even though the manifold geometry is not new, surprisingly, its usefulness for solving general non linear OT problems has not been popular. To this end, we specifically discuss optimization related ingredients that allow modeling the OT problem on smooth Riemannian manifolds by exploiting the geometry of the search space. We also discuss extensions where we reuse the developed optimization ingredients. We make available the Manifold optimization based Optimal Transport, or MOT, repository with codes useful in solving OT problems in Python and Matlab. The codes are available at url https github.com SatyadevNtv MOT .


Practical Assessment of Generalization Performance Robustness for Deep Networks via Contrastive Examples. Training images with data transformations have been suggested as contrastive examples to complement the testing set for generalization performance evaluation of deep neural networks (DNNs). In this work, we propose a practical framework ContRE (The word "contre" means "against" or "versus" in French.) that uses Contrastive examples for DNN geneRalization performance Estimation. Specifically, ContRE follows the assumption in contrastive learning that robust DNN models with good generalization performance are capable of extracting a consistent set of features and making consistent predictions from the same image under varying data transformations. Incorporating with a set of randomized strategies for well designed data transformations over the training set, ContRE adopts classification errors and Fisher ratios on the generated contrastive examples to assess and analyze the generalization performance of deep models in complement with a testing set. To show the effectiveness and the efficiency of ContRE, extensive experiments have been done using various DNN models on three open source benchmark datasets with thorough ablation studies and applicability analyses. Our experiment results confirm that (1) behaviors of deep models on contrastive examples are strongly correlated to what on the testing set, and (2) ContRE is a robust measure of generalization performance complementing to the testing set in various settings.


Optimal Design of Membrane Cascades for Gaseous and Liquid Mixtures via MINLP. Given the growing concern of reducing CO2 emissions, it is desirable to identify, for a given separation carried out through a membrane cascade, the optimum design that yields the lowest energy consumption. Nevertheless, designing a membrane cascade is challenging since, there are often multiple feasible configurations that differ in their energy consumption and cost. In this work, we develop a Mixed Integer Non linear Program (MINLP) that, for a given binary separation, which may be either liquid or gaseous, finds the cascade and its operating conditions that minimize energy consumption. To model the separation at each membrane in the cascade, we utilize the analytical solution of a system of differential and algebraic equations derived from the crossflow model and the solution diffusion theory. We provide numerical evidence which shows that our single stage membrane model accurately predicts experimental data. Unfortunately, the resulting membrane model is non convex and, even state of the art solvers struggle to prove global optimality of the cascades and the operating conditions identified. In this paper, we derive various cuts that help with relaxation quality and, consequently, accelerate convergence of branch and bound based solvers. More specifically, we demonstrate, on various examples, that our cuts help branch and bound solvers converge within 5 optimality gap in a reasonable amount of time and such a tolerance level was not achieved by a simple formulation of the membrane model. The proposed optimization model is an easy to use tool for practitioners and researchers to design energy efficient membrane cascades.


Robust output feedback stabilization for incompressible flows using low dimensional mathcal H infty controllers. Output based controllers are known to be fragile with respect to model uncertainties. The standard mathcal H infty control theory provides a general approach to robust controller design based on the solution of the mathcal H infty Riccati equations. In view of stabilizing incompressible flows in simulations, two major challenges have to be addressed the high dimensional nature of the spatially discretized model and the differential algebraic structure that comes with the incompressibility constraint. This work demonstrates the synthesis of low dimensional robust controllers with guaranteed robustness margins for the stabilization of incompressible flow problems. The performance and the robustness of the reduced order controller with respect to linearization and model reduction errors are investigated and illustrated in numerical examples.


A Optimal Active Learning. In this work we discuss the problem of active learning. We present an approach that is based on A optimal experimental design of ill posed problems and show how one can optimally label a data set by partially probing it, and use it to train a deep network. We present two approaches that make different assumptions on the data set. The first is based on a Bayesian interpretation of the semi supervised learning problem with the graph Laplacian that is used for the prior distribution and the second is based on a frequentist approach, that updates the estimation of the bias term based on the recovery of the labels. We demonstrate that this approach can be highly efficient for estimating labels and training a deep network.


Layout to Image Translation with Double Pooling Generative Adversarial Networks. In this paper, we address the task of layout to image translation, which aims to translate an input semantic layout to a realistic image. One open challenge widely observed in existing methods is the lack of effective semantic constraints during the image translation process, leading to models that cannot preserve the semantic information and ignore the semantic dependencies within the same object. To address this issue, we propose a novel Double Pooing GAN (DPGAN) for generating photo realistic and semantically consistent results from the input layout. We also propose a novel Double Pooling Module (DPM), which consists of the Square shape Pooling Module (SPM) and the Rectangle shape Pooling Module (RPM). Specifically, SPM aims to capture short range semantic dependencies of the input layout with different spatial scales, while RPM aims to capture long range semantic dependencies from both horizontal and vertical directions. We then effectively fuse both outputs of SPM and RPM to further enlarge the receptive field of our generator. Extensive experiments on five popular datasets show that the proposed DPGAN achieves better results than state of the art methods. Finally, both SPM and SPM are general and can be seamlessly integrated into any GAN based architectures to strengthen the feature representation. The code is available at https github.com Ha0Tang DPGAN.