Curvature of minimal graphs. We consider the Gaussian curvature conjecture of a minimal graph S over the unit disk. First of all we reduce the general conjecture to the estimating the Gaussian curvature of some Scherk's type minimal surfaces over a quadrilateral inscribed in the unit disk containing the origin inside. As an application we improve so far the obtained upper estimates of Gaussian curvature at the point above the center. Further we obtain an optimal estimate of the Gaussian curvature at the point mathbf w over the center of the disk, provided mathbf w satisfies certain "symmetric" conditions. The result extends a classical result of Finn and Osserman in 1964. In order to do so, we construct a certain family S t , t in t circ, pi 2 of Scherk's type minimal graphs over the isosceles trapezoid inscribed in the unit disk. Then we compare the Gaussian curvature of the graph S with that of S t at the point mathbf w over the center of the disk.


HKT from HK metrics. We solve the quaternionic Monge Amp ere equation on hyperK "ahler manifolds. In this way we prove the ansatz for the conjecture raised by Alesker and Verbitsky claiming that this equation should be solvable on any hyperK "ahler with torsion manifold, at least when the canonical bundle is trivial holomorphically. The novelty in our approach is that we do not assume any flatness of the underlying hypercomplex structure which was the case in all the approaches for the higher order a priori estimates so far. The resulting Calabi Yau type theorem for HKT metrics is discussed.


New binary self dual codes of lengths 80, 84 and 96 from composite matrices. In this work, we apply the idea of composite matrices arising from group rings to derive a number of different techniques for constructing self dual codes over finite commutative Frobenius rings. By applying these techniques over different alphabets, we construct best known singly even binary self dual codes of lengths 80, 84 and 96 as well as doubly even binary self dual codes of length 96 that were not known in the literature before.


Test case generation for agent based models A systematic literature review. Agent based models play an important role in simulating complex emergent phenomena and supporting critical decisions. In this context, a software fault may result in poorly informed decisions that lead to disastrous consequences. The ability to rigorously test these models is therefore essential. In this systematic literature review, we answer five research questions related to the key aspects of test case generation in agent based models What are the information artifacts used to generate tests? How are these tests generated? How is a verdict assigned to a generated test? How is the adequacy of a generated test suite measured? What level of abstraction of an agent based model is targeted by a generated test? Our results show that whilst the majority of techniques are effective for testing functional requirements at the agent and integration levels of abstraction, there are comparatively few techniques capable of testing society level behaviour. Additionally, we identify a need for more thorough evaluation using realistic case studies that feature challenging properties associated with a typical agent based model.


A Variety Theorem for Relational Universal Algebra. We develop an analogue of universal algebra in which generating symbols are interpreted as relations. We prove a variety theorem for these relational algebraic theories, in which we find that their categories of models are precisely the definable categories. The syntax of our relational algebraic theories is string diagrammatic, and can be seen as an extension of the usual term syntax for algebraic theories.


A Unified Metamodel for NoSQL and Relational Databases. The Database field is undergoing significant changes. Although relational systems are still predominant, the interest in NoSQL systems is continuously increasing. In this scenario, polyglot persistence is envisioned as the database architecture to be prevalent in the future. Multi model database tools normally use a generic or unified metamodel to represent schemas of the data model that they support. Such metamodels facilitate developing utilities, as they can be built on a common representation. Also, the number of mappings required to migrate databases from a data model to another is reduced, and integrability is favored. In this paper, we present the U Schema unified metamodel able to represent logical schemas for the four most popular NoSQL paradigms (columnar, document, key value, and graph) as well as relational schemas. We will formally define the mappings between U Schema and the data model defined for each paradigm. How these mappings have been implemented and validated will be discussed, and some applications of U Schema will be shown. To achieve flexibility to respond to data changes, most of NoSQL systems are "schema on write," and the declaration of schemas is not required. Such an absence of schema declaration makes structural variability possible, i.e., stored data of the same entity type can have different structure. Moreover, data relationships supported by each data model are different. We will show how all these issues have been tackled in our approach. Our metamodel goes beyond the existing proposals by distinguishing entity types and relationship types, representing aggregation and reference relationships, and including the notion of structural variability. Our contributions also include developing schema extraction strategies for schemaless systems of each NoSQL data model, and tackling performance and scalability in the implementation for each store.


Shift Happens Adjusting Classifiers. Minimizing expected loss measured by a proper scoring rule, such as Brier score or log loss (cross entropy), is a common objective while training a probabilistic classifier. If the data have experienced dataset shift where the class distributions change post training, then often the model's performance will decrease, over estimating the probabilities of some classes while under estimating the others on average. We propose unbounded and bounded general adjustment (UGA and BGA) methods that transform all predictions to (re )equalize the average prediction and the class distribution. These methods act differently depending on which proper scoring rule is to be minimized, and we have a theoretical guarantee of reducing loss on test data, if the exact class distribution is known. We also demonstrate experimentally that, when in practice the class distribution is known only approximately, there is often still a reduction in loss depending on the amount of shift and the precision to which the class distribution is known.


Explicit formulas for Killing magnetic curves in Heisenberg group. In this paper, We present the geometry three dimensional Heisenberg group (H 3,g) and its geodesics curves. After, we study the Killing magnetic curves and some geodesic Killing magnetic curves with its explicit formulas for such curves.


Neural Feature Selection for Learning to Rank. LEarning TO Rank (LETOR) is a research area in the field of Information Retrieval (IR) where machine learning models are employed to rank a set of items. In the past few years, neural LETOR approaches have become a competitive alternative to traditional ones like LambdaMART. However, neural architectures performance grew proportionally to their complexity and size. This can be an obstacle for their adoption in large scale search systems where a model size impacts latency and update time. For this reason, we propose an architecture agnostic approach based on a neural LETOR model to reduce the size of its input by up to 60 without affecting the system performance. This approach also allows to reduce a LETOR model complexity and, therefore, its training and inference time up to 50 .


MWQ Multiscale Wavelet Quantized Neural Networks. Model quantization can reduce the model size and computational latency, it has become an essential technique for the deployment of deep neural networks on resourceconstrained hardware (e.g., mobile phones and embedded devices). The existing quantization methods mainly consider the numerical elements of the weights and activation values, ignoring the relationship between elements. The decline of representation ability and information loss usually lead to the performance degradation. Inspired by the characteristics of images in the frequency domain, we propose a novel multiscale wavelet quantization (MWQ) method. This method decomposes original data into multiscale frequency components by wavelet transform, and then quantizes the components of different scales, respectively. It exploits the multiscale frequency and spatial information to alleviate the information loss caused by quantization in the spatial domain. Because of the flexibility of MWQ, we demonstrate three applications (e.g., model compression, quantized network optimization, and information enhancement) on the ImageNet and COCO datasets. Experimental results show that our method has stronger representation ability and can play an effective role in quantized neural networks.


Subtype aware Unsupervised Domain Adaptation for Medical Diagnosis. Recent advances in unsupervised domain adaptation (UDA) show that transferable prototypical learning presents a powerful means for class conditional alignment, which encourages the closeness of cross domain class centroids. However, the cross domain inner class compactness and the underlying fine grained subtype structure remained largely underexplored. In this work, we propose to adaptively carry out the fine grained subtype aware alignment by explicitly enforcing the class wise separation and subtype wise compactness with intermediate pseudo labels. Our key insight is that the unlabeled subtypes of a class can be divergent to one another with different conditional and label shifts, while inheriting the local proximity within a subtype. The cases of with or without the prior information on subtype numbers are investigated to discover the underlying subtype structure in an online fashion. The proposed subtype aware dynamic UDA achieves promising results on medical diagnosis tasks.


Uniqueness and global dynamics of spatially homogeneous non cutoff Boltzmann equation with moderate soft potentials. Departing from the weak solution, we prove the uniqueness, smoothing estimates and the global dynamics for the non cutoff spatially homogeneous Boltzmann equation with moderate soft potentials. Our results show that the behavior of the solution(including the production of regularity and the longtime behavior) can be it characterized quantitatively by the initial data at the large velocities, i.e.(i). initially polynomial decay at the large velocities in L 1 space will induce the finite smoothing estimates in weighted Sobolev spaces and the polynomial convergence rate (including the lower and upper bounds) to the equilibrium (ii). initially the exponential decay at the large velocities in L 1 space will induce C infty regularization effect and the stretched exponential convergence rate. The new ingredients of the proof lie in the development of the localized techniques in phase and frequency spaces and the propagation of the exponential momentum.


White Box Analysis over Machine Learning Modeling Performance of Configurable Systems. Performance influence models can help stakeholders understand how and where configuration options and their interactions influence the performance of a system. With this understanding, stakeholders can debug performance behavior and make deliberate configuration decisions. Current black box techniques to build such models combine various sampling and learning strategies, resulting in tradeoffs between measurement effort, accuracy, and interpretability. We present Comprex, a white box approach to build performance influence models for configurable systems, combining insights of local measurements, dynamic taint analysis to track options in the implementation, compositionality, and compression of the configuration space, without relying on machine learning to extrapolate incomplete samples. Our evaluation on 4 widely used, open source projects demonstrates that Comprex builds similarly accurate performance influence models to the most accurate and expensive black box approach, but at a reduced cost and with additional benefits from interpretable and local models.


Automorphisms of Minimal Surfaces of General Type with K S 2 1 , p g 2 . We classify the automorphism group of minimal surfaces of general type with K S 2 1 and rho g 2 . Furthermore, we show that the order of the automorphism group is bounded above by 200 and can only have prime factors p leq 31 with p neq 29 .


Graph Neural Network Training with Data Tiering. Graph Neural Networks (GNNs) have shown success in learning from graph structured data, with applications to fraud detection, recommendation, and knowledge graph reasoning. However, training GNN efficiently is challenging because 1) GPU memory capacity is limited and can be insufficient for large datasets, and 2) the graph based data structure causes irregular data access patterns. In this work, we provide a method to statistical analyze and identify more frequently accessed data ahead of GNN training. Our data tiering method not only utilizes the structure of input graph, but also an insight gained from actual GNN training process to achieve a higher prediction result. With our data tiering method, we additionally provide a new data placement and access strategy to further minimize the CPU GPU communication overhead. We also take into account of multi GPU GNN training as well and we demonstrate the effectiveness of our strategy in a multi GPU system. The evaluation results show that our work reduces CPU GPU traffic by 87 95 and improves the training speed of GNN over the existing solutions by 1.6 2.1x on graphs with hundreds of millions of nodes and billions of edges.


Spatio Temporal Representation Factorization for Video based Person Re Identification. Despite much recent progress in video based person re identification (re ID), the current state of the art still suffers from common real world challenges such as appearance similarity among various people, occlusions, and frame misalignment. To alleviate these problems, we propose Spatio Temporal Representation Factorization (STRF), a flexible new computational unit that can be used in conjunction with most existing 3D convolutional neural network architectures for re ID. The key innovations of STRF over prior work include explicit pathways for learning discriminative temporal and spatial features, with each component further factorized to capture complementary person specific appearance and motion information. Specifically, temporal factorization comprises two branches, one each for static features (e.g., the color of clothes) that do not change much over time, and dynamic features (e.g., walking patterns) that change over time. Further, spatial factorization also comprises two branches to learn both global (coarse segments) as well as local (finer segments) appearance features, with the local features particularly useful in cases of occlusion or spatial misalignment. These two factorization operations taken together result in a modular architecture for our parameter wise light STRF unit that can be plugged in between any two 3D convolutional layers, resulting in an end to end learning framework. We empirically show that STRF improves performance of various existing baseline architectures while demonstrating new state of the art results using standard person re ID evaluation protocols on three benchmarks.


A Compilation of Succinctness Results for Arithmetic Circuits. Arithmetic circuits (AC) are circuits over the real numbers with 0 1 valued input variables whose gates compute the sum or the product of their inputs. Positive AC that is, AC representing non negative functions subsume many interesting probabilistic models such as probabilistic sentential decision diagram (PSDD) or sum product network (SPN) on indicator variables. Efficient algorithms for many operations useful in probabilistic reasoning on these models critically depend on imposing structural restrictions to the underlying AC. Generally, adding structural restrictions yields new tractable operations but increases the size of the AC. In this paper we study the relative succinctness of classes of AC with different combinations of common restrictions. Building on existing results for Boolean circuits, we derive an unconditional succinctness map for classes of monotone AC that is, AC whose constant labels are non negative reals respecting relevant combinations of the restrictions we consider. We extend a small part of the map to classes of positive AC. Those are known to generally be exponentially more succinct than their monotone counterparts, but we observe here that for so called deterministic circuits there is no difference between the monotone and the positive setting which allows us to lift some of our results. We end the paper with some insights on the relative succinctness of positive AC by showing exponential lower bounds on the representations of certain functions in positive AC respecting structured decomposability.


Dominant subspace and low rank approximations from block Krylov subspaces without a gap. In this work we obtain results related to the approximation of h dimensional dominant subspaces and low rank approximations of matrices A in mathbb K m times n (where mathbb K mathbb R or mathbb C) in case there is no singular gap at the index h , i.e. if sigma h sigma h 1 (where sigma 1 geq ldots geq sigma p geq 0 denote the singular values of A , and p min m,n ). In order to do this, we develop a novel perspective for the convergence analysis of the classical deterministic block Krylov methods in this context. Indeed, starting with a matrix X in mathbb K n times r with r geq h satisfying a compatibility assumption with some h dimensional right dominant subspace, we show that block Krylov methods produce arbitrarily good approximations for both problems mentioned above. Our approach is based on recent work by Drineas, Ipsen, Kontopoulou and Magdon Ismail on approximation of structural left dominant subspaces. The main difference between our work and previous work on this topic is that instead of exploiting a singular gap at h (which is zero in this case) we exploit the nearest existing singular gaps.


Community Formation and Detection on GitHub Collaboration Networks. This paper studies community formation in OSS collaboration networks. While most current work examines the emergence of small scale OSS projects, our approach draws on a large scale historical dataset of 1.8 million GitHub users and their repository contributions. OSS collaborations are characterized by small groups of users that work closely together, leading to the presence of communities defined by short cycles in the underlying network structure. To understand the impact of this phenomenon, we apply a pre processing step that accounts for the cyclic network structure by using Renewal Nonbacktracking Random Walks (RNBRW) and the strength of pairwise collaborations before implementing the Louvain method to identify communities within the network. Equipping Louvain with RNBRW and the contribution strength provides a more assertive approach for detecting small scale teams and reveals nontrivial differences in community detection such as users tendencies toward preferential attachment to more established collaboration communities. Using this method, we also identify key factors that affect community formation, including the effect of users location and primary programming language, which was determined using a comparative method of contribution activities. Overall, this paper offers several promising methodological insights for both open source software experts and network scholars interested in studying team formation.


Self Supervised Knowledge Assimilation for Expert Layman Text Style Transfer. Expert layman text style transfer technologies have the potential to improve communication between members of scientific communities and the general public. High quality information produced by experts is often filled with difficult jargon laypeople struggle to understand. This is a particularly notable issue in the medical domain, where layman are often confused by medical text online. At present, two bottlenecks interfere with the goal of building high quality medical expert layman style transfer systems a dearth of pretrained medical domain language models spanning both expert and layman terminologies and a lack of parallel corpora for training the transfer task itself. To mitigate the first issue, we propose a novel language model (LM) pretraining task, Knowledge Base Assimilation, to synthesize pretraining data from the edges of a graph of expert and layman style medical terminology terms into an LM during self supervised learning. To mitigate the second issue, we build a large scale parallel corpus in the medical expert layman domain using a margin based criterion. Our experiments show that transformer based models pretrained on knowledge base assimilation and other well established pretraining tasks fine tuning on our new parallel corpus leads to considerable improvement against expert layman transfer benchmarks, gaining an average relative improvement of our human evaluation, the Overall Success Rate (OSR), by 106 . We release our code and parallel corpus for future research.


Fairer LP based Online Allocation via Analytic Center. In this paper, we consider an online resource allocation problem where a decision maker accepts or rejects incoming customer requests irrevocably in order to maximize expected reward given limited resources. At each time, a new order customer bid is revealed with a request of some resource(s) and a reward. We consider a stochastic setting where all the orders are i.i.d. sampled from an unknown distribution. Such formulation arises from many classic applications such as the canonical (quantity based) network revenue management problem and the Adwords problem. While the literature on the topic mainly focuses on regret minimization, our paper considers the textit fairness aspect of the problem. On a high level, we define the fairness in a way that a fair online algorithm should treat similar agents customers similarly, and the decision made for similar agents customers should be consistent over time. To achieve this goal, we define the fair offline solution as the analytic center of the offline optimal solution set, and introduce textit cumulative unfairness as the cumulative deviation from the online solutions to the fair offline solution over time. We propose a fair algorithm based on an interior point LP solver and a mechanism that dynamically detects unfair resource spending. Our algorithm achieves cumulative unfairness on the scale of order O( log(T)) , while maintains the regret to be bounded without dependency on T . In addition, compared to the literature, our result is produced under less restrictive assumptions on the degeneracy of the underlying linear program.


Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups. Most sensor setups for onboard autonomous perception are composed of LiDARs and vision systems, as they provide complementary information that improves the reliability of the different algorithms necessary to obtain a robust scene understanding. However, the effective use of information from different sources requires an accurate calibration between the sensors involved, which usually implies a tedious and burdensome process. We present a method to calibrate the extrinsic parameters of any pair of sensors involving LiDARs, monocular or stereo cameras, of the same or different modalities. The procedure is composed of two stages first, reference points belonging to a custom calibration target are extracted from the data provided by the sensors to be calibrated, and second, the optimal rigid transformation is found through the registration of both point sets. The proposed approach can handle devices with very different resolutions and poses, as usually found in vehicle setups. In order to assess the performance of the proposed method, a novel evaluation suite built on top of a popular simulation framework is introduced. Experiments on the synthetic environment show that our calibration algorithm significantly outperforms existing methods, whereas real data tests corroborate the results obtained in the evaluation suite. Open source code is available at https github.com beltransen velo2cam calibration


Shelling with MoS 2 Functional CuS MoS2 Hybrids as Electrocatalysts for the Oxygen Reduction and Hydrogen Evolution Reactions. The development of noble metal free electrocatalysts is of high importance for clean energy conversion applications. MoS 2 has been considered as a promising low cost catalyst for the hydrogen evolution reaction (HER), however its activity is limited by poor conductivity and low abundance of active sites. Moreover, its suitability as an effective catalyst for other reactions, in particluar the oxygen reduction reaction (ORR), was hardly explored to date. Herein, we show hybrid nanostructures of shelled CuS particles with MoS 2 layers, which produces several outcomes The MoS 2 shell is strained and defective, and charge transfer from the core to MoS 2 occurs, enabling activation of the basal plane of MoS 2 . Changing the feed ratio of the precursors led to control over morphology, such that the wrapping of the cores with the shell was continuously varied and characterized. We found an optimal hybrid structure, which provided high electrochemical active surface area and fast charge transfer kinetics, leading to improved activity not only towards HER (overpotential of 225 mV at 10 mA cm 1 ), but also for the sluggish ORR (onset potential 0.87 V vs RHE).


Human in the Loop Disinformation Detection Stance, Sentiment, or Something Else?. Both politics and pandemics have recently provided ample motivation for the development of machine learning enabled disinformation (a.k.a. fake news) detection algorithms. Existing literature has focused primarily on the fully automated case, but the resulting techniques cannot reliably detect disinformation on the varied topics, sources, and time scales required for military applications. By leveraging an already available analyst as a human in the loop, however, the canonical machine learning techniques of sentiment analysis, aspect based sentiment analysis, and stance detection become plausible methods to use for a partially automated disinformation detection system. This paper aims to determine which of these techniques is best suited for this purpose and how each technique might best be used towards this end. Training datasets of the same size and nearly identical neural architectures (a BERT transformer as a word embedder with a single feed forward layer thereafter) are used for each approach, which are then tested on sentiment and stance specific datasets to establish a baseline of how well each method can be used to do the other tasks. Four different datasets relating to COVID 19 disinformation are used to test the ability of each technique to detect disinformation on a topic that did not appear in the training data set. Quantitative and qualitative results from these tests are then used to provide insight into how best to employ these techniques in practice.


On certain edge transitive bicirculants of twice odd order. A graph admitting an automorphism with two orbits of the same length is called a bicirculant. Recently, Jajcay et al. initiated the investigation of the edge transitive bicirculants with the properties that one of the subgraphs induced by the latter orbits is a cycle and the valence is at least 6 (Electron. J. Combin., 2019). We show that the complement of the Petersen graph is the only such graph whose order is twice an odd number.


Adaptive VEM Stabilization Free A Posteriori Error Analysis. In the present paper we initiate the challenging task of building a mathematically sound theory for Adaptive Virtual Element Methods (AVEMs). Among the realm of polygonal meshes, we restrict our analysis to triangular meshes with hanging nodes in 2d the simplest meshes with a systematic refinement procedure that preserves shape regularity and optimal complexity. A major challenge in the a posteriori error analysis of AVEMs is the presence of the stabilization term, which is of the same order as the residual type error estimator but prevents the equivalence of the latter with the energy error. Under the assumption that any chain of recursively created hanging nodes has uniformly bounded length, we show that the stabilization term can be made arbitrarily small relative to the error estimator provided the stabilization parameter of the scheme is sufficiently large. This quantitative estimate leads to stabilization free upper and lower a posteriori bounds for the energy error. This novel and crucial property of VEMs hinges on the largest subspace of continuous piecewise linear functions and the delicate interplay between its coarser scales and the finer ones of the VEM space. Our results apply to H 1 conforming (lowest order) VEMs of any kind, including the classical and enhanced VEMs.


On minimal surfaces immersed in three dimensional Kropina Minkowski space. In this paper we consider a three dimensional Kropina space and obtain the partial differential equation that characterizes a minimal surfaces with the induced metric. Using this characterization equation we study various immersions of minimal surfaces. In particular, we obtain the partial differential equation that characterizes the minimal translation surfaces and show that the plane is the only such surface.


Segmentation free Heart Pathology Detection Using Deep Learning. Cardiovascular (CV) diseases are the leading cause of death in the world, and auscultation is typically an essential part of a cardiovascular examination. The ability to diagnose a patient based on their heart sounds is a rather difficult skill to master. Thus, many approaches for automated heart auscultation have been explored. However, most of the previously proposed methods involve a segmentation step, the performance of which drops significantly for high pulse rates or noisy signals. In this work, we propose a novel segmentation free heart sound classification method. Specifically, we apply discrete wavelet transform to denoise the signal, followed by feature extraction and feature reduction. Then, Support Vector Machines and Deep Neural Networks are utilised for classification. On the PASCAL heart sound dataset our approach showed superior performance compared to others, achieving 81 and 96 precision on normal and murmur classes, respectively. In addition, for the first time, the data were further explored under a user independent setting, where the proposed method achieved 92 and 86 precision on normal and murmur, demonstrating the potential of enabling automatic murmur detection for practical use.


Centrality and the KRH Invariant. The purpose of this paper is to discuss the categorical structure for a method of defining quantum invariants of knots, links and three manifolds. These invariants can be defined in terms of right integrals on certain Hopf algebras. We call such an invariant of 3 manifolds a Hennings invariant. The work reported in this paper has its background in previous work of the authors. The present paper gives an abstract description of these structures and shows how the Hopf algebraic image of a knot lies in the center of the corresponding Hopf algebra. The paper also shows how all the axiomatic properties of a quasi triangular Hopf algebra are involved in the topology via a functor from the Tangle Category to the Diagrammatic Category of a Hopf Algebra. The invariants described in this paper generalize to invariants of rotational virtual knots. The contents of this paper are an update of the original 1998 version published in JKTR.


On Ideals of L 1 algebras of Compact Quantum Groups. We develop a notion of a non commutative hull for a left ideal of the L 1 algebra of a compact quantum group mathbb G . A notion of non commutative spectral synthesis for compact quantum groups is achieved as well. It is shown that a certain Ditkin's property at infinity (which includes those mathbb G where widehat mathbb G has the approximation property) is equivalent to every hull having synthesis. We use this work to extend recent work of White that characterizes the weak closed ideals of a measure algebra of a compact group to those of the measure algebra of a coamenable compact quantum group. In the sequel, we use this work to study bounded right approximate identities of certain left ideals of L 1( mathbb G ) in relation to coamenability of mathbb G .


A note on phi Pr "ufer v multiplication rings. In this note, we show that a strongly phi ring R is a phi PvMR if and only if any phi torsion free R module is phi w flat, if and only if any divisible module is nonnil absolutely w pure module, if and only if any h divisible module is nonnil absolutely w pure module, if and only if any finitely generated nonnil ideal of R is w projective.


Combining Learning from Human Feedback and Knowledge Engineering to Solve Hierarchical Tasks in Minecraft. Real world tasks of interest are generally poorly defined by human readable descriptions and have no pre defined reward signals unless it is defined by a human designer. Conversely, data driven algorithms are often designed to solve a specific, narrowly defined, task with performance metrics that drives the agent's learning. In this work, we present the solution that won first place and was awarded the most human like agent in the 2021 NeurIPS Competition MineRL BASALT Challenge Learning from Human Feedback in Minecraft, which challenged participants to use human data to solve four tasks defined only by a natural language description and no reward function. Our approach uses the available human demonstration data to train an imitation learning policy for navigation and additional human feedback to train an image classifier. These modules, together with an estimated odometry map, are then combined into a state machine designed based on human knowledge of the tasks that breaks them down in a natural hierarchy and controls which macro behavior the learning agent should follow at any instant. We compare this hybrid intelligence approach to both end to end machine learning and pure engineered solutions, which are then judged by human evaluators. Codebase is available at https github.com viniciusguigo kairos minerl basalt.


SportsCap Monocular 3D Human Motion Capture and Fine grained Understanding in Challenging Sports Videos. Markerless motion capture and understanding of professional non daily human movements is an important yet unsolved task, which suffers from complex motion patterns and severe self occlusion, especially for the monocular setting. In this paper, we propose SportsCap the first approach for simultaneously capturing 3D human motions and understanding fine grained actions from monocular challenging sports video input. Our approach utilizes the semantic and temporally structured sub motion prior in the embedding space for motion capture and understanding in a data driven multi task manner. To enable robust capture under complex motion patterns, we propose an effective motion embedding module to recover both the implicit motion embedding and explicit 3D motion details via a corresponding mapping function as well as a sub motion classifier. Based on such hybrid motion information, we introduce a multi stream spatial temporal Graph Convolutional Network(ST GCN) to predict the fine grained semantic action attributes, and adopt a semantic attribute mapping block to assemble various correlated action attributes into a high level action label for the overall detailed understanding of the whole sequence, so as to enable various applications like action assessment or motion scoring. Comprehensive experiments on both public and our proposed datasets show that with a challenging monocular sports video input, our novel approach not only significantly improves the accuracy of 3D human motion capture, but also recovers accurate fine grained semantic action attributes.


Diversifying Neural Text Generation with Part of Speech Guided Softmax and Sampling. Neural text generation models are likely to suffer from the low diversity problem. Various decoding strategies and training based methods have been proposed to promote diversity only by exploiting contextual features, but rarely do they consider incorporating syntactic structure clues. In this work, we propose using linguistic annotation, i.e., part of speech (POS), to guide the text generation. In detail, we introduce POS Guided Softmax to explicitly model two posterior probabilities (i) next POS, and (ii) next token from the vocabulary of the target POS. A POS Guided Sampling strategy is further proposed to address the low diversity problem by enriching the diversity of POS. Extensive experiments and human evaluations demonstrate that, compared with existing state of the art methods, our POS Guided Softmax and Sampling (POSG) can generate more diverse text while maintaining comparable quality.


Fractional Sobolev isometric immersions of planar domains. We discuss C 1 regularity and developability of isometric immersions of flat domains into mathbb R 3 enjoying a local fractional Sobolev W 1 s, frac2s regularity for 2 3 le s 1 , generalizing the known results on Sobolev and H "older regimes. Ingredients of the proof include analysis of the weak Codazzi Mainardi equations of the isometric immersions and study of W 2, frac2s planar deformations with symmetric Jacobian derivative and vanishing distributional Jacobian determinant. On the way, we also show that the distributional Jacobian determinant, conceived as an operator defined on the Jacobian matrix, behaves like determinant of gradient matrices under products by scalar functions.


Recursively Summarizing Books with Human Feedback. A major challenge for scaling machine learning is training models to perform tasks that are very difficult or time consuming for humans to evaluate. We present progress on this problem on the task of abstractive summarization of entire fiction novels. Our method combines learning from human feedback with recursive task decomposition we use models trained on smaller parts of the task to assist humans in giving feedback on the broader task. We collect a large volume of demonstrations and comparisons from human labelers, and fine tune GPT 3 using behavioral cloning and reward modeling to do summarization recursively. At inference time, the model first summarizes small sections of the book and then recursively summarizes these summaries to produce a summary of the entire book. Our human labelers are able to supervise and evaluate the models quickly, despite not having read the entire books themselves. Our resulting model generates sensible summaries of entire books, even matching the quality of human written summaries in a few cases ( sim5 of books). We achieve state of the art results on the recent BookSum dataset for book length summarization. A zero shot question answering model using these summaries achieves state of the art results on the challenging NarrativeQA benchmark for answering questions about books and movie scripts. We release datasets of samples from our model.


2 distance list ( Delta 3) coloring of sparse graphs. A 2 distance list k coloring of a graph is a proper coloring of the vertices where each vertex has a list of at least k available colors and vertices at distance at most 2 cannot share the same color. We prove the existence of a 2 distance list ( Delta 3) coloring for graphs with maximum average degree less than frac83 and maximum degree Delta geq 4 as well as graphs with maximum average degree less than frac 14 5 and maximum degree Delta geq 6 .


The Limit Profile of Star Transpositions. We prove that the limit profile of star transpositions at time t n log n cn is equal to d text T.V. ( text Poiss (1 e c ), text Poiss (1)) . We prove this by developing a technique for comparing the limit profile behavior of two reversible Markov chains on the same space, that share the same stationary distribution and eigenbasis. We then compare the limit profile of star transpositions to the limit profile of random transpositions, as studied in cite Teyssier , and prove that they have the same limit profile at the respective cutoff times.


Liquid Structures a novel Computational Fluid Dynamics (CFD) inspired metamaterial. We present a theoretical framework for new structural metamaterials we refer to as liquid structures a topology of bistable mechanisms made up of a high number of cells that are sub mechanisms composed of pseudo rigid links and joints. The name liquid structures comes from the similarities they present with the kinematics of the constant flow of incompressible fluids they are inspired by in a limited domain. The layout of the cells are obtained through a two step process where (i) the node displacements are computed by means of a Computational Fluid Dynamics tool feeding and (ii) the kinematic synthesis of each cell that is subsequently performed. We report two illustrative examples where star and diamond type cells are employed. The paper concludes with a detailed discussion about future theoretical and manufacturing challenges arising from this new metamaterial paradigm.


DeepScanner a Robotic System for Automated 2D Object Dataset Collection with Annotations. In the proposed study, we describe the possibility of automated dataset collection using an articulated robot. The proposed technology reduces the number of pixel errors on a polygonal dataset and the time spent on manual labeling of 2D objects. The paper describes a novel automatic dataset collection and annotation system, and compares the results of automated and manual dataset labeling. Our approach increases the speed of data labeling 240 fold, and improves the accuracy compared to manual labeling 13 fold. We also present a comparison of metrics for training a neural network on a manually annotated and an automatically collected dataset.


Thinking Fast and Slow in AI the Role of Metacognition. AI systems have seen dramatic advancement in recent years, bringing many applications that pervade our everyday life. However, we are still mostly seeing instances of narrow AI many of these recent developments are typically focused on a very limited set of competencies and goals, e.g., image interpretation, natural language processing, classification, prediction, and many others. Moreover, while these successes can be accredited to improved algorithms and techniques, they are also tightly linked to the availability of huge datasets and computational power. State of the art AI still lacks many capabilities that would naturally be included in a notion of (human) intelligence. We argue that a better study of the mechanisms that allow humans to have these capabilities can help us understand how to imbue AI systems with these competencies. We focus especially on D. Kahneman's theory of thinking fast and slow, and we propose a multi agent AI architecture where incoming problems are solved by either system 1 (or "fast") agents, that react by exploiting only past experience, or by system 2 (or "slow") agents, that are deliberately activated when there is the need to reason and search for optimal solutions beyond what is expected from the system 1 agent. Both kinds of agents are supported by a model of the world, containing domain knowledge about the environment, and a model of "self", containing information about past actions of the system and solvers' skills.


Robust and accurate central algorithms for Multi Component mixture equations with Stiffened gas EOS. Simple and robust algorithms are developed for compressible Euler equations with the stiffened gas equation of state (EOS), representing gaseous mixtures in thermal equilibrium and without chemical reactions. These algorithms use a fully conservative approach in finite volume framework for approximating the governing equations. Also, these algorithms used central schemes with controlled numerical diffusion for this purpose. Both Mass fraction (Y ) and gamma based models are used with RICCA and MOVERS algorithms to resolve the basic features of the flow fields. These numerical schemes are tested thoroughly for pressure oscillations and preservation of the positivity of mass fraction at least in the first order numerical methods. Several test cases in both 1D and 2D are presented to demonstrate the robustness and accuracy of the numerical schemes.


A Trainable Reconciliation Method for Hierarchical Time Series. In numerous applications, it is required to produce forecasts for multiple time series at different hierarchy levels. An obvious example is given by the supply chain in which demand forecasting may be needed at a store, city, or country level. The independent forecasts typically do not add up properly because of the hierarchical constraints, so a reconciliation step is needed. In this paper, we propose a new general, flexible, and easy to implement reconciliation strategy based on an encoder decoder neural network. By testing our method on four real world datasets, we show that it can consistently reach or surpass the performance of existing methods in the reconciliation setting.


Where Should I Look? Optimised Gaze Control for Whole Body Collision Avoidance in Dynamic Environments. As robots operate in increasingly complex and dynamic environments, fast motion re planning has become a widely explored area of research. In a real world deployment, we often lack the ability to fully observe the environment at all times, giving rise to the challenge of determining how to best perceive the environment given a continuously updated motion plan. We provide the first investigation into a smart' controller for gaze control with the objective of providing effective perception of the environment for obstacle avoidance and motion planning in dynamic and unknown environments. We detail the novel problem of determining the best head camera behaviour for mobile robots when constrained by a trajectory. Furthermore, we propose a greedy optimisation based solution that uses a combination of voxelised rewards and motion primitives. We demonstrate that our method outperforms the benchmark methods in 2D and 3D environments, in respect of both the ability to explore the local surroundings, as well as in a superior success rate of finding collision free trajectories our method is shown to provide 7.4x better map exploration while consistently achieving a higher success rate for generating collision free trajectories. We verify our findings on a physical Toyota Human Support Robot (HSR) using a GPU accelerated perception framework.


Derivations of Quantum and Involution Generalized Weyl Algebras. We classify the derivations of degree one generalized Weyl algebras over a univariate Laurent polynomial ring. In particular, our results cover the Weyl Hayashi algebra, a quantization of the first Weyl algebra arising as a primitive factor algebra of U q ( mathfrak so 5) , and a family of algebras which localize to the group algebra of the infinite group with generators x and y , subject to the relation xy y 1 x.


Risk Averse Stochastic Optimal Control an efficiently computable statistical upper bound. In this paper, we discuss an application of the SDDP type algorithm to nested risk averse formulations of Stochastic Optimal Control (SOC) problems. We propose a construction of a statistical upper bound for the optimal value of risk averse SOC problems. This outlines an approach to a solution of a long standing problem in that area of research. The bound holds for a large class of convex and monotone conditional risk mappings. Finally, we show the validity of the statistical upper bound to solve a real life stochastic hydro thermal planning problem.


Analytical singular value decomposition for a class of stoichiometry matrices. We present the analytical singular value decomposition of the stoichiometry matrix for a spatially discrete reaction diffusion system on a one dimensional domain. The domain has two subregions which share a single common boundary. Each of the subregions is further partitioned into a finite number of compartments. Chemical reactions can occur within a compartment, whereas diffusion is represented as movement between adjacent compartments. Inspired by biology, we study both 1) the case where the reactions on each side of the boundary are different and only certain species diffuse across the boundary as well as 2) the case with spatially homogenous reactions and diffusion. We write the stoichiometry matrix for these two classes of systems using a Kronecker product formulation. For the first scenario, we apply linear perturbation theory to derive an approximate singular value decomposition in the limit as diffusion becomes much faster than reactions. For the second scenario, we derive an exact analytical singular value decomposition for all relative diffusion and reaction time scales. By writing the stoichiometry matrix using Kronecker products, we show that the singular vectors and values can also be written concisely using Kronecker products. Ultimately, we find that the singular value decomposition of the reaction diffusion stoichiometry matrix depends on the singular value decompositions of smaller matrices. These smaller matrices represent modified versions of the reaction only stoichiometry matrices and the analytically known diffusion only stoichiometry matrix. Our results provide a mathematical framework that can be used to study complex biochemical systems with metabolic compartments. MATLAB code for calculating the SVD equations is available at url www.github.com MathBioCU ReacDiffStoicSVD .


A sharp isoperimetric inequality in metric measure spaces with non negative Ricci curvature. We prove a sharp dimension free isoperimetric inequality, involving the volume entropy, in non compact metric measure spaces with non negative synthetic Ricci curvature.


Distributed Principal Component Analysis with Limited Communication. We study efficient distributed algorithms for the fundamental problem of principal component analysis and leading eigenvector computation on the sphere, when the data are randomly distributed among a set of computational nodes. We propose a new quantized variant of Riemannian gradient descent to solve this problem, and prove that the algorithm converges with high probability under a set of necessary spherical convexity properties. We give bounds on the number of bits transmitted by the algorithm under common initialization schemes, and investigate the dependency on the problem dimension in each case.


Output Randomization A Novel Defense for both White box and Black box Adversarial Models. Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this paper, we explore the use of output randomization as a defense against attacks in both the black box and white box models and propose two defenses. In the first defense, we propose output randomization at test time to thwart finite difference attacks in black box settings. Since this type of attack relies on repeated queries to the model to estimate gradients, we investigate the use of randomization to thwart such adversaries from successfully creating adversarial examples. We empirically show that this defense can limit the success rate of a black box adversary using the Zeroth Order Optimization attack to 0 . Secondly, we propose output randomization training as a defense against white box adversaries. Unlike prior approaches that use randomization, our defense does not require its use at test time, eliminating the Backward Pass Differentiable Approximation attack, which was shown to be effective against other randomization defenses. Additionally, this defense has low overhead and is easily implemented, allowing it to be used together with other defenses across various model architectures. We evaluate output randomization training against the Projected Gradient Descent attacker and show that the defense can reduce the PGD attack's success rate down to 12 when using cross entropy loss.


Finite Confluences and Closed Pattern Mining. The purpose of this article is to propose and investigate a partial order structure weaker than the lattice structure and which have nice properties regarding closure operators. We extend accordingly closed pattern mining and formal concept analysis to such structures we further call confluences. The primary motivation for investigating these structures is that it allows to reduce a lattice to a part whose elements are connected, as in some graph, still preserving a useful characterization of closure operators. Our investigation also considers how reducing one of the lattice involved in a Galois connection affects the structure of the closure operators ranges. When extending this way formal concept analysis we will focus on the intensional space, i.e. in reducing the pattern language, while recent investigations rather explored the reduction of the extensional space to connected elements.


CMUA Watermark A Cross Model Universal Adversarial Watermark for Combating Deepfakes. Malicious applications of deepfakes (i.e., technologies generating target facial attributes or entire faces from facial images) have posed a huge threat to individuals' reputation and security. To mitigate these threats, recent studies have proposed adversarial watermarks to combat deepfake models, leading them to generate distorted outputs. Despite achieving impressive results, these adversarial watermarks have low image level and model level transferability, meaning that they can protect only one facial image from one specific deepfake model. To address these issues, we propose a novel solution that can generate a Cross Model Universal Adversarial Watermark (CMUA Watermark), protecting a large number of facial images from multiple deepfake models. Specifically, we begin by proposing a cross model universal attack pipeline that attacks multiple deepfake models iteratively. Then, we design a two level perturbation fusion strategy to alleviate the conflict between the adversarial watermarks generated by different facial images and models. Moreover, we address the key problem in cross model optimization with a heuristic approach to automatically find the suitable attack step sizes for different models, further weakening the model level conflict. Finally, we introduce a more reasonable and comprehensive evaluation method to fully test the proposed method and compare it with existing ones. Extensive experimental results demonstrate that the proposed CMUA Watermark can effectively distort the fake facial images generated by multiple deepfake models while achieving a better performance than existing methods.


A generalized model of flocking with steering. We introduce and analyze a model for the dynamics of flocking and steering of a finite number of agents. In this model, each agent's acceleration consists of flocking and steering components. The flocking component is a generalization of many of the existing models and allows for the incorporation of many real world features such as acceleration bounds, partial masking effects and orientation bias. The steering component is also integral to capture real world phenomena. We provide rigorous sufficient conditions under which the agents flock and steer together. We also provide a formal singular perturbation study of the situation where flocking happens much faster than steering. We end our work by providing some numerical simulations to illustrate our theoretical results.


An adaptive high order surface finite element method for the self consistent field theory on general curved surfaces. In this paper, we develop an adaptive high order surface finite element method (FEM) incorporating the spectral deferred correction method for chain contour discretization to solve polymeric self consistent field equations on general curved surfaces. The high order surface FEM is obtained by the high order surface geometrical approximation and the high order function space approximation. Numerical results demonstrate that the precision order of these methods is consistent with the theoretical prediction. In order to describe the sharp interface in the strongly segregated system more accurately, an adaptive FEM equipped with a new Log marking strategy is proposed. Compared with the traditional strategy, the Log marking strategy can not only label the elements that need to be refined or coarsened, but also give the refined or coarsened times, which can make full use of the information of a posterior error estimator and improve the ecciency of the adaptive algorithm. To demonstrate the power of our approach, we investigate the self assembled patterns of diblock copolymers on several distinct curved surfaces. Numerical results illustrate the ecciency of the proposed method, especially for strongly segregated systems with economical discretization nodes.


Shock Induced Damage Mechanism Of Perineuronal Net. ECM components, such as the Perineuronal net (PNN), one of the most prevalent parts surrounding the neuronal cell. PNN is a protective net like structure regulating neuronal activity such as neurotransmission, charge balance and generates an action potential. Shock induced damage of this essential component may cause neuronal cell death and potentially leads to CTE, AD diseases, PTSD, etc. The shock generated possibly during an accident, improvised devie explosion or collision between NFL players may lead to damage to this safety net. The goal is to investigate the mechanics of PNN under shock wave. To understand the mechanics of PNN, mechanical properties of different PNN components such as glycan, GAG, and protein need to be evaluated. In this study, we evaluated the mechanical strength of PNN molecules and the interfacial strength between the components of PNN. Afterward, we have assessed the PNN molecules' damage efficiency at various conditions such as shock speed, preexisting bubble, and boundary conditions. The secondary structure altercation of the protein molecules of the PNN has been analyzed to evaluate damage intensity under varying shock loading. At higher shock speed, damage intensity is more elevated, and hyaluronan is most likely to break at the rigid junction. The primary structure of the protein molecules is most unlikely to fail. Instead, the molecules' secondary bonds will be altered. Our study suggests that the number of hydrogen bonds during the shock wave propagation decreased.


Rigidity of Lagrangian embeddings into symplectic tori and K3 surfaces. A Kahler type form is a symplectic form compatible with an integrable complex structure. Let M be either a torus or a K3 surface equipped with a Kahler type form. We show that the homology class of any Maslov zero Lagrangian torus in M has to be non zero and primitive. This extends previous results of Abouzaid Smith (for tori) and Sheridan Smith (for K3 surfaces) who proved it for particular Kahler type forms on M. In the K3 case our proof uses dynamical properties of the action of the diffeomorphism group of M on the space of the Kahler type forms. These properties are obtained using Shah's arithmetic version of Ratner's orbit closure theorem.


Video Instance Segmentation with a Propose Reduce Paradigm. Video instance segmentation (VIS) aims to segment and associate all instances of predefined classes for each frame in videos. Prior methods usually obtain segmentation for a frame or clip first, and merge the incomplete results by tracking or matching. These methods may cause error accumulation in the merging step. Contrarily, we propose a new paradigm Propose Reduce, to generate complete sequences for input videos by a single step. We further build a sequence propagation head on the existing image level instance segmentation network for long term propagation. To ensure robustness and high recall of our proposed framework, multiple sequences are proposed where redundant sequences of the same instance are reduced. We achieve state of the art performance on two representative benchmark datasets we obtain 47.6 in terms of AP on YouTube VIS validation set and 70.4 for J F on DAVIS UVOS validation set. Code is available at https github.com dvlab research ProposeReduce.


Object Level Reasoning with Logics Encoded in HOL Light. We present a generic framework that facilitates object level reasoning with logics that are encoded within the Higher Order Logic theorem proving environment of HOL Light. This involves proving statements in any logic using intuitive forward and backward chaining in a sequent calculus style. It is made possible by automated machinery that take care of the necessary structural reasoning and term matching automatically. Our framework can also handle type theoretic correspondences of proofs, effectively allowing the type checking and construction of computational processes via proof. We demonstrate our implementation using a simple propositional logic and its Curry Howard correspondence to the lambda calculus, and argue its use with linear logic and its various correspondences to session types.


RAC drawability is exists mathbb R complete. A RAC drawing of a graph is a straight line drawing in which every crossing occurs at a right angle. We show that deciding whether a graph has a RAC drawing is as hard as the existential theory of the reals, even if we know that every edge is involved in at most ten crossings and even if the drawing is specified up to isomorphism.


Graphs with high second eigenvalue multiplicity. Jiang, Tidor, Yao, Zhang, and Zhao recently showed that connected bounded degree graphs have sublinear second eigenvalue multiplicity (always referring to the adjacency matrix). This result was a key step in the solution to the problem of equiangular lines with fixed angles. It led to the natural question what is the maximum second eigenvalue multiplicity of a connected bounded degree n vertex graph? The best known upper bound is O(n log log n) . The previously known best known lower bound is on the order of n 1 3 (for infinitely many n ), coming from Cayley graphs on text PSL (2,q) . Here we give constructions showing a lower bound on the order of sqrt n log n . We also construct Cayley graphs with second eigenvalue multiplicity at least n 2 5 1 . Earlier techniques show that there are at most O(n log log n) eigenvalues (counting multiplicities) within O(1 log n) of the second eigenvalue. We give a construction showing this upper bound on approximate second eigenvalue multiplicity is tight up to a constant factor. This demonstrates a barrier to earlier techniques for upper bounding eigenvalue multiplicities.


Wide elastic wave bandgap metamaterial with single phase constituent. Accomplishing a wide elastic wave bandgap with single phase constituent is of primary interest in developing phononic metamaterials. In the present article, exploiting spatial periodicity, a single phase lattice is configured towards achieving a large frequency bandgap in sonic range. Numerical simulations reveal the presence of a comprehensive bandgap of 18 kHz in the 2 to 22 kHz range with systematically localizing the same constituent material in the lattice. Bloch wave modes unravel the involvement of dipole, monopole, and quadrupole resonances for wide and connected bandgaps. The existence of salient bandgaps is experimentally validated by analyzing the mechanical wave transmission.


Representation and modeling of charged particle distributions in tokamaks. Experimental diagnostics, analysis tools and simulations represent particle distributions in various forms and coordinates. Algorithms to manage these data are needed on platforms like the ITER Integrated Modelling Analysis Suite (IMAS), performing tasks such as archiving, modeling, conversion and visualization. A method that accomplishes some of the required tasks for distributions of charged particles with arbitrarily large magnetic drifts in axisymmetric tokamak geometry is described here. Given a magnetic configuration, we first construct a database of guiding center orbits, which serves as a basis for representing particle distributions. The orbit database contains the geometric information needed to perform conversions between arbitrary coordinates, modeling tasks, and resonance analyses. Using that database, an imported or newly modeled distribution is mapped to an exact equilibrium, where the dimensionality is reduced to three constants of motion (CoM). The orbit weight is uniquely given when the input is a true distribution one that measures the number of physical particles per unit of phase space volume. Less ideal inputs, such as distributions estimated without drifts, or models of particle sources, can also be processed. As an application example, we reconstruct the drift induced features of a distribution of fusion born alpha particles in a large tokamak, given only a birth profile, which is not a function of the alpha's CoM. Repeated back and forth transformations between CoM space and energy pitch cylinder coordinates are performed for verification and as a proof of principle for IMAS.


Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning. Data driven approaches for decision making applied to automated driving require appropriate generalization strategies, to ensure applicability to the world's variability. Current approaches either do not generalize well beyond the training data or are not capable to consider a variable number of traffic participants. Therefore we propose an invariant environment representation from the perspective of the ego vehicle. The representation encodes all necessary information for safe decision making. To assess the generalization capabilities of the novel environment representation, we train our agents on a small subset of scenarios and evaluate on the entire diverse set of scenarios. Here we show that the agents are capable to generalize successfully to unseen scenarios, due to the abstraction. In addition we present a simple occlusion model that enables our agents to navigate intersections with occlusions without a significant change in performance.


On Competitive Permutations for Set Cover by Intervals. We revisit the problem of computing an optimal partial cover of points by intervals. We show that the greedy algorithm computes a permutation Pi pi 1, pi 2, ldots of the intervals that is 3 4 competitive for any prefix of k intervals. That is, for any k , the intervals pi 1 cup cdots cup pi k covers at least 3 4 fraction of the points covered by the optimal solution using k intervals. We also provide an approximation algorithm that, in O(n m varepsilon) time, computes a cover by (1 varepsilon)k intervals that is as good as the optimal solution using k intervals, where n is the number of input points, and m is the number of intervals (we assume here the input is presorted). Finally, we show a counter example illustrating that the optimal solutions for set cover do not have the diminishing return property that is, the marginal benefit from using more sets is not monotonically decreasing. Fortunately, the diminishing returns does hold for intervals.


Hyperspace Neighbor Penetration Approach to Dynamic Programming for Model Based Reinforcement Learning Problems with Slowly Changing Variables in A Continuous State Space. Slowly changing variables in a continuous state space constitute an important category of reinforcement learning and see its application in many domains, such as modeling a climate control system where temperature, humidity, etc. change slowly over time. However, this subject is less addressed in recent studies. Classical methods with certain variants, such as Dynamic Programming with Tile Coding which discretizes the state space, fail to handle slowly changing variables because those methods cannot capture the tiny changes in each transition step, as it is computationally expensive or impossible to establish an extremely granular grid system. In this paper, we introduce a Hyperspace Neighbor Penetration (HNP) approach that solves the problem. HNP captures in each transition step the state's partial "penetration" into its neighboring hyper tiles in the gridded hyperspace, thus does not require the transition to be inter tile in order for the change to be captured. Therefore, HNP allows for a very coarse grid system, which makes the computation feasible. HNP assumes near linearity of the transition function in a local space, which is commonly satisfied. In summary, HNP can be orders of magnitude more efficient than classical method in handling slowly changing variables in reinforcement learning. We have made an industrial implementation of NHP with a great success.


Global well posedness of the Cauchy problem for the Jordan Moore Gibson Thompson equation with arbitrarily large higher order Sobolev norms. In this paper, we consider the 3D Jordan Moore Gibson Thompson equation arising in nonlinear acoustics. First, we prove that the solution exists globally in time provided that the lower order Sobolev norms of the initial data are considered to be small, while the higher order norms can be arbitrarily large. This improves some available results in the literature. Second, we prove a new decay estimate for the linearized model and removing the L 1 assumption on the initial data. The proof of this decay estimate is based on the high frequency and low frequency decomposition of the solution together with an interpolation inequality related to Sobolev spaces with negative order.


Frobenius Ehresmann structures and Cartan geometries in positive characteristic. The aim of the present paper is to lay the foundation for a theory of Ehresmann structures in positive characteristic, generalizing the Frobenius projective and Frobenius affine structures defined in the previous work. This theory deals with atlases of ' e tale coordinate charts on varieties modeled on homogenous spaces of algebraic groups, which we call Frobenius Ehresmann structures. These structures are compared with Cartan geometries in positive characteristic, as well as with higher dimensional generalizations of dormant indigenous bundles. In particular, we investigate the conditions under which these geometric structures are equivalent to each other. Also, we consider the classification problem of Frobenius Ehresmann structures on algebraic curves. The latter half of the present paper discusses the deformation theory of indigenous bundles in the algebraic setting. The tangent and obstruction spaces of various deformation functors are computed in terms of the hypercohomology groups of certain complexes. As a consequence, we formulate and prove the Ehresmann Weil Thurston principle for Frobenius Ehresmann structures. This fact asserts that deformations of a variety equipped with a Frobenius Ehresmann structure are completely determined by their monodromy crystals.


Deterministic control of SDEs with stochastic drift and multiplicative noise a variational approach. We consider a linear stochastic differential equation with stochastic drift and multiplicative noise. We study the problem of approximating its solution with the process that solves the equation where the possibly stochastic drift is replaced by a deterministic function. To do this, we use a combination of deterministic Pontryagin's maximum principle approach and direct methods of calculus of variations. We find necessary and sufficient conditions for a function u in L 1(0,T) to be a minimizer of a certain cost functional. To overcome the problem of the existence of such minimizer, we also consider suitable families of penalized coercive cost functionals. Finally, we consider the important example of the quadratic cost functional, showing that the expected value of the drift component is not always the best choice in the mean squared error approximation.


Weight Evolution Improving Deep Neural Networks Training through Evolving Inferior Weight Values. To obtain good performance, convolutional neural networks are usually over parameterized. This phenomenon has stimulated two interesting topics pruning the unimportant weights for compression and reactivating the unimportant weights to make full use of network capability. However, current weight reactivation methods usually reactivate the entire filters, which may not be precise enough. Looking back in history, the prosperity of filter pruning is mainly due to its friendliness to hardware implementation, but pruning at a finer structure level, i.e., weight elements, usually leads to better network performance. We study the problem of weight element reactivation in this paper. Motivated by evolution, we select the unimportant filters and update their unimportant elements by combining them with the important elements of important filters, just like gene crossover to produce better offspring, and the proposed method is called weight evolution (WE). WE is mainly composed of four strategies. We propose a global selection strategy and a local selection strategy and combine them to locate the unimportant filters. A forward matching strategy is proposed to find the matched important filters and a crossover strategy is proposed to utilize the important elements of the important filters for updating unimportant filters. WE is plug in to existing network architectures. Comprehensive experiments show that WE outperforms the other reactivation methods and plug in training methods with typical convolutional neural networks, especially lightweight networks. Our code is available at https github.com BZQLin Weight evolution.


Inconsistent Few Shot Relation Classification via Cross Attentional Prototype Networks with Contrastive Learning. Standard few shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., N way) and number of labeled data per class (i.e., K shot) during training vs. testing. In this work, we define a new task, textit inconsistent few shot RC , where the model needs to handle the inconsistency of N and K between training and testing. To address this new task, we propose Prototype Network based cross attention contrastive learning (ProtoCACL) to capture the rich mutual interactions between the support set and query set. Experimental results demonstrate that our ProtoCACL can outperform the state of the art baseline model under both inconsistent K and inconsistent N settings, owing to its more robust and discriminate representations. Moreover, we identify that in the inconsistent few shot learning setting, models can achieve better performance with textit less data than the standard few shot setting with carefully selected N and K . In the end of the paper, we provide further analyses and suggestions to systematically guide the selection of N and K under different scenarios.


Blocks of profinite groups with cyclic defect group. We demonstrate that the blocks of a profinite group whose defect groups are cyclic have a Brauer tree algebra structure analogous to the case of finite groups. We show further that the Brauer tree of a block with defect group mathbb Z p is of star type.


Knowledge Distillation Using Hierarchical Self Supervision Augmented Distribution. Knowledge distillation (KD) is an effective framework that aims to transfer meaningful information from a large teacher to a smaller student. Generally, KD often involves how to define and transfer knowledge. Previous KD methods often focus on mining various forms of knowledge, for example, feature maps and refined information. However, the knowledge is derived from the primary supervised task and thus is highly task specific. Motivated by the recent success of self supervised representation learning, we propose an auxiliary self supervision augmented task to guide networks to learn more meaningful features. Therefore, we can derive soft self supervision augmented distributions as richer dark knowledge from this task for KD. Unlike previous knowledge, this distribution encodes joint knowledge from supervised and self supervised feature learning. Beyond knowledge exploration, another crucial aspect is how to learn and distill our proposed knowledge effectively. To fully take advantage of hierarchical feature maps, we propose to append several auxiliary branches at various hidden layers. Each auxiliary branch is guided to learn self supervision augmented task and distill this distribution from teacher to student. Thus we call our KD method as Hierarchical Self Supervision Augmented Knowledge Distillation (HSSAKD). Experiments on standard image classification show that both offline and online HSSAKD achieves state of the art performance in the field of KD. Further transfer experiments on object detection further verify that HSSAKD can guide the network to learn better features, which can be attributed to learn and distill an auxiliary self supervision augmented task effectively.


Decomposition Coordination Method for Finite Horizon Bandit Problems. Optimally solving a multi armed bandit problem suffers the curse of dimensionality. Indeed, resorting to dynamic programming leads to an exponential growth of computing time, as the number of arms and the horizon increase. We introduce a decompositioncoordination heuristic, DeCo, that turns the initial problem into parallelly coordinated one armed bandit problems. As a consequence, we obtain a computing time which is essentially linear in the number of arms. In addition, the decomposition provides a theoretical lower bound on the regret. For the two armed bandit case, dynamic programming provides the exact solution, which is almost matched by the DeCo heuristic. Moreover, in numerical simulations with up to 100 rounds and 20 arms, DeCo outperforms classic algorithms (Thompson sampling and Kullback Leibler upper confidence bound) and almost matches the theoretical lower bound on the regret for 20 arms.


Special functions associated with automorphisms of the space of solutions to special double confluent Heun equation. The family of quads of interrelated functions holomorphic on the universal cover of the complex plane without zero (for brevity, pqrs functions), revealing a number of remarkable properties, is introduced. In particular, under certain conditions the transformations of the argument z of pqrs functions represented by lifts of the replacements z leftarrow 1 z z leftarrow z , and z leftarrow 1 z are equivalent to linear transformations with known coefficients. Pqrs functions arise in a natural way in constructing of certain linear operators acting as automorphisms on the space of solutions to the special double confluent Heun equation (sDCHE). Earlier such symmetries were known to exist only in the case of integer value of one of the constant parameters when the predecessors of pqrs functions appear as polynomials. In the present work, leaning on the generalized notion of pqrs functions, discrete symmetries of the space of solutions to sDCHE are extended to the general case, apart from some natural exceptions.


Multi Fidelity Digital Twins a Means for Better Cyber Physical Systems Testing?. Cyber Physical Systems (CPSs) combine software and physical components. These systems are widely applied in society within many domains, including the automotive, aerospace, railway, etc. Testing these systems is extremely challenging, therefore, it has attracted significant attention from the research community. A driving CPS testing technique in industry is simulation based testing. However, this poses significant challenges. In this new idea paper we present a novel approach to enhance the testing processes of CPSs. This novel approach is motivated with examples and open questions.


In Search of Socio Technical Congruence A Large Scale Longitudinal Study. We report on a large scale empirical study investigating the relevance of socio technical congruence over key basic software quality metrics, namely, bugs and churn. In particular, we explore whether alignment or misalignment of social communication structures and technical dependencies in large software projects influences software quality. To this end, we have defined a quantitative and operational notion of socio technical congruence, which we call socio technical motif congruence (STMC). STMC is a measure of the degree to which developers working on the same file or on two related files, need to communicate. As socio technical congruence is a complex and multi faceted phenomenon, the interpretability of the results is one of our main concerns, so we have employed a careful mixed methods statistical analysis. In particular, we provide analyses with similar techniques as employed by seminal work in the field to ensure comparability of our results with the existing body of work. The major result of our study, based on an analysis of 25 large open source projects, is that STMC is not related to project quality measures software bugs and churn in any temporal scenario. That is, we find no statistical relationship between the alignment of developer tasks and developer communications on the one hand, and project outcomes on the other hand. We conclude that, wherefore congruence does matter as literature shows, then its measurable effect lies elsewhere.


A Deep Metric Learning Approach to Account Linking. We consider the task of linking social media accounts that belong to the same author in an automated fashion on the basis of the content and metadata of their corresponding document streams. We focus on learning an embedding that maps variable sized samples of user activity ranging from single posts to entire months of activity to a vector space, where samples by the same author map to nearby points. The approach does not require human annotated data for training purposes, which allows us to leverage large amounts of social media content. The proposed model outperforms several competitive baselines under a novel evaluation framework modeled after established recognition benchmarks in other domains. Our method achieves high linking accuracy, even with small samples from accounts not seen at training time, a prerequisite for practical applications of the proposed linking framework.


The Complete Affine Automorphism Group of Polar Codes. Recently, a permutation based successive cancellation (PSC) decoding framework for polar codes attaches much attention. It decodes several permuted codewords with independent successive cancellation (SC) decoders. Its latency thus can be reduced to that of SC decoding. However, the PSC framework is ineffective for permutations falling into the lower triangular affine (LTA) automorphism group, as they are invariant under SC decoding. As such, a larger block lower triangular affine (BLTA) group that contains SC variant permutations was discovered for decreasing polar codes. But it was unknown whether BLTA equals the complete automorphism group. In this paper, we prove that BLTA equals the complete automorphisms of decreasing polar codes that can be formulated as affine trasformations.


Mean Variance Portfolio Selection in Contagious Markets. We consider a mean variance portfolio selection problem in a financial market with contagion risk. The risky assets follow a jump diffusion model, in which jumps are driven by a multivariate Hawkes process with mutual excitation effect. The mutual excitation feature of the Hawkes process captures the contagion risk in the sense that each price jump of an asset increases the likelihood of future jumps not only in the same asset but also in other assets. We apply the stochastic maximum principle, backward stochastic differential equation theory, and linear quadratic control technique to solve the problem and obtain the efficient strategy and efficient frontier in semi closed form, subject to a non local partial differential equation. Numerical examples are provided to illustrate our results.


Flat precover completing domains. Recently, many authors have embraced the study of certain properties of modules such as projectivity, injectivity and flatness from an alternative point of view. Rather than saying a module has a certain property or not, each module is assigned a relative domain which, somehow, measures to which extent it has this particular property. In this work, we introduce a new and fresh perspective on flatness of modules. However, we will first investigate a more general context by introducing domains relative to a precovering class x . We call these domains x precover completing domains. In particular, when x is the class of flat modules, we call them flat precover completing domains. This approach allows us to provide a common frame for a number of classical notions. Moreover, some known results are generalized and some classical rings are characterized in terms of these domains.


On the Mahler measure of the spectrum of rank one maps. We extend partially the Kakutani Zygmund dichotomy theorem to a class of generalized Riesz product type measures by proving that the generalized Riesz product is singular if and only if its Mahler measure is zero. As a consequence, we exhibit a new subclass of rank one maps acting on a finite measure space with singular spectrum. In our proof the H p theory coming to play. Furthermore, by appealing to a deep result of Bourgain, we prove that the Mahler measure of the spectrum of rank one map with cutting parameter p n O(n beta) , beta leq 1 is zero, and we establish that the integral of the absolute part of any generalized Riesz product is strictly less than 1. This answer partially a question asked by M. Nadkarni.


Development of a VR tool to study pedestrian route and exit choice behaviour in a multi story building. Although route and exit choice in complex buildings are important aspects of pedestrian behaviour, studies predominantly investigated pedestrian movement in a single level. This paper presents an innovative VR tool that was designed to investigate pedestrian route and exit choice in a multi story building. This tool supports free navigation and collects pedestrian walking trajectories, head movements and gaze points automatically. An experiment was conducted to evaluate the VR tool from objective standpoints (i.e., pedestrian behaviour) and subjective standpoints (i.e., the feeling of presence, system usability, simulation sickness). The results show that the VR tool allows for accurate collection of pedestrian behavioural data in the complex building. Moreover, the results of the questionnaire report high realism of the virtual environment, high immersive feeling, high usability, and low simulator sickness. This paper contributes by showcasing an innovative approach of applying VR technologies to study pedestrian behaviour in complex and realistic environments.


On small fractional parts of perturbed polynomials. Questions concerning small fractional parts of polynomials and pseudo polynomials have a long history in analytic number theory. In this paper, we improve on earlier work by Madritsch and Tichy. In particular, let f P phi where P is a polynomial of degree k and phi is a linear combination of functions of shape x c , c not in mathbb N , 1 c k . We prove that for any given irrational xi we have min substack 2 leq p leq X p text prime Vert xi lfloor f(p) rfloor Vert ll f, epsilon X rho(k) epsilon , for P belonging to a certain class of polynomials and with rho(k) 0 being an explicitly given rational function in k .


Using Machine Translation to Localize Task Oriented NLG Output. One of the challenges in a task oriented natural language application like the Google Assistant, Siri, or Alexa is to localize the output to many languages. This paper explores doing this by applying machine translation to the English output. Using machine translation is very scalable, as it can work with any English output and can handle dynamic text, but otherwise the problem is a poor fit. The required quality bar is close to perfection, the range of sentences is extremely narrow, and the sentences are often very different than the ones in the machine translation training data. This combination of requirements is novel in the field of domain adaptation for machine translation. We are able to reach the required quality bar by building on existing ideas and adding new ones finetuning on in domain translations, adding sentences from the Web, adding semantic annotations, and using automatic error detection. The paper shares our approach and results, together with a distillation model to serve the translation models at scale.


Detecting and Counting Oysters. Oysters are an essential species in the Chesapeake Bay living ecosystem. Oysters are filter feeders and considered the vacuum cleaners of the Chesapeake Bay that can considerably improve the Bay's water quality. Many oyster restoration programs have been initiated in the past decades and continued to date. Advancements in robotics and artificial intelligence have opened new opportunities for aquaculture. Drone like ROVs with high maneuverability are getting more affordable and, if equipped with proper sensory devices, can monitor the oysters. This work presents our efforts for videography of the Chesapeake bay bottom using an ROV, constructing a database of oysters, implementing Mask R CNN for detecting oysters, and counting their number in a video by tracking them.


Optimal Edge Weight Perturbations to Attack Shortest Paths. Finding shortest paths in a given network (e.g., a computer network or a road network) is a well studied task with many applications. We consider this task under the presence of an adversary, who can manipulate the network by perturbing its edge weights to gain an advantage over others. Specifically, we introduce the Force Path Problem as follows. Given a network, the adversary's goal is to make a specific path the shortest by adding weights to edges in the network. The version of this problem in which the adversary can cut edges is NP complete. However, we show that Force Path can be solved to within arbitrary numerical precision in polynomial time. We propose the PATHPERTURB algorithm, which uses constraint generation to build a set of constraints that require paths other than the adversary's target to be sufficiently long. Across a highly varied set of synthetic and real networks, we show that the optimal solution often reduces the required perturbation budget by about half when compared to a greedy baseline method.


Lazy Hermite Reduction and Creative Telescoping for Algebraic Functions. Bronstein's lazy Hermite reduction is a symbolic integration technique that reduces algebraic functions to integrands with only simple poles without the prior computation of an integral basis. We sharpen the lazy Hermite reduction by combining it with the polynomial reduction to solve the decomposition problem of algebraic functions. The sharpened reduction is then used to design a reduction based telescoping algorithm for algebraic functions in two variables.


Boosting Offline Reinforcement Learning with Residual Generative Modeling. Offline reinforcement learning (RL) tries to learn the near optimal policy with recorded offline experience without online exploration. Current offline RL research includes 1) generative modeling, i.e., approximating a policy using fixed data and 2) learning the state action value function. While most research focuses on the state action function part through reducing the bootstrapping error in value function approximation induced by the distribution shift of training data, the effects of error propagation in generative modeling have been neglected. In this paper, we analyze the error in generative modeling. We propose AQL (action conditioned Q learning), a residual generative model to reduce policy approximation error for offline RL. We show that our method can learn more accurate policy approximations in different benchmark datasets. In addition, we show that the proposed offline RL method can learn more competitive AI agents in complex control tasks under the multiplayer online battle arena (MOBA) game Honor of Kings.


On the compounding of higher order monotonic pseudo Boolean functions. Compounding submodular monotone (i.e. 2 alternating) set functions on a finite set preserves this property, as shown in 2010. A natural generalization to k alternating functions was presented in 2018, however hardly readable because of page long formulas. We give an easier proof of a more general result, exploiting known properties of higher order monotonic functions.


M regularity of mathbb Q twisted sheaves and its application to linear systems on abelian varieties. G. Pareschi and M. Popa give criterions for global generations and surjectivity of multiplication maps of global sections of coherent sheaves on abelian varieties in the theory of M regularity. In this paper, we generalize some of their criterions via the M regularity of mathbb Q twisted sheaves. As an application, we show that the M regularity of a suitable mathbb Q twisted sheaf implies property (N p) and jet ampleness for ample line bundles on abelian varieties.


Exploiting Multiple Timescales in Hierarchical Echo State Networks. Echo state networks (ESNs) are a powerful form of reservoir computing that only require training of linear output weights whilst the internal reservoir is formed of fixed randomly connected neurons. With a correctly scaled connectivity matrix, the neurons' activity exhibits the echo state property and responds to the input dynamics with certain timescales. Tuning the timescales of the network can be necessary for treating certain tasks, and some environments require multiple timescales for an efficient representation. Here we explore the timescales in hierarchical ESNs, where the reservoir is partitioned into two smaller linked reservoirs with distinct properties. Over three different tasks (NARMA10, a reconstruction task in a volatile environment, and psMNIST), we show that by selecting the hyper parameters of each partition such that they focus on different timescales, we achieve a significant performance improvement over a single ESN. Through a linear analysis, and under the assumption that the timescales of the first partition are much shorter than the second's (typically corresponding to optimal operating conditions), we interpret the feedforward coupling of the partitions in terms of an effective representation of the input signal, provided by the first partition to the second, whereby the instantaneous input signal is expanded into a weighted combination of its time derivatives. Furthermore, we propose a data driven approach to optimise the hyper parameters through a gradient descent optimisation method that is an online approximation of backpropagation through time. We demonstrate the application of the online learning rule across all the tasks considered.


On convergence of numerical solutions for the compressible MHD system with exactly divergence free magnetic field. We study a general convergence theory for the numerical solutions of compressible viscous and electrically conducting fluids with a focus on numerical schemes that preserve the divergence free property of magnetic field exactly. Our strategy utilizes the recent concepts of dissipative weak solutions and consistent approximations. First, we show the dissipative weak strong uniqueness principle, meaning a dissipative weak solution coincides with a classical solution as long as they emanate from the same initial data. Next, we show the convergence of consistent approximation towards the dissipative weak solution and thus the classical solution. Upon interpreting the consistent approximation as the stability and consistency of suitable numerical solutions we have established a generalized Lax equivalence theory convergence Longleftrightarrow stability and consistency. Further, to illustrate the application of this theory, we propose two novel mixed finite volume finite element methods with exact divergence free magnetic field. Finally, by showing solutions of these two schemes are consistent approximations, we conclude their convergence towards the dissipative weak solution and the classical solution.


Compensation of Multicore Fiber Skew Effects for Radio over Fiber mmWave Antenna Beamforming. In 5G networks, a Radio over Fiber architecture utilizing multicore fibers can be adopted for the transmission of mmwave signals feeding phased array antennas. The mmwave signals undergo phase shifts imposed by optical true time delay networks, to provide squint free beams. Multicore fibers are used to transfer the phase shifted optical signals. However, the intercore static skew of these fibers, if not compensated, distorts the radiation pattern. We propose an efficient method to compensate the differential delays, without full equalization of the transmission path lengths, reducing the power loss and complexity. Statistical analysis shows that regardless of the skew distribution, the frequency response can be estimated with respect to the rms skew delays. Simulation analysis of the complete Radio over Fiber and RF link validates the method.


Static and Dynamic Failure Localization through Progressive Network Tomography. We aim at assessing the states of the nodes in a network by means of end to end monitoring paths. The contribution of this paper is twofold. First, we consider a static failure scenario. In this context, we aim at minimizing the number of probes to obtain failure identification. To face this problem, we propose a progressive approach to failure localization based on stochastic optimization, whose solution is the optimal sequence of monitoring paths to probe. We address the complexity of the problem by proposing a greedy strategy in two variants one considers exact calculation of posterior probabilities of node failures, given the observation, whereas the other approximates these values by means of a novel failure centrality metric. Secondly, we adapt these two strategies to a dynamic failure scenario where nodes states can change throughout a monitoring period. By means of numerical experiments conducted on real network topologies, we demonstrate the practical applicability of our approach. Our performance evaluation evidences the superiority of our algorithms with respect to state of the art solutions based on classic Boolean Network Tomography as well as approaches based on sequential group testing.