General Low rank Matrix Optimization Geometric Analysis and Sharper Bounds. This paper considers the global geometry of general low rank minimization problems via the Burer Monterio factorization approach. For the rank 1 case, we prove that there is no spurious second order critical point for both symmetric and asymmetric problems if the rank 2 RIP constant delta is less than 1 2 . Combining with a counterexample with delta 1 2 , we show that the derived bound is the sharpest possible. For the arbitrary rank r case, the same property is established when the rank 2r RIP constant delta is at most 1 3 . We design a counterexample to show that the non existence of spurious second order critical points may not hold if delta is at least 1 2 . In addition, for any problem with delta between 1 3 and 1 2 , we prove that all second order critical points have a positive correlation to the ground truth. Finally, the strict saddle property, which can lead to the polynomial time global convergence of various algorithms, is established for both the symmetric and asymmetric problems when the rank 2r RIP constant delta is less than 1 3 . The results of this paper significantly extend several existing bounds in the literature.


Connes Moscovici Residue Cocycle For Some Dirac Type Operators. The residue cocycle associated to a suitable spectral triple is the key component of the Connes Moscovici local index theorem in noncommutative geometry. We review the relationship between the residue cocycle and heat kernel asymptotics. We use a modified version of the Getzler calculus to compute the cocycle for a class of Dirac type operators introduced by Bismut, obtained by deforming a Dirac operator by a closed 3 form B. We also compute the cocycle in low dimensions when the 3 form B is not closed.


Local and global well posedness of one dimensional free congested equations. This paper is dedicated to the study of a one dimensional congestion model, consisting of two different phases. In the congested phase, the pressure is free and the dynamics is incompressible, whereas in the non congested phase, the fluid obeys a pressureless compressible dynamics. We investigate the Cauchy problem for initial data which are small perturbations in the non congested zone of travelling wave profiles. We prove two different results. First, we show that for arbitrarily large perturbations, the Cauchy problem is locally well posed in weighted Sobolev spaces. The solution we obtain takes the form (vs, us)(t, x x(t)), where x x(t) is the congested zone and x x(t) is the non congested zone. The set x x(t) is a free surface, whose evolution is coupled with the one of the solution. Second, we prove that if the initial perturbation is sufficiently small, then the solution is global. This stability result relies on coercivity properties of the linearized operator around a travelling wave, and on the introduction of a new unknown which satisfies better estimates than the original one. In this case, we also prove that travelling waves are asymptotically stable.


Soft Robots Modeling a Literature Unwinding. The robotics community has seen an exponential growth in the level of complexity of the theoretical tools presented for the modeling of soft robotics devices. Different solutions have been presented to overcome the difficulties related to the modeling of soft robots, often leveraging on other scientific disciplines, such as continuum mechanics and computer graphics. These theoretical foundations are often taken for granted and this lead to an intricate literature that, consequently, has never been the subject of a complete review. Withing this scenario, the objective of the presented paper is twofold. The common theoretical roots that relate the different families of modeling techniques are highlighted, employing a unifying language that ease the analysis of their main connections and differences. Thus, the listing of the approaches naturally follows and a complete, untangled, review of the main works on the field is finally provided.


An upper bound on the revised first Betti number and a torus stability result for RCD spaces. We prove an upper bound on the rank of the abelianised revised fundamental group (called "revised first Betti number") of a compact RCD (K,N) space, in the same spirit of the celebrated Gromov Gallot upper bound on the first Betti number for a smooth compact Riemannian manifold with Ricci curvature bounded below. When the synthetic lower Ricci bound is close enough to (negative) zero and the aforementioned upper bound on the revised first Betti number is saturated (i.e. equal to the integer part of N , denoted by lfloor N rfloor ), then we establish a torus stability result stating that the space is lfloor N rfloor rectifiable as a metric measure space, and a finite cover must be mGH close to an lfloor N rfloor dimensional flat torus moreover, in case N is an integer, we prove that the space itself is bi H "older homeomorphic to a flat torus. This second result extends to the class of non smooth RCD ( delta, N) spaces a celebrated torus stability theorem by Colding (later refined by Cheeger Colding).


Graph Structural Attack by Spectral Distance. Graph Convolutional Networks (GCNs) have fueled a surge of interest due to their superior performance on graph learning tasks, but are also shown vulnerability to adversarial attacks. In this paper, an effective graph structural attack is investigated to disrupt graph spectral filters in the Fourier domain. We define the spectral distance based on the eigenvalues of graph Laplacian to measure the disruption of spectral filters. We then generate edge perturbations by simultaneously maximizing a task specific attack objective and the proposed spectral distance. The experiments demonstrate remarkable effectiveness of the proposed attack in the white box setting at both training and test time. Our qualitative analysis shows the connection between the attack behavior and the imposed changes on the spectral distribution, which provides empirical evidence that maximizing spectral distance is an effective manner to change the structural property of graphs in the spatial domain and perturb the frequency components in the Fourier domain.


Quantitative results for non normal matrices subject to random and deterministic perturbations. We consider the eigenvalue distribution of a fixed matrix subject to a small perturbation. In particular, we prove quantitative comparison results which show that the logarithmic potential is stable under perturbations with small norm or low rank, provided the smallest and largest singular values are not too extreme. We also establish a quantitative version of the Tao Vu replacement principle. As an application of our results, we study the spectral distribution of banded Toeplitz matrices subject to small random perturbations, including the case when the bandwidth grows with the dimension. For this model, we obtain a rate of convergence in Wasserstein distance of the empirical spectral measure to its limiting distribution. We give a number of examples of our methods including random multiplicative perturbations and large classes of deterministic perturbations that behave similar to random perturbations.


DS TransUNet Dual Swin Transformer U Net for Medical Image Segmentation. Automatic medical image segmentation has made great progress benefit from the development of deep learning. However, most existing methods are based on convolutional neural networks (CNNs), which fail to build long range dependencies and global context connections due to the limitation of receptive field in convolution operation. Inspired by the success of Transformer in modeling the long range contextual information, some researchers have expended considerable efforts in designing the robust variants of Transformer based U Net. Moreover, the patch division used in vision transformers usually ignores the pixel level intrinsic structural features inside each patch. To alleviate these problems, we propose a novel deep medical image segmentation framework called Dual Swin Transformer U Net (DS TransUNet), which might be the first attempt to concurrently incorporate the advantages of hierarchical Swin Transformer into both encoder and decoder of the standard U shaped architecture to enhance the semantic segmentation quality of varying medical images. Unlike many prior Transformer based solutions, the proposed DS TransUNet first adopts dual scale encoder subnetworks based on Swin Transformer to extract the coarse and fine grained feature representations of different semantic scales. As the core component for our DS TransUNet, a well designed Transformer Interactive Fusion (TIF) module is proposed to effectively establish global dependencies between features of different scales through the self attention mechanism. Furthermore, we also introduce the Swin Transformer block into decoder to further explore the long range contextual information during the up sampling process. Extensive experiments across four typical tasks for medical image segmentation demonstrate the effectiveness of DS TransUNet, and show that our approach significantly outperforms the state of the art methods.


Interpretable Self supervised Multi task Learning for COVID 19 Information Retrieval and Extraction. The rapidly evolving literature of COVID 19 related articles makes it challenging for NLP models to be effectively trained for information retrieval and extraction with the corresponding labeled data that follows the current distribution of the pandemic. On the other hand, due to the uncertainty of the situation, human experts' supervision would always be required to double check the decision making of these models highlighting the importance of interpretability. In the light of these challenges, this study proposes an interpretable self supervised multi task learning model to jointly and effectively tackle the tasks of information retrieval (IR) and extraction (IE) during the current emergency health crisis situation. Our results show that our model effectively leverage the multi task and self supervised learning to improve generalization, data efficiency and robustness to the ongoing dataset shift problem. Our model outperforms baselines in IE and IR tasks, respectively by micro f score of 0.08 (LCA F score of 0.05), and MAP of 0.05 on average. In IE the zero and few shot learning performances are on average 0.32 and 0.19 micro f score higher than those of the baselines.


ModalPINN an extension of Physics Informed Neural Networks with enforced truncated Fourier decomposition for periodic flow reconstruction using a limited number of imperfect sensors. Continuous reconstructions of periodic phenomena provide powerful tools to understand, predict and model natural situations and engineering problems. In line with the recent method called Physics Informed Neural Networks (PINN) where a multi layer perceptron directly approximates any physical quantity as a symbolic function of time and space coordinates, we present an extension, namely ModalPINN, that encodes the approximation of a limited number of Fourier mode shapes. In addition to the added interpretability, this representation performs up to two orders of magnitude more precisely for a similar number of degrees of freedom and training time in some cases as illustrated through the test case of laminar shedding of vortices over a cylinder. This added simplicity proves to be robust in regards to flow reconstruction using only a limited number of sensors with asymmetric data that simulates an experimental configuration, even when a Gaussian noise or a random delay is added, imitating imperfect and sparse information.


Self dual maps II links and symmetry. In this paper, we investigate representations of links that are either centrally symmetric in mathbb R 3 or antipodally symmetric in mathbb S 3 . By using the notions of antipodally self dual and antipodally symmetric maps, introduced and studied by the authors, we are able to present sufficient combinatorial conditions for a link L to admit such representations. The latter naturally arises sufficient conditions for L to be amphichiral. We also introduce another (closely related) method yielding again to sufficient conditions for L to be amphichiral. We finally prove that a link L , associated to a map G , is amphichiral if the self dual pairing of G is not one of 6 specific ones among the classification of the 24 self dual pairing Cor(G) rhd Aut(G) .


Type based Enforcement of Infinitary Trace Properties for Java. A common approach to improve software quality is to use programming guidelines to avoid common kinds of errors. In this paper, we consider the problem of enforcing guidelines for Featherweight Java (FJ). We formalize guidelines as sets of finite or infinite execution traces and develop a region based type and effect system for FJ that can enforce such guidelines. We build on the work by Erbatur, Hofmann and Z u a linescu, who presented a type system for verifying the finite event traces of terminating FJ programs. We refine this type system, separating region typing from FJ typing, and use ideas of Hofmann and Chen to extend it to capture also infinite traces produced by non terminating programs. Our type and effect system can express properties of both finite and infinite traces and can compute information about the possible infinite traces of FJ programs. Specifically, the set of infinite traces of a method is constructed as the greatest fixed point of the operator which calculates the possible traces of method bodies. Our type inference algorithm is realized by working with the finitary abstraction of the system based on B "uchi automata.


Bounded Reachability Problems are Decidable in FIFO Machines. The undecidability of basic decision problems for general FIFO machines such as reachability and unboundedness is well known. In this paper, we provide an underapproximation for the general model by considering only runs that are input bounded (i.e. the sequence of messages sent through a particular channel belongs to a given bounded language). We prove, by reducing this model to a counter machine with restricted zero tests, that the rational reachability problem (and by extension, control state reachability, unboundedness, deadlock, etc.) is decidable. This class of machines subsumes input letter bounded machines, flat machines, linear FIFO nets, and monogeneous machines, for which some of these problems were already shown to be decidable. These theoretical results can form the foundations to build a tool to verify general FIFO machines based on the analysis of input bounded machines.


Raise a Child in Large Language Model Towards Effective and Generalizable Fine tuning. Recent pretrained language models extend from millions to billions of parameters. Thus the need to fine tune an extremely large pretrained model with a limited training corpus arises in various downstream tasks. In this paper, we propose a straightforward yet effective fine tuning technique, Child Tuning, which updates a subset of parameters (called child network) of large pretrained models via strategically masking out the gradients of the non child network during the backward process. Experiments on various downstream tasks in GLUE benchmark show that Child Tuning consistently outperforms the vanilla fine tuning by 1.5 8.6 average score among four different pretrained models, and surpasses the prior fine tuning techniques by 0.6 1.3 points. Furthermore, empirical results on domain transfer and task transfer show that Child Tuning can obtain better generalization performance by large margins.


Online Multi Agent Forecasting with Interpretable Collaborative Graph Neural Network. This paper considers predicting future statuses of multiple agents in an online fashion by exploiting dynamic interactions in the system. We propose a novel collaborative prediction unit (CoPU), which aggregates the predictions from multiple collaborative predictors according to a collaborative graph. Each collaborative predictor is trained to predict the status of an agent by considering the impact of another agent. The edge weights of the collaborative graph reflect the importance of each predictor. The collaborative graph is adjusted online by multiplicative update, which can be motivated by minimizing an explicit objective. With this objective, we also conduct regret analysis to indicate that, along with training, our CoPU achieves similar performance with the best individual collaborative predictor in hindsight. This theoretical interpretability distinguishes our method from many other graph networks. To progressively refine predictions, multiple CoPUs are stacked to form a collaborative graph neural network. Extensive experiments are conducted on three tasks online simulated trajectory prediction, online human motion prediction and online traffic speed prediction, and our methods outperform state of the art works on the three tasks by 28.6 , 17.4 and 21.0 on average, respectively.


A Characterization of Individualization Refinement Trees. Individualization Refinement (IR) algorithms form the standard method and currently the only practical method for symmetry computations of graphs and combinatorial objects in general. Through backtracking, on each graph an IR algorithm implicitly creates an IR tree whose order is the determining factor of the running time of the algorithm. We give a precise and constructive characterization which trees are IR trees. This characterization is applicable both when the tree is regarded as an uncolored object but also when regarded as a colored object where vertex colors stem from a node invariant. We also provide a construction that given a tree produces a corresponding graph whenever possible. This provides a constructive proof that our necessary conditions are also sufficient for the characterization.


Multiplicity Free Gonality on Graphs. The divisorial gonality of a graph is the minimum degree of a positive rank divisor on that graph. We introduce the multiplicity free gonality of a graph, which restricts our consideration to divisors that place at most (1 ) chip on each vertex. We give a sufficient condition in terms of vertex connectivity for these two versions of gonality to be equal and we show that no function of gonality can bound multiplicity free gonality, even for simple graphs. We also prove that multiplicity free gonality is NP hard to compute, while still determining it for graph families for which gonality is currently unknown. We also present new gonalities, such as for the wheel graphs.


Small World Student Network at the University of Texas at Dallas in Times of Social Distancing. To limit the spread of the novel coronavirus on college campuses, a common strategy for the Fall 2020 and Spring 2021 terms has been to offer instruction weighted toward hybrid or fully online modalities. Colleges are now considering whether and how to expand hybrid or fully in person instruction for future terms, and learn lessons from this experience for future use. Our paper uses Fall 2019 enrollment data for a medium sized public American university to analyze whether some student groupings by class standing or course level are more susceptible to the spread of infectious disease through academic enrollment networks. Replicating Weeden and Cornwell 8 , we find that enrollment networks at the institution are "small worlds" characterized by high clustering, short average path lengths, and multiple independent connections. Connectivity decreases as class standing (graduate vs. undergraduate senior vs. freshman) and course level increase as students move from generalized to specialized course loads, networks cluster by major. Holding other factors constant, policies focusing on in person instruction for lower division students conflict with the greater risk of infectious spread through a lower division network in the absence of additional steps to minimize academic connectivity. There are academic and financial incentives for emphasizing the freshman experience, including concerns about student attrition from the first to second academic year and recouping costs of infrastructure investments in dormitories. Possible solutions could include (i) restricting face to face or hybrid instruction to courses in students' academic majors, which would disrupt larger networks into smaller ones and thus restrict the spread of infection across majors, and (ii) take a "scalpel" approach to instruction modes by moving online courses most likely to facilitate epidemic spread.


Degree Tables for Secure Distributed Matrix Multiplication. We consider the problem of secure distributed matrix multiplication (SDMM) in which a user wishes to compute the product of two matrices with the assistance of honest but curious servers. We construct polynomial codes for SDMM by studying a recently introduced combinatorial tool called the degree table. For a fixed partitioning, minimizing the total communication cost of a polynomial code for SDMM is equivalent to minimizing N , the number of distinct elements in the corresponding degree table. We propose new constructions of degree tables with a low number of distinct elements. These new constructions lead to a general family of polynomial codes for SDMM, which we call mathsf GASP r (Gap Additive Secure Polynomial codes) parametrized by an integer r . mathsf GASP r outperforms all previously known polynomial codes for SDMM under an outer product partitioning. We also present lower bounds on N and prove the optimality or asymptotic optimality of our constructions for certain regimes. Moreover, we formulate the construction of optimal degree tables as an integer linear program and use it to prove the optimality of mathsf GASP r for all the system parameters that we were able to test.


Planning with Biological Neurons and Synapses. We revisit the planning problem in the blocks world, and we implement a known heuristic for this task. Importantly, our implementation is biologically plausible, in the sense that it is carried out exclusively through the spiking of neurons. Even though much has been accomplished in the blocks world over the past five decades, we believe that this is the first algorithm of its kind. The input is a sequence of symbols encoding an initial set of block stacks as well as a target set, and the output is a sequence of motion commands such as "put the top block in stack 1 on the table". The program is written in the Assembly Calculus, a recently proposed computational framework meant to model computation in the brain by bridging the gap between neural activity and cognitive function. Its elementary objects are assemblies of neurons (stable sets of neurons whose simultaneous firing signifies that the subject is thinking of an object, concept, word, etc.), its commands include project and merge, and its execution model is based on widely accepted tenets of neuroscience. A program in this framework essentially sets up a dynamical system of neurons and synapses that eventually, with high probability, accomplishes the task. The purpose of this work is to establish empirically that reasonably large programs in the Assembly Calculus can execute correctly and reliably and that rather realistic if idealized higher cognitive functions, such as planning in the blocks world, can be implemented successfully by such programs.


S2R DepthNet Learning a Generalizable Depth specific Structural Representation. Human can infer the 3D geometry of a scene from a sketch instead of a realistic image, which indicates that the spatial structure plays a fundamental role in understanding the depth of scenes. We are the first to explore the learning of a depth specific structural representation, which captures the essential feature for depth estimation and ignores irrelevant style information. Our S2R DepthNet (Synthetic to Real DepthNet) can be well generalized to unseen real world data directly even though it is only trained on synthetic data. S2R DepthNet consists of a) a Structure Extraction (STE) module which extracts a domaininvariant structural representation from an image by disentangling the image into domain invariant structure and domain specific style components, b) a Depth specific Attention (DSA) module, which learns task specific knowledge to suppress depth irrelevant structures for better depth estimation and generalization, and c) a depth prediction module (DP) to predict depth from the depth specific representation. Without access of any real world images, our method even outperforms the state of the art unsupervised domain adaptation methods which use real world images of the target domain for training. In addition, when using a small amount of labeled real world data, we achieve the state ofthe art performance under the semi supervised setting. The code and trained models are available at https github.com microsoft S2R DepthNet.


Strong ergodicity phenomena for Bernoulli shifts of bounded algebraic dimension. The algebraic dimension of a Polish permutation group Q leq mathrm Sym ( mathbb N ) is the smallest n in omega , so that for all A subseteq mathbb N of size n 1 , the orbit of every a in A under the pointwise stabilizer of A setminus a is finite. We study the Bernoulli shift P curvearrowright mathbb R mathbb N for various Polish permutation groups P and we provide criteria under which the P shift is generically ergodic relative to the injective part of the Q shift, when Q has algebraic dimension leq n . We use this to show that the sequence of pairwise reduction incomparable equivalence relations defined in KP21 is a strictly increasing sequence in the Borel reduction hierarchy. We also use our main theorem to exhibit an equivalence relation of pinned cardinal aleph 1 which strongly resembles the equivalence relation of pinned cardinal aleph 1 from Zap11 , but which does not Borel reduce to the latter. It remains open whether they are actually incomparable under Borel reductions. Our proofs rely on the study of symmetric models whose symmetries come from the group Q . We show that when Q is "locally finite" e.g. when Q mathrm Aut ( mathcal M ) , where mathcal M is a locally finite countable structure with no algebraicity the corresponding symmetric model admits a theory of supports which is analogous to that in the basic Cohen model.


Movie Recommender System using critic consensus. Recommendation systems are perhaps one of the most important agents for industry growth through the modern Internet world. Previous approaches on recommendation systems include collaborative filtering and content based filtering recommendation systems. These 2 methods are disjointed in nature and require the continuous storage of user preferences for a better recommendation. To provide better integration of the two processes, we propose a hybrid recommendation system based on the integration of collaborative and content based content, taking into account the top critic consensus and movie rating score. We would like to present a novel model that recommends movies based on the combination of user preferences and critical consensus scores.


Tutorials on Testing Neural Networks. Deep learning achieves remarkable performance on pattern recognition, but can be vulnerable to defects of some important properties such as robustness and security. This tutorial is based on a stream of research conducted since the summer of 2018 at a few UK universities, including the University of Liverpool, University of Oxford, Queen's University Belfast, University of Lancaster, University of Loughborough, and University of Exeter. The research aims to adapt software engineering methods, in particular software testing methods, to work with machine learning models. Software testing techniques have been successful in identifying software bugs, and helping software developers in validating the software they design and implement. It is for this reason that a few software testing techniques such as the MC DC coverage metric have been mandated in industrial standards for safety critical systems, including the ISO26262 for automotive systems and the RTCA DO 178B C for avionics systems. However, these techniques cannot be directly applied to machine learning models, because the latter are drastically different from traditional software, and their design follows a completely different development life cycle. As the outcome of this thread of research, the team has developed a series of methods that adapt the software testing techniques to work with a few classes of machine learning models. The latter notably include convolutional neural networks, recurrent neural networks, and random forest. The tools developed from this research are now collected, and publicly released, in a GitHub repository url https github.com TrustAI DeepConcolic , with the BSD 3 Clause licence. This tutorial is to go through the major functionalities of the tools with a few running examples, to exhibit how the developed techniques work, what the results are, and how to interpret them.


Simulation studies of the Moliere radius for em calorimeter materials. The Monte Carlo calculations of the Moliere radius (RM) for some homogeneous and heterogeneous media used in electromagnetic calorimetry in the energy range from 50 MeV to 10 GeV are presented in detail. The obtained results, the uncertainties in determining RM, estimations of the absorbed energy, methods for approximating the absorbed energy, and the accuracy of the results are discussed as well. Some RM are shown for calorimeter prototypes of the Spin Physics Detector experiment (SPD). A one parameter function of the Moliere radius dependence on the absorber scintillator thickness ratio is obtained.


Modeling Realistic Adversarial Attacks against Network Intrusion Detection Systems. The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to adversarial attacks that create tiny perturbations aimed at decreasing the effectiveness of detecting threats. We observe that existing literature assumes threat models that are inappropriate for realistic cybersecurity scenarios because they consider opponents with complete knowledge about the cyber detector or that can freely interact with the target systems. By focusing on Network Intrusion Detection Systems based on machine learning, we identify and model the real capabilities and circumstances required by attackers to carry out feasible and successful adversarial attacks. We then apply our model to several adversarial attacks proposed in literature and highlight the limits and merits that can result in actual adversarial attacks. The contributions of this paper can help hardening defensive systems by letting cyber defenders address the most critical and real issues, and can benefit researchers by allowing them to devise novel forms of adversarial attacks based on realistic threat models.


Fredholmness and Weylness of block operator matrices. This paper deals with characterizations of Fredholmness and Weylness of upper triangular operator matrices of an arbitrary dimension n geq 2 . We present various characterization results in the settings of separable and arbitrary infinite dimensional Hilbert spaces, thus extending some known results from cite CAO , cite CAO2 , cite ZHANG to case of arbitrary n geq2 . As corollaries, we get corrected perturbation results from cite WU , cite WU2 , cite ZHANG . Namely, we show that certain perturbation results for upper triangular operators of dimension n 2 can not hold with an equality, but only with a double inclusion instead, and we explain why closedness of ranges of diagonal operators must not be neglected in the results of this kind. Finally, we give a comment on possible extensions to infinite dimensional Banach spaces.


Analyticity of the Lyapunov exponents of random products of quasi periodic cocycles. We show that the top Lyapunov exponent lambda (p) , p (p 1, cdots, p N) with p i 0 for each i , associated with a random product of quasi periodic cocycles depends real analytically on the transition probabilities p whenever lambda (p) is simple. Moreover if the spectrum at p is simple (all Lyapunov exponents having multiplicity one ) then all Lyapunov exponents depend real analytically on p .


Improving Graph Representation Learning by Contrastive Regularization. Graph representation learning is an important task with applications in various areas such as online social networks, e commerce networks, WWW, and semantic webs. For unsupervised graph representation learning, many algorithms such as Node2Vec and Graph SAGE make use of "negative sampling" and or noise contrastive estimation loss. This bears similar ideas to contrastive learning, which "contrasts" the node representation similarities of semantically similar (positive) pairs against those of negative pairs. However, despite the success of contrastive learning, we found that directly applying this technique to graph representation learning models (e.g., graph convolutional networks) does not always work. We theoretically analyze the generalization performance and propose a light weight regularization term that avoids the high scales of node representations' norms and the high variance among them to improve the generalization performance. Our experimental results further validate that this regularization term significantly improves the representation quality across different node similarity definitions and outperforms the state of the art methods.


Day ahead electricity price prediction applying hybrid models of LSTM based deep learning methods and feature selection algorithms under consideration of market coupling. The availability of accurate day ahead electricity price forecasts is pivotal for electricity market participants. In the context of trade liberalisation and market harmonisation in the European markets, accurate price forecasting becomes difficult for electricity market participants to obtain because electricity forecasting requires the consideration of features from ever growing coupling markets. This study provides a method of exploring the influence of market coupling on electricity price prediction. We apply state of the art long short term memory (LSTM) deep neural networks combined with feature selection algorithms for electricity price prediction under the consideration of market coupling. LSTM models have a good performance in handling nonlinear and complex problems and processing time series data. In our empirical study of the Nordic market, the proposed models obtain considerably accurate results. The results show that feature selection is essential to achieving accurate prediction, and features from integrated markets have an impact on prediction. The feature importance analysis implies that the German market has a salient role in the price generation of Nord Pool.


Hop Constrained Metric Embeddings and their Applications. In network design problems, such as compact routing, the goal is to route packets between nodes using the (approximated) shortest paths. A desirable property of these routes is a small number of hops, which makes them more reliable, and reduces the transmission costs. Following the overwhelming success of stochastic tree embeddings for algorithmic design, Haeupler, Hershkowitz, and Zuzic (STOC'21) studied hop constrained Ramsey type metric embeddings into trees. Specifically, embedding f G(V,E) rightarrow T has Ramsey hop distortion (t,M, beta,h) (here t, beta,h ge1 and M subseteq V ) if forall u,v in M , d G ( beta cdot h) (u,v) le d T(u,v) le t cdot d G (h) (u,v) . t is called the distortion, beta is called the hop stretch, and d G (h) (u,v) denotes the minimum weight of a u v path with at most h hops. Haeupler em et al. constructed embedding where M contains 1 epsilon fraction of the vertices and beta t O( frac log 2 n epsilon ) . They used their embedding to obtain multiple bicriteria approximation algorithms for hop constrained network design problems. In this paper, we first improve the Ramsey type embedding to obtain parameters t beta frac tilde O ( log n) epsilon , and generalize it to arbitrary distortion parameter t (in the cost of reducing the size of M ). This embedding immediately implies polynomial improvements for all the approximation algorithms from Haeupler em et al. . Further, we construct hop constrained clan embeddings (where each vertex has multiple copies), and use them to construct bicriteria approximation algorithms for the group Steiner tree problem, matching the state of the art of the non constrained version. Finally, we use our embedding results to construct hop constrained distance oracles, distance labeling, and most prominently, the first hop constrained compact routing scheme with provable guarantees.


A formula for symbolic powers. Let S be a Cohen Macaulay ring which is local or standard graded over a field, and let I be an unmixed ideal that is also generically a complete intersection. Our goal in this paper is multi fold. First, we give a multiplicity based characterization of when an unmixed subideal J subseteq I (m) equals the m th symbolic power I (m) of I . Second, we provide a saturation type formula to compute I (m) and employ it to deduce a theoretical criterion for when I (m) I m . Third, we establish an explicit linear bound on the exponent that makes the saturation formula effective, and use it to obtain lower bounds for the initial degree of I (m) . Along the way, we prove a conjecture (in fact, a generalized version of it) due to Eisenbud and Mazur about rm ann S(I (m) I m) , and we propose a conjecture connecting the symbolic defect of an ideal to Jacobian ideals.


The Age or Excess of the MGinf Queue Busy Cycle Mean Value. In this work, approximate and exact results concerning a performance measure of the MGinf system, the age or the excess of the busy cycle, are presented. It will be seen that it is also a measure of the busy period performance. Service distributions for which it is given for a simple expression and others for which this does not happen are considered. For this last case, bounds are deduced. A special emphasis is given to the exponential distribution and to those related with it, useful in reliability theory.


The response of pre osteoblasts and osteoclasts to gallium containing mesoporous bioactive glasses. Mesoporous bioactive glasses (MBGs) in the system SiO2 CaO P2O5 Ga2O3 have been synthesized by the evaporation induced self assembly method and subsequent impregnation with Ga cations. Two different compositions have been prepared and the local environment of Ga(III) has been characterized using 29Si, 71Ga and 31P NMR analysis, demonstrating that Ga(III) is efficiently incorporated as both, network former (GaO4 units) and network modifier (GaO6 units). In vitro bioactivity tests evidenced that Ga containing MBGs retain their capability for nucleation and growth of an apatite like layer in contact with a simulated body fluid with ion concentrations nearly equal to those of human blood plasma. Finally, in vitro cell culture tests evidenced that Ga incorporation results in a selective effect on osteoblasts and osteoclasts. Indeed, the presence of this element enhances the early differentiation towards osteoblast phenotype while disturbing osteoclastogenesis. Considering these results, Ga doped MBGs might be proposed as bone substitutes, especially in osteoporosis scenarios.


Network wide traffic signal control optimization using a multi agent deep reinforcement learning. Inefficient traffic control may cause numerous problems such as traffic congestion and energy waste. This paper proposes a novel multi agent reinforcement learning method, named KS DDPG (Knowledge Sharing Deep Deterministic Policy Gradient) to achieve optimal control by enhancing the cooperation between traffic signals. By introducing the knowledge sharing enabled communication protocol, each agent can access to the collective representation of the traffic environment collected by all agents. The proposed method is evaluated through two experiments respectively using synthetic and real world datasets. The comparison with state of the art reinforcement learning based and conventional transportation methods demonstrate the proposed KS DDPG has significant efficiency in controlling large scale transportation networks and coping with fluctuations in traffic flow. In addition, the introduced communication mechanism has also been proven to speed up the convergence of the model without significantly increasing the computational burden.


A Camera free fiber speckle wavemeter. Recovering the wavelength from disordered speckle patterns has become an exciting prospect as a wavelength measurement method due to its high resolution and simple design. In previous studies, panel cameras have been used to detect the subtle differences between speckle patterns. However, the volume, bandwidth, sensitivity, and cost (in non visible bands) associated with panel cameras have hindered their utility in broader applications, especially in high speed and low cost measurements. In this work, we broke the limitations imposed by panel cameras by using a quadrant detector (QD) to capture the speckle images. In the scheme of QD detection, speckle images are directly filtered by convolution, where the kernel is equal to one quarter of a speckle pattern. First, we proposed an up sampling algorithm to pre process the QD data. Then a new convolution neural network (CNN) based algorithm, shallow residual network (SRN), was proposed to train the up sampled images. The experimental results show that a resolution of 4 fm ( 0.5 MHz) was achieved at 1550nm with an updating speed of 1 kHz. More importantly, the SRN shows excellent robustness. The wavelength can be precisely reconstructed from raw QD data without any averaging, even where there exists apparent noise. The low cost, simple structure, high speed and robustness of this design promote the speckle based wavemeter to the industrial grade. In addition, without the restriction of panel cameras, it is believed that this wavemeter opens new routes in many other fields, such as distributed optical fiber sensors, optical communications, and laser frequency stabilization.


Modified contact simplex iteration. We study the iterations of the procedure of taking the contact simplex. We define the concept of the root of the simplex, which is a homothety image of contact simplex with a special coefficient greater than 1. The article shows that once we iterate the root of a given simplex, the circumcenter sequence of these simplices has two partial limits.


Optimal transport of vector measures. We develop and study a theory of optimal transport for vector measures. We resolve in the negative a conjecture of Klartag, that given a vector measure on Euclidean space with total mass zero, the mass of any transport set is again zero. We provide a counterexample to the conjecture. We generalise the Kantorovich Rubinstein duality to the vector measures setting. Employing the generalisation, we answer the conjecture in the affirmative provided there exists an optimal transport with absolutely continuous marginals of its total variation.


Identification and prediction of time varying parameters of COVID 19 model a data driven deep learning approach. Data driven deep learning provides efficient algorithms for parameter identification of epidemiology models. Unlike the constant parameters, the complexity of identifying time varying parameters is largely increased. In this paper, a variant of physics informed neural network (PINN) is adopted to identify the time varying parameters of the Susceptible Infectious Recovered Deceased model for the spread of COVID 19 by fitting daily reported cases. The learned parameters are verified by utilizing an ordinary differential equation solver to compute the corresponding solutions of this compartmental model. The effective reproduction number based on these parameters is calculated. Long Short Term Memory (LSTM) neural network is employed to predict the future weekly time varying parameters. The numerical simulations demonstrate that PINN combined with LSTM yields accurate and effective results.


Self Supervision is All You Need for Solving Rubik's Cube. While combinatorial problems are of great academic and practical importance, previous approaches like explicit search and reinforcement learning have been complex and costly. We therefore propose a simple and robust method to solve combinatorial problems whose goals are predefined. Assuming that more optimal moves occur more frequently as a path of random moves connecting two combinatorial states, we show that a Deep Neural Network can generate near optimal solutions merely by training it to predict the last move of a random scramble based on the problem state. When solving 1,000 test cases of Rubik's Cube, our method outperformed DeepCubeA with a mean solution length of 21.27 moves, also achieving over 10 times higher efficiency for training and 2.0 times for inference. The proposed method may apply to other goal predefined combinatorial problems, though it has a few constraints.


Medical Dead ends and Learning to Identify High risk States and Treatments. Machine learning has successfully framed many sequential decision making problems as either supervised prediction, or optimal decision making policy identification via reinforcement learning. In data constrained offline settings, both approaches may fail as they assume fully optimal behavior or rely on exploring alternatives that may not exist. We introduce an inherently different approach that identifies possible "dead ends" of a state space. We focus on the condition of patients in the intensive care unit, where a "medical dead end" indicates that a patient will expire, regardless of all potential future treatment sequences. We postulate "treatment security" as avoiding treatments with probability proportional to their chance of leading to dead ends, present a formal proof, and frame discovery as an RL problem. We then train three independent deep neural models for automated state construction, dead end discovery and confirmation. Our empirical results discover that dead ends exist in real clinical data among septic patients, and further reveal gaps between secure treatments and those that were administered.


Demographic Biases of Crowd Workers in Key Opinion Leaders Finding. Key Opinion Leaders (KOLs) are people that have a strong influence and their opinions are listened to by people when making important decisions. Crowdsourcing provides an efficient and cost effective means to gather data for the KOL finding task. However, data collected through crowdsourcing is affected by the inherent demographic biases of crowd workers. To avoid such demographic biases, we need to measure how biased each crowd worker is. In this paper, we propose a simple yet effective approach based on demographic information of candidate KOLs and their counterfactual value. We argue that it is effectiveness because of the extra information that we can consider together with labeled data to curate a less biased dataset.


Deterministic mean field games with control on the acceleration and state constraints. We consider deterministic mean field games in which the agents control their acceleration and are constrained to remain in a domain of R n. We study relaxed equilibria in the Lagrangian setting they are described by a probability measure on trajectories. The main results of the paper concern the existence of relaxed equilibria under suitable assumptions. The fact that the optimal trajectories of the related optimal control problem solved by the agents do not form a compact set brings a difficulty in the proof of existence. The proof also requires closed graph properties of the map which associates to initial conditions the set of optimal trajectories.


Higgledy piggledy sets in projective spaces of small dimension. This work focuses on higgledy piggledy sets of k subspaces in text PG (N,q) , i.e. sets of projective subspaces that are 'well spread out'. More precisely, the set of intersection points of these k subspaces with any (N k) subspace kappa of text PG (N,q) spans kappa itself. We highlight three methods to construct small higgledy piggledy sets of k subspaces and discuss, for k in 1,N 2 , 'optimal' sets that cover the smallest possible number of points. Furthermore, we investigate small non trivial higgledy piggledy sets in text PG (N,q) , N leqslant5 . Our main result is the existence of six lines of text PG (4,q) in higgledy piggledy arrangement, two of which intersect. Exploiting the construction methods mentioned above, we also show the existence of six planes of text PG (4,q) in higgledy piggledy arrangement, two of which maximally intersect, as well as the existence of two higgledy piggledy sets in text PG (5,q) consisting of eight planes and seven solids, respectively. Finally, we translate these geometrical results to a coding and graph theoretical context.


Propagation aware Social Recommendation by Transfer Learning. Social aware recommendation approaches have been recognized as an effective way to solve the data sparsity issue of traditional recommender systems. The assumption behind is that the knowledge in social user user connections can be shared and transferred to the domain of user item interactions, whereby to help learn user preferences. However, most existing approaches merely adopt the first order connections among users during transfer learning, ignoring those connections in higher orders. We argue that better recommendation performance can also benefit from high order social relations. In this paper, we propose a novel Propagation aware Transfer Learning Network (PTLN) based on the propagation of social relations. We aim to better mine the sharing knowledge hidden in social networks and thus further improve recommendation performance. Specifically, we explore social influence in two aspects (a) higher order friends have been taken into consideration by order bias (b) different friends in the same order will have distinct importance for recommendation by an attention mechanism. Besides, we design a novel regularization to bridge the gap between social relations and user item interactions. We conduct extensive experiments on two real world datasets and beat other counterparts in terms of ranking accuracy, especially for the cold start users with few historical interactions.


SARiSsa A Mobile Application for the Proactive Control of SARS CoV 2 Spread. In this work we propose the design principles behind the development of a smart application utilized by mobile devices in order to control the spread of SARS CoV 2 coronavirus disease that caused the COVID 19 pandemic. Through the deployment of this application utilizing their Bluetooth enabled devices, individuals may keep track of their close contacts, and if nearby contacts using the same application are reported later as infected the proximate individual is informed in order to be quarantined for a short of time, preventing hence the spread of the virus. Through the latest year, there have been developed several applications in the Google Play Store that can be deployed by smart devices utilizing their Bluetooth connectivity for the nearby device tracking. However, in this work we propose an open architecture for the development of such applications, that also incorporates a more elaborated graph theoretic and algorithmic background regarding the contact tracing. The proposed contact tracing algorithm, that can be embedded in the deployment of the application, provides a more immediate tracking of the contacts of an infected individuals, providing a wider extent in the tracing of the contacts, leading hence to a more immediate mitigation of the epidemic.


Guaranteed blind deconvolution and demixing via hierarchically sparse reconstruction. The blind deconvolution problem amounts to reconstructing both a signal and a filter from the convolution of these two. It constitutes a prominent topic in mathematical and engineering literature. In this work, we analyze a sparse version of the problem The filter h in mathbb R mu is assumed to be s sparse, and the signal b in mathbb R n is taken to be sigma sparse, both supports being unknown. We observe a convolution between the filter and a linear transformation of the signal. Motivated by practically important multi user communication applications, we derive a recovery guarantee for the simultaneous demixing and deconvolution setting. We achieve efficient recovery by relaxing the problem to a hierarchical sparse recovery for which we can build on a flexible framework. At the same time, for this we pay the price of some sub optimal guarantees compared to the number of free parameters of the problem. The signal model we consider is sufficiently general to capture many applications in a number of engineering fields. Despite their practical importance, we provide first rigorous performance guarantees for efficient and simple algorithms for the bi sparse and generalized demixing setting. We complement our analytical results by presenting results of numerical simulations. We find evidence that the sub optimal scaling s 2 sigma log( mu) log(n) of our derived sufficient condition is likely overly pessimistic and that the observed performance is better described by a scaling proportional to s sigma up to log factors.


Protecting Anonymous Speech A Generative Adversarial Network Methodology for Removing Stylistic Indicators in Text. With Internet users constantly leaving a trail of text, whether through blogs, emails, or social media posts, the ability to write and protest anonymously is being eroded because artificial intelligence, when given a sample of previous work, can match text with its author out of hundreds of possible candidates. Existing approaches to authorship anonymization, also known as authorship obfuscation, often focus on protecting binary demographic attributes rather than identity as a whole. Even those that do focus on obfuscating identity require manual feedback, lose the coherence of the original sentence, or only perform well given a limited subset of authors. In this paper, we develop a new approach to authorship anonymization by constructing a generative adversarial network that protects identity and optimizes for three different losses corresponding to anonymity, fluency, and content preservation. Our fully automatic method achieves comparable results to other methods in terms of content preservation and fluency, but greatly outperforms baselines in regards to anonymization. Moreover, our approach is able to generalize well to an open set context and anonymize sentences from authors it has not encountered before.


Upcycling Low Nickel Polycrystalline Cathodes from Retired Electric Vehicle Batteries into Single Crystal Nickel Rich Cathodes. The electrification revolution in automobile industry and others demands annual production capacity of batteries at least on the order of 102 gigawatts hours, which presents a twofold challenge to supply of key materials such as cobalt and nickel and to recycling when the batteries retire. Pyrometallurgical and hydrometallurgical recycling are currently used in industry but suffer from complexity, high costs, and secondary pollution. Here we report a direct recycling method in molten salts (MSDR) that is environmentally benign and value creating based on a techno economic analysis using real world data and price information. We also experimentally demonstrate the feasibility of MSDR by upcycling a low nickel polycrystalline LiNi0.5Mn0.3Co0.2O2 (NMC) cathode material that is widely used in early year electric vehicles into Ni rich (Ni 65 ) single crystal NMCs with increased energy density ( 10 increase) and outstanding electrochemical performance ( 94 capacity retention after 500 cycles in pouch type full cells). This work opens up new opportunities for closed loop recycling of electric vehicle batteries and manufacturing of next generation NMC cathode materials.


On the fly Code Activation for Attack Surface Reduction. Modern code reuse attacks are taking full advantage of bloated software. Attackers piece together short sequences of instructions in otherwise benign code to carry out malicious actions. Eliminating these reusable code snippets, known as gadgets, has become one of the prime concerns of attack surface reduction. The aim is to break these chains of gadgets, thereby making such code reuse attacks impossible or substantially less common. Previous work on attack surface reduction has typically tried to eliminate such attacks by subsetting the application, e.g. via user specified inputs, configurations, or features, or by focusing on third party libraries to achieve high gadget reductions with minimal interference to the application. In this work we present a general, whole program attack surface reduction technique called OCA that significantly reduces gadgets and has minor performance degradation. OCA requires no user inputs and leaves all features intact. OCA identifies specific program points and through analysis determines key function sets to enable disable at runtime. The runtime system, thus, controls the set of enabled functions during execution, thereby significantly reducing the set of active gadgets an attacker can use, and by extension, cutting down the set of active gadget chains dramatically. On SPEC CPU 2017, our framework achieves 73.2 total gadget reduction with only 4 average slowdown. On 10 GNU coreutils applications, it achieves 87.2 reduction. On the nginx server it achieves 80.3 reduction with 2 slowdown. We also provide a gadget chain breaking study across all applications, and show that our framework breaks the shell spawning chain in all cases.


Seq Masks Bridging the gap between appearance and gait modeling for video based person re identification. ideo based person re identification (Re ID) aims to match person images in video sequences captured by disjoint surveillance cameras. Traditional video based person Re ID methods focus on exploring appearance information, thus, vulnerable against illumination changes, scene noises, camera parameters, and especially clothes carrying variations. Gait recognition provides an implicit biometric solution to alleviate the above headache. Nonetheless, it experiences severe performance degeneration as camera view varies. In an attempt to address these problems, in this paper, we propose a framework that utilizes the sequence masks (SeqMasks) in the video to integrate appearance information and gait modeling in a close fashion. Specifically, to sufficiently validate the effectiveness of our method, we build a novel dataset named MaskMARS based on MARS. Comprehensive experiments on our proposed large wild video Re ID dataset MaskMARS evidenced our extraordinary performance and generalization capability. Validations on the gait recognition metric CASIA B dataset further demonstrated the capability of our hybrid model.


Forwarding Lyapunov design for the stabilization of coupled ODEs and exponentially stable PDEs. This paper is about the stabilization of a cascade system composed by an infinite dimensional system, that we suppose to be exponentially stable, and an ordinary differential equation (ODE), that we suppose to be marginally stable. The system is controlled through the infinite dimensional system. Such a structure is particularly useful when applying the internal model approach on infinite dimensional systems. Our strategy relies on the forwarding method, which uses a Lyapunov functional and a Sylvester equation to build a feedback law. Under some classical assumptions in the output regulation theory, we prove that the closed loop system is globally exponentially stable.


Galileo between Jesuits The Fault is in the Stars. In the middle of the seventeenth century, Andr 'e Tacquet, S.J. briefly discussed a scientific argument regarding the structure of a Copernican universe, and commented on Galileo Galilei's discussion of that same argument Galileo's discussion in turn being a commentary on a version of the argument by Christoph Scheiner, S.J. The argument was based on observations of the sizes of stars. This exchange involving Galileo and two Jesuits illustrates how through much of the seventeenth century, science meaning observations measurements, and calculations supported a view of the Copernican universe in which stars were not other suns, but were dim bodies, far larger than the sun. Johannes Kepler emphasized this, especially in arguing against Giordano Bruno. Jesuit astronomers like Tacquet and Scheiner understood this. Those who might have listened to Jesuit astronomers would likewise have understood this Robert Bellarmine, for example, whose role in the debate over Copernicanism is well known. To many, such a universe was, in the words of Galileo's Dialogue character Sagredo, "beyond belief," and no modern view of a universe of many distant suns would be scientifically supportable until after Tacquet's death in 1660. The Copernican universe of the seventeenth century looked radically different from the universe as modern astronomers understand it, and recognizing this fact allows for interesting questions to be asked regarding the actions of those, such as Bellarmine, who were responding to the work of Copernicus.


A characterization of ell p spaces symmetrically finitely represented in symmetric sequence spaces. For a separable symmetric sequence space X of fundamental type we identify the set mathcal F (X) of all p in 1, infty such that ell p is block finitely represented in the unit vector basis e k k 1 infty of X in such a way that the unit basis vectors of ell p ( c 0 if p infty ) correspond to pairwise disjoint blocks of e k with the same ordered distribution. It turns out that mathcal F (X) coincides with the set of approximate eigenvalues of the operator (x k) mapsto sum k 2 infty x k 2 e k in X . In turn, we establish that the latter set is the interval 2 alpha X ,2 beta X , where alpha X and beta X are the Boyd indices of X . As an application, we find the set mathcal F (X) for arbitrary Lorentz and separable sequence Orlicz spaces.


Autonomous Driving Implementation in an Experimental Environment. Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane tracking. In this study, an autonomous driving system is developed and tested in the experimental environment designed for this purpose. In this system, a model vehicle having a camera is used to trace the lanes and avoid obstacles to experimentally study autonomous driving behavior. Convolutional Neural Network models were trained for Lane tracking. For the vehicle to avoid obstacles, corner detection, optical flow, focus of expansion, time to collision, balance calculation, and decision mechanism were created, respectively.


Tree Embeddings and Tree Star Ramsey Numbers. We say that a graph F can be embedded into a graph G if G contains an isomorphic copy of F as a subgraph. Guo and Volkmann cite GV conjectured that if G is a connected graph with at least n vertices and minimum degree at least n 3 , then any tree with n vertices and maximum degree at most n 4 can be embedded into G . In this paper, we give a result slightly stronger than this conjecture and obtain a sufficient and necessary condition that a tree with n vertices and maximum degree at most n 3 can be embedded into a connected graph G with at least n vertices and minimum degree at least n 3 . Our result implies that the conjecture of Guo and Volkmann is true with one exception. We also give an application to the Ramsey number of a tree versus a star.


A review of multiscale 0D 1D computational modeling of coronary circulation with applications to cardiac arrhythmias. Computational hemodynamics is becoming an increasingly important tool in clinical applications and surgical procedures involving the cardiovascular system. Aim of this review is to provide a compact summary of state of the art 0D 1D multiscale models of the arterial coronary system, with particular attention to applications related to cardiac arrhythmias, whose effects on the coronary circulation remain so far poorly understood. The focus on 0D 1D models only is motivated by the competitive computational cost, the reliability of the outcomes for the whole cardiovascular system, and the ability to directly account for cardiac arrhythmias. The analyzed studies show that cardiac arrhythmias by their own are able to promote significant alterations of the coronary hemodynamics, with a worse scenario as the mean heart rate (HR) increases. The present review can stimulate future investigation, both in computational and clinical research, devoted to the hemodynamic effects induced by cardiac arrhythmias on the coronary circulation.


CFC Net A Critical Feature Capturing Network for Arbitrary Oriented Object Detection in Remote Sensing Images. Object detection in optical remote sensing images is an important and challenging task. In recent years, the methods based on convolutional neural networks have made good progress. However, due to the large variation in object scale, aspect ratio, and arbitrary orientation, the detection performance is difficult to be further improved. In this paper, we discuss the role of discriminative features in object detection, and then propose a Critical Feature Capturing Network (CFC Net) to improve detection accuracy from three aspects building powerful feature representation, refining preset anchors, and optimizing label assignment. Specifically, we first decouple the classification and regression features, and then construct robust critical features adapted to the respective tasks through the Polarization Attention Module (PAM). With the extracted discriminative regression features, the Rotation Anchor Refinement Module (R ARM) performs localization refinement on preset horizontal anchors to obtain superior rotation anchors. Next, the Dynamic Anchor Learning (DAL) strategy is given to adaptively select high quality anchors based on their ability to capture critical features. The proposed framework creates more powerful semantic representations for objects in remote sensing images and achieves high performance real time object detection. Experimental results on three remote sensing datasets including HRSC2016, DOTA, and UCAS AOD show that our method achieves superior detection performance compared with many state of the art approaches. Code and models are available at https github.com ming71 CFC Net.


Automatic Generation of Machine Learning Synthetic Data Using ROS. Data labeling is a time intensive process. As such, many data scientists use various tools to aid in the data generation and labeling process. While these tools help automate labeling, many still require user interaction throughout the process. Additionally, most target only a few network frameworks. Any researchers exploring multiple frameworks must find additional tools orwrite conversion scripts. This paper presents an automated tool for generating synthetic data in arbitrary network formats. It uses Robot Operating System (ROS) and Gazebo, which are common tools in the robotics community. Through ROS paradigms, it allows extensive user customization of the simulation environment and data generation process. Additionally, a plugin like framework allows the development of arbitrary data format writers without the need to change the main body of code. Using this tool, the authors were able to generate an arbitrarily large image dataset for three unique training formats using approximately 15 min of user setup time and a variable amount of hands off run time, depending on the dataset size. The source code for this data generation tool is available at https github.com Navy RISE Lab nn data collection


Maximum Entropy Differential Dynamic Programming. In this paper, we present a novel maximum entropy formulation of the Differential Dynamic Programming algorithm and derive two variants using unimodal and multimodal value functions parameterizations. By combining the maximum entropy Bellman equations with a particular approximation of the cost function, we are able to obtain a new formulation of Differential Dynamic Programming which is able to escape from local minima via exploration with a multimodal policy. To demonstrate the efficacy of the proposed algorithm, we provide experimental results using four systems on tasks that are represented by cost functions with multiple local minima and compare them against vanilla Differential Dynamic Programming. Furthermore, we discuss connections with previous work on the linearly solvable stochastic control framework and its extensions in relation to compositionality.


Koszul type determinantal formulas for families of mixed multilinear systems. Effective computation of resultants is a central problem in elimination theory and polynomial system solving. Commonly, we compute the resultant as a quotient of determinants of matrices and we say that there exists a determinantal formula when we can express it as a determinant of a matrix whose elements are the coefficients of the input polynomials. We study the resultant in the context of mixed multilinear polynomial systems, that is multilinear systems with polynomials having different supports, on which determinantal formulas were not known. We construct determinantal formulas for two kind of multilinear systems related to the Multiparameter Eigenvalue Problem (MEP) first, when the polynomials agree in all but one block of variables second, when the polynomials are bilinear with different supports, related to a bipartite graph. We use the Weyman complex to construct Koszul type determinantal formulas that generalize Sylvester type formulas. We can use the matrices associated to these formulas to solve square systems without computing the resultant. The combination of the resultant matrices with the eigenvalue and eigenvector criterion for polynomial systems leads to a new approach for solving MEP.


The search of Type I codes. A self dual binary linear code is called Type I code if it has singly even codewords, i.e. it has codewords with weight divisible by 2. The purpose of this paper is to investigate interesting properties of Type I codes of different lengths. Further, we build up a computer based code searching program based on our knowledge about Type I codes. Some computation results achieved by this program are given.


Cat like Jumping and Landing of Legged Robots in Low gravity Using Deep Reinforcement Learning. In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off the shelf deep reinforcement learning algorithm, we trained a neural network to control a jumping quadruped robot while solely using its limbs for attitude control. We present tasks of increasing complexity leading to a combination of three dimensional (re )orientation and landing locomotion behaviors of a quadruped robot traversing simulated low gravity celestial bodies. We show that our approach easily generalizes across these tasks and successfully trains policies for each case. Using sim to real transfer, we deploy trained policies in the real world on the SpaceBok robot placed on an experimental testbed designed for two dimensional micro gravity experiments. The experimental results demonstrate that repetitive, controlled jumping and landing with natural agility is possible.


Norm tori of etale algebras and unramified Brauer groups. Let k be a field, and let L be an 'etale k algebra of finite rank. If a is a nonzero element in k , let X a be the affine variety defined by the norm equation N L k (x) a . Assuming that L has at least one factor that is a cyclic field extension of k , we give a combinatorial description of the unramified Brauer group of X a .


A curated, ontology based, large scale knowledge graph of artificial intelligence tasks and benchmarks. Research in artificial intelligence (AI) is addressing a growing number of tasks through a rapidly growing number of models and methodologies. This makes it difficult to keep track of where novel AI methods are successfully or still unsuccessfully applied, how progress is measured, how different advances might synergize with each other, and how future research should be prioritized. To help address these issues, we created the Intelligence Task Ontology and Knowledge Graph (ITO), a comprehensive, richly structured and manually curated resource on artificial intelligence tasks, benchmark results and performance metrics. The current version of ITO contain 685,560 edges, 1,100 classes representing AI processes and 1,995 properties representing performance metrics. The goal of ITO is to enable precise and network based analyses of the global landscape of AI tasks and capabilities. ITO is based on technologies that allow for easy integration and enrichment with external data, automated inference and continuous, collaborative expert curation of underlying ontological models. We make the ITO dataset and a collection of Jupyter notebooks utilising ITO openly available.


Projective manifolds whose tangent bundle is Ulrich. In this article, we give numerical restrictions on the Chern classes of Ulrich bundles on higher dimensional manifolds, which are inspired by the results of Casnati in the case of surfaces. As a by product, we prove that the only projective manifolds whose tangent bundle is Ulrich are the twisted cubic and the Veronese surface. Moreover, we prove that the cotangent bundle is never Ulrich.


Concurrent Transmission for Multi Robot Coordination. An efficient communication mechanism forms the backbone for any multi robot system to achieve fruitful collaboration and coordination. Limitation in the existing asynchronous transmission based strategies in fast dissemination and aggregation compels the designers to prune down such requirements as much as possible. This also restricts the possible application areas of mobile multi robot systems. In this work, we introduce concurrent transmission based strategy as an alternative. Despite the commonly found difficulties in concurrent transmission such as microsecond level time synchronization, hardware heterogeneity, etc., we demonstrate how it can be exploited for multi robot systems. We propose a split architecture where the two major activities communication and computation are carried out independently and coordinate through periodic interactions. The proposed split architecture is applied on a custom build full networked control system consisting of five two wheel differential drive mobile robots having heterogeneous architecture. We use the proposed design in a leader follower setting for coordinated dynamic speed variation as well as the independent formation of various shapes. Experiments show a centimeter level spatial and millisecond level temporal accuracy while spending very low radio duty cycling over multi hop communication under a wide testing area.


Elliptic parametrices in the 0 calculus of Mazzeo and Melrose. The purpose of this note is to spell out the details of the construction of parametrices for fully elliptic uniformly degenerate pseudodifferential operators on manifolds X with boundary. Following the original work by Mazzeo Melrose on the 0 calculus, the parametrices are shown to have (polyhomogeneous) conormal Schwartz kernels on the 0 double space, a resolution of X 2 . The extended 0 double space introduced by Lauter plays a useful role in the construction.


DRAFT What you always wanted to know but could not find about block based environments. Block based environments are visual programming environments, which are becoming more and more popular because of their ease of use. The ease of use comes thanks to their intuitive graphical representation and structural metaphors (jigsaw like puzzles) to display valid combinations of language constructs to the users. Part of the current popularity of block based environments is thanks to Scratch. As a result they are often associated with tools for children or young learners. However, it is unclear how these types of programming environments are developed and used in general. So we conducted a systematic literature review on block based environments by studying 152 papers published between 2014 and 2020, and a non systematic tool review of 32 block based environments. In particular, we provide a helpful inventory of block based editors for end users on different topics and domains. Likewise, we focused on identifying the main components of block based environments, how they are engineered, and how they are used. This survey should be equally helpful for language engineering researchers and language engineers alike.


Sparse Grid Method for Highly Efficient Computation of Exposures for xVA. Every x adjustment in the so called xVA financial risk management framework relies on the computation of exposures. Considering thousands of Monte Carlo paths and tens of simulation steps, a financial portfolio needs to be evaluated numerous times during the lifetime of the underlying assets. This is the bottleneck of every simulation of xVA. In this article, we explore numerical techniques for improving the simulation of exposures. We aim to decimate the number of portfolio evaluations, particularly for large portfolios involving multiple, correlated risk factors. The usage of the Stochastic Collocation (SC) method, together with Smolyaks sparse grid extension, allows for a significant reduction in the number of portfolio evaluations, even when dealing with many risk factors. The proposed model can be easily applied to any portfolio and size. We report that for a realistic portfolio comprising linear derivatives, the expected reduction in the portfolio evaluations may exceed 6000 times, depending on the dimensionality and the required accuracy. We give illustrative examples and examine the method with realistic multi currency portfolios.


Chaos and turbulence in clouds. Spatial buoyancy helical distributed chaos (turbulence) in the cumulus, stratiform, stratocumulus, cirrus and cirrus mammatus clouds have been studied using results of direct numerical simulations and measurements in cloudy atmosphere. It is shown that in the considered cases the moments of helicity distribution dominate the kinetic energy spectra both in the middle of the clouds and in the cloud top regions.


Cell phenotypic transition proceeds through concerted reorganization of gene regulatory network. Phenotype transition takes place in many biological processes such as differentiation, and understanding how a cell reprograms its global gene expression profile is a problem of rate theories. A cell phenotype transition accompanies with switching of expression rates of clusters of genes, analogous to domain flipping in an Ising system. Here through analyzing single cell RNA sequencing data in the framework of transition path theory, we set to study how such a genome wide expression program switching proceeds in three different cell transition processes. For each process after reconstructing a Markov transition model in the cell state space, we formed an ensemble of shortest paths connecting the initial and final cell states, reconstructed a reaction coordinate describing the transition progression, and inferred the gene regulation network (GRN) along the reaction coordinate. In all three processes we observed common pattern that the frustration of gene regulatory network (GRN), defined as overall confliction between the regulation received by genes and their expression states, first increases then decreases when approaching a new phenotype. The results support a mechanism of concerted silencing of genes that are active in the initial phenotype and activation of genes that are active in the final phenotype.


Bilevel methods for image reconstruction. This review discusses methods for learning parameters for image reconstruction problems using bilevel formulations. Image reconstruction typically involves optimizing a cost function to recover a vector of unknown variables that agrees with collected measurements and prior assumptions. State of the art image reconstruction methods learn these prior assumptions from training data using various machine learning techniques, such as bilevel methods. One can view the bilevel problem as formalizing hyperparameter optimization, as bridging machine learning and cost function based optimization methods, or as a method to learn variables best suited to a specific task. More formally, bilevel problems attempt to minimize an upper level loss function, where variables in the upper level loss function are themselves minimizers of a lower level cost function. This review contains a running example problem of learning tuning parameters and the coefficients for sparsifying filters used in a regularizer. Such filters generalize the popular total variation regularization method, and learned filters are closely related to convolutional neural networks approaches that are rapidly gaining in popularity. Here, the lower level problem is to reconstruct an image using a regularizer with learned sparsifying filters the corresponding upper level optimization problem involves a measure of reconstructed image quality based on training data. This review discusses multiple perspectives to motivate the use of bilevel methods and to make them more easily accessible to different audiences. We then turn to ways to optimize the bilevel problem, providing pros and cons of the variety of proposed approaches. Finally we overview bilevel applications in image reconstruction.


OMNet Learning Overlapping Mask for Partial to Partial Point Cloud Registration. Point cloud registration is a key task in many computational fields. Previous correspondence matching based methods require the inputs to have distinctive geometric structures to fit a 3D rigid transformation according to point wise sparse feature matches. However, the accuracy of transformation heavily relies on the quality of extracted features, which are prone to errors with respect to partiality and noise. In addition, they can not utilize the geometric knowledge of all the overlapping regions. On the other hand, previous global feature based approaches can utilize the entire point cloud for the registration, however they ignore the negative effect of non overlapping points when aggregating global features. In this paper, we present OMNet, a global feature based iterative network for partial to partial point cloud registration. We learn overlapping masks to reject non overlapping regions, which converts the partial to partial registration to the registration of the same shape. Moreover, the previously used data is sampled only once from the CAD models for each object, resulting in the same point clouds for the source and reference. We propose a more practical manner of data generation where a CAD model is sampled twice for the source and reference, avoiding the previously prevalent over fitting issue. Experimental results show that our method achieves state of the art performance compared to traditional and deep learning based methods. Code is available at https github.com megvii research OMNet.


OCRTOC A Cloud Based Competition and Benchmark for Robotic Grasping and Manipulation. In this paper, we propose a cloud based benchmark for robotic grasping and manipulation, called the OCRTOC benchmark. The benchmark focuses on the object rearrangement problem, specifically table organization tasks. We provide a set of identical real robot setups and facilitate remote experiments of standardized table organization scenarios in varying difficulties. In this workflow, users upload their solutions to our remote server and their code is executed on the real robot setups and scored automatically. After each execution, the OCRTOC team resets the experimental setup manually. We also provide a simulation environment that researchers can use to develop and test their solutions. With the OCRTOC benchmark, we aim to lower the barrier of conducting reproducible research on robotic grasping and manipulation and accelerate progress in this field. Executing standardized scenarios on identical real robot setups allows us to quantify algorithm performances and achieve fair comparisons. Using this benchmark we held a competition in the 2020 International Conference on Intelligence Robots and Systems (IROS 2020). In total, 59 teams took part in this competition worldwide. We present the results and our observations of the 2020 competition, and discuss our adjustments and improvements for the upcoming OCRTOC 2021 competition. The homepage of the OCRTOC competition is www.ocrtoc.org, and the OCRTOC software package is available at https github.com OCRTOC OCRTOC software package.


Optimal L 2 extensions on tube domains and a simple proof of Pr 'ekopa's theorem. We prove the optimal L 2 extension theorem of Ohsawa Takegoshi type on a tube domain. As an application, we give a simple proof of Pr 'ekopa's theorem.


Multi Modal Aesthetic Assessment for MObile Gaming Image. With the proliferation of various gaming technology, services, game styles, and platforms, multi dimensional aesthetic assessment of the gaming contents is becoming more and more important for the gaming industry. Depending on the diverse needs of diversified game players, game designers, graphical developers, etc. in particular conditions, multi modal aesthetic assessment is required to consider different aesthetic dimensions perspectives. Since there are different underlying relationships between different aesthetic dimensions, e.g., between the Colorfulness' and Color Harmony', it could be advantageous to leverage effective information attached in multiple relevant dimensions. To this end, we solve this problem via multi task learning. Our inclination is to seek and learn the correlations between different aesthetic relevant dimensions to further boost the generalization performance in predicting all the aesthetic dimensions. Therefore, the bottleneck' of obtaining good predictions with limited labeled data for one individual dimension could be unplugged by harnessing complementary sources of other dimensions, i.e., augment the training data indirectly by sharing training information across dimensions. According to experimental results, the proposed model outperforms state of the art aesthetic metrics significantly in predicting four gaming aesthetic dimensions.


Exploring deep learning methods for recognizing rare diseases and their clinical manifestations from texts. Although rare diseases are characterized by low prevalence, approximately 300 million people are affected by a rare disease. The early and accurate diagnosis of these conditions is a major challenge for general practitioners, who do not have enough knowledge to identify them. In addition to this, rare diseases usually show a wide variety of manifestations, which might make the diagnosis even more difficult. A delayed diagnosis can negatively affect the patient's life. Therefore, there is an urgent need to increase the scientific and medical knowledge about rare diseases. Natural Language Processing (NLP) and Deep Learning can help to extract relevant information about rare diseases to facilitate their diagnosis and treatments. The paper explores the use of several deep learning techniques such as Bidirectional Long Short Term Memory (BiLSTM) networks or deep contextualized word representations based on Bidirectional Encoder Representations from Transformers (BERT) to recognize rare diseases and their clinical manifestations (signs and symptoms) in the RareDis corpus. This corpus contains more than 5,000 rare diseases and almost 6,000 clinical manifestations. BioBERT, a domain specific language representation based on BERT and trained on biomedical corpora, obtains the best results. In particular, this model obtains an F1 score of 85.2 for rare diseases, outperforming all the other models.


Doubling inequality at the boundary for the Kirchhoff Love plate's equation with supported conditions. In this article we derive a doubling inequality at the boundary for solutions to the Kirchhoff Love isotropic plate's equation satisfying supported boundary conditions. To this end, we combine the use of a suitable conformal mapping which flattens the boundary and a reflection argument which guarantees the needed regularity of the extended solution. We finally apply inequalities of Carleman type in order to derive the result. The latter implies Strong Unique Continuation Property at the boundary (SUCPB).


The Edge Geometry of Regular Polygons Part 1. There are multiple mappings that can be used to generate what we call the 'edge geometry' of a regular N gon, but they are all based on piecewise isometries acting on the extended edges of N to form a 'singularity' set W. This singularity set is also known as the 'web' because it is connected and consists of rays or line segments, with possible accumulation points in the limit. We will use three such maps here, all of which appear to share the same local geometry of W. These mappings are the outer billiards map Tau, the digital filter map Df and the 'dual center' map Dc. In 'Outer billiards, digital filters and kicked Hamiltonians' (arXiv 1206.5223) we show that the Df and Dc maps are equivalent to a 'shear and rotation' in a toral space and in the complex plane respectively, and in 'First Families of Regular Polygons and their Mutations' (arXiv 1612.09295) we show that the web for Tau can also be reduced to a shear and rotation. This equivalence of maps supports the premise that this web geometry is inherent in the N gon. Here we describe the edge geometry up to N 25 and in Part 2 this will be extended to N 50. In all cases this geometry defines an invariant region local to N. Typically this region contains multiple S k 'tiles' from the First Family of N, but our emphasis is on the S 1 and S 2 tiles adjacent to N. Since the web evolves in a multi step fashion, it is possible to make predictions about the 'next generation' tiles which will survive in the early web of S 1 and S 2 . The Edge Conjecture defines just 8 classes of N gons based on this edge geometry. Since the webs are recursive these predictions have long term implications.


The category of simple graphs is coreflective in the comma category of groups under the free group functor. We show that the comma category ( mathcal F downarrow mathbf Grp ) of groups under the free group functor mathcal F mathbf Set to mathbf Grp contains the category mathbf Gph of simple graphs as a full coreflective subcategory. More broadly, we generalize the embedding of topological spaces into Steven Vickers' category of topological systems to a simple technique for embedding certain categories into comma categories, then show as a straightforward application that simple graphs are coreflective in ( mathcal F downarrow mathbf Grp ) .


Revisiting Efficient Object Detection Backbones from Zero Shot Neural Architecture Search. In object detection models, the detection backbone consumes more than half of the overall inference cost. Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Architecture Search (NAS). However, existing NAS methods for object detection require hundreds to thousands of GPU hours of searching, making them impractical in fast paced research and development. In this work, we propose a novel zero shot NAS method to address this issue. The proposed method, named ZenDet, automatically designs efficient detection backbones without training network parameters, reducing the architecture design cost to nearly zero yet delivering the state of the art (SOTA) performance. Under the hood, ZenDet maximizes the differential entropy of detection backbones, leading to a better feature extractor for object detection under the same computational budgets. After merely one GPU day of fully automatic design, ZenDet innovates SOTA detection backbones on multiple detection benchmark datasets with little human intervention. Comparing to ResNet 50 backbone, ZenDet is 2.0 better in mAP when using the same amount of FLOPs parameters and is 1.54 times faster on NVIDIA V100 at the same mAP. Code and pre trained models will be released later.


Interpretable deep learning models to help achieve the Sustainable Development Goals. We discuss our insights into interpretable artificial intelligence (AI) models, and how they are essential in the context of developing ethical AI systems, as well as data driven solutions compliant with the Sustainable Development Goals (SDGs). We highlight the potential of extracting truly interpretable models from deep learning methods, for instance via symbolic models obtained through inductive biases, to ensure a sustainable development of AI.


TS MULE Local Interpretable Model Agnostic Explanations for Time Series Forecast Models. Time series forecasting is a demanding task ranging from weather to failure forecasting with black box models achieving state of the art performances. However, understanding and debugging are not guaranteed. We propose TS MULE, a local surrogate model explanation method specialized for time series extending the LIME approach. Our extended LIME works with various ways to segment and perturb the time series data. In our extension, we present six sampling segmentation approaches for time series to improve the quality of surrogate attributions and demonstrate their performances on three deep learning model architectures and three common multivariate time series datasets.


A Sphere Packing Error Exponent for Mismatched Decoding. We derive a sphere packing error exponent for coded transmission over discrete memoryless channels with a fixed decoding metric. By studying the error probability of the code over an auxiliary channel, we find a lower bound to the probability of error of mismatched decoding. The bound is shown to decay exponentially for coding rates smaller than a new upper bound to the mismatch capacity. For rates higher than the new upper bound, the error probability is shown to be bounded away from zero. The new upper bound is shown to improve over previous upper bounds to the mismatch capacity.


The Stationary Prophet Inequality Problem. We study a continuous and infinite time horizon counterpart to the classic prophet inequality, which we term the stationary prophet inequality problem. Here, copies of a good arrive and perish according to Poisson point processes. Buyers arrive similarly and make take it or leave it offers for unsold items. The objective is to maximize the (infinite) time average revenue of the seller. Our main results are pricing based policies which (i) achieve a 1 2 approximation of the optimal offline policy, which is best possible, and (ii) achieve a better than (1 1 e) approximation of the optimal online policy. Result (i) improves upon bounds implied by recent work of Collina et al. (WINE'20), and is the first optimal prophet inequality for a stationary problem. Result (ii) improves upon a 1 1 e bound implied by recent work of Aouad and Sarita c c (EC'20), and shows that this prevalent bound in online algorithms is not optimal for this problem.


Domain Adaptive Monocular Depth Estimation With Semantic Information. The advent of deep learning has brought an impressive advance to monocular depth estimation, e.g., supervised monocular depth estimation has been thoroughly investigated. However, the large amount of the RGB to depth dataset may not be always available since collecting accurate depth ground truth according to the RGB image is a time consuming and expensive task. Although the network can be trained on an alternative dataset to overcome the dataset scale problem, the trained model is hard to generalize to the target domain due to the domain discrepancy. Adversarial domain alignment has demonstrated its efficacy to mitigate the domain shift on simple image classification tasks in previous works. However, traditional approaches hardly handle the conditional alignment as they solely consider the feature map of the network. In this paper, we propose an adversarial training model that leverages semantic information to narrow the domain gap. Based on the experiments conducted on the datasets for the monocular depth estimation task including KITTI and Cityscapes, the proposed compact model achieves state of the art performance comparable to complex latest models and shows favorable results on boundaries and objects at far distances.


Non Comparative Fairness for Human Auditing and Its Relation to Traditional Fairness Notions. Bias evaluation in machine learning based services (MLS) based on traditional algorithmic fairness notions that rely on comparative principles is practically difficult, making it necessary to rely on human auditor feedback. However, in spite of taking rigorous training on various comparative fairness notions, human auditors are known to disagree on various aspects of fairness notions in practice, making it difficult to collect reliable feedback. This paper offers a paradigm shift to the domain of algorithmic fairness via proposing a new fairness notion based on the principle of non comparative justice. In contrary to traditional fairness notions where the outcomes of two individuals groups are compared, our proposed notion compares the MLS' outcome with a desired outcome for each input. This desired outcome naturally describes a human auditor's expectation, and can be easily used to evaluate MLS on crowd auditing platforms. We show that any MLS can be deemed fair from the perspective of comparative fairness (be it in terms of individual fairness, statistical parity, equal opportunity or calibration) if it is non comparatively fair with respect to a fair auditor. We also show that the converse holds true in the context of individual fairness. Given that such an evaluation relies on the trustworthiness of the auditor, we also present an approach to identify fair and reliable auditors by estimating their biases with respect to a given set of sensitive attributes, as well as quantify the uncertainty in the estimation of biases within a given MLS. Furthermore, all of the above results are also validated on COMPAS, German credit and Adult Census Income datasets.