The Duality of Data and Knowledge Across the Three Waves of AI. We discuss how over the last 30 to 50 years, Artificial Intelligence (AI) systems that focused only on data have been handicapped, and how knowledge has been critical in developing smarter, intelligent, and more effective systems. In fact, the vast progress in AI can be viewed in terms of the three waves of AI as identified by DARPA. During the first wave, handcrafted knowledge has been at the center piece, while during the second wave, the data driven approaches supplanted knowledge. Now we see a strong role and resurgence of knowledge fueling major breakthroughs in the third wave of AI underpinning future intelligent systems as they attempt human like decision making, and seek to become trusted assistants and companions for humans. We find a wider availability of knowledge created from diverse sources, using manual to automated means both by repurposing as well as by extraction. Using knowledge with statistical learning is becoming increasingly indispensable to help make AI systems more transparent and auditable. We will draw a parallel with the role of knowledge and experience in human intelligence based on cognitive science, and discuss emerging neuro symbolic or hybrid AI systems in which knowledge is the critical enabler for combining capabilities of the data intensive statistical AI systems with those of symbolic AI systems, resulting in more capable AI systems that support more human like intelligence.


Rotation Invariant Graph Neural Networks using Spin Convolutions. Progress towards the energy breakthroughs needed to combat climate change can be significantly accelerated through the efficient simulation of atomic systems. Simulation techniques based on first principles, such as Density Functional Theory (DFT), are limited in their practical use due to their high computational expense. Machine learning approaches have the potential to approximate DFT in a computationally efficient manner, which could dramatically increase the impact of computational simulations on real world problems. Approximating DFT poses several challenges. These include accurately modeling the subtle changes in the relative positions and angles between atoms, and enforcing constraints such as rotation invariance or energy conservation. We introduce a novel approach to modeling angular information between sets of neighboring atoms in a graph neural network. Rotation invariance is achieved for the network's edge messages through the use of a per edge local coordinate frame and a novel spin convolution over the remaining degree of freedom. Two model variants are proposed for the applications of structure relaxation and molecular dynamics. State of the art results are demonstrated on the large scale Open Catalyst 2020 dataset. Comparisons are also performed on the MD17 and QM9 datasets.


Entropy solutions of non local scalar conservation laws with congestion via deterministic particle method. We develop deterministic particle schemes to solve non local scalar conservation laws with congestion. We show that the discrete approximations converge to the unique entropy solution with an explicit rate of convergence under more general assumptions that the existing literature the velocity fields are less regular (in particular the interaction force can have a discontinuity at the origin) with no prescribed attractive repulsive regime and the mobility can have unbounded support. We complement our results with some numerical simulations, among which we show the applicability of the schemes to the multi species setting.


An Energy Efficient Quad Camera Visual System for Autonomous Machines on FPGA Platform. In our past few years' of commercial deployment experiences, we identify localization as a critical task in autonomous machine applications, and a great acceleration target. In this paper, based on the observation that the visual frontend is a major performance and energy consumption bottleneck, we present our design and implementation of an energy efficient hardware architecture for ORB (Oriented Fast and Rotated BRIEF) based localization system on FPGAs. To support our multi sensor autonomous machine localization system, we present hardware synchronization, frame multiplexing, and parallelization techniques, which are integrated in our design. Compared to Nvidia TX1 and Intel i7, our FPGA based implementation achieves 5.6x and 3.4x speedup, as well as 3.0x and 34.6x power reduction, respectively.


Safe, Fast, Concurrent Proof Checking for the lambda Pi Calculus Modulo Rewriting. Several proof assistants, such as Isabelle or Coq, can concurrently check multiple proofs. In contrast, the vast majority of today's small proof checkers either does not support concurrency at all or only limited forms thereof, restricting the efficiency of proof checking on multi core processors. This work shows the design of a small, memory and thread safe kernel that efficiently checks proofs both concurrently and non concurrently. This design is implemented in a new proof checker called Kontroli for the lambda Pi calculus modulo rewriting, which is an established framework to uniformly express a multitude of logical systems. Kontroli is faster than the reference proof checker for this calculus, Dedukti, on all of five evaluated datasets obtained from proof assistants and interactive theorem provers. Furthermore, Kontroli reduces the time of the most time consuming part of proof checking using eight threads by up to 6.6x.


Leading or Following? Dyadic Robot Imitative Interaction Using the Active Inference Framework. This study investigated how social interaction among robotic agents changes dynamically depending on the individual belief of action intention. In a set of simulation studies, we examine dyadic imitative interactions of robots using a variational recurrent neural network model. The model is based on the free energy principle such that a pair of interacting robots find themselves in a loop, attempting to predict and infer each other's actions using active inference. We examined how regulating the complexity term to minimize free energy determines the dynamic characteristics of networks and interactions. When one robot trained with tighter regulation and another trained with looser regulation interact, the latter tends to lead the interaction by exerting stronger action intention, while the former tends to follow by adapting to its observations. The study confirms that the dyadic imitative interaction becomes successful by achieving a high synchronization rate when a leader and a follower are determined by developing action intentions with strong belief and weak belief, respectively.


Assessing the Effectiveness of Syntactic Structure to Learn Code Edit Representations. In recent times, it has been shown that one can use code as data to aid various applications such as automatic commit message generation, automatic generation of pull request descriptions and automatic program repair. Take for instance the problem of commit message generation. Treating source code as a sequence of tokens, state of the art techniques generate commit messages using neural machine translation models. However, they tend to ignore the syntactic structure of programming languages. Previous work, i.e., code2seq has used structural information from Abstract Syntax Tree (AST) to represent source code and they use it to automatically generate method names. In this paper, we elaborate upon this state of the art approach and modify it to represent source code edits. We determine the effect of using such syntactic structure for the problem of classifying code edits. Inspired by the code2seq approach, we evaluate how using structural information from AST, i.e., paths between AST leaf nodes can help with the task of code edit classification on two datasets of fine grained syntactic edits. Our experiments shows that attempts of adding syntactic structure does not result in any improvements over less sophisticated methods. The results suggest that techniques such as code2seq, while promising, have a long way to go before they can be generically applied to learning code edit representations. We hope that these results will benefit other researchers and inspire them to work further on this problem.


Inverse Reinforcement Learning for Strategy Identification. In adversarial environments, one side could gain an advantage by identifying the opponent's strategy. For example, in combat games, if an opponents strategy is identified as overly aggressive, one could lay a trap that exploits the opponent's aggressive nature. However, an opponent's strategy is not always apparent and may need to be estimated from observations of their actions. This paper proposes to use inverse reinforcement learning (IRL) to identify strategies in adversarial environments. Specifically, the contributions of this work are 1) the demonstration of this concept on gaming combat data generated from three pre defined strategies and 2) the framework for using IRL to achieve strategy identification. The numerical experiments demonstrate that the recovered rewards can be identified using a variety of techniques. In this paper, the recovered reward are visually displayed, clustered using unsupervised learning, and classified using a supervised learner.


Symmetric Operations on Domains of Size at Most 4. To convert a fractional solution to an instance of a constraint satisfaction problem into a solution, a rounding scheme is needed, which can be described by a collection of symmetric operations with one of each arity. An intriguing possibility, raised in a recent paper by Carvalho and Krokhin, would imply that any clone of operations on a set D which contains symmetric operations of arities 1, 2, ldots, lvert D rvert contains symmetric operations of all arities in the clone. If true, then it is possible to check whether any given family of constraint satisfaction problems is solved by its linear programming relaxation. We characterize all idempotent clones containing symmetric operations of arities 1, 2, ldots, lvert D rvert for all sets D with size at most four and prove that each one contains symmetric operations of every arity, proving the conjecture above for lvert D rvert leq 4 .


Automatic analysis of artistic paintings using information based measures. The artistic community is increasingly relying on automatic computational analysis for authentication and classification of artistic paintings. In this paper, we identify hidden patterns and relationships present in artistic paintings by analysing their complexity, a measure that quantifies the sum of characteristics of an object. Specifically, we apply Normalized Compression (NC) and the Block Decomposition Method (BDM) to a dataset of 4,266 paintings from 91 authors and examine the potential of these information based measures as descriptors of artistic paintings. Both measures consistently described the equivalent types of paintings, authors, and artistic movements. Moreover, combining the NC with a measure of the roughness of the paintings creates an efficient stylistic descriptor. Furthermore, by quantifying the local information of each painting, we define a fingerprint that describes critical information regarding the artists' style, their artistic influences, and shared techniques. More fundamentally, this information describes how each author typically composes and distributes the elements across the canvas and, therefore, how their work is perceived. Finally, we demonstrate that regional complexity and two point height difference correlation function are useful auxiliary features that improve current methodologies in style and author classification of artistic paintings. The whole study is supported by an extensive website (http panther.web.ua.pt) for fast author characterization and authentication.


Implicit Feature Refinement for Instance Segmentation. We propose a novel implicit feature refinement module for high quality instance segmentation. Existing image video instance segmentation methods rely on explicitly stacked convolutions to refine instance features before the final prediction. In this paper, we first give an empirical comparison of different refinement strategies,which reveals that the widely used four consecutive convolutions are not necessary. As an alternative, weight sharing convolution blocks provides competitive performance. When such block is iterated for infinite times, the block output will eventually convergeto an equilibrium state. Based on this observation, the implicit feature refinement (IFR) is developed by constructing an implicit function. The equilibrium state of instance features can be obtained by fixed point iteration via a simulated infinite depth network. Our IFR enjoys several advantages 1) simulates an infinite depth refinement network while only requiring parameters of single residual block 2) produces high level equilibrium instance features of global receptive field 3) serves as a plug and play general module easily extended to most object recognition frameworks. Experiments on the COCO and YouTube VIS benchmarks show that our IFR achieves improved performance on state of the art image video instance segmentation frameworks, while reducing the parameter burden (e.g.1 AP improvement on Mask R CNN with only 30.0 parameters in mask head). Code is made available at https github.com lufanma IFR.git


Test case prioritization using test case diversification and fault proneness estimations. Context Regression testing activities greatly reduce the risk of faulty software release. However, the size of the test suites grows throughout the development process, resulting in time consuming execution of the test suite and delayed feedback to the software development team. This has urged the need for approaches such as test case prioritization (TCP) and test suite reduction to reach better results in case of limited resources. In this regard, proposing approaches that use auxiliary sources of data such as bug history can be interesting. Objective Our aim is to propose an approach for TCP that takes into account test case coverage data, bug history, and test case diversification. To evaluate this approach we study its performance on real world open source projects. Method The bug history is used to estimate the fault proneness of source code areas. The diversification of test cases is preserved by incorporating fault proneness on a clustering based approach scheme. Results The proposed methods are evaluated on datasets collected from the development history of five real world projects including 357 versions in total. The experiments show that the proposed methods are superior to coverage based TCP methods. Conclusion The proposed approach shows that improvement of coverage based and fault proneness based methods is possible by using a combination of diversification and fault proneness incorporation.


OrbNet Denali A machine learning potential for biological and organic chemistry with semi empirical cost and DFT accuracy. We present OrbNet Denali, a machine learning model for electronic structure that is designed as a drop in replacement for ground state density functional theory (DFT) energy calculations. The model is a message passing neural network that uses symmetry adapted atomic orbital features from a low cost quantum calculation to predict the energy of a molecule. OrbNet Denali is trained on a vast dataset of 2.3 million DFT calculations on molecules and geometries. This dataset covers the most common elements in bio and organic chemistry (H, Li, B, C, N, O, F, Na, Mg, Si, P, S, Cl, K, Ca, Br, I) as well as charged molecules. OrbNet Denali is demonstrated on several well established benchmark datasets, and we find that it provides accuracy that is on par with modern DFT methods while offering a speedup of up to three orders of magnitude. For the GMTKN55 benchmark set, OrbNet Denali achieves WTMAD 1 and WTMAD 2 scores of 7.19 and 9.84, on par with modern DFT functionals. For several GMTKN55 subsets, which contain chemical problems that are not present in the training set, OrbNet Denali produces a mean absolute error comparable to those of DFT methods. For the Hutchison conformers benchmark set, OrbNet Denali has a median correlation coefficient of R 2 0.90 compared to the reference DLPNO CCSD(T) calculation, and R 2 0.97 compared to the method used to generate the training data (wB97X D3 def2 TZVP), exceeding the performance of any other method with a similar cost. Similarly, the model reaches chemical accuracy for non covalent interactions in the S66x10 dataset. For torsional profiles, OrbNet Denali reproduces the torsion profiles of wB97X D3 def2 TZVP with an average MAE of 0.12 kcal mol for the potential energy surfaces of the diverse fragments in the TorsionNet500 dataset.


Arbitrarily accelerating space time wave packets. All known realizations of optical wave packets that accelerate along their propagation axis, such as Airy wave packets in dispersive media or wave front modulated X waves, exhibit a constant acceleration that is, the group velocity varies linearly with propagation. Here we synthesize space time wave packets that travel in free space with arbitrary axial acceleration profiles, including group velocities that change with integer or fractional exponents of the distance. Furthermore, we realize a composite acceleration profile the wave packet first accelerates from an initial to a terminal group velocity, decelerates back to the initial value, and then travels at a fixed group velocity. These never before seen optical acceleration phenomena are all produced using the same experimental arrangement that precisely sculpts the wave packet's spatio temporal spectral structure.


Success Weighted by Completion Time A Dynamics Aware Evaluation Criteria for Embodied Navigation. We present Success weighted by Completion Time (SCT), a new metric for evaluating navigation performance for mobile robots. Several related works on navigation have used Success weighted by Path Length (SPL) as the primary method of evaluating the path an agent makes to a goal location, but SPL is limited in its ability to properly evaluate agents with complex dynamics. In contrast, SCT explicitly takes the agent's dynamics model into consideration, and aims to accurately capture how well the agent has approximated the fastest navigation behavior afforded by its dynamics. While several embodied navigation works use point turn dynamics, we focus on unicycle cart dynamics for our agent, which better exemplifies the dynamics model of popular mobile robotics platforms (e.g., LoCoBot, TurtleBot, Fetch, etc.). We also present RRT Unicycle, an algorithm for unicycle dynamics that estimates the fastest collision free path and completion time from a starting pose to a goal location in an environment containing obstacles. We experiment with deep reinforcement learning and reward shaping to train and compare the navigation performance of agents with different dynamics models. In evaluating these agents, we show that in contrast to SPL, SCT is able to capture the advantages in navigation speed a unicycle model has over a simpler point turn model of dynamics. Lastly, we show that we can successfully deploy our trained models and algorithms outside of simulation in the real world. We embody our agents in an real robot to navigate an apartment, and show that they can generalize in a zero shot manner.


Diffy Inductive Reasoning of Array Programs using Difference Invariants. We present a novel verification technique to prove interesting properties of a class of array programs with a symbolic parameter N denoting the size of arrays. The technique relies on constructing two slightly different versions of the same program. It infers difference relations between the corresponding variables at key control points of the joint control flow graph of the two program versions. The desired post condition is then proved by inducting on the program parameter N , wherein the difference invariants are crucially used in the inductive step. This contrasts with classical techniques that rely on finding potentially complex loop invaraints for each loop in the program. Our synergistic combination of inductive reasoning and finding simple difference invariants helps prove properties of programs that cannot be proved even by the winner of Arrays sub category from SV COMP 2021. We have implemented a prototype tool called diffy to demonstrate these ideas. We present results comparing the performance of diffy with that of state of the art tools.


CentripetalText An Efficient Text Instance Representation for Scene Text Detection. Scene text detection remains a grand challenge due to the variation in text curvatures, orientations, and aspect ratios. One of the hardest problems in this task is how to represent text instances of arbitrary shapes. Although many methods have been proposed to model irregular texts in a flexible manner, most of them lose simplicity and robustness. Their complicated post processings and the regression under Dirac delta distribution undermine the detection performance and the generalization ability. In this paper, we propose an efficient text instance representation named CentripetalText (CT), which decomposes text instances into the combination of text kernels and centripetal shifts. Specifically, we utilize the centripetal shifts to implement pixel aggregation, guiding the external text pixels to the internal text kernels. The relaxation operation is integrated into the dense regression for centripetal shifts, allowing the correct prediction in a range instead of a specific value. The convenient reconstruction of text contours and the tolerance of prediction errors in our method guarantee the high detection accuracy and the fast inference speed, respectively. Besides, we shrink our text detector into a proposal generation module, namely CentripetalText Proposal Network, replacing Segmentation Proposal Network in Mask TextSpotter v3 and producing more accurate proposals. To validate the effectiveness of our method, we conduct experiments on several commonly used scene text benchmarks, including both curved and multi oriented text datasets. For the task of scene text detection, our approach achieves superior or competitive performance compared to other existing methods, e.g., F measure of 86.3 at 40.0 FPS on Total Text, F measure of 86.1 at 34.8 FPS on MSRA TD500, etc. For the task of end to end scene text recognition, our method outperforms Mask TextSpotter v3 by 1.1 on Total Text.


A projection method for Navier Stokes equations with a boundary condition including the total pressure. We consider a projection method for time dependent incompressible Navier Stokes equations with a total pressure boundary condition. The projection method is one of the numerical calculation methods for incompressible viscous fluids often used in engineering. In general, the projection method needs additional boundary conditions to solve a pressure Poisson equation, which does not appear in the original Navier Stokes problem. On the other hand, many mechanisms generate flow by creating a pressure difference, such as water distribution systems and blood circulation. We propose a new additional boundary condition for the projection method with a Dirichlet type pressure boundary condition and no tangent flow. We demonstrate stability for the scheme and establish error estimates for the velocity and pressure under suitable norms. A numerical experiment verifies the theoretical convergence results. Furthermore, the existence of a weak solution to the original Navier Stokes problem is proved by using the stability.


Desingularization of the Sweeping Process Mapping. In 9 , the celebrated K L inequality has been extended from definable functions f mathbb R n rightarrow mathbb R to definable multivalued maps S mathbb R rightrightarrows mathbb R n , by establishing that the co derivative mapping D ast S admits a desingularization around every critical value. As was the case in the gradient dynamics, this desingularization yields a uniform control of the lengths of all bounded orbits of the corresponding sweeping process dot gamma (t) in N S(t) ( gamma(t)) . In this paper, working outside the framework of o minimal geometry, we characterize the existence of a desingularization for the coderivative in terms of the behaviour of the sweeping process orbits and the integrability of the talweg function. These results are close in spirit with the ones in 3 , where characterizations for the desingularization of the (sub)gradient of functions had been obtained.


Rewire then Probe A Contrastive Recipe for Probing Biomedical Knowledge of Pre trained Language Models. Knowledge probing is crucial for understanding the knowledge transfer mechanism behind the pre trained language models (PLMs). Despite the growing progress of probing knowledge for PLMs in the general domain, specialised areas such as biomedical domain are vastly under explored. To catalyse the research in this direction, we release a well curated biomedical knowledge probing benchmark, MedLAMA, which is constructed based on the Unified Medical Language System (UMLS) Metathesaurus. We test a wide spectrum of state of the art PLMs and probing approaches on our benchmark, reaching at most 3 of acc 10. While highlighting various sources of domain specific challenges that amount to this underwhelming performance, we illustrate that the underlying PLMs have a higher potential for probing tasks. To achieve this, we propose Contrastive Probe, a novel self supervised contrastive probing approach, that adjusts the underlying PLMs without using any probing data. While Contrastive Probe pushes the acc 10 to 28 , the performance gap still remains notable. Our human expert evaluation suggests that the probing performance of our Contrastive Probe is still under estimated as UMLS still does not include the full spectrum of factual knowledge. We hope MedLAMA and Contrastive Probe facilitate further developments of more suited probing techniques for this domain.


Video Captioning in Compressed Video. Existing approaches in video captioning concentrate on exploring global frame features in the uncompressed videos, while the free of charge and critical saliency information already encoded in the compressed videos is generally neglected. We propose a video captioning method which operates directly on the stored compressed videos. To learn a discriminative visual representation for video captioning, we design a residuals assisted encoder (RAE), which spots regions of interest in I frames under the assistance of the residuals frames. First, we obtain the spatial attention weights by extracting features of residuals as the saliency value of each location in I frame and design a spatial attention module to refine the attention weights. We further propose a temporal gate module to determine how much the attended features contribute to the caption generation, which enables the model to resist the disturbance of some noisy signals in the compressed videos. Finally, Long Short Term Memory is utilized to decode the visual representations into descriptions. We evaluate our method on two benchmark datasets and demonstrate the effectiveness of our approach.


Hybrid integrated low noise linearly chirped Frequency Modulated Continuous Wave laser source based on self injection to external cavity. A low noise linearly frequency modulated continuous wave laser source with a wide frequency bandwidth is demonstrated. By two dimensional thermal tuning, the laser source shows 42 GHz continuous frequency tuning with 49.86 Hz intrinsic linewidth under static operation. For dynamical FMCW, the laser source has 10.25 GHz frequency bandwidth at 100 Hz chirped frequency and 5.56 GHz at 1 kHz chirped frequency. With pre distortion linearization, it can distinguish 3 m length difference at 45 km distance in the fibre length measured experiment, which demonstrate a potential for application in ultra long fibre sensing and FMCW LiDAR.


Bifurcations in inertial focusing of a particle suspended in flow through curved rectangular ducts. Particles suspended in a fluid flow through a curved duct can focus to specific locations within the duct cross section. This particle focusing is a result of a balance between two dominant forces acting on the particle (i) the inertial lift force arising from small but non negligible inertia of the fluid, and (ii) the secondary drag force due to the cross sectional vortices induced by the curvature of the duct. By adopting a simplified particle dynamics model developed by Ha et al. 2 , we investigate both analytically and numerically, the particle equilibria and their bifurcations when a small particle is suspended in low flow rate fluid flow through a curved duct having a 2 times1 and a 1 times2 rectangular cross section. In certain parameter regimes of the model, we analytically obtain the particle equilibria and deduce their stability, while for other parameter regimes, we numerically calculate the particle equilibria and stability. Moreover, we observe a number of different bifurcations in particle equilibria such as saddle node, pitchfork and Hopf, as the model parameters are varied. These results may aid in the design of inertial microfluidic devices aimed at particle separation by size.


Spectral and dual energy X ray imaging for medical applications. Spectral imaging is an umbrella term for energy resolved x ray imaging in medicine. The technique makes use of the energy dependence of x ray attenuation to either increase the contrast to noise ratio, or to provide quantitative image data and reduce image artefacts by so called material decomposition. Spectral imaging is not new, but has gained interest in recent years because of rapidly increasing availability of spectral and dual energy CT and the dawn of energy resolved photon counting detectors. This review examines the current technological status of spectral and dual energy imaging and a number of practical applications of the technology.


Exploiting Network Structures to Improve Semantic Representation for the Financial Domain. This paper presents the participation of the MiniTrue team in the FinSim 3 shared task on learning semantic similarities for the financial domain in English language. Our approach combines contextual embeddings learned by transformer based language models with network structures embeddings extracted on external knowledge sources, to create more meaningful representations of financial domain entities and terms. For this, two BERT based language models and a knowledge graph embedding model are used. Besides, we propose a voting function to joint three basic models for the final inference. Experimental results show that the model with the knowledge graph embeddings has achieved a superior result than these models with only contextual embeddings. Nevertheless, we also observe that our voting function brings an extra benefit to the final system.


Quantifying nanoscale electromagnetic fields in near field microscopy by Fourier demodulation analysis. Confining light to sharp metal tips has become a versatile technique to study optical and electronic properties far below the diffraction limit. Particularly near field microscopy in the mid infrared spectral range has found a variety of applications in probing nanostructures and their dynamics. Yet, the ongoing quest for ultimately high spatial resolution down to the single nanometer regime and quantitative three dimensional nano tomography depends vitally on a precise knowledge of the spatial distribution of the near fields emerging from the probe. Here, we perform finite element simulations of a tip with realistic geometry oscillating above a dielectric sample. By introducing a novel Fourier demodulation analysis of the electric field at each point in space, we reliably quantify the distribution of the near fields above and within the sample. Besides inferring the lateral field extension, which can be smaller than the tip radius of curvature, we also quantify the probing volume within the sample. Finally, we visualize the scattering process into the far field at a given demodulation order, for the first time, and shed light onto the nanoscale distribution of the near fields and its evolution as the tip sample distance is varied. Our work represents a crucial step in understanding and tailoring the spatial distribution of evanescent fields in optical nanoscopy.


Data Augmentation Using Many To Many RNNs for Session Aware Recommender Systems. The ACM WSDM WebTour 2021 Challenge organized by Booking.com focuses on applying Session Aware recommender systems in the travel domain. Given a sequence of travel bookings in a user trip, we look to recommend the user's next destination. To handle the large dimensionality of the output's space, we propose a many to many RNN model, predicting the next destination chosen by the user at every sequence step as opposed to only the final one. We show how this is a computationally efficient alternative to doing data augmentation in a many to one RNN, where we consider every subsequence of a session starting from the first element. Our solution achieved 4th place in the final leaderboard, with an accuracy 4 of 0.5566.


GCNScheduler Scheduling Distributed Computing Applications using Graph Convolutional Networks. We consider the classical problem of scheduling task graphs corresponding to complex applications on distributed computing systems. A number of heuristics have been previously proposed to optimize task scheduling with respect to metrics such as makespan and throughput. However, they tend to be slow to run, particularly for larger problem instances, limiting their applicability in more dynamic systems. Motivated by the goal of solving these problems more rapidly, we propose, for the first time, a graph convolutional network based scheduler (GCNScheduler). By carefully integrating an inter task data dependency structure with network settings into an input graph and feeding it to an appropriate GCN, the GCNScheduler can efficiently schedule tasks of complex applications for a given objective. We evaluate our scheme with baselines through simulations. We show that not only can our scheme quickly and efficiently learn from existing scheduling schemes, but also it can easily be applied to large scale settings where current scheduling schemes fail to handle. We show that it achieves better makespan than the classic HEFT algorithm, and almost the same throughput as throughput oriented HEFT (TP HEFT), while providing several orders of magnitude faster scheduling times in both cases. For example, for makespan minimization, GCNScheduler schedules 50 node task graphs in about 4 milliseconds while HEFT takes more than 1500 seconds and for throughput maximization, GCNScheduler schedules 100 node task graphs in about 3.3 milliseconds, compared to about 6.9 seconds for TP HEFT.


From calmness to Hoffman constants for linear semi infinite inequality systems. In this paper we focus on different global, semi local and local versions of Hoffman type inequalities expressed in a variational form. In a first stage our analysis is developed for generic multifunctions between metric spaces and we finally deal with the feasible set mapping associated with linear semi infinite inequality systems (finitely many variables and possibly infinitely many constraints) parameterized by their right hand side. The Hoffman modulus is shown to coincide with the supremum of Lipschitz upper semicontinuity and calmness moduli when confined to multifunctions with a convex graph and closed images in a reflexive Banach space, which is the case of our feasible set mapping. Moreover, for this particular multifunction a formula only involving the system's left hand side of the global Hoffman constant is derived, providing a generalization to our semi infinite context of finite counterparts developed in the literature. In the particular case of locally polyhedral systems, the paper also provides a point based formula for the (semi local) Hoffman modulus in terms of the calmness moduli at certain feasible points (extreme points when the nominal feasible set contains no lines), yielding a practically tractable expression for finite systems.


Energy Optimization of Faulty Quantized Min Sum LDPC Decoders. The objective of this paper is to minimize the energy consumption of a quantized Min Sum LDPC decoder, by considering aggressive voltage downscaling of the decoder circuit. Since low power supply may introduce faults in the memories used by the decoder architecture, this paper proposes to optimize the energy consumption of the faulty Min Sum decoder while satisfying a given performance criterion. The proposed optimization method relies on a coordinate descent algorithm that optimizes code and decoder parameters which have a strong influence on the decoder energy consumption codeword length, number of quantization bits, and failure probability of the memories. Optimal parameter values are provided for several codes defined by their protographs, and significant energy gains are observed compared to non optimized setups.


Bayesian neural network priors for edge preserving inversion. We consider Bayesian inverse problems wherein the unknown state is assumed to be a function with discontinuous structure a priori. A class of prior distributions based on the output of neural networks with heavy tailed weights is introduced, motivated by existing results concerning the infinite width limit of such networks. We show theoretically that samples from such priors have desirable discontinuous like properties even when the network width is finite, making them appropriate for edge preserving inversion. Numerically we consider deconvolution problems defined on one and two dimensional spatial domains to illustrate the effectiveness of these priors MAP estimation, dimension robust MCMC sampling and ensemble based approximations are utilized to probe the posterior distribution. The accuracy of point estimates is shown to exceed those obtained from non heavy tailed priors, and uncertainty estimates are shown to provide more useful qualitative information.


Semi classical description of electron dynamics in extended systems under intense laser fields. We propose a semi classical approach based on the Vlasov equation to describe the time dependent electronic dynamics in a bulk simple metal under an ultrashort intense laser pulse. We include in the effective potential not only the ionic Coulomb potential and mean field electronic Coulomb potential from the one body electron distribution but also the exchange correlation potential within the local density approximation (LDA). The initial ground state is obtained by the Thomas Fermi model. To numerically solve the Vlasov equation, we extend the pseudo particle method, previously used for nuclei and atomic clusters, to solids, taking the periodic boundary condition into account. We apply the present implementation to a bulk aluminum (FCC) conventional unit cell irradiated with a short laser pulse. The optical conductivity, refractive index, extinction coefficient, and reflectivity as well as energy absorption calculated with the Vlasov LDA method are in excellent agreement with the results by the time dependent density functional theory and experimental references.


Non existence of negative curves. Let X be a projective toric surface of Picard number one blown up at a general point. We bring an infinite family of examples of such X whose Kleiman Mori cone of curves is not closed there is no negative curve generating one of the two boundary rays of the cone. These examples are related to Nagata's conjecture and rationality of Seshadri constants.


Banach space valued Pisier and Riesz type inequalities on discrete cube. This is an attempt to build Banach space valued theory for certain singular integrals on Hamming cube. Of course all estimates below are dimension independent, and we tried to find ultimate sharp assumptions on the Banach space for a corresponding operators to be bounded. In certain cases we succeeded, although there are still many open questions, some of them are listed in the last Section. Using the approach of cite IVHV and also quantum random variables approach of cite ELP we generalize several theorems of Pisier cite P and Hyt "onen Naor cite HN . We also improve the constant in L 1 Poincar 'e inequality on Hamming cube, the previous results are due to Talagrand and Ben Efraim Lust Piquard.


Negotiation Aware Reachability Based Safety Verification for AutonomousDriving in Interactive Scenarios. Safety assurance is a critical yet challenging aspect when developing self driving technologies. Hamilton Jacobi backward reachability analysis is a formal verification tool for verifying the safety of dynamic systems in the presence of disturbances. However, the standard approach is too conservative to be applied to self driving applications due to its worst case assumption on humans' behaviors (i.e., guard against worst case outcomes). In this work, we integrate a learning based prediction algorithm and a game theoretic human behavioral model to online update the conservativeness of backward reachability analysis. We evaluate our approach using real driving data. The results show that, with reasonable assumptions on human behaviors, our approach can effectively reduce the conservativeness of the standard approach without sacrificing its safety verification ability.


rSoccer A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer. Reinforcement learning is an active research area with a vast number of applications in robotics, and the RoboCup competition is an interesting environment for studying and evaluating reinforcement learning methods. A known difficulty in applying reinforcement learning to robotics is the high number of experience samples required, being the use of simulated environments for training the agents followed by transfer learning to real world (sim to real) a viable path. This article introduces an open source simulator for the IEEE Very Small Size Soccer and the Small Size League optimized for reinforcement learning experiments. We also propose a framework for creating OpenAI Gym environments with a set of benchmarks tasks for evaluating single agent and multi agent robot soccer skills. We then demonstrate the learning capabilities of two state of the art reinforcement learning methods as well as their limitations in certain scenarios introduced in this framework. We believe this will make it easier for more teams to compete in these categories using end to end reinforcement learning approaches and further develop this research area.


An Overview of Laser Injection against Embedded Neural Network Models. For many IoT domains, Machine Learning and more particularly Deep Learning brings very efficient solutions to handle complex data and perform challenging and mostly critical tasks. However, the deployment of models in a large variety of devices faces several obstacles related to trust and security. The latest is particularly critical since the demonstrations of severe flaws impacting the integrity, confidentiality and accessibility of neural network models. However, the attack surface of such embedded systems cannot be reduced to abstract flaws but must encompass the physical threats related to the implementation of these models within hardware platforms (e.g., 32 bit microcontrollers). Among physical attacks, Fault Injection Analysis (FIA) are known to be very powerful with a large spectrum of attack vectors. Most importantly, highly focused FIA techniques such as laser beam injection enable very accurate evaluation of the vulnerabilities as well as the robustness of embedded systems. Here, we propose to discuss how laser injection with state of the art equipment, combined with theoretical evidences from Adversarial Machine Learning, highlights worrying threats against the integrity of deep learning inference and claims that join efforts from the theoretical AI and Physical Security communities are a urgent need.


Why do we use constants of motion while studying the motion of a heavy symmetric top?. While studying the motion of a heavy symmetric top, in general, constants of motion are used. Some students may want to understand the motion in terms of torque, which can lie on their routine based on the usage of Newton's second law. However, this is not easy, and examples of this work will illustrate this situation. In this work, first, we will show the equivalence of torque angular momentum relation and Euler equations for a heavy symmetric top which give the description of the motion in terms of torque. Then, we will study some simple motions of a heavy symmetric top in terms of torque, angular momentum, angular velocities and accelerations, which can help students in understanding rigid body rotations and the necessity of considering the motion of a heavy symmetric top in terms of constants. We will also study Perry's historical observational principle on the relation between precession and the rise of the top.


A Speaker Verification Backend with Robust Performance across Conditions. In this paper, we address the problem of speaker verification in conditions unseen or unknown during development. A standard method for speaker verification consists of extracting speaker embeddings with a deep neural network and processing them through a backend composed of probabilistic linear discriminant analysis (PLDA) and global logistic regression score calibration. This method is known to result in systems that work poorly on conditions different from those used to train the calibration model. We propose to modify the standard backend, introducing an adaptive calibrator that uses duration and other automatically extracted side information to adapt to the conditions of the inputs. The backend is trained discriminatively to optimize binary cross entropy. When trained on a number of diverse datasets that are labeled only with respect to speaker, the proposed backend consistently and, in some cases, dramatically improves calibration, compared to the standard PLDA approach, on a number of held out datasets, some of which are markedly different from the training data. Discrimination performance is also consistently improved. We show that joint training of the PLDA and the adaptive calibrator is essential the same benefits cannot be achieved when freezing PLDA and fine tuning the calibrator. To our knowledge, the results in this paper are the first evidence in the literature that it is possible to develop a speaker verification system with robust out of the box performance on a large variety of conditions.


Comment on Field dependent surface resistance for superconducting niobium accelerating cavities. First, this is a response to a criticism I have received about the paper which is mentioned in the title. Second, the aim is to show the important role of small (compared to coherence length) weak superconducting spots when located at the surface in connection with the proximity and percolation effects.


Perceptual Score What Data Modalities Does Your Model Perceive?. Machine learning advances in the last decade have relied significantly on large scale datasets that continue to grow in size. Increasingly, those datasets also contain different data modalities. However, large multi modal datasets are hard to annotate, and annotations may contain biases that we are often unaware of. Deep net based classifiers, in turn, are prone to exploit those biases and to find shortcuts. To study and quantify this concern, we introduce the perceptual score, a metric that assesses the degree to which a model relies on the different subsets of the input features, i.e., modalities. Using the perceptual score, we find a surprisingly consistent trend across four popular datasets recent, more accurate state of the art multi modal models for visual question answering or visual dialog tend to perceive the visual data less than their predecessors. This trend is concerning as answers are hence increasingly inferred from textual cues only. Using the perceptual score also helps to analyze model biases by decomposing the score into data subset contributions. We hope to spur a discussion on the perceptiveness of multi modal models and also hope to encourage the community working on multi modal classifiers to start quantifying perceptiveness via the proposed perceptual score.


A SDF Learning Disentangled Signed Distance Functions for Articulated Shape Representation. Recent work has made significant progress on using implicit functions, as a continuous representation for 3D rigid object shape reconstruction. However, much less effort has been devoted to modeling general articulated objects. Compared to rigid objects, articulated objects have higher degrees of freedom, which makes it hard to generalize to unseen shapes. To deal with the large shape variance, we introduce Articulated Signed Distance Functions (A SDF) to represent articulated shapes with a disentangled latent space, where we have separate codes for encoding shape and articulation. We assume no prior knowledge on part geometry, articulation status, joint type, joint axis, and joint location. With this disentangled continuous representation, we demonstrate that we can control the articulation input and animate unseen instances with unseen joint angles. Furthermore, we propose a Test Time Adaptation inference algorithm to adjust our model during inference. We demonstrate our model generalize well to out of distribution and unseen data, e.g., partial point clouds and real world depth images.


LegoFormer Transformers for Block by Block Multi view 3D Reconstruction. Most modern deep learning based multi view 3D reconstruction techniques use RNNs or fusion modules to combine information from multiple images after encoding them. These two separate steps have loose connections and do not consider all available information while encoding each view. We propose LegoFormer, a transformer based model that unifies object reconstruction under a single framework and parametrizes the reconstructed occupancy grid by its decomposition factors. This reformulation allows the prediction of an object as a set of independent structures then aggregated to obtain the final reconstruction. Experiments conducted on ShapeNet display the competitive performance of our network with respect to the state of the art methods. We also demonstrate how the use of self attention leads to increased interpretability of the model output.


Apparatus for Measuring Strength in Biaxial Compression. Most measurements of compressive strength of ductile materials have involved Hopkinson Kolsky bars or Taylor anvils placing samples in uniaxial compression. In these geometries strain is limited by the tendency of the sample to petal, in analogy to necking in uniaxial tension. Estimation of strength for any other form of the stress tensor requires assuming a shape for the yield surface because data exist only for uniaxial compression these assumptions are untested. In an imploding spherical shell compression is biaxial, the plastic strain may not be small and the material behavior may be nonlinear as a result of work hardening and heating by plastic work. We propose to measure the strengths of materials in biaxial compression,both quasistatically and dynamically, using the compression of thin spherical shells. We suggest surrounding the shell with an annulus filled with a mixture of H 2 and Cl 2 gases whose volumetric detonation is initiated by a flash of blue and near ultraviolet light. Less promising approaches are described in appendices.


Probabilistic Human Motion Prediction via A Bayesian Neural Network. Human motion prediction is an important and challenging topic that has promising prospects in efficient and safe human robot interaction systems. Currently, the majority of the human motion prediction algorithms are based on deterministic models, which may lead to risky decisions for robots. To solve this problem, we propose a probabilistic model for human motion prediction in this paper. The key idea of our approach is to extend the conventional deterministic motion prediction neural network to a Bayesian one. On one hand, our model could generate several future motions when given an observed motion sequence. On the other hand, by calculating the Epistemic Uncertainty and the Heteroscedastic Aleatoric Uncertainty, our model could tell the robot if the observation has been seen before and also give the optimal result among all possible predictions. We extensively validate our approach on a large scale benchmark dataset Human3.6m. The experiments show that our approach performs better than deterministic methods. We further evaluate our approach in a Human Robot Interaction (HRI) scenario. The experimental results show that our approach makes the interaction more efficient and safer.


On the independence of Robinson's set of axioms for propositional calculus. We give a normal five valued truth table proving independence of one of the axioms in Robinson's set of axioms for propositional calculus from 1968, answering a question raised in his article, where he uses a non normal truth table. We also give a normal four valued truth table proving independence of one of the other axioms, where he uses a normal five valued truth table.


Generalized optical theorem for Rayleigh scattering approximation. A general expression for the optical theorem for probe sources given in terms of propagation invariant beams is derived. This expression is obtained using the far field approximation for Rayleigh regime. In order to illustrate this results is revisited the classical and standard scattering elastic problem of a dielectric sphere for which the incident field can be any propagation invariant beam.


Development of X ray spectrometer automatic adjustment system based on global optimization algorithm. In high energy resolution X ray spectroscopy beamlines of synchrotron radiation facilities, it is important to keep X ray spectrometer operating in optimal conditions. The adjusting process is normally very time consuming due to the irregular light source beam point, and it is difficult to get global optimum. This study aims to develop an intelligent adjusting system based on global optimization algorithm for high energy resolution X ray spectroscopy beamline commissioning. First of all, based on the two dimensional experimental data, automatic adjustment process was established. Then the automatic optimization was applied to adjust X ray spectrometer practically, and upgraded iteratively. Online tests results show that this automatic adjustment process converges to the optimal solution quickly, and the convergence time is about several hundred steps, more efficient than manual optimization process. After automatic adjustment, we can get correct X ray spectrum based on the adjusted spectrometer.


Contact problems with friction for hemitropic solids boundary variational inequality approach. We study the interior and exterior contact problems for hemitropic elastic solids. We treat the cases when the friction effects, described by Tresca friction (given friction model), are taken into consideration either on some part of the boundary of the body or on the whole boundary. We equivalently reduce these problems to a boundary variational inequality with the help of the Steklov Poincar'e type operator. Based on our boundary variational inequality approach we prove existence and uniqueness theorems for weak solutions. We prove that the solutions continuously depend on the data of the original problem and on the friction coefficient. For the interior problem necessary and sufficient conditions of solvability are established when friction is taken into consideration on the whole boundary.


On the noncommutative Poisson geometry of certain wild character varieties. To show that certain wild character varieties are multiplicative analogues of quiver varieties, Boalch introduced colored multiplicative quiver varieties. They form a class of (nondegenerate) Poisson varieties attached to colored quivers whose representation theory is controlled by fission algebras noncommutative algebras generalizing the multiplicative preprojective algebras of Crawley Boevey and Shaw. Previously, Van den Bergh exploited the Kontsevich Rosenberg principle to prove that the natural Poisson structure of any (non colored) multiplicative quiver variety is induced by an H 0 Poisson structure on the underlying multiplicative preprojective algebra indeed, it turns out that this noncommutative structure comes from a Hamiltonian double quasi Poisson algebra constructed from the quiver itself. In this article we conjecture that, via the Kontsevich Rosenberg principle, the natural Poisson structure on each colored multiplicative quiver variety is induced by an H 0 Poisson structure on the underlying fission algebra which, in turn, is obtained from a Hamiltonian double quasi Poisson algebra attached to the colored quiver. We study some consequences of this conjecture and we prove it in two significant cases the interval and the triangle.


Do Abstractions Have Politics? Toward a More Critical Algorithm Analysis. The expansion of computer science (CS) education in K 12 and higher education in the United States has prompted deeper engagement with equity that moves beyond inclusion toward a more critical CS education. Rather than frame computing as a value neutral tool, a justice centered approach to equitable CS education draws on critical pedagogy to ensure the rightful presence of political struggles by emphasizing the development of not only knowledge and skills but also CS disciplinary identities. While recent efforts have integrated ethics into several areas of the undergraduate CS curriculum, critical approaches for teaching data structures and algorithms in particular are undertheorized. Basic Data Structures remains focused on runtime centered algorithm analysis. We argue for affordance analysis, a more critical algorithm analysis based on an affordance account of value embedding. Drawing on critical methods from science and technology studies, philosophy of technology, and human computer interaction, affordance analysis examines how the design of computational abstractions such as data structures and algorithms embody affordances, which in turn embody values with political consequences. We illustrate 5 case studies of how affordance analysis refutes social determination of technology, foregrounds the limitations of data abstractions, and implicates the design of algorithms in disproportionately distributing benefits and harms to particular social identities within the matrix of domination.


Level set learning with pseudo reversible neural networks for nonlinear dimension reduction in function approximation. Due to the curse of dimensionality and the limitation on training data, approximating high dimensional functions is a very challenging task even for powerful deep neural networks. Inspired by the Nonlinear Level set Learning (NLL) method that uses the reversible residual network (RevNet), in this paper we propose a new method of Dimension Reduction via Learning Level Sets (DRiLLS) for function approximation. Our method contains two major components one is the pseudo reversible neural network (PRNN) module that effectively transforms high dimensional input variables to low dimensional active variables, and the other is the synthesized regression module for approximating function values based on the transformed data in the low dimensional space. The PRNN not only relaxes the invertibility constraint of the nonlinear transformation present in the NLL method due to the use of RevNet, but also adaptively weights the influence of each sample and controls the sensitivity of the function to the learned active variables. The synthesized regression uses Euclidean distance in the input space to select neighboring samples, whose projections on the space of active variables are used to perform local least squares polynomial fitting. This helps to resolve numerical oscillation issues present in traditional local and global regressions. Extensive experimental results demonstrate that our DRiLLS method outperforms both the NLL and Active Subspace methods, especially when the target function possesses critical points in the interior of its input domain.


Normalized solutions to a class of Kirchhoff equations with Sobolev critical exponent. In this paper, we consider the existence and asymptotic properties of solutions to the following Kirchhoff equation begin equation label 1 nonumber Bigl(a b int R 3 left nabla u right 2 Bigl) Delta u lambda u u p 2 u mu u q 2 u text in mathbb R 3 end equation under the normalized constraint int mathbb R 3 u 2 c 2 , where a ! !0 , b ! !0 , c ! !0 , 2 ! !q ! ! frac 14 3 ! ! p ! leq !6 or frac 14 3 ! !q ! ! p ! leq ! 6 , mu ! !0 and lambda ! in ! R appears as a Lagrange multiplier. In both cases for the range of p and q , the Sobolev critical exponent p ! !6 is involved and the corresponding energy functional is unbounded from below on S c Big u in H 1 ( mathbb R 3 ) int mathbb R 3 u 2 c 2 Big . If 2 ! !q ! ! frac 10 3 and frac 14 3 ! ! p ! !6 , we obtain a multiplicity result to the equation. If 2 ! !q ! ! frac 10 3 ! ! p ! !6 or frac 14 3 ! !q ! ! p ! leq ! 6 , we get a ground state solution to the equation. Furthermore, we derive several asymptotic results on the obtained normalized solutions. Our results extend the results of N. Soave (J. Differential Equations 2020 J. Funct. Anal. 2020), which studied the nonlinear Schr " o dinger equations with combined nonlinearities, to the Kirchhoff equations. To deal with the special difficulties created by the nonlocal term ( int R 3 left nabla u right 2 ) Delta u appearing in Kirchhoff type equations, we develop a perturbed Pohozaev constraint approach and we find a way to get a clear picture of the profile of the fiber map via careful analysis. In the meantime, we need some subtle energy estimates under the L 2 constraint to recover compactness in the Sobolev critical case.


Injecting Knowledge in Data driven Vehicle Trajectory Predictors. Vehicle trajectory prediction tasks have been commonly tackled from two distinct perspectives either with knowledge driven methods or more recently with data driven ones. On the one hand, we can explicitly implement domain knowledge or physical priors such as anticipating that vehicles will follow the middle of the roads. While this perspective leads to feasible outputs, it has limited performance due to the difficulty to hand craft complex interactions in urban environments. On the other hand, recent works use data driven approaches which can learn complex interactions from the data leading to superior performance. However, generalization, textit i.e. , having accurate predictions on unseen data, is an issue leading to unrealistic outputs. In this paper, we propose to learn a "Realistic Residual Block" (RRB), which effectively connects these two perspectives. Our RRB takes any off the shelf knowledge driven model and finds the required residuals to add to the knowledge aware trajectory. Our proposed method outputs realistic predictions by confining the residual range and taking into account its uncertainty. We also constrain our output with Model Predictive Control (MPC) to satisfy kinematic constraints. Using a publicly available dataset, we show that our method outperforms previous works in terms of accuracy and generalization to new scenes. We will release our code and data split here https github.com vita epfl RRB.


Adelfa A System for Reasoning about LF Specifications. We present a system called Adelfa that provides mechanized support for reasoning about specifications developed in the Edinburgh Logical Framework or LF. Underlying Adelfa is a new logic named L LF. Typing judgements in LF are represented by atomic formulas in L LF and quantification is permitted over contexts and terms that appear in such formulas. Contexts, which constitute type assignments to uniquely named variables that are modelled using the technical device of nominal constants, are characterized in L LF by context schemas that describe their inductive structure. We present these formulas and an associated semantics before sketching a proof system for constructing arguments that are sound with respect to the semantics. We then outline the realization of this proof system in Adelfa and illustrate its use through a few example proof developments. We conclude the paper by relating Adelfa to existing systems for reasoning about LF specifications.


Dynamic optimal transport on networks. In this paper we study a dynamical optimal transport problem on a network that allows for transport of mass between different edges if a penalty kappa is paid. We show existence of minimisers using duality and discuss the relationships of the distance functional to other metrics such as the Fisher Rao and the classical Wasserstein metric and analyse the resulting distance functional in the limiting case kappa rightarrow infty .


Existence of birational small Cohen Macaulay modules over biquadratic extensions in mixed characteristic. Let S be an unramified regular local ring of mixed characteristic two and R the integral closure of S in a biquadratic extension of its quotient field obtained by adjoining roots of sufficiently general square free elements f,g in S . Let S 2 denote the subring of S obtained by lifting to S the image of the Frobenius map on S 2S . When at least one of f,g in S 2 , we characterize the Cohen Macaulayness of R and show that R admits a birational small Cohen Macaulay module. It is noted that R is not automatically Cohen Macaulay in case f,g in S 2 or if f,g notin S 2 .


Representation by degenerate Frobenius Euler polynomials. The aim of this paper is to represent any polynomial in terms of the degenerate Frobenius Euler polynomials and more generally of the higher order degenerate Frobenius Euler polynomials. We derive explicit formulas with the help of umbral calculus and illustrate our results with some examples.


Consensus Control for Decentralized Deep Learning. Decentralized training of deep learning models enables on device learning over networks, as well as efficient scaling to large compute clusters. Experiments in earlier works reveal that, even in a data center setup, decentralized training often suffers from the degradation in the quality of the model the training and test performance of models trained in a decentralized fashion is in general worse than that of models trained in a centralized fashion, and this performance drop is impacted by parameters such as network size, communication topology and data partitioning. We identify the changing consensus distance between devices as a key parameter to explain the gap between centralized and decentralized training. We show in theory that when the training consensus distance is lower than a critical quantity, decentralized training converges as fast as the centralized counterpart. We empirically validate that the relation between generalization performance and consensus distance is consistent with this theoretical observation. Our empirical insights allow the principled design of better decentralized training schemes that mitigate the performance drop. To this end, we provide practical training guidelines and exemplify its effectiveness on the data center setup as the important first step.


Spectral optimization of inhomogeneous plates. This article is devoted to the study of spectral optimisation for inhomogeneous plates. In particular, we optimise the first eigenvalue of a vibrating plate with respect to its thickness and or density. Our result is threefold. First, we prove existence of an optimal thickness, using fine tools hinging on topological properties of rearrangement classes. Second, in the case of a circular plate, we provide a characterisation of this optimal thickness by means of Talenti inequalities. Finally, we prove a stability result when assuming that the thickness and the density of the plate are linearly related. This proof relies on H convergence tools applied to biharmonic operators.


Inference of Upcoming Human Grasp Using EMG During Reach to Grasp Movement. Electromyography (EMG) data has been extensively adopted as an intuitive interface for instructing human robot collaboration. A major challenge of the real time detection of human grasp intent is the identification of dynamic EMG from hand movements. Previous studies mainly implemented steady state EMG classification with a small number of grasp patterns on dynamic situations, which are insufficient to generate differentiated control regarding the muscular activity variation in practice. In order to better detect dynamic movements, more EMG variability could be integrated into the model. However, only limited research were concentrated on such detection of dynamic grasp motions, and most existing assessments on non static EMG classification either require supervised ground truth timestamps of the movement status, or only contain limited kinematic variations. In this study, we propose a framework for classifying dynamic EMG signals into gestures, and examine the impact of different movement phases, using an unsupervised method to segment and label the action transitions. We collected and utilized data from large gesture vocabularies with multiple dynamic actions to encode the transitions from one grasp intent to another based on common sequences of the grasp movements. The classifier for identifying the gesture label was constructed afterwards based on the dynamic EMG signal, with no supervised annotation of kinematic movements required. Finally, we evaluated the performances of several training strategies using EMG data from different movement phases, and explored the information revealed from each phase. All experiments were evaluated in a real time style with the performance transitions over time presented.


Feature extraction and evaluation for BioMedical Question Answering. In this paper, we present our work on the BioASQ pipeline. The goal is to answer four types of questions summary, yes no, factoids, and list. Our goal is to empirically evaluate different modules involved the feature extractor and the sentence selection block. We used our pipeline to test the effectiveness of each module for all kinds of question types and perform error analysis. We defined metrics that are useful for future research related to the BioASQ pipeline critical to improve the performance of the training pipeline.


Inelastic Neutron Scattering Analysis with Time Dependent Gaussian Field Models. Converting neutron scattering data to real space time dependent structures can only be achieved through suitable models, which is particularly challenging for geometrically disordered structures. We address this problem by introducing time dependent clipped Gaussian field models. General expressions are derived for all space and time correlation functions relevant to coherent inelastic neutron scattering, for multiphase systems and arbitrary scattering contrasts. Various dynamic models are introduced that enable one to add time dependence to any given spatial statistics, as captured e.g. by small angle scattering. In a first approach, the Gaussian field is decomposed into localised waves that are allowed to fluctuate in time or to move, either ballistically or diffusively. In a second approach, a dispersion relation is used to make the spectral components of the field time dependent. The various models lead to qualitatively different dynamics, which can be discriminated by neutron scattering. The methods of the paper are illustrated with oil water microemulsion studied by small angle scattering and neutron spin echo. All available data in both film and bulk contrasts, over the entire range of q and tau are analyzed jointly with a single model. The analysis points to static large scale structure of the oil and water domains, while the interfaces are subject to thermal fluctuations. The fluctuations have an amplitude around 6 nm and contribute to 30 of the total interface area.


Non almost regular quaternary m gonal forms. The maximal n which admits a non almost regular m gonal form of rank n is 4 . In this article, we consider the m gonal forms of rank 4 which is not almost regular.


Multi Valued Cognitive Maps Calculations with Linguistic Variables without Using Numbers. A concept of multi valued cognitive maps is introduced in this paper. The concept expands the fuzzy one. However, all variables and weights are not linearly ordered in the concept, but are only partially ordered. Such an ap proach allows us to operate in cognitive maps with partially ordered linguis tic variables directly, without vague fuzzification defuzzification methods. Hence, we may consider more subtle differences in degrees of experts' uncer tainty, than in the fuzzy case. We prove the convergence of such cognitive maps and give a simple computational example which demonstrates using such a partially ordered uncertainty degree scale.


Implementation and Parallel Optimization of the Lees Edwards Boundary Condition in ESPResSo . The Lees Edwards boundary condition (LEbc) was first developed by Lees and Edwards in 1970s. The current implementation of LEbc in the ESPResSo MD software package provides a new possibility in simulating molecular or coarse grained systems under such non equilibrium conditions, namely by introducing a shear flow which has potential applications in high speed fluids, thermoplastic and other non equilibrium processes etc. Using the LEbc code, shear flow simulations were carried out in model systems such as the Lennard Jones fluids and the Kremer Grest polymer melts. Some important physical properties and phenomena, including the linear profiles of shear velocities, non layered density distribution and shear thinning, are successfully reproduced or captured. Results also show in good agreement with those from the previous literature even with unphysical simulation conditions, which on the other side gives a solid validation to our implementation of LEbc. Regarding the high performance computing (HPC) environments, we considered in depth and paid efforts on the parallelization of the LEbc code in ESPResSo . By this, a modified scheme for data communication has been introduced within the framework of the domain decomposition. The benchmarks show a linear and good scaling for simulations which are parallelized up to 1024 processors in supercomputer systems.


FuseDream Training Free Text to Image Generation with Improved CLIP GAN Space Optimization. Generating images from natural language instructions is an intriguing yet highly challenging task. We approach text to image generation by combining the power of the retrained CLIP representation with an off the shelf image generator (GANs), optimizing in the latent space of GAN to find images that achieve maximum CLIP score with the given input text. Compared to traditional methods that train generative models from text to image starting from scratch, the CLIP GAN approach is training free, zero shot and can be easily customized with different generators. However, optimizing CLIP score in the GAN space casts a highly challenging optimization problem and off the shelf optimizers such as Adam fail to yield satisfying results. In this work, we propose a FuseDream pipeline, which improves the CLIP GAN approach with three key techniques 1) an AugCLIP score which robustifies the CLIP objective by introducing random augmentation on image. 2) a novel initialization and over parameterization strategy for optimization which allows us to efficiently navigate the non convex landscape in GAN space. 3) a composed generation technique which, by leveraging a novel bi level optimization formulation, can compose multiple images to extend the GAN space and overcome the data bias. When promoted by different input text, FuseDream can generate high quality images with varying objects, backgrounds, artistic styles, even novel counterfactual concepts that do not appear in the training data of the GAN we use. Quantitatively, the images generated by FuseDream yield top level Inception score and FID score on MS COCO dataset, without additional architecture design or training. Our code is publicly available at url https github.com gnobitab FuseDream .


Facets and facet subgraphs of adjacency polytopes. Adjacency polytopes, a.k.a. symmetric edge polytopes, associated with undirected graphs have been defined and studied in several seemingly independent areas including number theory, discrete geometry, and dynamical systems. In particular, the authors are motivated by the study of the algebraic Kuramoto equations of unmixed form whose Newton polytopes are the adjacency polytopes. The interplay between the geometric structure of adjacency polytopes and the topological structure of the underlying graphs is a recurring theme in recent studies. In particular, "facet face subgraphs" emerged as one of the central concepts in describing this symmetry. Continuing along this line of inquiry we provide a complete description of the correspondence between facets faces of an adjacency polytope and maximal bipartite subgraphs of the underlying connected graph.


Learning invariance preserving moment closure model for Boltzmann BGK equation. As one of the main governing equations in kinetic theory, the Boltzmann equation is widely utilized in aerospace, microscopic flow, etc. Its high resolution simulation is crucial in these related areas. However, due to the high dimensionality of the Boltzmann equation, high resolution simulations are often difficult to achieve numerically. The moment method which was first proposed by Grad is among the popular numerical methods to achieve efficient high resolution simulations. We can derive the governing equations in the moment method by taking moments on both sides of the Boltzmann equation, which effectively reduces the dimensionality of the problem. However, one of the main challenges is that it leads to an unclosed moment system, and closure is needed to obtain a closed moment system. It is truly an art in designing closures for moment systems and has been a significant research field in kinetic theory. Other than the traditional human designs of closures, the machine learning based approach has attracted much attention lately in Han et al. and Huang et al. In this work, we propose a machine learning based method to derive a moment closure model for the Boltzmann BGK equation. In particular, the closure relation is approximated by a carefully designed deep neural network that possesses desirable physical invariances, i.e., the Galilean invariance, reflecting invariance, and scaling invariance, inherited from the original Boltzmann BGK equation and playing an important role in the correct simulation of the Boltzmann equation. Numerical simulations on the 1D 1D examples including the smooth and discontinuous initial condition problems, Sod shock tube problem, the shock structure problems, and the 1D 3D examples including the smooth and discontinuous problems demonstrate satisfactory numerical performances of the proposed invariance preserving neural closure method.


Towards Modularity Optimization Using Reinforcement Learning to Community Detection in Dynamic Social Networks. The identification of community structure in a social network is an important problem tackled in the literature of network analysis. There are many solutions to this problem using a static scenario, when facing a dynamic scenario some solutions may be adapted but others simply do not fit, moreover when considering the demand to analyze constantly growing networks. In this context, we propose an approach to the problem of community detection in dynamic networks based on a reinforcement learning strategy to deal with changes on big networks using a local optimization on the modularity score of the changed entities. An experiment using synthetic and real world dynamic network data shows results comparable to static scenarios.


Construction of simple quotients of Bernstein Zelevinsky derivatives and highest derivative multisegments. Let F be a non Archimedean field. A sequence of derivatives of generalized Steinberg representations can be used to construct simple quotients of Bernstein Zelevinsky derivatives of irreducible representations of mathrm GL n(F) . We introduce a notion of a highest derivative multisegment and use it to give a combinatorial criteria when two sequences of derivatives of generalized Steinberg representations give rise isomorphic simple quotients of Bernstein Zelevinsky derivatives of an irreducible representation. We also show a certain uniqueness statement which hence gives a canonical sequence and show that such sequence possesses several useful properties. Those results can be translated to affine Hecke algebra of type A, by using our previous formulation of Bernstein Zelevinsky derivatives in affine Hecke algebra of type A setting.


Convergence of Anisotropic Consensus Based Optimization in Mean Field Law. In this paper we study anisotropic consensus based optimization (CBO), a multi agent metaheuristic derivative free optimization method capable of globally minimizing nonconvex and nonsmooth functions in high dimensions. CBO is based on stochastic swarm intelligence, and inspired by consensus dynamics and opinion formation. Compared to other metaheuristic algorithms like particle swarm optimization, CBO is of a simpler nature and therefore more amenable to theoretical analysis. By adapting a recently established proof technique, we show that anisotropic CBO converges globally with a dimension independent rate for a rich class of objective functions under minimal assumptions on the initialization of the method. Moreover, the proof technique reveals that CBO performs a convexification of the optimization problem as the number of agents goes to infinity, thus providing an insight into the internal CBO mechanisms responsible for the success of the method. To motivate anisotropic CBO from a practical perspective, we further test the method on a complicated high dimensional benchmark problem, which is well understood in the machine learning literature.


Distinct Angle Problems and Variants. The Erd H o s distinct distance problem is a ubiquitous problem in discrete geometry. Less well known is Erd H o s' distinct angle problem, the problem of finding the minimum number of distinct angles between n non collinear points in the plane. The standard problem is already well understood. However, it admits many of the same variants as the distinct distance problem, many of which are unstudied. We provide upper and lower bounds on a broad class of distinct angle problems. We show that the number of distinct angles formed by n points in general position is O(n log 2(7) ) , providing the first non trivial bound for this quantity. We introduce a new class of asymptotically optimal point configurations with no four cocircular points. Then, we analyze the sensitivity of asymptotically optimal point sets to perturbation, yielding a much broader class of asymptotically optimal configurations. In higher dimensions we show that a variant of Lenz's construction admits fewer distinct angles than the optimal configurations in two dimensions. We also show that the minimum size of a maximal subset of n points in general position admitting only unique angles is Omega(n 1 5 ) and O(n log 2(7) 3 ) . We also provide bounds on the partite variants of the standard distinct angle problem.


Understanding the Effects of Dataset Characteristics on Offline Reinforcement Learning. In real world, affecting the environment by a weak policy can be expensive or very risky, therefore hampers real world applications of reinforcement learning. Offline Reinforcement Learning (RL) can learn policies from a given dataset without interacting with the environment. However, the dataset is the only source of information for an Offline RL algorithm and determines the performance of the learned policy. We still lack studies on how dataset characteristics influence different Offline RL algorithms. Therefore, we conducted a comprehensive empirical analysis of how dataset characteristics effect the performance of Offline RL algorithms for discrete action environments. A dataset is characterized by two metrics (1) the average dataset return measured by the Trajectory Quality (TQ) and (2) the coverage measured by the State Action Coverage (SACo). We found that variants of the off policy Deep Q Network family require datasets with high SACo to perform well. Algorithms that constrain the learned policy towards the given dataset perform well for datasets with high TQ or SACo. For datasets with high TQ, Behavior Cloning outperforms or performs similarly to the best Offline RL algorithms.


Anomaly Detection in Particle Accelerators using Autoencoders. The application of machine learning techniques for anomaly detection in particle accelerators has gained popularity in recent years. These efforts have ranged from the analysis of quenches in radio frequency cavities and superconducting magnets to anomalous beam position monitors, and even losses in rings. Using machine learning for anomaly detection can be challenging owing to the inherent imbalance in the amount of data collected during normal operations as compared to during faults. Additionally, the data are not always labeled and therefore supervised learning is not possible. Autoencoders, neural networks that form a compressed representation and reconstruction of the input data, are a useful tool for such situations. Here we explore the use of autoencoder reconstruction analysis for the prediction of magnet faults in the Advanced Photon Source (APS) storage ring at Argonne National Laboratory.


Exponential stability of linear systems under a class of Desch Schappacher perturbations. In this paper we investigate the uniform exponential stability of the system frac dx(t) dt Ax(t) rho Bx(t), ( rho 0), where the unbounded operator A is the infinitesimal generator of a linear C 0 semigroup of contractions S(t) in a Hilbert space X and B is a Desch Schappacher operator. Then we give sufficient conditions for exponential stability of the above system. The obtained stability result is then applied to show the uniform exponential stabilization of bilinear partial differential equations.


Operator spaces with the WEP, the OLLP and the Gurarii property. We construct non exact operator spaces satisfying the Weak Expectation Property (WEP) and the Operator space version of the Local Lifting Property (OLLP). These examples should be compared with the example we recently gave of a C algebra with WEP and LLP. The construction produces several new analogues among operator spaces of the Gurarii space, extending Oikhberg's previous work. Each of our "Gurarii operator spaces" is associated to a class of finite dimensional operator spaces (with suitable properties). In each case we show the space exists and is unique up to completely isometric isomorphism.


Location Prediction via Bi direction Speculation and Dual level Association. Location prediction is of great importance in location based applications for the construction of the smart city. To our knowledge, existing models for location prediction focus on users' preferences on POIs from the perspective of the human side. However, modeling users' interests from the historical trajectory is still limited by the data sparsity. Additionally, most of existing methods predict the next location according to the individual data independently, but the data sparsity makes it difficult to mine explicit mobility patterns or capture the casual behavior for each user. To address the issues above, we propose a novel Bi direction Speculation and Dual level Association method (BSDA), which considers both users' interests in POIs and POIs' appeal to users. Furthermore, we develop the cross user and cross POI association to alleviate the data sparsity by similar users and POIs to enrich the candidates. Experimental results on two public datasets demonstrate that BSDA achieves significant improvements over state of the art methods.


Image reconstruction in light sheet microscopy spatially varying deconvolution and mixed noise. We study the problem of deconvolution for light sheet microscopy, where the data is corrupted by spatially varying blur and a combination of Poisson and Gaussian noise. The spatial variation of the point spread function (PSF) of a light sheet microscope is determined by the interaction between the excitation sheet and the detection objective PSF. First, we introduce a model of the image formation process that incorporates this interaction, therefore capturing the main characteristics of this imaging modality. Then, we formulate a variational model that accounts for the combination of Poisson and Gaussian noise through a data fidelity term consisting of the infimal convolution of the single noise fidelities, first introduced in L. Calatroni et al. "Infimal convolution of data discrepancies for mixed noise removal", SIAM Journal on Imaging Sciences 10.3 (2017), 1196 1233. We establish convergence rates in a Bregman distance under a source condition for the infimal convolution fidelity and a discrepancy principle for choosing the value of the regularisation parameter. The inverse problem is solved by applying the primal dual hybrid gradient (PDHG) algorithm in a novel way. Finally, numerical experiments performed on both simulated and real data show superior reconstruction results in comparison with other methods.


ppAURORA Privacy Preserving Area Under Receiver Operating Characteristic and Precision Recall Curves with Secure 3 Party Computation. Computing an AUC as a performance measure to compare the quality of different machine learning models is one of the final steps of many research projects. Many of these methods are trained on privacy sensitive data and there are several different approaches like epsilon differential privacy, federated machine learning and methods based on cryptographic approaches if the datasets cannot be shared or evaluated jointly at one place. In this setting, it can also be a problem to compute the global performance measure like an AUC, since the labels might also contain privacy sensitive information. There have been approaches based on epsilon differential privacy to deal with this problem, but to the best of our knowledge, no exact privacy preserving solution has been introduced. In this paper, we propose an MPC based framework, called fw , with private merging of sorted lists and novel methods for comparing two secret shared values, selecting between two secret shared values, converting the modulus, and performing division to compute the exact AUC as one could obtain on the pooled original test samples. With fw computation of the exact area under precision recall curve and receiver operating characteristic curve is even possible when ties between prediction confidence values exist. To show the applicability of fw , we use it to evaluate a model trained to predict acute myeloid leukemia therapy response and we also assess its scalability via experiments on synthetic data. The experiments show that we efficiently compute exactly the same AUC with both evaluation metrics in a privacy preserving manner as one can obtain on the pooled test samples in the plaintext domain. Our solution provides security against semi honest corruption of at most one of the servers performing the secure computation.


Leave No User Behind Towards Improving the Utility of Recommender Systems for Non mainstream Users. In a collaborative filtering recommendation scenario, biases in the data will likely propagate in the learned recommendations. In this paper we focus on the so called mainstream bias the tendency of a recommender system to provide better recommendations to users who have a mainstream taste, as opposed to non mainstream users. We propose NAECF, a conceptually simple but effective idea to address this bias. The idea consists of adding an autoencoder (AE) layer when learning user and item representations with text based Convolutional Neural Networks. The AEs, one for the users and one for the items, serve as adversaries to the process of minimizing the rating prediction error when learning how to recommend. They enforce that the specific unique properties of all users and items are sufficiently well incorporated and preserved in the learned representations. These representations, extracted as the bottlenecks of the corresponding AEs, are expected to be less biased towards mainstream users, and to provide more balanced recommendation utility across all users. Our experimental results confirm these expectations, significantly improving the recommendations for non mainstream users while maintaining the recommendation quality for mainstream users. Our results emphasize the importance of deploying extensive content based features, such as online reviews, in order to better represent users and items to maximize the de biasing effect.


Emotion Ratings How Intensity, Annotation Confidence and Agreements are Entangled. When humans judge the affective content of texts, they also implicitly assess the correctness of such judgment, that is, their confidence. We hypothesize that people's (in)confidence that they performed well in an annotation task leads to (dis)agreements among each other. If this is true, confidence may serve as a diagnostic tool for systematic differences in annotations. To probe our assumption, we conduct a study on a subset of the Corpus of Contemporary American English, in which we ask raters to distinguish neutral sentences from emotion bearing ones, while scoring the confidence of their answers. Confidence turns out to approximate inter annotator disagreements. Further, we find that confidence is correlated to emotion intensity perceiving stronger affect in text prompts annotators to more certain classification performances. This insight is relevant for modelling studies of intensity, as it opens the question wether automatic regressors or classifiers actually predict intensity, or rather human's self perceived confidence.


Computing semigroups with error control. We develop an algorithm that computes strongly continuous semigroups on infinite dimensional Hilbert spaces with explicit error control. Given a generator A , a time t 0 , an arbitrary initial vector u 0 and an error tolerance epsilon 0 , the algorithm computes exp(tA)u 0 with error bounded by epsilon . The algorithm is based on a combination of a regularized functional calculus, suitable contour quadrature rules, and the adaptive computation of resolvents in infinite dimensions. As a particular case, we show that it is possible, even when only allowing pointwise evaluation of coefficients, to compute, with error control, semigroups on the unbounded domain L 2( mathbb R d) that are generated by partial differential operators with polynomially bounded coefficients of locally bounded total variation. For analytic semigroups (and more general Laplace transform inversion), we provide a quadrature rule whose error decreases like exp( cN log(N)) for N quadrature points, that remains stable as N rightarrow infty , and which is also suitable for infinite dimensional operators. Numerical examples are given, including Schr "odinger and wave equations on the aperiodic Ammann Beenker tiling, complex perturbed fractional diffusion equations on L 2( mathbb R ) , and damped Euler Bernoulli beam equations.


Risk Aware Motion Planning in Partially Known Environments. Recent trends envisage robots being deployed in areas deemed dangerous to humans, such as buildings with gas and radiation leaks. In such situations, the model of the underlying hazardous process might be unknown to the agent a priori, giving rise to the problem of planning for safe behaviour in partially known environments. We employ Gaussian process regression to create a probabilistic model of the hazardous process from local noisy samples. The result of this regression is then used by a risk metric, such as the Conditional Value at Risk, to reason about the safety at a certain state. The outcome is a risk function that can be employed in optimal motion planning problems. We demonstrate the use of the proposed function in two approaches. First is a sampling based motion planning algorithm with an event based trigger for online replanning. Second is an adaptation to the incremental Gaussian Process motion planner (iGPMP2), allowing it to quickly react and adapt to the environment. Both algorithms are evaluated in representative simulation scenarios, where they demonstrate the ability of avoiding high risk areas.


Towards Reusable Surrogate Models Graph Based Transfer Learning on Trusses. Surrogate models have several uses in engineering design, including speeding up design optimization, noise reduction, test measurement interpolation, gradient estimation, portability, and protection of intellectual property. Traditionally, surrogate models require that all training data conform to the same parametrization (e.g. design variables), limiting design freedom and prohibiting the reuse of historical data. In response, this paper proposes Graph based Surrogate Models (GSMs) for trusses. The GSM can accurately predict displacement fields from static loads given the structure's geometry as input, enabling training across multiple parametrizations. GSMs build upon recent advancements in geometric deep learning which have led to the ability to learn on undirected graphs a natural representation for trusses. To further promote flexible surrogate models, the paper explores transfer learning within the context of engineering design, and demonstrates positive knowledge transfer across data sets of different topologies, complexities, loads and applications, resulting in more flexible and data efficient surrogate models for trusses.


Formalizing relations in type theory. Type theory plays an important role in foundations of mathematics as a framework for formalizing mathematics and a base for proof assistants providing semi automatic proof checking and construction. Derivation of each theorem in type theory results in a formal term encapsulating the whole proof process. In this paper we use a variant of type theory, namely the Calculus of Constructions with Definitions, to formalize the standard theory of binary relations. This includes basic operations on relations, criteria for special properties of relations, invariance of these properties under the basic operations, equivalence relation, well ordering, and transfinite induction. Definitions and proofs are presented as flag style derivations.