Fair Robust Assignment using Redundancy. We study the consideration of fairness in redundant assignment for multi agent task allocation. It has recently been shown that redundant assignment of agents to tasks provides robustness to uncertainty in task performance. However, the question of how to fairly assign these redundant resources across tasks remains unaddressed. In this paper, we present a novel problem formulation for fair redundant task allocation, which we cast as the optimization of worst case task costs under a cardinality constraint. Solving this problem optimally is NP hard. We exploit properties of supermodularity to propose a polynomial time, near optimal solution. In supermodular redundant assignment, the use of additional agents always improves task costs. Therefore, we provide a solution set that is alpha times larger than the cardinality constraint. This constraint relaxation enables our approach to achieve a super optimal cost by using a sub optimal assignment size. We derive the sub optimality bound on this cardinality relaxation, alpha . Additionally, we demonstrate that our algorithm performs near optimally without the cardinality relaxation. We show simulations of redundant assignments of robots to goal nodes on transport networks with uncertain travel times. Empirically, our algorithm outperforms benchmarks, scales to large problems, and provides improvements in both fairness and average utility.


An Augmented Lagrangian Method for Optimization Problems with Structured Geometric Constraints. This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints are nonconvex and possibly complicated, but allow for a fast computation of projections onto this nonconvex set. Typical problem classes which satisfy this requirement are optimization problems with disjunctive constraints (like complementarity or cardinality constraints) as well as optimization problems over sets of matrices which have to satisfy additional rank constraints. The key idea behind our method is to keep these complicated constraints explicitly in the constraints and to penalize only the remaining constraints by an augmented Lagrangian function. The resulting subproblems are then solved with the aid of a problem tailored nonmonotone projected gradient method. The corresponding convergence theory allows for an inexact solution of these subproblems. Nevertheless, the overall algorithm computes so called Mordukhovich stationary points of the original problem under a mild asymptotic regularity condition, which is generally weaker than most of the respective available problem tailored constraint qualifications. Extensive numerical experiments addressing complementarity and cardinality constrained optimization problems as well as a semidefinite reformulation of MAXCUT problems visualize the power of our approach.


Minimizing Communication while Maximizing Performance in Multi Agent Reinforcement Learning. Inter agent communication can significantly increase performance in multi agent tasks that require co ordination to achieve a shared goal. Prior work has shown that it is possible to learn inter agent communication protocols using multi agent reinforcement learning and message passing network architectures. However, these models use an unconstrained broadcast communication model, in which an agent communicates with all other agents at every step, even when the task does not require it. In real world applications, where communication may be limited by system constraints like bandwidth, power and network capacity, one might need to reduce the number of messages that are sent. In this work, we explore a simple method of minimizing communication while maximizing performance in multi task learning simultaneously optimizing a task specific objective and a communication penalty. We show that the objectives can be optimized using Reinforce and the Gumbel Softmax reparameterization. We introduce two techniques to stabilize training 50 training and message forwarding. Training with the communication penalty on only 50 of the episodes prevents our models from turning off their outgoing messages. Second, repeating messages received previously helps models retain information, and further improves performance. With these techniques, we show that we can reduce communication by 75 with no loss of performance.


Shock and shear layer interaction in a confined supersonic cavity flow. The impinging shock of varying strengths on the free shear layer in a confined supersonic cavity flow is studied numerically using the detached eddy simulation. The resulting spatiotemporal variations are analyzed between the different cases using unsteady statistics, x t diagrams, spectral analysis, and modal decomposition. A cavity of length to depth ratio L D 2 at a freestream Mach number of M infty 1.71 is considered to be in a confined passage. Impinging shock strength is controlled by changing the ramp angle ( theta ) on the top wall. The static pressure ratio across the impinging shock ( p 2 p 1 ) is used to quantify the impinging shock strength. Five different impinging shock strengths are studied by changing the pressure ratio 1.0,1.2,1.5,1.7 and 2.0 . As the pressure ratio increases from 1.0 to 2.0, the cavity wall experiences a maximum pressure of 25 due to shock loading. At p 2 p 1 1.5 , fundamental fluidic mode or Rossiter's frequency corresponding to n 1 mode vanishes whereas frequencies correspond to higher modes ( n 2 and 4 ) resonate. Wavefronts interaction from the longitudinal reflections inside the cavity with the transverse disturbances from the shock shear layer interactions is identified to drive the strong resonant behavior. Due to Mach reflections inside the confined passage at p 2 p 1 2.0 , shock cavity resonance is lost. Based on the present findings, an idea to use a shock laden confined cavity flow in an enclosed supersonic wall jet configuration as passive flow control or a fluidic device is also demonstrated.


HIPPODROME Data Race Repair using Static Analysis Summaries. Implementing bug free concurrent programs is a challenging task in modern software development. State of the art static analyses find hundreds of concurrency bugs in production code, scaling to large codebases. Yet, fixing these bugs in constantly changing codebases represents a daunting effort for programmers, particularly because a fix in the concurrent code can introduce other bugs in a subtle way. In this work, we show how to harness compositional static analysis for concurrency bug detection, to enable a new Automated Program Repair (APR) technique for data races in large concurrent Java codebases. The key innovation of our work is an algorithm that translates procedure summaries inferred by the analysis tool for the purpose of bug reporting, into small local patches that fix concurrency bugs (without introducing new ones). This synergy makes it possible to extend the virtues of compositional static concurrency analysis to APR, making our approach effective (it can detect and fix many more bugs than existing tools for data race repair), scalable (it takes seconds to analyse and suggest fixes for sizeable codebases), and usable (generally, it does not require annotations from the users and can perform continuous automated repair). Our study conducted on popular open source projects has confirmed that our tool automatically produces concurrency fixes similar to those proposed by the developers in the past.


All Day Object Tracking for Unmanned Aerial Vehicle. Visual object tracking, which is representing a major interest in image processing field, has facilitated numerous real world applications. Among them, equipping unmanned aerial vehicle (UAV) with real time robust visual trackers for all day aerial maneuver, is currently attracting incremental attention and has remarkably broadened the scope of applications of object tracking. However, prior tracking methods have merely focused on robust tracking in the well illuminated scenes, while ignoring trackers' capabilities to be deployed in the dark. In darkness, the conditions can be more complex and harsh, easily posing inferior robust tracking or even tracking failure. To this end, this work proposed a novel discriminative correlation filter based tracker with illumination adaptive and anti dark capability, namely ADTrack. ADTrack firstly exploits image illuminance information to enable adaptability of the model to the given light condition. Then, by virtue of an efficient and effective image enhancer, ADTrack carries out image pretreatment, where a target aware mask is generated. Benefiting from the mask, ADTrack aims to solve a dual regression problem where dual filters, i.e., the context filter and target focused filter, are trained with mutual constraint. Thus ADTrack is able to maintain continuously favorable performance in all day conditions. Besides, this work also constructed one UAV nighttime tracking benchmark UAVDark135, comprising of more than 125k manually annotated frames, which is also very first UAV nighttime tracking benchmark. Exhaustive experiments are extended on authoritative daytime benchmarks, i.e., UAV123 10fps, DTB70, and the newly built dark benchmark UAVDark135, which have validated the superiority of ADTrack in both bright and dark conditions on a single CPU.


On an innovative architecture for digital immunity passports and vaccination certificates. With the COVID 19 pandemic entering a second phase and vaccination strategies being applied by countries and governments worldwide, there is an increasing expectation by people to return to normal life. There is currently a debate about immunity passports, privacy, and the enablement of individuals to safely enter everyday social life, workplace, and travel. Such digital immunity passports and vaccination certificates should meet people's expectations for privacy while enabling them to present to 3rd party verifiers tamper evident credentials. This paper provides a comprehensive answer to the technological, ethical and security challenges, by proposing an architecture that provides to individuals, employers, and government agencies, a digital, decentralized, portable, immutable, and non refutable health status cryptographic proof. It can be used to evaluate the risk of allowing individuals to return to work, travel, and public life activities.


Probing to Minimize. We develop approximation algorithms for set selection problems with deterministic constraints, but random objective values, i.e., stochastic probing problems. When the goal is to maximize the objective, approximation algorithms for probing problems are well studied. On the other hand, few techniques are known for minimizing the objective, especially in the adaptive setting, where information about the random objective is revealed during the set selection process and allowed to influence it. For minimization problems in particular, incorporating adaptivity can have a considerable effect on performance. In this work, we seek approximation algorithms that compare well to the optimal adaptive policy. We develop new techniques for adaptive minimization, applying them to a few problems of interest. The core technique we develop here is an approximate reduction from an adaptive expectation minimization problem to a set of adaptive probability minimization problems which we call threshold problems. By providing near optimal solutions to these threshold problems, we obtain bicriteria adaptive policies. We apply this method to obtain an adaptive approximation algorithm for the MIN ELEMENT problem, where the goal is to adaptively pick random variables to minimize the expected minimum value seen among them, subject to a knapsack constraint. This partially resolves an open problem raised in Goel et. al's "How to probe for an extreme value". We further consider three extensions on the MIN ELEMENT problem, where our objective is the sum of the smallest k element weights, or the weight of the min weight basis of a given matroid, or where the constraint is not given by a knapsack but by a matroid constraint. For all three variations we explore, we develop adaptive approximation algorithms for their corresponding threshold problems, and prove their near optimality via coupling arguments.


Quasi stationary distributions of multi dimensional diffusion processes. The present paper is devoted to the investigation of the long term behavior of a class of singular multi dimensional diffusion processes that get absorbed in finite time with probability one. Our focus is on the analysis of quasi stationary distributions (QSDs), which describe the long term behavior of the system conditioned on not being absorbed. Under natural Lyapunov conditions, we construct a QSD and prove the sharp exponential convergence to this QSD for compactly supported initial distributions. Under stronger Lyapunov conditions ensuring that the diffusion process comes down from infinity, we show the uniqueness of a QSD and the exponential convergence to the QSD for all initial distributions. Our results can be seen as the multi dimensional generalization of Cattiaux et al (Ann. Prob. 2009) as well as the complement to Hening and Nguyen (Ann. Appl. Prob. 2018) which looks at the long term behavior of multi dimensional diffusions that can only become extinct asymptotically. The centerpiece of our approach concerns a uniformly elliptic operator that we relate to the generator, or the Fokker Planck operator, associated to the diffusion process. This operator only has singular coefficients in its zeroth order terms and can be handled more easily than the generator. For this operator, we establish the discreteness of its spectrum, its principal spectral theory, the stochastic representation of the semigroup generated by it, and the global regularity for the associated parabolic equation. We show how our results can be applied to most ecological models, among which cooperative, competitive, and predator prey Lotka Volterra systems.


Tactical Reframing of Online Disinformation Campaigns Against The Istanbul Convention. In March 2021, Turkey withdrew from The Istanbul Convention, a human rights treaty that addresses violence against women, citing issues with the convention's implicit recognition of sexual and gender minorities. In this work, we trace disinformation campaigns related to the Istanbul Convention and its associated Turkish law that circulate on divorced men's rights Facebook groups. We find that these groups adjusted the narrative and focus of the campaigns to appeal to a larger audience, which we refer to as "tactical reframing." Initially, the men organized in a grass roots manner to campaign against the Turkish law that was passed to codify the convention, focusing on one sided custody of children and indefinite alimony. Later, they reframed their campaign and began attacking the Istanbul Convention, highlighting its acknowledgment of homosexuality. This case study highlights how disinformation campaigns can be used to weaponize homophobia in order to limit the rights of women. To the best of our knowledge, this is the first case study that analyzes a narrative reframing in the context of a disinformation campaign on social media.


A Gradient Method for Multilevel Optimization. Although application examples of multilevel optimization have already been discussed since the 1990s, the development of solution methods was almost limited to bilevel cases due to the difficulty of the problem. In recent years, in machine learning, Franceschi et al. have proposed a method for solving bilevel optimization problems by replacing their lower level problems with the T steepest descent update equations with some prechosen iteration number T . In this paper, we have developed a gradient based algorithm for multilevel optimization with n levels based on their idea and proved that our reformulation asymptotically converges to the original multilevel problem. As far as we know, this is one of the first algorithms with some theoretical guarantee for multilevel optimization. Numerical experiments show that a trilevel hyperparameter learning model considering data poisoning produces more stable prediction results than an existing bilevel hyperparameter learning model in noisy data settings.


BAANet Learning Bi directional Adaptive Attention Gates for Multispectral Pedestrian Detection. Thermal infrared (TIR) image has proven effectiveness in providing temperature cues to the RGB features for multispectral pedestrian detection. Most existing methods directly inject the TIR modality into the RGB based framework or simply ensemble the results of two modalities. This, however, could lead to inferior detection performance, as the RGB and TIR features generally have modality specific noise, which might worsen the features along with the propagation of the network. Therefore, this work proposes an effective and efficient cross modality fusion module called Bi directional Adaptive Attention Gate (BAA Gate). Based on the attention mechanism, the BAA Gate is devised to distill the informative features and recalibrate the representations asymptotically. Concretely, a bi direction multi stage fusion strategy is adopted to progressively optimize features of two modalities and retain their specificity during the propagation. Moreover, an adaptive interaction of BAA Gate is introduced by the illumination based weighting strategy to adaptively adjust the recalibrating and aggregating strength in the BAA Gate and enhance the robustness towards illumination changes. Considerable experiments on the challenging KAIST dataset demonstrate the superior performance of our method with satisfactory speed.


Categorical models of unstable G global homotopy theory. We prove that the category textbf G Cat of small categories with G action forms a model of unstable G global homotopy theory for every discrete group G , generalizing Schwede's global model structure on textbf Cat . As a consequence, we prove that textbf G Cat models proper G equivariant homotopy theory not only when we test weak equivalences on fixed points, but also when we test them on categorical homotopy fixed points.


Dissipativity and optimal control. The close link between dissipativity and optimal control is already apparent in Jan C. Willems' first papers on the subject. In recent years, research on this link has been revived with a particular focus on nonlinear problems and applications in model predictive control (MPC). This paper surveys these recent developments and some of Willems' and other authors' earlier results.


Locating Language Specific Information in Contextualized Embeddings. Multilingual pretrained language models (MPLMs) exhibit multilinguality and are well suited for transfer across languages. Most MPLMs are trained in an unsupervised fashion and the relationship between their objective and multilinguality is unclear. More specifically, the question whether MPLM representations are language agnostic or they simply interleave well with learned task prediction heads arises. In this work, we locate language specific information in MPLMs and identify its dimensionality and the layers where this information occurs. We show that language specific information is scattered across many dimensions, which can be projected into a linear subspace. Our study contributes to a better understanding of MPLM representations, going beyond treating them as unanalyzable blobs of information.


physics.flu-dyn physics.app-ph physics.bio-ph physics.ins-det

A Swimming Rheometer Self propulsion of a freely suspended swimmer enabled by viscoelastic normal stresses. Self propulsion at low Reynolds number is notoriously restricted, a concept that is commonly known as the "scallop theorem". Here we present a truly self propelled swimmer (force and torque free) that, while unable to swim in a Newtonian fluid due to the scallop theorem, propels itself in a non Newtonian fluid as a result of fluid elasticity. This propulsion mechanism is demonstrated using a robotic swimmer, comprised of a "head" sphere and a "tail" sphere, whose swimming speed is shown to have reasonable agreement with a microhydrodynamic asymptotic theory and numerical simulations. Schlieren imaging demonstrates that propulsion of the swimmer is driven by a strong viscoelastic jet at the tail, which develops due to the fore aft asymmetry of the swimmer. Optimized cylindrical and conic tail geometries are shown to double the propulsive signal, relative to the optimal spherical tail. Finally, we show that we can use observations of this robot to infer rheological properties of the surrounding fluid. We measure the primary normal stress coefficient at shear rates less than 1 Hz, and show reasonable agreement with extrapolated benchtop measurements (between 0.8 to 1.2 Pa sec2 difference). We also discuss how our swimmer can be used to measure the second normal stress coefficient and other rheological properties. The study experimentally demonstrates the exciting potential for a "swimming rheometer", bringing passive physics driven fluid sensing to numerous applications in chemical and bioengineering.


Social Neuro AI Social Interaction as the "dark matter" of AI. This article introduces a three axis framework indicating how AI can be informed by biological examples of social learning mechanisms. We argue that the complex human cognitive architecture owes a large portion of its expressive power to its ability to engage in social and cultural learning. However, the field of AI has mostly embraced a solipsistic perspective on intelligence. We thus argue that social interactions not only are largely unexplored in this field but also are an essential element of advanced cognitive ability, and therefore constitute metaphorically the dark matter of AI. In the first section, we discuss how social learning plays a key role in the development of intelligence. We do so by discussing social and cultural learning theories and empirical findings from social neuroscience. Then, we discuss three lines of research that fall under the umbrella of Social NeuroAI and can contribute to developing socially intelligent embodied agents in complex environments. First, neuroscientific theories of cognitive architecture, such as the global workspace theory and the attention schema theory, can enhance biological plausibility and help us understand how we could bridge individual and social theories of intelligence. Second, intelligence occurs in time as opposed to over time, and this is naturally incorporated by dynamical systems. Third, embodiment has been demonstrated to provide more sophisticated array of communicative signals. To conclude, we discuss the example of active inference, which offers powerful insights for developing agents that possess biological realism, can self organize in time, and are socially embodied.


An improved Liouville type theorem for Beltrami flows. In this note, we improved the Liouville type theorem for the Beltrami flows. Two different methods are used to prove it. One is the monotonicity method, and the other is proof by contradiction. The conditions that we proposed on Beltrami flows are significantly weaker than previously known conditions.


A complex network approach to time series analysis with application in diagnosis of neuromuscular disorders. Electromyography (EMG) refers to a biomedical signal indicating neuromuscular activity and muscle morphology. Experts accurately diagnose neuromuscular disorders using this time series. Modern data analysis techniques have recently led to introducing novel approaches for mapping time series data to graphs and complex networks with applications in diverse fields, including medicine. The resulting networks develop a completely different visual acuity that can be used to complement physician findings of time series. This can lead to a more enriched analysis, reduced error, more accurate diagnosis of the disease, and increased accuracy and speed of the treatment process. The mapping process may cause the loss of essential data from the time series and not retain all the time series features. As a result, achieving an approach that can provide a good representation of the time series while maintaining essential features is crucial. This paper proposes a new approach to network development named GraphTS to overcome the limited accuracy of existing methods through EMG time series using the visibility graph method. For this purpose, EMG signals are pre processed and mapped to a complex network by a standard visibility graph algorithm. The resulting networks can differentiate between healthy and patient samples. In the next step, the properties of the developed networks are given in the form of a feature matrix as input to classifiers after extracting optimal features. Performance evaluation of the proposed approach with deep neural network shows 99.30 accuracy for training data and 99.18 for test data. Therefore, in addition to enriched network representation and covering the features of time series for healthy, myopathy, and neuropathy EMG, the proposed technique improves accuracy, precision, recall, and F score.


An expressiveness hierarchy of Behavior Trees and related architectures. In this paper we provide a formal framework for comparing the expressive power of Behavior Trees (BTs) to other action selection architectures. Taking inspiration from the analogous comparisons of structural programming methodologies, we formalise the concept of expressiveness'. This leads us to an expressiveness hierarchy of control architectures, which includes BTs, Decision Trees (DTs), Teleo reactive Programs (TRs) and Finite State Machines (FSMs). By distinguishing between BTs with auxiliary variables and those without, we demonstrate the existence of a trade off in BT design between readability and expressiveness. We discuss what this means for BTs in practice.


SIFT Matching by Context Exposed. This paper investigates how to step up local image descriptor matching by exploiting matching context information. Two main contexts are identified, originated respectively from the descriptor space and from the keypoint space. The former is generally used to design the actual matching strategy while the latter to filter matches according to the local spatial consistency. On this basis, a new matching strategy and a novel local spatial filter, named respectively blob matching and Delaunay Triangulation Matching (DTM) are devised. Blob matching provides a general matching framework by merging together several strategies, including rank based pre filtering as well as many to many and symmetric matching, enabling to achieve a global improvement upon each individual strategy. DTM alternates between Delaunay triangulation contractions and expansions to figure out and adjust keypoint neighborhood consistency. Experimental evaluation shows that DTM is comparable or better than the state of the art in terms of matching accuracy and robustness. Evaluation is carried out according to a new benchmark devised for analyzing the matching pipeline in terms of correct correspondences on both planar and non planar scenes, including several state of the art methods as well as the common SIFT matching approach for reference. This evaluation can be of assistance for future research in this field.


Context Matters in Semantically Controlled Language Generation for Task oriented Dialogue Systems. This work combines information about the dialogue history encoded by pre trained model with a meaning representation of the current system utterance to realize contextual language generation in task oriented dialogues. We utilize the pre trained multi context ConveRT model for context representation in a model trained from scratch and leverage the immediate preceding user utterance for context generation in a model adapted from the pre trained GPT 2. Both experiments with the MultiWOZ dataset show that contextual information encoded by pre trained model improves the performance of response generation both in automatic metrics and human evaluation. Our presented contextual generator enables higher variety of generated responses that fit better to the ongoing dialogue. Analysing the context size shows that longer context does not automatically lead to better performance, but the immediate preceding user utterance plays an essential role for contextual generation. In addition, we also propose a re ranker for the GPT based generation model. The experiments show that the response selected by the re ranker has a significant improvement on automatic metrics.


Naturally occurring fluorescence in transparent insect wings. In spite of the crucial role it is believed to play in nature, fluorescence in natural organisms remains under investigated from optical, chemical and biological perspectives. One example is the transparent wings of insects from the order Hemiptera fluorescence emission has so far not been reported in any of the 3,000 described species of the superfamily Cicadoidea. The phenomenon has however been investigated in several butterfly and moth species, in which the coloured wing scales are known to embed fluorophores such as papiliochrome II. Photonic structures present in these scales may mediate the associated light emission. Fluorescence has also been described in the vein joints and the membrane of the transparent wings of damselflies and dragonflies. This emission was attributed to the presence of autofluorescent proteins such as resilin that gives rise to low stiffness and high strain in the biological tissues, allowing passive wing deformations. In this article, we characterised the fluorescence emission from the transparent wings of the grey cicada textit Cicada orni (Linnaeus, 1758) and the common cicada textit Lyristes (Tibicen) plebejus (Scopoli, 1763), using linear and nonlinear optical methods. We compared their properties with the fluorescence emission from two other insects exhibiting transparent wings, namely, textit Hemaris fuciformis (Linnaeus, 1758) commonly known as the broad bordered bee hawk moth and the Bornean damselfly textit Vestalis amabilis Lieftinck, 1965. These fluorescent behaviours were optically characterised by one and multi photon microscopy and spectrometry, allowing us to infer the symmetry of the material as well as the biological role of the fluorophores in the visual perception of insects and to explain the high absorption by the material in the range 300 400 nm.


Well Ordered Flag Spaces as Functors of Points. Using Grothendieck's "functor of points" approach to algebraic geometry, we define a new infinite dimensional algebro geometric flag space as a k functor (for k a ring) which maps a k algebra R to the set of certain well ordered chains of submodules of an infinite rank free R module. This generalizes the well known construction of a k functor that is represented by the classical (i.e. finite dimensional) full flag scheme. We prove that as in the finite dimensional case, there is an action of a general linear group on our flag space, that the stabilizer of the standard flag is the subgroup B of upper triangular matrices, and that the Bruhat decomposition holds, meaning that our space is covered by the disjoint Schubert cells text sh (B sigma B) B indexed by permutations sigma of an infinite set. Finally, in the case of flags indexed by the ordinal omega 1 , we define an analog of the Bruhat order on this infinite permutation group and prove that when k is a domain, Ehresmann's closure relations still hold, i.e. that the closure overline text sh (B sigma B) B is covered by the Schubert cells indexed by permutations smaller than sigma in the infinite Bruhat order.


TDAM Top Down Attention Module for Contextually Guided Feature Selection in CNNs. Attention modules for Convolutional Neural Networks (CNNs) are an effective method to enhance performance on multiple computer vision tasks. While existing methods appropriately model channel , spatial and self attention, they primarily operate in a feedforward bottom up manner. Consequently, the attention mechanism strongly depends on the local information of a single input feature map and does not incorporate relatively semantically richer contextual information available at higher layers that can specify "what and where to look" in lower level feature maps through top down information flow. Accordingly, in this work, we propose a lightweight top down attention module (TDAM) that iteratively generates a "visual searchlight" to perform channel and spatial modulation of its inputs and outputs more contextually relevant feature maps at each computation step. Our experiments indicate that TDAM enhances the performance of CNNs across multiple object recognition benchmarks and outperforms prominent attention modules while being more parameter and memory efficient. Further, TDAM based models learn to "shift attention" by localizing individual objects or features at each computation step without any explicit supervision resulting in a 5 improvement for ResNet50 on weakly supervised object localization.


The non connectedness of certain sets defined after univariate polynomials. We consider the set of monic real univariate polynomials of a given degree d with non vanishing coefficients, with given signs of the coefficients and with given quantities pos of their positive and neg of their negative roots (all roots are distinct). For d 6 and for signs of the coefficients ( , , , , , , ) , we prove that the set of such polynomials having two positive, two negative and two complex conjugate roots, is not connected. For pos neg leq 3 and for any d , we give the exhaustive answer to the question for which signs of the coefficients there exist polynomials with such values of pos and neg .


Teamwork makes von Neumann work Min Max Optimization in Two Team Zero Sum Games. Motivated by recent advances in both theoretical and applied aspects of multiplayer games, spanning from e sports to multi agent generative adversarial networks, we focus on min max optimization in team zero sum games. In this class of games, players are split into two teams with payoffs equal within the same team and of opposite sign across the opponent team. Unlike the textbook two player zero sum games, finding a Nash equilibrium in our class can be shown to be CLS hard, i.e., it is unlikely to have a polynomial time algorithm for computing Nash equilibria. Moreover, in this generalized framework, we establish that even asymptotic last iterate or time average convergence to a Nash Equilibrium is not possible using Gradient Descent Ascent (GDA), its optimistic variant, and extra gradient. Specifically, we present a family of team games whose induced utility is emph non multi linear with emph non attractive emph per se mixed Nash Equilibria, as strict saddle points of the underlying optimization landscape. Leveraging techniques from control theory, we complement these negative results by designing a modified GDA that converges locally to Nash equilibria. Finally, we discuss connections of our framework with AI architectures with team competition structures like multi agent generative adversarial networks.


On the uniform Besov regularity of local times of general processes. Our main purpose is to use a new condition, alpha local nondeterminism, which is an alternative to the classical local nondeterminism usually utilized in the Gaussian framework, in order to investigate Besov regularity, in the time variable t uniformly in the space variable x , for local times L(x, t) of a class of continuous processes. We also extend the classical Adler's theorem 1, Theorem 8.7.1 to the Besov spaces case. These results are then exploited to study the Besov irregularity of the sample paths of the underlying processes. Based on similar known results in the case of the bifractional Brownian motion, we believe that our results are sharp. As applications, we get sharp Besov regularity results for some classical Gaussian processes and the solutions of systems of non linear stochastic heat equations. The Besov regularity of their corresponding local times is also obtained.


Elastic Collision Based Dynamic Partitioning Scheme for Hybrid Simulations. The scattering adapted flexible inner region ensemble separator (SAFIRES) is a partitioning scheme designed to divide a simulation cell into two regions to be treated with different computational methodologies. SAFIRES prevents particles from crossing between regions and resolves boundary events through elastic collisions of the particles mediated by the boundary, conserving energy and momenta. A multiple time step propagation algorithm is introduced where the time step is scaled automatically to identify the moment a collision occurs. If the length of the time step is kept constant, the new propagator reduces to a regular algorithm for Langevin dynamics, and to the velocity Verlet algorithm for classical dynamics if the friction coefficient is set to zero. SAFIRES constitutes the exact limit of the premise behind boundary based methods such as FIRES, BEST, and BCC which take advantage of the indistinguishability of molecules on opposite sides of the separator. It gives correct average ensemble statistics despite the introduction of an ensemble separator. SAFIRES is tested in simulations where the molecules on the two sides are treated in the same way, for a Lennard Jones (LJ) liquid and a LJ liquid in contact with a surface, as well as for liquid modelling simulations using the TIP4P force field. Simulations using SAFIRES are shown to reproduce the unconstrained reference simulations without significant deviations.


Secure Links Secure by Design Communications in IEC 61499 Industrial Control Applications. Increasing automation and external connectivity in industrial control systems (ICS) demand a greater emphasis on software level communication security. In this article, we propose a secure by design development method for building ICS applications, where requirements from security standards like ISA IEC 62443 are fulfilled by design time abstractions called secure links. Proposed as an extension to the IEC 61499 development standard, secure links incorporate both light weight and traditional security mechanisms into applications with negligible effort. Applications containing secure links can be automatically compiled into fully IEC 61499 compliant software. Experimental results show secure links significantly reduce design and code complexity and improve application maintainability and requirements traceability.


Q A MAESTRO Q A Post Recommendation for Fixing Java Runtime Exceptions. Programmers often use Q A sites (e.g., Stack Overflow) to understand a root cause of program bugs. Runtime exceptions is one of such important class of bugs that is actively discussed on Stack Overflow. However, it may be difficult for beginner programmers to come up with appropriate keywords for search. Moreover, they need to switch their attentions between IDE and browser, and it is time consuming. To overcome these difficulties, we proposed a method, Q A MAESTRO'', to find suitable Q A posts automatically for Java runtime exception by utilizing structure information of codes described in programming Q A website. In this paper, we describe a usage scenario of IDE plugin, the architecture and user interface of the implementation, and results of user studies. A video is available at https youtu.be 4X24jJrMUVw. A demo software is available at https github.com FujitsuLaboratories Q A MAESTRO.


On the improved no local collapsing theorem of Ricci flow. In this note we derive an improved no local collapsing theorem of Ricci flow under the scalar curvature bound condition along the worldline of the basepoint. It is a refinement of Perelman's no local collapsing theorem.


Bursts of cooperation triggered by external stimuli in violent and other uncertain situations. Individuals are reluctant to cooperate for public goods if others freeride on their efforts. Cooperation can be fostered by mechanisms that make benefits exceed costs, such as norms with sanctions, but these take time to develop and may be ineffective for impromptu challenges such as defense against or defeat of opponents. Nevertheless, cooperation can be triggered by situational stimuli, for example the sight of victims or provocations by opponents. An Ising spinglass model demonstrates that at a critical level of stimuli, few accidental cooperators entail a burst of cooperation among the rest. If the proportion of defectors is above the critical threshold, however, bursts do not occur, and only a few group members cooperate. The distinction between bursts and fizzles is strongly supported by video data of street violence. Ultimately, the model is generalized by incorporating the usual mechanisms, and can then explain cooperation without stimuli.


On a general variational framework for existence and uniqueness in Differential Equations. Starting from the classic contraction mapping principle, we establish a general, flexible, variational setting that turns out to be applicable to many situations of existence in Differential Equations. We show its potentiality with some selected examples including initial value, Cauchy problems for ODEs non linear, monotone PDEs linear and non linear hyperbolic problems and steady Navier Stokes systems.


Pseudo Relevance Feedback with Deep Language Models and Dense Retrievers Successes and Pitfalls. Pseudo Relevance Feedback (PRF) is known to improve the effectiveness of bag of words retrievers. At the same time, deep language models have been shown to outperform traditional bag of words rerankers. However, it is unclear how to integrate PRF directly with emergent deep language models. In this article, we address this gap by investigating methods for integrating PRF signals into rerankers and dense retrievers based on deep language models. We consider text based and vector based PRF approaches, and investigate different ways of combining and scoring relevance signals. An extensive empirical evaluation was conducted across four different datasets and two task settings (retrieval and ranking). Text based PRF results show that the use of PRF had a mixed effect on deep rerankers across different datasets. We found that the best effectiveness was achieved when (i) directly concatenating each PRF passage with the query, searching with the new set of queries, and then aggregating the scores (ii) using Borda to aggregate scores from PRF runs. Vector based PRF results show that the use of PRF enhanced the effectiveness of deep rerankers and dense retrievers over several evaluation metrics. We found that higher effectiveness was achieved when (i) the query retains either the majority or the same weight within the PRF mechanism, and (ii) a shallower PRF signal (i.e., a smaller number of top ranked passages) was employed, rather than a deeper signal. Our vector based PRF method is computationally efficient thus this represents a general PRF method others can use with deep rerankers and dense retrievers.


Three dimensional modeling of minority carrier lateral diffusion length including random alloy fluctuations in (In,Ga)N and (Al,Ga)N single quantum wells. For nitride based InGaN and AlGaN quantum well (QW) LEDs, the potential fluctuations caused by natural alloy disorders limit the lateral intra QW carrier diffusion length and current spreading. The diffusion length mainly impacts the overall LED efficiency through sidewall nonradiative recombination, especially for mu LEDs. In this paper, we study the carrier lateral diffusion length for nitride based green, blue, and ultraviolet C (UVC) QWs in three dimensions. We solve the Poisson and drift diffusion equations in the framework of localization landscape theory. The full three dimensional model includes the effects of random alloy composition fluctuations and electric fields in the QWs. The dependence of the minority carrier diffusion length on the majority carrier density is studied with a full three dimensional model. The results show that the diffusion length is limited by the potential fluctuations and the recombination rate, the latter being controlled by the polarization induced electric field in the QWs and by the screening of the internal electric fields by carriers.


Dimensional reduction in cohomological Donaldson Thomas theory. For oriented 1 shifted symplectic derived Artin stacks, Ben Bassat Brav Bussi Joyce introduced certain perverse sheaves on them which can be regarded as sheaf theoretic categorifications of the Donaldson Thomas invariants. In this paper, we prove that the hypercohomology of the above perverse sheaf on the 1 shifted cotangent stack over a quasi smooth derived Artin stack is isomorphic to the Borel Moore homology of the base stack up to a certain shift of degree. This is a global version of the dimensional reduction theorem due to Davison. We give two applications of our main theorem. Firstly, we apply it to the study of the cohomological Donaldson Thomas invariants for local surfaces. Secondly, regarding our main theorem as a version of Thom isomorphism theorem for dual obstruction cones, we propose a sheaf theoretic construction of the virtual fundamental classes for quasi smooth derived Artin stacks.


Coffea casa an analysis facility prototype. Data analysis in HEP has often relied on batch systems and event loops users are given a non interactive interface to computing resources and consider data event by event. The "Coffea casa" prototype analysis facility is an effort to provide users with alternate mechanisms to access computing resources and enable new programming paradigms. Instead of the command line interface and asynchronous batch access, a notebook based web interface and interactive computing is provided. Instead of writing event loops, the column based Coffea library is used. In this paper, we describe the architectural components of the facility, the services offered to end users, and how it integrates into a larger ecosystem for data access and authentication.


Confluence in quantum K theory of weak Fano manifolds and q oscillatory integrals for toric manifolds. For a smooth projective variety whose anti canonical bundle is nef, we prove confluence of the small K theoretic J function, i.e., after rescaling appropriately the Novikov variables, the small K theoretic J function has a limit when q to 1 , which coincides with the small cohomological J function. Furthermore, in the case of a Fano toric manifold X of Picard rank 2, we prove the K theoretic version of an identity due to Iritani that compares the I function of the toric manifold and the oscillatory integral of the toric mirror. In particular, our confluence result yields a new proof of Iritani's identity in the case of a toric manifold of Picard rank 2.


An Abstract Contract Theory for Programs with Procedures. When developing complex software and systems, contracts provide a means for controlling the complexity by dividing the responsibilities among the components of the system in a hierarchical fashion. In specific application areas, dedicated contract theories formalise the notion of contract and the operations on contracts in a manner that supports best the development of systems in that area. At the other end, contract meta theories attempt to provide a systematic view on the various contract theories by axiomatising their desired properties. However, there exists a noticeable gap between the most well known contract meta theory of Benveniste et al., which focuses on the design of embedded and cyber physical systems, and the established way of using contracts when developing general software, following Meyer's design by contract methodology. At the core of this gap appears to be the notion of procedure while it is a central unit of composition in software development, the meta theory does not suggest an obvious way of treating procedures as components. In this paper, we provide a first step towards a contract theory that takes procedures as the basic building block, and is at the same time an instantiation of the meta theory. To this end, we propose an abstract contract theory for sequential programming languages with procedures, based on denotational semantics. We show that, on the one hand, the specification of contracts of procedures in Hoare logic, and their procedure modular verification, can be cast naturally in the framework of our abstract contract theory. On the other hand, we also show our contract theory to fulfil the axioms of the meta theory. In this way, we give further evidence for the utility of the meta theory, and prepare the ground for combining our instantiation with other, already existing instantiations.


Anytime Stochastic Task and Motion Policies. In order to solve complex, long horizon tasks, intelligent robots need to carry out high level, abstract planning and reasoning in conjunction with motion planning. However, abstract models are typically lossy and plans or policies computed using them can be inexecutable. These problems are exacerbated in stochastic situations where the robot needs to reason about and plan for multiple contingencies. We present a new approach for integrated task and motion planning in stochastic settings. In contrast to prior work in this direction, we show that our approach can effectively compute integrated task and motion policies whose branching structures encode agent behaviors that handle multiple execution time contingencies. We prove that our algorithm is probabilistically complete and can compute feasible solution policies in an anytime fashion so that the probability of encountering an unresolved contingency decreases over time. Empirical results on a set of challenging problems show the utility and scope of our method.


SAFRAN An interpretable, rule based link prediction method outperforming embedding models. Neural embedding based machine learning models have shown promise for predicting novel links in knowledge graphs. Unfortunately, their practical utility is diminished by their lack of interpretability. Recently, the fully interpretable, rule based algorithm AnyBURL yielded highly competitive results on many general purpose link prediction benchmarks. However, current approaches for aggregating predictions made by multiple rules are affected by redundancies. We improve upon AnyBURL by introducing the SAFRAN rule application framework, which uses a novel aggregation approach called Non redundant Noisy OR that detects and clusters redundant rules prior to aggregation. SAFRAN yields new state of the art results for fully interpretable link prediction on the established general purpose benchmarks FB15K 237, WN18RR and YAGO3 10. Furthermore, it exceeds the results of multiple established embedding based algorithms on FB15K 237 and WN18RR and narrows the gap between rule based and embedding based algorithms on YAGO3 10.


Visualization Resources A Starting Point. Visualization, as a vibrant field for researchers, practitioners, and higher educational institutions, is growing and evolving very rapidly. Tremendous progress has been made since 1987, the year often cited as the beginning of data visualization as a distinct field. As such, the number of visualization resources and the demand for those resources are increasing at a very fast pace. We present a collection of open visualization resources for all those with an interest in interactive data visualization and visual analytics. Because the number of resources is so large, we focus on collections of resources, of which there are already very many ranging from literature collections to collections of practitioner resources. We develop a novel classification of visualization resource collections based on the resource type, e.g. literature based, web based, etc. The result is a helpful overview and details on demand of many useful resources. The collection offers a valuable jump start for those seeking out data visualization resources from all backgrounds spanning from beginners such as students to teachers, practitioners, and researchers wishing to create their own advanced or novel visual designs.


Curious Exploration and Return based Memory Restoration for Deep Reinforcement Learning. Reward engineering and designing an incentive reward function are non trivial tasks to train agents in complex environments. Furthermore, an inaccurate reward function may lead to a biased behaviour which is far from an efficient and optimised behaviour. In this paper, we focus on training a single agent to score goals with binary success failure reward function in Half Field Offense domain. As the major advantage of this research, the agent has no presumption about the environment which means it only follows the original formulation of reinforcement learning agents. The main challenge of using such a reward function is the high sparsity of positive reward signals. To address this problem, we use a simple prediction based exploration strategy (called Curious Exploration) along with a Return based Memory Restoration (RMR) technique which tends to remember more valuable memories. The proposed method can be utilized to train agents in environments with fairly complex state and action spaces. Our experimental results show that many recent solutions including our baseline method fail to learn and perform in complex soccer domain. However, the proposed method can converge easily to the nearly optimal behaviour. The video presenting the performance of our trained agent is available at http bit.ly HFO Binary Reward.


What is understandable in Bayesian network explanations?. Explaining predictions from Bayesian networks, for example to physicians, is non trivial. Various explanation methods for Bayesian network inference have appeared in literature, focusing on different aspects of the underlying reasoning. While there has been a lot of technical research, there is very little known about how well humans actually understand these explanations. In this paper, we present ongoing research in which four different explanation approaches were compared through a survey by asking a group of human participants to interpret the explanations.


The spectral form of Koopman representations of the group of measurable functions with values in the circle. We compute the spectral form of the Koopman representation induced by a natural boolean action of L 0( lambda, mathbb T ) identified earlier by the authors. Our computation establishes the sharpness of the constraints on spectral forms of Koopman representations of L 0( lambda, mathbb T ) previously found by the second author.


IoT based Smart Home Device Monitor Using Private Blockchain Technology and Localization. Internet of Things (IoT) based smart home applications are rising in popularity. However, this trend attracts malicious activity, which causes cost efficient security to be in high demand. This paper proposes a low end design that reinforces the security of a home network. It uses private blockchain technology and localization via RSSI based trilateration. We investigated the benefits of private blockchains over their public counterpart, and we improve the precision of the localization algorithm by testing it against different wireless technologies. The results conclude that using a private blockchain with a WiFi based communication system produces the most efficient iteration of the proposed design.


Dynamic Normalization. Batch Normalization has become one of the essential components in CNN. It allows the network to use a higher learning rate and speed up training. And the network doesn't need to be initialized carefully. However, in our work, we find that a simple extension of BN can increase the performance of the network. First, we extend BN to adaptively generate scale and shift parameters for each mini batch data, called DN C (Batch shared and Channel wise). We use the statistical characteristics of mini batch data ( E X , Std X in mathbb R c ) as the input of SC module. Then we extend BN to adaptively generate scale and shift parameters for each channel of each sample, called DN B (Batch and Channel wise). Our experiments show that DN C model can't train normally, but DN B model has very good robustness. In classification task, DN B can improve the accuracy of the MobileNetV2 on ImageNet 100 more than 2 with only 0.6 additional Mult Adds. In detection task, DN B can improve the accuracy of the SSDLite on MS COCO nearly 4 mAP with the same settings. Compared with BN, DN B has stable performance when using higher learning rate or smaller batch size.


A Vectorization Scheme for Nonconvex Set Optimization Problems. In this paper, we study a solution approach for set optimization problems with respect to the lower set less relation. This approach can serve as a base for numerically solving set optimization problems by using established solvers from multiobjective optimization. Our strategy consists of deriving a parametric family of multiobjective optimization problems whose optimal solution sets approximate, in a specific sense, that of the set valued problem with arbitrary accuracy. We also examine particular classes of set valued mappings for which the corresponding set optimization problem is equivalent to a multiobjective optimization problem in the generated family. Surprisingly, this includes set valued mappings with a convex graph.


Real time RGBD based Extended Body Pose Estimation. We present a system for real time RGBD based estimation of 3D human pose. We use parametric 3D deformable human mesh model (SMPL X) as a representation and focus on the real time estimation of parameters for the body pose, hands pose and facial expression from Kinect Azure RGB D camera. We train estimators of body pose and facial expression parameters. Both estimators use previously published landmark extractors as input and custom annotated datasets for supervision, while hand pose is estimated directly by a previously published method. We combine the predictions of those estimators into a temporally smooth human pose. We train the facial expression extractor on a large talking face dataset, which we annotate with facial expression parameters. For the body pose we collect and annotate a dataset of 56 people captured from a rig of 5 Kinect Azure RGB D cameras and use it together with a large motion capture AMASS dataset. Our RGB D body pose model outperforms the state of the art RGB only methods and works on the same level of accuracy compared to a slower RGB D optimization based solution. The combined system runs at 30 FPS on a server with a single GPU. The code will be available at https saic violet.github.io rgbd kinect pose


Learning How to Search Generating Effective Test Cases Through Adaptive Fitness Function Selection. Search based test generation is guided by feedback from one or more fitness functions scoring functions that judge solution optimality. Choosing informative fitness functions is crucial to meeting the goals of a tester. Unfortunately, many goals such as forcing the class under test to throw exceptions, increasing test suite diversity, and attaining Strong Mutation Coverage do not have effective fitness function formulations. We propose that meeting such goals requires treating fitness function identification as a secondary optimization step. An adaptive algorithm that can vary the selection of fitness functions could adjust its selection throughout the generation process to maximize goal attainment, based on the current population of test suites. To test this hypothesis, we have implemented two reinforcement learning algorithms in the EvoSuite unit test generation framework, and used these algorithms to dynamically set the fitness functions used during generation for the three goals identified above. We have evaluated our framework, EvoSuiteFIT, on a set of Java case examples. EvoSuiteFIT techniques attain significant improvements for two of the three goals, and show limited improvements on the third when the number of generations of evolution is fixed. Additionally, for two of the three goals, EvoSuiteFIT detects faults missed by the other techniques. The ability to adjust fitness functions allows strategic choices that efficiently produce more effective test suites, and examining these choices offers insight into how to attain our testing goals. We find that adaptive fitness function selection is a powerful technique to apply when an effective fitness function does not already exist for achieving a testing goal.


Student Teacher Feature Pyramid Matching for Anomaly Detection. Anomaly detection is a challenging task and usually formulated as an one class learning problem for the unexpectedness of anomalies. This paper proposes a simple yet powerful approach to this issue, which is implemented in the student teacher framework for its advantages but substantially extends it in terms of both accuracy and efficiency. Given a strong model pre trained on image classification as the teacher, we distill the knowledge into a single student network with the identical architecture to learn the distribution of anomaly free images and this one step transfer preserves the crucial clues as much as possible. Moreover, we integrate the multi scale feature matching strategy into the framework, and this hierarchical feature matching enables the student network to receive a mixture of multi level knowledge from the feature pyramid under better supervision, thus allowing to detect anomalies of various sizes. The difference between feature pyramids generated by the two networks serves as a scoring function indicating the probability of anomaly occurring. Due to such operations, our approach achieves accurate and fast pixel level anomaly detection. Very competitive results are delivered on the MVTec anomaly detection dataset, superior to the state of the art ones.


The Sticky Matroid Conjecture. We show Kantor's conjecture (1974) holds in rank 4. This proves both the sticky matroid conjecture of Poljak and Turzik (1982) and the whole Kantor's conjecture, due to an argument of Bachem, Kern, and Bonin, and an equivalence argument of Hochstattler and Wilhelmi, respectively.


Rethinking real numbers as infinite decimals. We give a detailed construction of the complete ordered field of real numbers by means of infinite decimal expansions. We prove that in the canonical encoding of decimals neither addition nor multiplication is em computable , but that both operations are em weakly computable we introduce both kinds of computability in greater generality. We determine which additive and multiplicative shifts (restrictions of addition and multiplication to one variable) are computable, and prove that each of these shifts becomes computable after a permutation of encoding. We ask if it is the case for the bivariate addition and multiplication.


On the one dimensional cubic NLS in a critical space. In this note we study the initial value problem in a critical space for the one dimensional Schr "odinger equation with a cubic non linearity and under some smallness conditions. In particular the initial data is given by a sequence of Dirac deltas with different amplitudes but equispaced. This choice is motivated by a related geometrical problem the one describing the flow of curves in three dimensions moving in the direction of the binormal with a velocity that is given by the curvature.


Polynomial averages and pointwise ergodic theorems on nilpotent groups. We establish pointwise almost everywhere convergence for ergodic averages along polynomial sequences in nilpotent groups of step two of measure preserving transformations on sigma finite measure spaces. We also establish corresponding maximal inequalities on L p for 1 p leq infty and rho variational inequalities on L 2 for 2 rho infty . This gives an affirmative answer to the Furstenberg Bergelson Leibman conjecture in the linear case for all polynomial ergodic averages in discrete nilpotent groups of step two. Our proof is based on almost orthogonality techniques that go far beyond Fourier transform tools, which are not available in the non commutative, nilpotent setting. In particular, we develop what we call a nilpotent circle method that allows us to adapt some of the ideas of the classical circle method to the setting of nilpotent groups.


Fast Design Space Exploration of Nonlinear Systems Part I. System design tools are often only available as input output blackboxes for a given design as input they compute an output representing system behavior. Blackboxes are intended to be run in the forward direction. This paper presents a new method of solving the inverse design problem namely, given requirements or constraints on output, find an input that also optimizes an objective function. This problem is challenging for several reasons. First, blackboxes are not designed to be run in reverse. Second, inputs and outputs can be discrete and continuous. Third, finding designs concurrently satisfying a set of requirements is hard because designs satisfying individual requirements may conflict with each other. Fourth, blackbox evaluations can be expensive. Finally, blackboxes can sometimes fail to produce an output. This paper presents CNMA, a new method of solving the inverse problem that overcomes these challenges. CNMA tries to sample only the part of the design space relevant to solving the problem, leveraging the power of neural networks, Mixed Integer Linear Programs, and a new learning from failure feedback loop. The paper also presents a parallel version of CNMA that improves the efficiency and quality of solutions over the sequential version, and tries to steer it away from local optima. CNMA's performance is evaluated against conventional optimization methods for seven nonlinear design problems of 8 (two problems), 10, 15, 36 and 60 real valued dimensions and one with 186 binary dimensions. Conventional methods evaluated are off the shelf implementations of Bayesian Optimization with Gaussian Processes, Nelder Mead and Random Search. The first two do not solve problems that are high dimensional, have discrete and continuous variables or whose blackboxes can fail to return values. CNMA solves all problems, and surpasses the performance of conventional methods by up to 87 .


Synergies Between Affordance and Geometry 6 DoF Grasp Detection via Implicit Representations. Grasp detection in clutter requires the robot to reason about the 3D scene from incomplete and noisy perception. In this work, we draw insight that 3D reconstruction and grasp learning are two intimately connected tasks, both of which require a fine grained understanding of local geometry details. We thus propose to utilize the synergies between grasp affordance and 3D reconstruction through multi task learning of a shared representation. Our model takes advantage of deep implicit functions, a continuous and memory efficient representation, to enable differentiable training of both tasks. We train the model on self supervised grasp trials data in simulation. Evaluation is conducted on a clutter removal task, where the robot clears cluttered objects by grasping them one at a time. The experimental results in simulation and on the real robot have demonstrated that the use of implicit neural representations and joint learning of grasp affordance and 3D reconstruction have led to state of the art grasping results. Our method outperforms baselines by over 10 in terms of grasp success rate. Additional results and videos can be found at https sites.google.com view rpl giga2021


Link Prediction on N ary Relational Facts A Graph based Approach. Link prediction on knowledge graphs (KGs) is a key research topic. Previous work mainly focused on binary relations, paying less attention to higher arity relations although they are ubiquitous in real world KGs. This paper considers link prediction upon n ary relational facts and proposes a graph based approach to this task. The key to our approach is to represent the n ary structure of a fact as a small heterogeneous graph, and model this graph with edge biased fully connected attention. The fully connected attention captures universal inter vertex interactions, while with edge aware attentive biases to particularly encode the graph structure and its heterogeneity. In this fashion, our approach fully models global and local dependencies in each n ary fact, and hence can more effectively capture associations therein. Extensive evaluation verifies the effectiveness and superiority of our approach. It performs substantially and consistently better than current state of the art across a variety of n ary relational benchmarks. Our code is publicly available.


Enhance Information Propagation for Graph Neural Network by Heterogeneous Aggregations. Graph neural networks are emerging as continuation of deep learning success w.r.t. graph data. Tens of different graph neural network variants have been proposed, most following a neighborhood aggregation scheme, where the node features are updated via aggregating features of its neighboring nodes from layer to layer. Though related research surges, the power of GNNs are still not on par with their counterpart CNNs in computer vision and RNNs in natural language processing. We rethink this problem from the perspective of information propagation, and propose to enhance information propagation among GNN layers by combining heterogeneous aggregations. We argue that as richer information are propagated from shallow to deep layers, the discriminative capability of features formulated by GNN can benefit from it. As our first attempt in this direction, a new generic GNN layer formulation and upon this a new GNN variant referred as HAG Net is proposed. We empirically validate the effectiveness of HAG Net on a number of graph classification benchmarks, and elaborate all the design options and criterions along with.


This Looks Like That... Does it? Shortcomings of Latent Space Prototype Interpretability in Deep Networks. Deep neural networks that yield human interpretable decisions by architectural design have lately become an increasingly popular alternative to post hoc interpretation of traditional black box models. Among these networks, the arguably most widespread approach is so called prototype learning, where similarities to learned latent prototypes serve as the basis of classifying an unseen data point. In this work, we point to an important shortcoming of such approaches. Namely, there is a semantic gap between similarity in latent space and similarity in input space, which can corrupt interpretability. We design two experiments that exemplify this issue on the so called ProtoPNet. Specifically, we find that this network's interpretability mechanism can be led astray by intentionally crafted or even JPEG compression artefacts, which can produce incomprehensible decisions. We argue that practitioners ought to have this shortcoming in mind when deploying prototype based models in practice.


A Machine Learning Surrogate Model for ab initio Electronic Correlations at Extreme Conditions. The electronic structure in matter under extreme conditions is a challenging complex system prevalent in astrophysical objects and highly relevant for technological applications. We show how machine learning surrogates in terms of neural networks have a profound impact on the efficient modeling of matter under extreme conditions. We demonstrate the utility of a surrogate model that is trained on emph ab initio quantum Monte Carlo data for various applications in the emerging field of warm dense matter research.


SemSegMap 3D Segment Based Semantic Localization. Localization is an essential task for mobile autonomous robotic systems that want to use pre existing maps or create new ones in the context of SLAM. Today, many robotic platforms are equipped with high accuracy 3D LiDAR sensors, which allow a geometric mapping, and cameras able to provide semantic cues of the environment. Segment based mapping and localization have been applied with great success to 3D point cloud data, while semantic understanding has been shown to improve localization performance in vision based systems. In this paper we combine both modalities in SemSegMap, extending SegMap into a segment based mapping framework able to also leverage color and semantic data from the environment to improve localization accuracy and robustness. In particular, we present new segmentation and descriptor extraction processes. The segmentation process benefits from additional distance information from color and semantic class consistency resulting in more repeatable segments and more overlap after re visiting a place. For the descriptor, a tight fusion approach in a deep learned descriptor extraction network is performed leading to a higher descriptiveness for landmark matching. We demonstrate the advantages of this fusion on multiple simulated and real world datasets and compare its performance to various baselines. We show that we are able to find 50.9 more high accuracy prior less global localizations compared to SegMap on challenging datasets using very compact maps while also providing accurate full 6 DoF pose estimates in real time.


Multi linear products with odd factors in pseudo differential calculus with symbols in modulation spaces. We give sufficient conditions on the Lebesgue exponents for compositions of odd numbers of pseudo differential operators with symbols in modulation spaces. As a byproduct, we obtain sufficient conditions for twisted convolutions of odd numbers of factors to be bounded on Wiener amalgam spaces.


BEIR A Heterogenous Benchmark for Zero shot Evaluation of Information Retrieval Models. Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out of distribution (OOD) generalization capabilities. To address this, and to facilitate researchers to broadly evaluate the effectiveness of their models, we introduce Benchmarking IR (BEIR), a robust and heterogeneous evaluation benchmark for information retrieval. We leverage a careful selection of 18 publicly available datasets from diverse text retrieval tasks and domains and evaluate 10 state of the art retrieval systems including lexical, sparse, dense, late interaction and re ranking architectures on the BEIR benchmark. Our results show BM25 is a robust baseline and re ranking and late interaction based models on average achieve the best zero shot performances, however, at high computational costs. In contrast, dense and sparse retrieval models are computationally more efficient but often underperform other approaches, highlighting the considerable room for improvement in their generalization capabilities. We hope this framework allows us to better evaluate and understand existing retrieval systems, and contributes to accelerating progress towards better robust and generalizable systems in the future. BEIR is publicly available at https github.com UKPLab beir.


Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks. The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on physics and use supercomputers to simulate the atmosphere to make forecasts hours and days in advance. Better physics based forecasts require improvements in the models themselves, which can be a substantial scientific challenge, as well as improvements in the underlying resolution, which can be computationally prohibitive. An emerging class of weather models based on neural networks represents a paradigm shift in weather forecasting the models learn the required transformations from data instead of relying on hand coded physics and are computationally efficient. For neural models, however, each additional hour of lead time poses a substantial challenge as it requires capturing ever larger spatial contexts and increases the uncertainty of the prediction. In this work, we present a neural network that is capable of large scale precipitation forecasting up to twelve hours ahead and, starting from the same atmospheric state, the model achieves greater skill than the state of the art physics based models HRRR and HREF that currently operate in the Continental United States. Interpretability analyses reinforce the observation that the model learns to emulate advanced physics principles. These results represent a substantial step towards establishing a new paradigm of efficient forecasting with neural networks.


fauci email a json digest of Anthony Fauci's released emails. A collection of over 3000 pages of emails sent by Anthony Fauci and his staff were released in an effort to understand the United States government response to the COVID 19 pandemic. We describe how this email data was translated into a resource consisting of json files that make many future studies easy. Findings from our processed data include (i) successful organizational partitions using the simple mincut techniques in Zachary's karate club methodology, (ii) a natural example where the normalized cut and minimum conductance set are extremely different, and (iii) organizational groups identified by optimum modularity clusters that illustrate a working hierarchy. These example uses suggest the data will be useful for future research and pedagogical uses in terms of human and system behavioral interactions. We explain a number of ways to turn email information into a network, a hypergraph, a temporal sequence, and a tensor for subsequent analysis as well as a few examples of such analysis.


Physically Motivated Recursively Embedded Atom Neural Networks Incorporating Local Completeness and Nonlocality. Recent advances in machine learned interatomic potentials largely benefit from the atomistic representation and locally invariant many body descriptors. It was however recently argued that including three (or even four ) body features is incomplete to distinguish specific local structures. Utilizing an embedded density descriptor made by linear combinations of neighboring atomic orbitals and realizing that each orbital coefficient physically depends on its own local environment, we propose a recursively embedded atom neural network model. We formally prove that this model can efficiently incorporate complete many body correlations without explicitly computing high order terms. This model not only successfully addresses challenges regarding local completeness and nonlocality in representative systems, but also provides an easy and general way to update local many body descriptors to have a message passing form without changing their basic structures.


Disentangled Sequence to Sequence Learning for Compositional Generalization. There is mounting evidence that existing neural network models, in particular the very popular sequence to sequence architecture, struggle to systematically generalize to unseen compositions of seen components. We demonstrate that one of the reasons hindering compositional generalization relates to representations being entangled. We propose an extension to sequence to sequence models which encourages disentanglement by adaptively re encoding (at each time step) the source input. Specifically, we condition the source representations on the newly decoded target context which makes it easier for the encoder to exploit specialized information for each prediction rather than capturing it all in a single forward pass. Experimental results on semantic parsing and machine translation empirically show that our proposal delivers more disentangled representations and better generalization.


Real Negatives Matter Continuous Training with Real Negatives for Delayed Feedback Modeling. One of the difficulties of conversion rate (CVR) prediction is that the conversions can delay and take place long after the clicks. The delayed feedback poses a challenge fresh data are beneficial to continuous training but may not have complete label information at the time they are ingested into the training pipeline. To balance model freshness and label certainty, previous methods set a short waiting window or even do not wait for the conversion signal. If conversion happens outside the waiting window, this sample will be duplicated and ingested into the training pipeline with a positive label. However, these methods have some issues. First, they assume the observed feature distribution remains the same as the actual distribution. But this assumption does not hold due to the ingestion of duplicated samples. Second, the certainty of the conversion action only comes from the positives. But the positives are scarce as conversions are sparse in commercial systems. These issues induce bias during the modeling of delayed feedback. In this paper, we propose DElayed FEedback modeling with Real negatives (DEFER) method to address these issues. The proposed method ingests real negative samples into the training pipeline. The ingestion of real negatives ensures the observed feature distribution is equivalent to the actual distribution, thus reducing the bias. The ingestion of real negatives also brings more certainty information of the conversion. To correct the distribution shift, DEFER employs importance sampling to weigh the loss function. Experimental results on industrial datasets validate the superiority of DEFER. DEFER have been deployed in the display advertising system of Alibaba, obtaining over 6.0 improvement on CVR in several scenarios. The code and data in this paper are now open sourced https github.com gusuperstar defer.git .


WebGPT Browser assisted question answering with human feedback. We fine tune GPT 3 to answer long form questions using a text based web browsing environment, which allows the model to search and navigate the web. By setting up the task so that it can be performed by humans, we are able to train models on the task using imitation learning, and then optimize answer quality with human feedback. To make human evaluation of factual accuracy easier, models must collect references while browsing in support of their answers. We train and evaluate our models on ELI5, a dataset of questions asked by Reddit users. Our best model is obtained by fine tuning GPT 3 using behavior cloning, and then performing rejection sampling against a reward model trained to predict human preferences. This model's answers are preferred by humans 56 of the time to those of our human demonstrators, and 69 of the time to the highest voted answer from Reddit.


SGN Sparse Gauss Newton for Accelerated Sensitivity Analysis. We present a sparse Gauss Newton solver for accelerated sensitivity analysis with applications to a wide range of equilibrium constrained optimization problems. Dense Gauss Newton solvers have shown promising convergence rates for inverse problems, but the cost of assembling and factorizing the associated matrices has so far been a major stumbling block. In this work, we show how the dense Gauss Newton Hessian can be transformed into an equivalent sparse matrix that can be assembled and factorized much more efficiently. This leads to drastically reduced computation times for many inverse problems, which we demonstrate on a diverse set of examples. We furthermore show links between sensitivity analysis and nonlinear programming approaches based on Lagrange multipliers and prove equivalence under specific assumptions that apply for our problem setting.


CRASS A Novel Data Set and Benchmark to Test Counterfactual Reasoning of Large Language Models. We introduce the CRASS (counterfactual reasoning assessment) data set and benchmark utilizing questionized counterfactual conditionals as a novel and powerful tool to evaluate large language models. We present the data set design and benchmark as well as the accompanying API that supports scoring against a crowd validated human baseline. We test six state of the art models against our benchmark. Our results show that it poses a valid challenge for these models and opens up considerable room for their improvement.


Self Calibrating Neural Radiance Fields. In this work, we propose a camera self calibration algorithm for generic cameras with arbitrary non linear distortions. We jointly learn the geometry of the scene and the accurate camera parameters without any calibration objects. Our camera model consists of a pinhole model, a fourth order radial distortion, and a generic noise model that can learn arbitrary non linear camera distortions. While traditional self calibration algorithms mostly rely on geometric constraints, we additionally incorporate photometric consistency. This requires learning the geometry of the scene, and we use Neural Radiance Fields (NeRF). We also propose a new geometric loss function, viz., projected ray distance loss, to incorporate geometric consistency for complex non linear camera models. We validate our approach on standard real image datasets and demonstrate that our model can learn the camera intrinsics and extrinsics (pose) from scratch without COLMAP initialization. Also, we show that learning accurate camera models in a differentiable manner allows us to improve PSNR over baselines. Our module is an easy to use plugin that can be applied to NeRF variants to improve performance. The code and data are currently available at https github.com POSTECH CVLab SCNeRF.


Sig Wasserstein GANs for Time Series Generation. Synthetic data is an emerging technology that can significantly accelerate the development and deployment of AI machine learning pipelines. In this work, we develop high fidelity time series generators, the SigWGAN, by combining continuous time stochastic models with the newly proposed signature W 1 metric. The former are the Logsig RNN models based on the stochastic differential equations, whereas the latter originates from the universal and principled mathematical features to characterize the measure induced by time series. SigWGAN allows turning computationally challenging GAN min max problem into supervised learning while generating high fidelity samples. We validate the proposed model on both synthetic data generated by popular quantitative risk models and empirical financial data. Codes are available at https github.com SigCGANs Sig Wasserstein GANs.git.


Experience Report Teaching Code Analysis and Verification Using Frama C. Formal methods provide systematic and rigorous techniques for software development. We strongly believe that they must be taught in computer science curricula. In this paper we present the pedagogic rationale and the concrete implementation of two courses on the use of formal methods, sharing some material. These courses promote the usage of formal verification to ensure safety and security of software, exemplified in the domain of the Internet of Things.


A semi Lagrangian scheme for Hamilton Jacobi Bellman equations with oblique boundary conditions. We investigate in this work a fully discrete semi Lagrangian approximation of second order possibly degenerate Hamilton Jacobi Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in the study of optimal control of diffusion processes with oblique reflection at the boundary of the domain. The proposed scheme is shown to satisfy a consistency type property, it is monotone and stable. Our main result is the convergence of the numerical solution towards the unique viscosity solution of the HJB equation. The convergence result holds under the same asymptotic relation between the time and space discretization steps as in the classical setting for semi Lagrangian schemes. We present some numerical results that confirm the numerical convergence of the scheme.


Negative Sample is Negative in Its Own Way Tailoring Negative Sentences for Image Text Retrieval. Matching model is essential for Image Text Retrieval framework. Existing research usually train the model with a triplet loss and explore various strategy to retrieve hard negative sentences in the dataset. We argue that current retrieval based negative sample construction approach is limited in the scale of the dataset thus fail to identify negative sample of high difficulty for every image. We propose our TAiloring neGative Sentences with Discrimination and Correction (TAGS DC) to generate synthetic sentences automatically as negative samples. TAGS DC is composed of masking and refilling to generate synthetic negative sentences with higher difficulty. To keep the difficulty during training, we mutually improve the retrieval and generation through parameter sharing. To further utilize fine grained semantic of mismatch in the negative sentence, we propose two auxiliary tasks, namely word discrimination and word correction to improve the training. In experiments, we verify the effectiveness of our model on MS COCO and Flickr30K compared with current state of the art models and demonstrates its robustness and faithfulness in the further analysis. Our code is available in https github.com LibertFan TAGS.


The Inverse Problems of some Mathematical Programming Problems. The non convex quadratic orogramming problem and the non monotone linear complementarity problem are NP complete problems. In this paper we first show taht the inverse problem of determinning a KKT point of the non convex quadratic programming problem is polynomial. We then show that the inverse problems of non monotone linear complementarity problem are polynomial solvable in some cases, and in another case is NP hard. Therefore we solve an open question raised by Heuberger on inverse NP hard problems and prove that CoNP NP.


Skeletal Graph Self Attention Embedding a Skeleton Inductive Bias into Sign Language Production. Recent approaches to Sign Language Production (SLP) have adopted spoken language Neural Machine Translation (NMT) architectures, applied without sign specific modifications. In addition, these works represent sign language as a sequence of skeleton pose vectors, projected to an abstract representation with no inherent skeletal structure. In this paper, we represent sign language sequences as a skeletal graph structure, with joints as nodes and both spatial and temporal connections as edges. To operate on this graphical structure, we propose Skeletal Graph Self Attention (SGSA), a novel graphical attention layer that embeds a skeleton inductive bias into the SLP model. Retaining the skeletal feature representation throughout, we directly apply a spatio temporal adjacency matrix into the self attention formulation. This provides structure and context to each skeletal joint that is not possible when using a non graphical abstract representation, enabling fluid and expressive sign language production. We evaluate our Skeletal Graph Self Attention architecture on the challenging RWTH PHOENIX Weather 2014T(PHOENIX14T) dataset, achieving state of the art back translation performance with an 8 and 7 improvement over competing methods for the dev and test sets.


On cost design in applications of optimal control. A new approach to feedback control design based on optimal control is proposed. Instead of expensive computations of the value function for different penalties on the states and inputs, we use a control Lyapunov function that amounts to be a value function of an optimal control problem with suitable cost design and then study combinations of input and state penalty that are compatible with this value function. This drastically simplifies the role of the Hamilton Jacobi Bellman equation, since it is no longer a partial differential equation to be solved, but an algebraic relationship between different terms of the cost. The paper illustrates this idea in different examples, including mathcal H infty control and optimal control of coupled oscillators.


Phase noise in communication systems from measures to models. We consider the phase noise affecting communication systems, where local oscillators are employed to obtain a reference signal for frequency and timing synchronizations. We try to fill the gap between measurements and analytical models, in case of free running and phase locked oscillators. In particular, we propose a closed form expression for the power spectral density of the phase noise described by few parameters that are explicitly linked to the oscillator measurements. We also propose an analytical model for the oscillator power spectral density. We then consider the discrete time domain, and analyse the most common discrete time phase noise channel model with reference to the measurements parameters and to the system bandwidth. In this context, we show that the proposed models for power spectral densities lead to analytical models for the discrete time phase noise signal, that can be used for the design of estimation detection algorithms, for performance evaluation, or simply for fast simulations.


Positive Pressure Testing Booths Development and Deployment In Response To The COVID 19 Outbreak. The COVID 19 pandemic left an unprecedented impact on the general public health, resulting in thousands of deaths in the US alone. Nationwide testing plans were initiated to control the spread, with drive through being the currently dominant testing approach, which, however, exhausts personal protective equipment supplies, and is unfriendly to individuals not owning a vehicle. Walk up testing booths are a safe alternative, but are too prohibitively priced on the market to allow for nationwide deployment. In this paper, we present an accessible, mobile, affordable, and safe version of a positive pressure COVID 19 testing booth. The booths are manufactured using primarily off the shelf components from US vendors with minimized customization. The booths' mobility allows them to be easily transported within local communities to test a larger subset of the population with fewer transportation options. Moreover, the final bill of materials does not surpass USD 3,900, which is about half of the market price. The booths are air conditioned and HEPA filtered to offer healthcare providers a safe and comfortable working environment. The prototype passed required pressure and air exchange tests, and was positively reviewed by two healthcare professionals. Currently, five booths are deployed and used at the Johns Hopkins University School of Nursing, Baltimore City Health Department, and two community health centers in Baltimore. Our design facilitates walk up testing in the US, as it decreases PPE consumption reduces the risk of infection and is accessible to lower income communities and non drivers.


Realizations of countable Borel equivalence relations. We study topological realizations of countable Borel equivalence relations, including realizations by continuous actions of countable groups, with additional desirable properties. Some examples include minimal realizations on any perfect Polish space, realizations as K sigma relations, and realizations by continuous actions on the Baire space. We also consider questions related to realizations of specific important equivalence relations, like Turing and arithmetical equivalence. We focus in particular on the problem of realization by continuous actions on compact spaces and more specifically subshifts. This leads to the study of properties of subshifts, including universality of minimal subshifts, and a characterization of amenability of a countable group in terms of subshifts. Moreover we consider a natural universal space for actions and equivalence relations and study the descriptive and topological properties in this universal space of various properties, like, e.g., compressibility, amenability or hyperfiniteness.


Ontological Entities for Planning and Describing Cultural Heritage 3D Models Creation. In the last decades the rapid development of technologies and methodologies in the field of digitization and 3D modelling has led to an increasing proliferation of 3D technologies in the Cultural Heritage domain. Despite the great potential of 3D digital heritage, the "special effects" of 3D may often overwhelm its importance in research. Projects and consortia of scholars have tried to put order in the different fields of application of these technologies, providing guidelines and proposing workflows. The use of computer graphics as an effective methodology for CH research and communication highlighted the need of transparent provenance data to properly document digital assets and understand the degree of scientific quality and reliability of their outcomes. The building and release of provenance knowledge, consisting in the complete formal documentation of each phase of the process, is therefore of fundamental importance to ensure its repeatability and to guarantee the integration and interoperability of the generated metadata on the Semantic Web. This paper proposes a methodology for documenting the planning and creation of 3D models used in archaeology and Cultural Heritage, by means of an application profile based on the CIDOC CRM ecosystem and other international standards.


Learning the Implicit Semantic Representation on Graph Structured Data. Existing representation learning methods in graph convolutional networks are mainly designed by describing the neighborhood of each node as a perceptual whole, while the implicit semantic associations behind highly complex interactions of graphs are largely unexploited. In this paper, we propose a Semantic Graph Convolutional Networks (SGCN) that explores the implicit semantics by learning latent semantic paths in graphs. In previous work, there are explorations of graph semantics via meta paths. However, these methods mainly rely on explicit heterogeneous information that is hard to be obtained in a large amount of graph structured data. SGCN first breaks through this restriction via leveraging the semantic paths dynamically and automatically during the node aggregating process. To evaluate our idea, we conduct sufficient experiments on several standard datasets, and the empirical results show the superior performance of our model.