Breakdown of light transport models in photonic scattering slabs with strong absorption and anisotropy. The radiative transfer equation (RTE) models the transport of light inside photonic scattering samples such as paint, foam and tissue. Analytic approximations to solve the RTE fail for samples with strong absorption and dominant anisotropic scattering and predict unphysical negative energy densities and the diffuse flux in the wrong direction. Here we fully characterize the unphysical regions of three popular approximations to the RTE for a slab, namely the P 1 approximation (or diffusion approximation), the P 3 approximation, and a popular modification to P 3 that corrects the forward scattering in the approximation. We find that the delta function correction to P 3 eliminates the unphysical range in the forward scattering. In addition, we compare the predictions of these analytical methods to exact Monte Carlo simulations for the physical and unphysical regions. We present maps of relative errors for the albedo and the anisotropy of the scatterers for a realistic index contrast typical of a polymer slab in air and optical thickness. The relative error maps provide a guideline for the accuracy of the analytical methods to interpret experiments on light transport in photonic scattering slabs. Our results show that the P 1 approximation is significantly inaccurate to extract transport parameters unless the sample scatters purely isotropic and elastic. The P 3 approximation exceeds P 1 in terms of accuracy in its physical range for moderate absorption, and the P 3 with the delta function correction is the most accurate approximation considered here for the forward direction.


Transformers with multi modal features and post fusion context for e commerce session based recommendation. Session based recommendation is an important task for e commerce services, where a large number of users browse anonymously or may have very distinct interests for different sessions. In this paper we present one of the winning solutions for the Recommendation task of the SIGIR 2021 Workshop on E commerce Data Challenge. Our solution was inspired by NLP techniques and consists of an ensemble of two Transformer architectures Transformer XL and XLNet trained with autoregressive and autoencoding approaches. To leverage most of the rich dataset made available for the competition, we describe how we prepared multi model features by combining tabular events with textual and image vectors. We also present a model prediction analysis to better understand the effectiveness of our architectures for the session based recommendation.


On the convexity theory of generating functions. In this paper, we extend our convexity theory for C 2 cost functions in optimal transportation to more general generating functions, which were originally introduced by the second author to extend the framework of optimal transportation to embrace near field geometric optics. In particular we provide an alternative geometric treatment to the previous analytic approach using differential inequalities, which also gives a different derivation of the invariance of the fundamental regularity conditions under duality. We also extend our local theory to cover the strict version of these conditions for C 2 cost and generating functions.


Bregman Circumcenters Monotonicity and Forward Weak Convergence. Recently, we systematically studied the basic theory of Bregman circumcenters in another paper. In this work, we aim to apply Bregman circumcenters to optimization algorithms. Here, we propose the forward Bregman monotonicity which is a generalization of the powerful Fej 'er monotonicity and show a weak convergence result of the forward Bregman monotone sequence. We also naturally introduce the Bregman circumcenter mappings associated with a finite set of operators. Then we provide sufficient conditions for the sequence of iterations of the forward Bregman circumcenter mapping to be forward Bregman monotone. Furthermore, we prove that the sequence of iterations of the forward Bregman circumcenter mapping weakly converges to a point in the intersection of the fixed point sets of relevant operators, which reduces to the known weak convergence result of the circumcentered method under the Euclidean distance. In addition, particular examples are provided to illustrate the Bregman isometry and Browder's demiclosedness principle, and our convergence result.


ILVR Conditioning Method for Denoising Diffusion Probabilistic Models. Denoising diffusion probabilistic models (DDPM) have shown remarkable performance in unconditional image generation. However, due to the stochasticity of the generative process in DDPM, it is challenging to generate images with the desired semantics. In this work, we propose Iterative Latent Variable Refinement (ILVR), a method to guide the generative process in DDPM to generate high quality images based on a given reference image. Here, the refinement of the generative process in DDPM enables a single DDPM to sample images from various sets directed by the reference image. The proposed ILVR method generates high quality images while controlling the generation. The controllability of our method allows adaptation of a single DDPM without any additional learning in various image generation tasks, such as generation from various downsampling factors, multi domain image translation, paint to image, and editing with scribbles.


The spatial structure of electrostatically forced Faraday waves. The instability of the interface between a dielectric and a conducting liquid, excited by a spatially homogeneous interface normal time periodic electric field, is studied based on experiments and theory. Special attention is paid to the spatial structure of the excited Faraday waves. The dominant modes of the instability are extracted using high speed imaging in combination with an algorithm evaluating light refraction at the liquid liquid interface. The influence of the liquid viscosities on the critical voltage corresponding to the onset of instability and on the dominant wavelength is studied. Overall, good agreement with theoretical predictions that are based on viscous fluids in an infinite domain is demonstrated. Depending on the relative influence of the domain boundary, the patterns exhibit either discrete modes corresponding to surface harmonics or boundary independent patterns. The agreement between experiments and theory confirms that the electrostatically forced Faraday instability is sufficiently well understood, which may pave the way to control electrostatically driven instabilities. Last but not least, the analogies to classical Faraday instabilities may enable new approaches to study effects that have so far only been observed for mechanical forcing.


On Surface Decarboxylation Coupling Facilitated by Lock to Unlock Variation of Molecules upon the Reaction. On surface synthesis (OSS) involving relatively high energy barriers remains challenging due to a typical dilemma firm molecular anchor is required to prevent molecular desorption upon the reaction, whereas sufficient lateral mobility is crucial for subsequent coupling and assembly. By locking the molecular precursors on the substrate then unlocking them during the reaction, we present a strategy to address this challenge. High yield synthesis based on well defined decarboxylation, intermediate transition and hexamerization is demonstrated, resulting in an extended and ordered network exclusively composed of the newly synthesized macrocyclic compound. Thanks to the steric hindrance of its maleimide group, we attain a preferential selection of the coupling. This work unlocks a promising path to enrich the reaction types and improve the coupling selectivity hence the structual homogeneity of the final product for OSS.


Precisely monotone sets in step 2 rank 3 Carnot algebras. A subset of a Carnot group is said to be precisely monotone if the restriction of its characteristic function to each integral curve of every left invariant horizontal vector field is monotone. Equivalently, a precisely monotone set is a h convex set with h convex complement. Such sets have been introduced and classified in the Heisenberg setting by Cheeger and Kleiner in the 2010's. In the present paper, we study precisely monotone sets in the wider setting of step 2 Carnot groups, equivalently step 2 Carnot algebras. In addition to general properties, we prove a classification in step 2 rank 3 Carnot algebras that generalizes the classification already known in the Heisenberg setting using sublevel sets of h affine functions. A significant novelty is that such sublevel sets can be different from half spaces.


Uniqueness of equivariant harmonic maps to symmetric spaces and buildings. We prove uniqueness of equivariant harmonic maps into irreducible symmetric spaces of non compact type and Euclidean buildings associated to isometric actions by Zariski dense subgroups.


Prior Aided Streaming Network for Multi task Affective Recognitionat the 2nd ABAW2 Competition. Automatic affective recognition has been an important research topic in human computer interaction (HCI) area. With recent development of deep learning techniques and large scale in the wild annotated datasets, the facial emotion analysis is now aimed at challenges in the real world settings. In this paper, we introduce our submission to the 2nd Affective Behavior Analysis in the wild (ABAW2) Competition. In dealing with different emotion representations, including Categorical Emotions (CE), Action Units (AU), and Valence Arousal (VA), we propose a multi task streaming network by a heuristic that the three representations are intrinsically associated with each other. Besides, we leverage an advanced facial expression embedding as prior knowledge, which is capable of capturing identity invariant expression features while preserving the expression similarities, to aid the down streaming recognition tasks. The extensive quantitative evaluations as well as ablation studies on the Aff Wild2 dataset prove the effectiveness of our proposed prior aided streaming network approach.


Morphological Matrices as a Tool for Crowdsourced Ideation. Designing a novel product is a difficult task not well suited for non expert crowd workers. In this work in progress paper, we first motivate why the design of persuasive products is an interesting context for studying creativity and the creative leap. We then present a pilot study on the crowdsourced design of persuasive products. The pilot study motivated our subsequent feasibility study on the use of morphological matrices as a tool for crowdsourced ideation and product design. Given the morphological matrix, workers were able to come up with valid and significantly more relevant ideas for novel persuasive products.


Generalized persistence and graded structures. We investigate the correspondence between generalized persistence modules and graded modules in the case the indexing set has a monoid action. We introduce the notion of an action category over a monoid graded ring. We show that the category of additive functors from this category to the category of Abelian groups is isomorphic to the category of modules graded over the set with a monoid action, and to the category of unital modules over a certain smash product. Furthermore, when the indexing set is a poset, we provide a new characterization for a generalized persistence module being finitely presented.


Monolithic vs. hybrid controller for multi objective Sim to Real learning. Simulation to real (Sim to Real) is an attractive approach to construct controllers for robotic tasks that are easier to simulate than to analytically solve. Working Sim to Real solutions have been demonstrated for tasks with a clear single objective such as "reach the target". Real world applications, however, often consist of multiple simultaneous objectives such as "reach the target" but "avoid obstacles". A straightforward solution in the context of reinforcement learning (RL) is to combine multiple objectives into a multi term reward function and train a single monolithic controller. Recently, a hybrid solution based on pre trained single objective controllers and a switching rule between them was proposed. In this work, we compare these two approaches in the multi objective setting of a robot manipulator to reach a target while avoiding an obstacle. Our findings show that the training of a hybrid controller is easier and obtains a better success failure trade off than a monolithic controller. The controllers trained in simulator were verified by a real set up.


Global well posedness for H 1 ( mathbb R ) perturbations of KdV with exotic spatial asymptotics. Given a suitable solution V(t,x) to the Korteweg de Vries equation on the real line, we prove global well posedness for initial data u(0,x) in V(0,x) H 1 ( mathbb R ) . Our conditions on V do include regularity but do not impose any assumptions on spatial asymptotics. We show that periodic profiles V(0,x) in H 5( mathbb R mathbb Z ) satisfy our hypotheses. In particular, we can treat localized perturbations of the much studied periodic traveling wave solutions (cnoidal waves) of KdV. In our companion paper we show that smooth step like initial data also satisfy our hypotheses. We employ the method of commuting flows introduced by Killip and Vi c s an in the special case V equiv 0 , we recover their sharp H 1 ( mathbb R ) result.


U Net Convolutional Network for Recognition of Vessels and Materials in Chemistry Lab. Convolutional networks have been widely applied for computer vision system. Encouraged by these results, a U Net convolutional network was applied to recognition of vessels and materials in chemistry lab using the recent Vector LabPics dataset, which contains 2187 images of materials within mostly transparent vessels in a chemistry lab and other general settings, labeled with 13 classes. By optimizing hyperparameters including learning rates and learning rate decays, 87 accuracy in vessel recognition was achieved. In the case of relatively small training and test sets (relatively rare materials states, the number of training set samples less than 500 and the number of test set samples less than 100), a comprehensive improvement over 18 in IoU and 19 in accuracy for the best model were achieved. Further improvements may be achievable by incorporating improved convolutional network structure into our models.


Leveraging GPU batching for scalable nonlinear programming through massive Lagrangian decomposition. We present the implementation of a trust region Newton algorithm ExaTron for bound constrained nonlinear programming problems, fully running on multiple GPUs. Without data transfers between CPU and GPU, our implementation has achieved the elimination of a major performance bottleneck under a memory bound situation, particularly when solving many small problems in batch. We discuss the design principles and implementation details for our kernel function and core operations. Different design choices are justified by numerical experiments. By using the application of distributed control of alternating current optimal power flow, where a large problem is decomposed into many smaller nonlinear programs using a Lagrangian approach, we demonstrate computational performance of ExaTron on the Summit supercomputer at Oak RidgeNational Laboratory. Our numerical results show the linear scaling with respect to the batch size and the number of GPUs and more than 35 times speedup on 6 GPUs than on 40 CPUs available on a single node.


Towards a Very Large Scale Traffic Simulator for Multi Agent Reinforcement Learning Testbeds. Smart traffic control and management become an emerging application for Deep Reinforcement Learning (DRL) to solve traffic congestion problems in urban networks. Different traffic control and management policies can be tested on the traffic simulation. Current DRL based studies are mainly supported by the microscopic simulation software (e.g., SUMO), while it is not suitable for city wide control due to the computational burden and gridlock effect. To the best of our knowledge, there is a lack of studies on the large scale traffic simulator for DRL testbeds, which could further hinder the development of DRL. In view of this, we propose a meso macro traffic simulator for very large scale DRL scenarios. The proposed simulator integrates mesoscopic and macroscopic traffic simulation models to improve efficiency and eliminate gridlocks. The mesoscopic link model simulates flow dynamics on roads, and the macroscopic Bathtub model depicts vehicle movement in regions. Moreover, both types of models can be hybridized to accommodate various DRL tasks. This creates portals for mixed transportation applications under different contexts. The result shows that the developed simulator only takes 46 seconds to finish a 24 hour simulation in a very large city with 2.2 million vehicles, which is much faster than SUMO. Additionally, we develop a graphic interface for users to visualize the simulation results in a web explorer. In the future, the developed meso macro traffic simulator could serve as a new environment for very large scale DRL problems.


From Multisets over Distributions to Distributions over Multisets. A well known challenge in the semantics of programming languages is how to combine non determinism and probability. At a technical level, the problem arises from the fact that there is a no distributive law between the powerset monad and the distribution monad as noticed some twenty years ago by Plotkin. More recently, it has become clear that there is a distributive law of the multiset monad over the distribution monad. This article elaborates the details of this distributivity and shows that there is a rich underlying theory relating multisets and probability distributions. It is shown that the new distributive law, called parallel multinomial law, can be defined in (at least) four equivalent ways. It involves putting multinomial distributions in parallel and commutes with hypergeometric distributions. Further, it is shown that this distributive law commutes with a new form of zipping for multisets. Abstractly, this can be described in terms of monoidal structure for a fixed size multiset functor, when lifted to the Kleisli category of the distribution monad. Concretely, an application of the theory to sampling semantics is included.


The direct force correction based framework for general co rotational analysis. The use of nonlinear projection matrix in co rotational (CR) analysis was pioneered by Rankin and Nour Omid in 1990s (Computers Structures, 30 (1988) 257 267 Comput. Methods Appl. Mech. Engrg., 93 (1991) 353 384), and has almost became a standard manner for CR formulations deduction over the past thirty years. This matrix however relies heavily on a hysterical and sophisticated derivation of the variation of the local displacements to the global ones, leading to complicated expressions for the internal force vector and the tangent stiffness matrix, which may devalue the simplicity and convenience for the original intention of using CR approach. This paper begins by making a discussion on existing element independent CR formulation and the objective is to develop a new and simple framework for general CR analysis that avoids using conventional nonlinear projection matrix. Multiple numerical examples involving various kinds of elements and different choices of element local CR frame are presented to demonstrate the performance of the proposed framework. The outcomes show that for all the examples the accuracy of the results are comparable with those obtained in conjunction with conventional nonlinear projection matrix.


A framework for data driven solution and parameter estimation of PDEs using conditional generative adversarial networks. This work is the first to employ and adapt the image to image translation concept based on conditional generative adversarial networks (cGAN) towards learning a forward and an inverse solution operator of partial differential equations (PDEs). Even though the proposed framework could be applied as a surrogate model for the solution of any PDEs, here we focus on steady state solutions of coupled hydro mechanical processes in heterogeneous porous media. Strongly heterogeneous material properties, which translate to the heterogeneity of coefficients of the PDEs and discontinuous features in the solutions, require specialized techniques for the forward and inverse solution of these problems. Additionally, parametrization of the spatially heterogeneous coefficients is excessively difficult by using standard reduced order modeling techniques. In this work, we overcome these challenges by employing the image to image translation concept to learn the forward and inverse solution operators and utilize a U Net generator and a patch based discriminator. Our results show that the proposed data driven reduced order model has competitive predictive performance capabilities in accuracy and computational efficiency as well as training time requirements compared to state of the art data driven methods for both forward and inverse problems.


On the experiences of adopting automated data validation in an industrial machine learning project. Background Data errors are a common challenge in machine learning (ML) projects and generally cause significant performance degradation in ML enabled software systems. To ensure early detection of erroneous data and avoid training ML models using bad data, research and industrial practice suggest incorporating a data validation process and tool in ML system development process. Aim The study investigates the adoption of a data validation process and tool in industrial ML projects. The data validation process demands significant engineering resources for tool development and maintenance. Thus, it is important to identify the best practices for their adoption especially by development teams that are in the early phases of deploying ML enabled software systems. Method Action research was conducted at a large software intensive organization in telecommunications, specifically within the analytics R D organization for an ML use case of classifying faults from returned hardware telecommunication devices. Results Based on the evaluation results and learning from our action research, we identified three best practices, three benefits, and two barriers to adopting the data validation process and tool in ML projects. We also propose a data validation framework (DVF) for systematizing the adoption of a data validation process. Conclusions The results show that adopting a data validation process and tool in ML projects is an effective approach of testing ML enabled software systems. It requires having an overview of the level of data (feature, dataset, cross dataset, data stream) at which certain data quality tests can be applied.


On chip erbium doped lithium niobate microring lasers. Lithium niobate on insulator (LNOI), regarded as an important candidate platform for optical integration due to its excellent nonlinear, electro optic and other physical properties, has become a research hotspot. Light source, as an essential component for integrated optical system, is urgently needed. In this paper, we reported the realization of 1550 nm band on chip LNOI microlasers based on erbium doped LNOI ring cavities with loaded quality factors higher than one million, which were fabricated by using electron beam lithography and inductively coupled plasma reactive ion etching processes. These microlasers demonstrated a low pump threshold of 20 mu W and stable performance under the pump of a 980 nm band continuous laser. Comb like laser spectra spanning from 1510 nm to 1580 nm were observed in high pump power regime, which lays the foundation of the realization of pulsed laser and frequency combs on rare earth ion doped LNOI platform. This work has effectively promoted the development of on chip integrated active LNOI devices.


An Analysis of Stochastic Variance Reduced Gradient for Linear Inverse Problems. Stochastic variance reduced gradient (SVRG) is a popular variance reduction technique for accelerating stochastic gradient descent (SGD). We provide a first analysis of the method for solving a class of linear inverse problems in the lens of the classical regularization theory. We prove that for a suitable constant step size schedule, the method can achieve an optimal convergence rate in terms of the noise level (under suitable regularity condition) and the variance of the SVRG iterate error is smaller than that by SGD. These theoretical findings are corroborated by a set of numerical experiments.


Large time limit of nonlinearly coupled measure valued equations that model many server queues with reneging. The large time behavior of a nonlinearly coupled pair of measure valued transport equations with discontinuous boundary conditions, parameterized by a positive real valued parameter lambda , is considered. These equations describe the hydrodynamic or fluid limit of many server queues with reneging (with traffic intensity lambda ), which model phenomena in diverse disciplines, including biology and operations research. For a broad class of reneging distributions with finite mean and service distributions with finite mean and hazard rate function that is either decreasing or bounded away from zero and infinity, it is shown that if the fluid equations have a unique invariant state, then the Dirac measure at this state is the unique random fixed point of the fluid equations, which implies that the stationary distributions of scaled N server systems converge to the unique invariant state of the corresponding fluid equations. Moreover, when lambda ne 1 , it is shown that the solution to the fluid equation starting from any initial condition converges to this unique invariant state in the large time limit. The proof techniques are different under the two sets of assumptions on the service distribution. When the hazard rate function is decreasing, a reformulation of the dynamics in terms of a certain renewal equation is used, in conjunction with recursive asymptotic estimates. When the hazard rate function is bounded away from zero and infinity, the proof uses an extended relative entropy functional as a Lyapunov function. Analogous large time convergence results are also established for a system of coupled measure valued equations modeling a multiclass queue.


Towards compact high efficiency grating couplers for visible wavelength photonics. While grating couplers have become the de facto standard for optical access to integrated silicon photonics platforms, performance at visible wavelengths, in moderate index contrast platforms like silicon nitride, leaves much to be desired. In particular, the index contrast governs the diffraction efficiency per grating tooth and resulting coupler length. In this work, we develop two ideas to address this problem a second order grating that sums multiple optical modes to increase its intensity output as a means to design efficient out couplers, and an embedded metal grating that enhances the attainable refractive index contrast. We experimentally evaluate the second device to be the more viable and present results that can be developed to realise compact efficient visible wavelength photonic interconnects, with a view towards cryogenic deployment, where space is significantly constrained.


SDR based Testbed for Real time CQI Prediction for URLLC. Ultra reliable Low Latency Communication (URLLC) is a key feature of 5G systems. The quality of service (QoS) requirements imposed by URLLC are less than 10ms delay and less than 10 5 packet loss rate (PLR). To satisfy such strict requirements with minimal channel resource consumption, the devices need to accurately predict the channel quality and select Modulation and Coding Scheme (MCS) for URLLC in a proper way. This paper presents a novel real time channel prediction system based on Software Defined Radio that uses a neural network. The paper also describes and shares an open channel measurement dataset that can be used to compare various channel prediction approaches in different mobility scenarios in future research on URLLC


Asymptotic Results for Rough Continuous state Branching Processes. In this paper we provide explicit representations of Laplace transforms of extinction time and total progeny of rough continuous state branching processes introduced in 7 . Also, we show that their tail distributions are much fatter than those of Feller branching diffusions.


A multi grid sampling multi scale method for crack initiation and propagation. In this study, a multi grid sampling multi scale (MGSMS) method is proposed by coupling with finite element (FEM), extended finite element (XFEM) and molecular dynamics (MD) methods.Crack is studied comprehensively from microscopic initiations to macroscopic propagation by MGSMS method. In order to establish the coupling relationship between macroscopic and microscopic model, multi grid FEM is used to transmit the macroscopic displacement boundary conditions to the atomic model and the multi grid XFEM is used to feedback the microscopic crack initiations to the macroscopic model. Moreover, an image recognition based crack extracting method is proposed to extract the crack coordinate from the MD result files of efficiently and the Latin hypercube sampling method is used to reduce the computational cost of MD. Numerical results show that MGSMS method can be used to calculate micro crack initiations and transmit it to the macro crack model. The crack initiation and propagation simulation of plate under mode I loading is completed.


Model Agnostic Answer Reranking System for Adversarial Question Answering. While numerous methods have been proposed as defenses against adversarial examples in question answering (QA), these techniques are often model specific, require retraining of the model, and give only marginal improvements in performance over vanilla models. In this work, we present a simple model agnostic approach to this problem that can be applied directly to any QA model without any retraining. Our method employs an explicit answer candidate reranking mechanism that scores candidate answers on the basis of their content overlap with the question before making the final prediction. Combined with a strong base QAmodel, our method outperforms state of the art defense techniques, calling into question how well these techniques are actually doing and strong these adversarial testbeds are.


AI and HPC enabled Lead Generation for SARS CoV 2 Models and Processes to Extract Druglike Molecules Contained in Natural Language Text. Researchers worldwide are seeking to repurpose existing drugs or discover new drugs to counter the disease caused by severe acute respiratory syndrome coronavirus 2 (SARS CoV 2). A promising source of candidates for such studies is molecules that have been reported in the scientific literature to be drug like in the context of coronavirus research. We report here on a project that leverages both human and artificial intelligence to detect references to drug like molecules in free text. We engage non expert humans to create a corpus of labeled text, use this labeled corpus to train a named entity recognition model, and employ the trained model to extract 10912 drug like molecules from the COVID 19 Open Research Dataset Challenge (CORD 19) corpus of 198875 papers. Performance analyses show that our automated extraction model can achieve performance on par with that of non expert humans.


Necessary and Sufficient Conditions for Optimal Control of Semilinear Stochastic Partial Differential Equations. Using a recently introduced representation of the second order adjoint state as the solution of a function valued backward stochastic partial differential equation (SPDE), we calculate the viscosity super and subdifferential of the value function evaluated along an optimal trajectory for controlled semilinear SPDEs. This establishes the well known connection between Pontryagin's maximum principle and dynamic programming within the framework of viscosity solutions. As a corollary, we derive that the correction term in the stochastic Hamiltonian arising in non smooth stochastic control problems is non positive. These results directly lead us to a stochastic verification theorem for fully nonlinear Hamilton Jacobi Bellman equations in the framework of viscosity solutions.


MultiCite Modeling realistic citations requires moving beyond the single sentence single label setting. Citation context analysis (CCA) is an important task in natural language processing that studies how and why scholars discuss each others' work. Despite decades of study, traditional frameworks for CCA have largely relied on overly simplistic assumptions of how authors cite, which ignore several important phenomena. For instance, scholarly papers often contain rich discussions of cited work that span multiple sentences and express multiple intents concurrently. Yet, CCA is typically approached as a single sentence, single label classification task, and thus existing datasets fail to capture this interesting discourse. In our work, we address this research gap by proposing a novel framework for CCA as a document level context extraction and labeling task. We release MultiCite, a new dataset of 12,653 citation contexts from over 1,200 computational linguistics papers. Not only is it the largest collection of expert annotated citation contexts to date, MultiCite contains multi sentence, multi label citation contexts within full paper texts. Finally, we demonstrate how our dataset, while still usable for training classic CCA models, also supports the development of new types of models for CCA beyond fixed width text classification. We release our code and dataset at https github.com allenai multicite.


CLIPDraw Exploring Text to Drawing Synthesis through Language Image Encoders. This work presents CLIPDraw, an algorithm that synthesizes novel drawings based on natural language input. CLIPDraw does not require any training rather a pre trained CLIP language image encoder is used as a metric for maximizing similarity between the given description and a generated drawing. Crucially, CLIPDraw operates over vector strokes rather than pixel images, a constraint that biases drawings towards simpler human recognizable shapes. Results compare between CLIPDraw and other synthesis through optimization methods, as well as highlight various interesting behaviors of CLIPDraw, such as satisfying ambiguous text in multiple ways, reliably producing drawings in diverse artistic styles, and scaling from simple to complex visual representations as stroke count is increased. Code for experimenting with the method is available at https colab.research.google.com github kvfrans clipdraw blob main clipdraw.ipynb


Run Time Monitoring of Machine Learning for Robotic Perception A Survey of Emerging Trends. As deep learning continues to dominate all state of the art computer vision tasks, it is increasingly becoming an essential building block for robotic perception. This raises important questions concerning the safety and reliability of learning based perception systems. There is an established field that studies safety certification and convergence guarantees of complex software systems at design time. However, the unknown future deployment environments of an autonomous system and the complexity of learning based perception make the generalization of design time verification to run time problematic. In the face of this challenge, more attention is starting to focus on run time monitoring of performance and reliability of perception systems with several trends emerging in the literature. This paper attempts to identify these trends and summarise the various approaches to the topic.


Data driven sparse skin stimulation can convey social touch information to humans. During social interactions, people use auditory, visual, and haptic cues to convey their thoughts, emotions, and intentions. Due to weight, energy, and other hardware constraints, it is difficult to create devices that completely capture the complexity of human touch. Here we explore whether a sparse representation of human touch is sufficient to convey social touch signals. To test this we collected a dataset of social touch interactions using a soft wearable pressure sensor array, developed an algorithm to map recorded data to an array of actuators, then applied our algorithm to create signals that drive an array of normal indentation actuators placed on the arm. Using this wearable, low resolution, low force device, we find that users are able to distinguish the intended social meaning, and compare performance to results based on direct human touch. As online communication becomes more prevalent, such systems to convey haptic signals could allow for improved distant socializing and empathetic remote human human interaction.


Maximal Unipotent Monodromy, congruences " a la Lucas" and Algebraic independence. Let f(z) in 1 z mathbb Q z and mathcal S be an infinite set of prime numbers such that, for all p in mathcal S , we can reduce f(z) modulo p . When f(z) is D finite, we usually get that f(z) mid p is algebraic over mathbb F p(z) . If in addition f(z) mid p cancels a polynomial of the form X A p(z)X p l , we can use these equations to obtain results of transcendence and algebraic independence over mathbb Q (z) . In this article, we look for conditions on the differential operators canceling f(z) which guarantee the existence of these particular equations. Suppose that f(z) cancels a differential operator mathcal H in mathbb Q (z) d dz endowed with a strong Frobenius structure for all p in mathcal S as well as a Fuchsian differential operator mathcal D in mathbb Q (z) d dz such that zero is a regular singular point of mathcal D and the zero exponents of mathcal D are all zero. Our main result establishes that for almost any p in mathcal S , f(z) mid p cancels a polynomial of the form X A p(z)X p l , where A p(z) is a rational fraction with coefficients in mathbb F p of height less than or equal to Cp 2l and C is a strictly positive constant independent of p . We also study the algebraic independence on mathbb Q (z) of these series.


Numerical analysis of a self similar turbulent flow in Bose Einstein condensates. We study a self similar solution of the kinetic equation describing weak wave turbulence in Bose Einstein condensates. This solution presumably corresponds to an asymptotic behavior of a spectrum evolving from a broad class of initial data, and it features a non equilibrium finite time condensation of the wave spectrum n( omega) at the zero frequency omega . The self similar solution is of the second kind, and it satisfies boundary conditions corresponding to a nonzero constant spectrum (with all its derivative being zero) at omega 0 and a power law asymptotic n( omega) to omega x at omega to infty x in mathbb R . Finding it amounts to solving a nonlinear eigenvalue problem, i.e. finding the value x of the exponent x for which these two boundary conditions can be satisfied simultaneously. To solve this problem we develop a new high precision algorithm based on Chebyshev approximations and double exponential formulas for evaluating the collision integral, as well as the iterative techniques for solving the integro differential equation for the self similar shape function. This procedures allow to achieve a solution with accuracy approx 4.7 which is realized for x approx 1.22 .


Backtracking (the) Algorithms on the Hamiltonian Cycle Problem. Even though the Hamiltonian cycle problem is NP complete, many of its problem instances aren't. In fact, almost all the hard instances reside in one area near the Koml 'os Szemer 'edi bound, of frac 1 2 v cdot ln(v) frac 1 2 v cdot ln( ln(v)) edges, where randomly generated graphs have an approximate 50 chance of being Hamiltonian. If the number of edges is either much higher or much lower, the problem is not hard most backtracking algorithms decide such instances in (near) polynomial time. Recently however, targeted search efforts have identified very hard Hamiltonian cycle problem instances very far away from the Koml 'os Szemer 'edi bound. In that study, the used backtracking algorithm was Vandegriend Culberson's, which was supposedly the most efficient of all Hamiltonian backtracking algorithms. In this paper, we make a unified large scale quantitative comparison for the best known backtracking algorithms described between 1877 and 2016. We confirm the suspicion that the Koml 'os Szemer 'edi bound is a hard area for all backtracking algorithms, but also that Vandegriend Culberson is indeed the most efficient algorithm, when expressed in consumed computing time. When measured in recursive effectiveness however, the algorithm by Frank Rubin, almost half a century old, performs best. In a more general algorithmic assessment, we conjecture that edge pruning and non Hamiltonicity checks might be largely responsible for these recursive savings. When expressed in system time however, denser problem instances require much more time per recursion. This is most likely due to the costliness of the extra search pruning procedures, which are relatively elaborate. We supply large amounts of experimental data, and a unified single program implementation for all six algorithms. All data and algorithmic source code is made public for further use by our colleagues.


Context aware short term interest first model for session based recommendation. In the case that user profiles are not available, the recommendation based on anonymous session is particularly important, which aims to predict the items that the user may click at the next moment based on the user's access sequence over a while. In recent years, with the development of recurrent neural network, attention mechanism, and graph neural network, the performance of session based recommendation has been greatly improved. However, the previous methods did not comprehensively consider the context dependencies and short term interest first of the session. Therefore, we propose a context aware short term interest first model (CASIF).The aim of this paper is improve the accuracy of recommendations by combining context and short term interest. In CASIF, we dynamically construct a graph structure for session sequences and capture rich context dependencies via graph neural network (GNN), latent feature vectors are captured as inputs of the next step. Then we build the short term interest first module, which can to capture the user's general interest from the session in the context of long term memory, at the same time get the user's current interest from the item of the last click. In the end, the short term and long term interest are combined as the final interest and multiplied by the candidate vector to obtain the recommendation probability. Finally, a large number of experiments on two real world datasets demonstrate the effectiveness of our proposed method.


Existence and uniqueness of solutions in fractional Orlicz Sobolev spaces for a nonlocal singular elliptic problem. In this article, we investigate the existence and uniqueness of a positive solution for a class of singular nonlinear elliptic problem with boundary condition. Our result holds in fractional Orlicz Sobolev spaces.


Unsupervised Learning of General Purpose Embeddings for Code Changes. Applying machine learning to tasks that operate with code changes requires their numerical representation. In this work, we propose an approach for obtaining such representations during pre training and evaluate them on two different downstream tasks applying changes to code and commit message generation. During pre training, the model learns to apply the given code change in a correct way. This task requires only code changes themselves, which makes it unsupervised. In the task of applying code changes, our model outperforms baseline models by 5.9 percentage points in accuracy. As for the commit message generation, our model demonstrated the same results as supervised models trained for this specific task, which indicates that it can encode code changes well and can be improved in the future by pre training on a larger dataset of easily gathered code changes.


D3D HOI Dynamic 3D Human Object Interactions from Videos. We introduce D3D HOI a dataset of monocular videos with ground truth annotations of 3D object pose, shape and part motion during human object interactions. Our dataset consists of several common articulated objects captured from diverse real world scenes and camera viewpoints. Each manipulated object (e.g., microwave oven) is represented with a matching 3D parametric model. This data allows us to evaluate the reconstruction quality of articulated objects and establish a benchmark for this challenging task. In particular, we leverage the estimated 3D human pose for more accurate inference of the object spatial layout and dynamics. We evaluate this approach on our dataset, demonstrating that human object relations can significantly reduce the ambiguity of articulated object reconstructions from challenging real world videos. Code and dataset are available at https github.com facebookresearch d3d hoi.


Episodic Transformer for Vision and Language Navigation. Interaction and navigation defined by natural language instructions in dynamic environments pose significant challenges for neural agents. This paper focuses on addressing two challenges handling long sequence of subtasks, and understanding complex human instructions. We propose Episodic Transformer (E.T.), a multimodal transformer that encodes language inputs and the full episode history of visual observations and actions. To improve training, we leverage synthetic instructions as an intermediate representation that decouples understanding the visual appearance of an environment from the variations of natural language instructions. We demonstrate that encoding the history with a transformer is critical to solve compositional tasks, and that pretraining and joint training with synthetic instructions further improve the performance. Our approach sets a new state of the art on the challenging ALFRED benchmark, achieving 38.4 and 8.5 task success rates on seen and unseen test splits.


Sparse Brudnyi and John Nirenberg Spaces. A generalization of the theory of Y. Brudnyi cite yuri , and A. and Y. Brudnyi cite BB20a , cite BB20b , is presented. Our construction connects Brudnyi's theory, which relies on local polynomial approximation, with new results on sparse domination. In particular, we find an analogue of the maximal theorem for the fractional maximal function, solving a problem proposed by Kruglyak Kuznetsov. Our spaces shed light on the structure of the John Nirenberg spaces. We show that SJN p (sparse John Nirenberg space) coincides with L p ,1 p infty. This characterization yields the John Nirenberg inequality by extrapolation and is useful in the theory of commutators.


Heteroclinic cycling and extinction in May Leonard models with demographic stochasticity. May and Leonard (SIAM J. Appl. Math 1975) introduced a three species Lotka Volterra type population model that exhibits heteroclinic cycling. Rather than producing a periodic limit cycle, the trajectory takes longer and longer to complete each "cycle", passing closer and closer to unstable fixed points in which one population dominates and the others approach zero. Aperiodic heteroclinic dynamics have subsequently been studied in ecological systems (side blotched lizards colicinogenic E. coli), in the immune system, in neural information processing models ("winnerless competition"), and in models of neural central pattern generators. Yet as May and Leonard observed "Biologically, the behavior (produced by the model) is nonsense. Once it is conceded that the variables represent animals, and therefore cannot fall below unity, it is clear that the system will, after a few cycles, converge on some single population, extinguishing the other two." Here, we explore different ways of introducing discrete stochastic dynamics based on May and Leonard's ODE model, with application to ecological population dynamics, and to a neuromotor central pattern generator system. We study examples of several quantitatively distinct asymptotic behaviors, including total extinction of all species, extinction to a single species, and persistent cyclic dominance with finite mean cycle length.


Brain Performance Analysis based on an Electroencephalogram Headset. Deficit of attention, anxiety, sleep disorders are some of the problems which affect many persons. As these issues can evolve into severe conditions, more factors should be taken into consideration. The paper proposes a conception which aims to help students to enhance their brain performance. An electrocephalogram headset is used to trigger the brainwaves, along with a web application which manages the input data which comes from the headset and from the user. Factors like current activity, mood, focus, stress, relaxation, engagement, excitement and interest are provided in numerical format through the use of the headset. The users offer information about their activities related to relaxation, listening to music, watching a movie, and studying. Based on the analysis, it was found that the users consider the application easy to use. As the users are more equilibrated emotionally, their results are improved. This allowed the persons to be more confident on themselves. In the case of students, the neurofeedback can be studied for the better sport and artistic performances, including the case of the attention deficit hyperactivity disorder. Aptitudes for a subject can be determined based on the relevant generated brainwaves. The learning environment is an important factor during the analysis of the results. Teachers, professors, students and parents can collaborate and, based on the gathered data, new teaching methods can be adopted in the classroom and at home. The proposed solution can guide the students while studying, as well as the persons who wish to be more productive while solving their tasks.


An Automated Approach for the Recognition of Bengali License Plates. Automatic Number Plate Recognition (ALPR) is a system for automatically identifying the license plates of any vehicle. This process is important for tracking, ticketing, and any billing system, among other things. With the use of information and communication technology (ICT), all systems are being automated, including the vehicle tracking system. This study proposes a hybrid method for detecting license plates using characters from them. Our captured image information was used for the recognition procedure in Bangladeshi vehicles, which is the topic of this study. Here, for license plate detection, the YOLO model was used where 81 was correctly predicted. And then, for license plate segmentation, Otsu's Thresholding was used and eventually, for character recognition, the CNN model was applied. This model will allow the vehicle's automated license plate detection system to avoid any misuse.


A binary operation on irreducible components of Lusztig's nilpotent varieties I definition and properties. We define a binary operation on the set of irreducible components of Lusztig's nilpotent varieties of a quiver. We study commutativity, cancellativity and associativity of this operation. We focus on rigid irreducible components and discuss inductive ways to construct them.


Bounding the Kirby Thompson invariant of spun knots. A bridge trisection of a smooth surface in S 4 is a decomposition analogous to a bridge splitting of a link in S 3 . The Kirby Thompson invariant of a bridge trisection measures its complexity in terms of distances between disc sets in the pants complex of the trisection surface. We give the first significant bounds for the Kirby Thompson invariant of spun knots. In particular, we show that the Kirby Thompson invariant of the spun trefoil is 15.


Phase retrieval for affine groups over prime fields. We study phase retrieval for group frames arising from permutation representations, focusing on the action of the affine group of a finite field. We investigate various versions of the phase retrieval problem, including conjugate phase retrieval, sign retrieval, and matrix recovery. Our main result establishes that the canonical irreducible representation of the affine group mathbb Z p rtimes mathbb Z p ast (with p prime), acting on the vectors in mathbb C p with zero sum, has the strongest retrieval property, allowing to reconstruct matrices from scalar products with a group orbit consisting of rank one projections. We explicitly characterize the generating vectors that ensure this property, provide a linear matrix recovery algorithm and explicit examples of vectors that allow matrix recovery. We also comment on more general permutation representations.


Moments of Orthogonal Polynomials and Exponential Generating Functions. Starting from the moment sequences of classical orthogonal polynomials we derive the orthogonality purely algebraically. We consider also the moments of ( q 1 ) classical orthogonal polynomials, and study those cases in which the exponential generating function has a nice form. In the opposite direction, we show that the generalized Dumont Foata polynomials with six parameters are the moments of rescaled continuous dual Hahn polynomials. Finally we show that one of our methods can be applied to deal with the moments of Askey Wilson polynomials.


BrainScaleS Large Scale Spike Communication using Extoll. The BrainScaleS Neuromorphic Computing System is currently connected to a compute cluster via Gigabit Ethernet network technology. This is convenient for the currently used experiment mode, where neuronal networks cover at most one wafer module. When modelling networks of larger size, as for example a full sized cortical microcircuit model, one has to think about connecting neurons across wafer modules to larger networks. This can be done, using the Extoll networking technology, which provides high bandwidth and low latencies, as well as a low overhead packet protocol format.


Backward Touchard congruence. The celebrated Touchard congruence states that B n p B n B n 1 modulo p , where p is a prime number and B n denotes the Bell number. In this paper we study divisibility properties of B n p and their generalizations involving higher powers of p as well as the r Bell numbers. In particular, we show a closely relation of the considered problem to the Sun Zagier congruence, which is additionally improved by deriving mbox a new relation between r Bell and derangement numbers. Finally, we conclude some results on the period of the Bell numbers modulo p .


From Extreme Multi label to Multi class A Hierarchical Approach for Automated ICD 10 Coding Using Phrase level Attention. Clinical coding is the task of assigning a set of alphanumeric codes, referred to as ICD (International Classification of Diseases), to a medical event based on the context captured in a clinical narrative. The latest version of ICD, ICD 10, includes more than 70,000 codes. As this is a labor intensive and error prone task, automatic ICD coding of medical reports using machine learning has gained significant interest in the last decade. Existing literature has modeled this problem as a multi label task. Nevertheless, such multi label approach is challenging due to the extremely large label set size. Furthermore, the interpretability of the predictions is essential for the endusers (e.g., healthcare providers and insurance companies). In this paper, we propose a novel approach for automatic ICD coding by reformulating the extreme multi label problem into a simpler multi class problem using a hierarchical solution. We made this approach viable through extensive data collection to acquire phrase level human coder annotations to supervise our models on learning the specific relations between the input text and predicted ICD codes. Our approach employs two independently trained networks, the sentence tagger and the ICD classifier, stacked hierarchically to predict a codeset for a medical report. The sentence tagger identifies focus sentences containing a medical event or concept relevant to an ICD coding. Using a supervised attention mechanism, the ICD classifier then assigns each focus sentence with an ICD code. The proposed approach outperforms strong baselines by large margins of 23 in subset accuracy, 18 in micro F1, and 15 in instance based F 1. With our proposed approach, interpretability is achieved not through implicitly learned attention scores but by attributing each prediction to a particular sentence and words selected by human coders.


NANOG GATA6 Interactions Revisited A Statistical Mechanics Approach towards Cell Fate Decisions. In preimplantation mammalian embryos, the second cell fate decision introduces spatial patterns of embryonic and extra embryonic precursor cells. The transcription factors NANOG and GATA6 are the earliest markers for the two cell types and interact between cells via the fibroblast growth factor signaling pathway. Computational models have been used to mimic the patterns and cell type proportions found in experimental studies. However, these models are always phenomenological in nature and lack a proper physical explanation. We derive a cell fate decision model motivated by the ideas of statistical mechanics. The model incorporates intra and intercellular interactions of NANOG and GATA6. A detailed mathematical analysis on the resulting dynamical system is presented. We find that our model is capable of generating tissue wide spatial patterns of the two cell types. Its advantages are revealed in the simple physical and biological interpretation of the parameters and their interactions. In numerical simulations, we showcase the ability to replicate checkerboard patterns of different cell type proportions varying only a single parameter. The tight control of the system as well as the ease of use and the direct expandability to other signaling types provide solid reasons for the continued use of our model. We are convinced that our approach presents an exciting perspective in relation to cell fate decisions. Moreover, the concepts are generalizable to questions regarding cell signaling beyond the mammalian embryo.


Learning physics confers pose sensitivity in structure based virtual screening. In drug discovery, structure based virtual high throughput screening (vHTS) campaigns aim to identify bioactive ligands or "hits" for therapeutic protein targets from docked poses at specific binding sites. However, while generally successful at this task, many deep learning methods are known to be insensitive to protein ligand interactions, decreasing the reliability of hit detection and hindering discovery at novel binding sites. Here, we overcome this limitation by introducing a class of models with two key features 1) we condition bioactivity on pose quality score, and 2) we present poor poses of true binders to the model as negative examples. The conditioning forces the model to learn details of physical interactions. We evaluate these models on a new benchmark designed to detect pose sensitivity.


Monte Carlo Information Oriented Planning. In this article, we discuss how to solve information gathering problems expressed as rho POMDPs, an extension of Partially Observable Markov Decision Processes (POMDPs) whose reward rho depends on the belief state. Point based approaches used for solving POMDPs have been extended to solving rho POMDPs as belief MDPs when its reward rho is convex in B or when it is Lipschitz continuous. In the present paper, we build on the POMCP algorithm to propose a Monte Carlo Tree Search for rho POMDPs, aiming for an efficient on line planner which can be used for any rho function. Adaptations are required due to the belief dependent rewards to (i) propagate more than one state at a time, and (ii) prevent biases in value estimates. An asymptotic convergence proof to epsilon optimal values is given when rho is continuous. Experiments are conducted to analyze the algorithms at hand and show that they outperform myopic approaches.


On Decentralized Multi Transmitter Coded Caching. This paper investigates a setup consisting of multiple transmitters serving multiple cache enabled clients through a linear network, which covers both wired and wireless transmission situations. We investigate decentralized coded caching scenarios in which there is either no cooperation or limited cooperation between the clients at the cache content placement phase. For the fully decentralized caching case (i.e., no cooperation) we analyze the performance of the system in terms of the Coding Delay metric. Furthermore, we investigate a hybrid cache content placement scenario in which there are two groups of users with different cache content placement situations (i.e., limited cooperation). Also, we examine the effect of finite file size in above scenarios.


Enhancing exploration algorithms for navigation with visual SLAM. Exploration is an important step in autonomous navigation of robotic systems. In this paper we introduce a series of enhancements for exploration algorithms in order to use them with vision based simultaneous localization and mapping (vSLAM) methods. We evaluate developed approaches in photo realistic simulator in two modes with ground truth depths and neural network reconstructed depth maps as vSLAM input. We evaluate standard metrics in order to estimate exploration coverage.


Dirichlet series for complex powers of the Riemann zeta function. To obtain the Dirichlet series for complex powers of the Riemann zeta function, we define and study the basic properties of a sequence of polynomials that, used as coefficients of the respective terms of the Dirichlet series of the Riemann zeta function in the half plane x 1 , produces the required exponential function. Unlike the method described in ( 4 , p. 278), which requires more advanced knowledge of the relationships between Dirichlet series and multiplicative arithmetic functions, our approach only needs mathematical induction on the total number of prime divisors of n , the Dirichlet product and the use of an analytic property characteristic of the exponential function in the complex plane.


Sound Event Detection Guided by Semantic Contexts of Scenes. Some studies have revealed that contexts of scenes (e.g., "home," "office," and "cooking") are advantageous for sound event detection (SED). Mobile devices and sensing technologies give useful information on scenes for SED without the use of acoustic signals. However, conventional methods can employ pre defined contexts in inference stages but not undefined contexts. This is because one hot representations of pre defined scenes are exploited as prior contexts for such conventional methods. To alleviate this problem, we propose scene informed SED where pre defined scene agnostic contexts are available for more accurate SED. In the proposed method, pre trained large scale language models are utilized, which enables SED models to employ unseen semantic contexts of scenes in inference stages. Moreover, we investigated the extent to which the semantic representation of scene contexts is useful for SED. Experimental results performed with TUT Sound Events 2016 2017 and TUT Acoustic Scenes 2016 2017 datasets show that the proposed method improves micro and macro F scores by 4.34 and 3.13 percentage points compared with conventional Conformer and CNN BiGRU based SED, respectively.


Universal enveloping algebras of Lie Rinehart algebras as a left adjoint functor. We prove how the universal enveloping algebra constructions for Lie Rinehart algebras and anchored Lie algebras are naturally left adjoint functors. This provides a conceptual motivation for the universal properties these constructions satisfy. As a supplement, the categorical approach offers new insights into the definitions of Lie Rinehart algebra morphisms, of modules over Lie Rinehart algebras and of the infinitesimal gauge algebra of a module.


A New Type Warped Product Metric in Contact Geometry. In this study, we show that there is an alpha Sasakian structure on product manifold M 1 times beta (I) where M 1 is a Kaehlerian manifold that has exact 1 form and beta (I) is an open curve. After then, we define a new type warped product metric to study the warped product of almost Hermitian manifolds with almost contact metric manifolds.


SHAPr An Efficient and Versatile Membership Privacy Risk Metric for Machine Learning. Data used to train machine learning (ML) models can be sensitive. Membership inference attacks (MIAs), attempting to determine whether a particular data record was used to train an ML model, risk violating membership privacy. ML model builders need a principled definition of a metric that enables them to quantify the privacy risk of (a) individual training data records, (b) independently of specific MIAs, (c) efficiently. None of the prior work on membership privacy risk metrics simultaneously meets all of these criteria. We propose such a metric, SHAPr, which uses Shapley values to quantify a model's memorization of an individual training data record by measuring its influence on the model's utility. This memorization is a measure of the likelihood of a successful MIA. Using ten benchmark datasets, we show that SHAPr is effective (precision 0.94 pm 0.06 , recall 0.88 pm 0.06 ) in estimating susceptibility of a training data record for MIAs, and is efficient (computable within minutes for smaller datasets and in 90 minutes for the largest dataset). SHAPr is also versatile in that it can be used for other purposes like assessing fairness or assigning valuation for subsets of a dataset. For example, we show that SHAPr correctly captures the disproportionate vulnerability of different subgroups to MIAs. Using SHAPr, we show that the membership privacy risk of a dataset is not necessarily improved by removing high risk training data records, thereby confirming an observation from prior work in a significantly extended setting (in ten datasets, removing up to 50 of data).


Experience vs Data A Case for More Data informed Retrospective Activities. Effective Retrospective meetings are vital for ensuring productive development processes because they provide the means for Agile software development teams to discuss and decide on future improvements of their collaboration. Retrospective agendas often include activities that encourage sharing ideas and motivate participants to discuss possible improvements. The outcomes of these activities steer the future directions of team dynamics and influence team happiness. However, few empirical evaluations of Retrospective activities are currently available. Additionally, most activities rely on team members experiences and neglect to take existing project data into account. With this paper we want to make a case for data driven decision making principles, which have largely been adopted in other business areas. Towards this goal we review existing retrospective activities and highlight activities that already use project data as well as activities that could be augmented to take advantage of additional, more subjective data sources. We conclude that data driven decision making principles, are advantageous, and yet underused, in modern Agile software development. Making use of project data in retrospective activities would strengthen this principle and is a viable approach as such data can support the teams in making decisions on process improvement.


Towards Consistent Document level Entity Linking Joint Models for Entity Linking and Coreference Resolution. We consider the task of document level entity linking (EL), where it is important to make consistent decisions for entity mentions over the full document jointly. We aim to leverage explicit "connections" among mentions within the document itself we propose to join the EL task with that of coreference resolution (coref). This is complementary to related works that exploit either (i) implicit document information (e.g., latent relations among entity mentions, or general language models) or (ii) connections between the candidate links (e.g, as inferred from the external knowledge base). Specifically, we cluster mentions that are linked via coreference, and enforce a single EL for all of the clustered mentions together. The latter constraint has the added benefit of increased coverage by joining EL candidate lists for the thus clustered mentions. We formulate the coref EL problem as a structured prediction task over directed trees and use a globally normalized model to solve it. Experimental results on two datasets show a boost of up to 5 F1 score on both coref and EL tasks, compared to their standalone counterparts. For a subset of hard cases, with individual mentions lacking the correct EL in their candidate entity list, we obtain a 50 increase in accuracy.


RAP Robustness Aware Perturbations for Defending against Backdoor Attacks on NLP Models. Backdoor attacks, which maliciously control a well trained model's outputs of the instances with specific triggers, are recently shown to be serious threats to the safety of reusing deep neural networks (DNNs). In this work, we propose an efficient online defense mechanism based on robustness aware perturbations. Specifically, by analyzing the backdoor training process, we point out that there exists a big gap of robustness between poisoned and clean samples. Motivated by this observation, we construct a word based robustness aware perturbation to distinguish poisoned samples from clean samples to defend against the backdoor attacks on natural language processing (NLP) models. Moreover, we give a theoretical analysis about the feasibility of our robustness aware perturbation based defense method. Experimental results on sentiment analysis and toxic detection tasks show that our method achieves better defending performance and much lower computational costs than existing online defense methods. Our code is available at https github.com lancopku RAP.


Class fields, Dirichlet characters and extended genus fields of global function fields. We obtain the extended genus field of an abelian extension of a rational function field. We follow the definition of Angl es and Jaulent, which uses class field theory. First we show that the natural definition of extended genus field of a cyclotomic function field obtained by means of Dirichlet characters is the same as the one given by Angl es and Jaulent. Next we study the extended genus field of a finite abelian extension of a rational function field along the lines of the study of genus fields of abelian extensions of rational function fields and compare this approach with the one given by Angl es and Jaulent.


A Statutory Article Retrieval Dataset in French. Statutory article retrieval is the task of automatically retrieving law articles relevant to a legal question. While recent advances in natural language processing have sparked considerable interest in many legal tasks, statutory article retrieval remains primarily untouched due to the scarcity of large scale and high quality annotated datasets. To address this bottleneck, we introduce the Belgian Statutory Article Retrieval Dataset (BSARD), which consists of 1,100 French native legal questions labeled by experienced jurists with relevant articles from a corpus of 22,600 Belgian law articles. Using BSARD, we benchmark several state of the art retrieval approaches, including lexical and dense architectures, both in zero shot and supervised setups. We find that fine tuned dense retrieval models significantly outperform other systems. Our best performing baseline achieves 74.8 R 100, which is promising for the feasibility of the task and indicates there is still room for improvement. By the specificity of the domain and addressed task, BSARD presents a unique challenge problem for future research on legal information retrieval. Our dataset and source code are publicly available.


X view Non egocentric Multi View 3D Object Detector. 3D object detection algorithms for autonomous driving reason about 3D obstacles either from 3D birds eye view or perspective view or both. Recent works attempt to improve the detection performance via mining and fusing from multiple egocentric views. Although the egocentric perspective view alleviates some weaknesses of the birds eye view, the sectored grid partition becomes so coarse in the distance that the targets and surrounding context mix together, which makes the features less discriminative. In this paper, we generalize the research on 3D multi view learning and propose a novel multi view based 3D detection method, named X view, to overcome the drawbacks of the multi view methods. Specifically, X view breaks through the traditional limitation about the perspective view whose original point must be consistent with the 3D Cartesian coordinate. X view is designed as a general paradigm that can be applied on almost any 3D detectors based on LiDAR with only little increment of running time, no matter it is voxel grid based or raw point based. We conduct experiments on KITTI and NuScenes datasets to demonstrate the robustness and effectiveness of our proposed X view. The results show that X view obtains consistent improvements when combined with four mainstream state of the art 3D methods SECOND, PointRCNN, Part A 2, and PV RCNN.


Predicting Relative Thresholds for Object Oriented Metrics. Object oriented software metrics provide a numerical characterization of software quality. They have also been used in the assessment and identification of technical debt. However, metrics generally need to be used with thresholds as reference points that help to interpret their values properly and objectively. The problem is that, while there are many proposed metrics, there are relatively few studies on thresholds and threshold calculation methods hence, the effective application of metrics in practice has been limited. Moreover, although it has been acknowledged that thresholds should not be absolute, but rather relative to certain contextual factors, the context is still not considered in most threshold studies. In this paper, the relationship between system size (as a contextual factor) and metric thresholds is investigated. The objective is to build predictive models that estimate thresholds based solely on system size, and to assess the feasibility of this approach as a threshold estimation method. An empirical study is conducted for this purpose using 36 defect prediction datasets and six metrics. The results show that the proposed threshold estimation method is feasible, and it can achieve an accuracy remarkably comparable to more complex threshold models.


Moonshine at Landau Ginzburg points. We formulate a conjecture predicting unexpected relationships among the coefficients of the elliptic expansions of Klein's modular j function around j 0 and j 1728. Our conjecture is inspired by recent developments in mirror symmetry, in particular by work of Tu computing categorical enumerative invariants of matrix factorization categories and by work of Li Shen Zhou computing FJRW invariants of elliptic curves.


Prototype Design of a Timing and Fast Control system in the CBM Experiment. The Compressed Baryonic Matter (CBM) experiment is designed to handle interaction rates of up to 10 MHz and up to 1 TB s of raw data generated. With triggerless streaming data acquisition in the experiment and beam intensity fluctuations, it is expected that occasional data bursts will surpass bandwidth capabilities of the Data Acquisition System (DAQ) system. In order to preserve integrity of event data, the bandwidth of DAQ must be throttled in an organised way with minimum information loss. The Timing and Fast Control (TFC) system provides a latency optimised datapath for throttling commands and distributes a system clock together with a global timestamp. This paper describes a prototype design of the system with focus on synchronisation and its evaluation.


A Survey of Knowledge Enhanced Pre trained Models. Pre trained models learn contextualized word representations on large scale text corpus through a self supervised learning method, which has achieved promising performance after fine tuning. These models, however, suffer from poor robustness and lack of interpretability. Pre trained models with knowledge injection, which we call knowledge enhanced pre trained models (KEPTMs), possess deep understanding and logical reasoning and introduce interpretability to some extent. In this survey, we provide a comprehensive overview of KEPTMs for natural language processing. We first introduce the progress of pre trained models and knowledge representation learning. Then we systematically categorize existing KEPTMs from three different perspectives. Finally, we outline some potential directions of KEPTMs for future research.


Directional dark field implicit x ray speckle tracking using an anisotropic diffusion Fokker Planck equation. When a macroscopic sized non crystalline sample is illuminated using coherent x ray radiation, a bifurcation of photon energy flow may occur. The coarse grained complex refractive index of the sample may be considered to attenuate and refract the incident coherent beam, leading to a coherent component of the transmitted beam. Spatially unresolved sample microstructure, associated with the fine grained components of the complex refractive index, introduces a diffuse component to the transmitted beam. This diffuse photon scattering channel may be viewed in terms of position dependent fans of ultra small angle x ray scatter. These position dependent fans, at the exit surface of the object, may under certain circumstances be approximated as having a locally elliptical shape. By using an anisotropic diffusion Fokker Planck approach to model this bifurcated x ray energy flow, we show how all three components (attenuation, refraction and locally elliptical diffuse scatter) may be recovered. This is done via x ray speckle tracking, in which the sample is illuminated with spatially random x ray fields generated by coherent illumination of a spatially random membrane. The theory is developed, and then successfully applied to experimental x ray data.


Parametric study of upstream flame propagation in hydrogen enriched premixed combustion effects of swirl, geometry and premixedness. The effect of swirl, premixedness and geometry has been investigated for hydrogen enriched premixed flame using Large Eddy Simulation (LES) with a Thickened Flame (TF) model. Swirl strength has been varied to study the effects of swirl on flame behavior in a laboratory scale premixed combustor operated under atmospheric conditions. In addition, the levels of premixedness and geometry have also been changed to study the role of these quantities on flame behavior. The turbulent flow field and the chemistry are coupled through TF model. In the LES TF approach, the flame front is resolved on the computational grid through artificial thickening and the individual species transport equations are directly solved with the reaction rates specified using Arrhenius chemistry. Good agreement is found when comparing predictions with the published experimental data including the predicted RMS fluctuations. Also, the results show that higher swirl strength and increase in level of premixedness make the system more susceptible to upstream flame movement due to higher combustibility of hydrogen, which increases the reaction along the flame front, thereby raises temperature in the reaction zone and leads to combustion induced vortex breakdown (CIVB). Moreover, upstream flame movement is always observed at higher swirl strength irrespective of level of premixedness and burner geometry, whereas the premixed systems exhibit stable behavior while operating at low swirl.


An algorithm for the Faulhaber polynomials. Let S p(n) denote the sum of p th powers of the first n positive integers 1 p 2 p cdots n p . In this paper, first we express S p(n) in the so called Faulhaber form, namely, as an even or odd polynomial in (n 1 2) , according as p is odd or even. Then, using the relation S p(n) S p(n 1) n p , we derive a recursive formula for the associated Faulhaber coefficients. Applying Cramer's rule to the corresponding system of equations, we obtain an explicit determinant formula for the said coefficients. Furthermore, we show how to convert the (even or odd) Faulhaber polynomials in (n 1 2) into polynomials in S 1(n) for any arbitrary p , and vice versa.


An approach utilizing negation of extended dimensional vector of disposing mass for ordinal evidences combination in a fuzzy environment. How to measure the degree of uncertainty of a given frame of discernment has been a hot topic for years. A lot of meaningful works have provided some effective methods to measure the degree properly. However, a crucial factor, sequence of propositions, is missing in the definition of traditional frame of discernment. In this paper, a detailed definition of ordinal frame of discernment has been provided. Besides, an innovative method utilizing a concept of computer vision to combine the order of propositions and the mass of them is proposed to better manifest relationships between the two important element of the frame of discernment. More than that, a specially designed method covering some powerful tools in indicating the degree of uncertainty of a traditional frame of discernment is also offered to give an indicator of level of uncertainty of an ordinal frame of discernment on the level of vector.


Fair Decision Making for Food Inspections. Data and algorithms are essential and complementary parts of a large scale decision making process. However, their injudicious use can lead to unforeseen consequences, as has been observed by researchers and activists alike in the recent past. In this paper, we revisit the application of predictive models by the Chicago Department of Public Health to schedule restaurant inspections and prioritize the detection of critical food code violations. We perform the first analysis of the model's fairness to the population served by the restaurants in terms of average time to find a critical violation. We find that the model treats inspections unequally based on the sanitarian who conducted the inspection and that, in turn, there are geographic disparities in the benefits of the model. We examine four alternate methods of model training and two alternative ways of scheduling using the model and find that the latter generate more desirable results. The challenges from this application point to important directions for future work around fairness with collective entities rather than individuals, the use of critical violations as a proxy, and the disconnect between fair classification and fairness in the dynamic scheduling system.


Estimating the 3D Time Variable Water Vapor Contents of the Troposphere from a Single GNSS Receiver. We describe here a new algorithm to model the water contents of the atmosphere from GNSS slant wet delays relative to a single receiver. We first make the assumption that the water vapor contents are mainly governed by a scale height (exponential law), and secondly that the departures from this decaying exponential can be mapped as a set of low degree 3D Zernike functions (w.r.t. space) and Tchebyshev polynomials (w.r.t. time.) We give an example of inversion with data acquired over a one day time span at the Geodesy Observatory of Tahiti.


AndroidCompass A Dataset of Android Compatibility Checks in Code Repositories. Many developers and organizations implement apps for Android, the most widely used operating system for mobile devices. Common problems developers face are the various hardware devices, customized Android variants, and frequent updates, forcing them to implement workarounds for the different versions and variants of Android APIs used in practice. In this paper, we contribute the Android Compatibility checkS dataSet (AndroidCompass) that comprises changes to compatibility checks developers use to enforce workarounds for specific Android versions in their apps. We extracted 80,324 changes to compatibility checks from 1,394 apps by analyzing the version histories of 2,399 projects from the F Droid catalog. With AndroidCompass, we aim to provide data on when and how developers introduced or evolved workarounds to handle Android incompatibilities. We hope that AndroidCompass fosters research to deal with version incompatibilities, address potential design flaws, identify security concerns, and help derive solutions for other developers, among others helping researchers to develop and evaluate novel techniques, and Android app as well as operating system developers in engineering their software.


On the motion of an evaporating respiratory droplet. An analysis of the projectile motion in stagnant air is presented for an evaporating respiratory micro droplet which has been ejected from the mouth as an isolated droplet. It is assumed that the air resistance is a nonlinear function of the droplet's velocity and that the rate of decrease of the droplet's external surface area depends only on the relative humidity and the ambient temperature. The droplet's initial content is considered to be 98 wt water, 1 wt salt and 1 wt protein. The change of the average density of the droplet due to water evaporation is determined, up to the instant when the droplet reduces to its nucleus, consisting of salt and dry protein only. The numerical solution of the governing differential equations of droplet's motion gives the trajectories of different sized droplets ejected at different velocities and angles, and under different relative humidities and rates of evaporation. The evaporation times are compared with the times for droplets to reach the ground after being ejected from a given height. The maximum horizontal and vertical distances reached by the droplet are evaluated in the presence of wind and discussed in the context of possible infection spreading.


A unified approach to nonlinear Perron Frobenius theory. Let f mathbb R n 0 rightarrow mathbb R n 0 be an order preserving and homogeneous function. We show that the set of eigenvectors of f in mathbb R n 0 is nonempty and bounded in Hilbert's projective metric if and only if f satisfies a condition involving upper and lower Collatz Wielandt numbers of readily computed auxiliary functions. This condition generalizes a test for the existence of eigenvectors using hypergraphs that was proved by Akian, Gaubert, and Hochart. We include several examples to show how the new condition can be combined with the hypergraph test to give a systematic approach to determine when homogeneous and order preserving functions have eigenvectors in mathbb R n 0 . We also observe that if the entries of f are real analytic functions on mathbb R n 0 , then the set of eigenvectors of f in mathbb R n 0 is nonempty and bounded in Hilbert's projective metric if and only if the eigenvector is unique, up to scaling.


Elongation of Curvature Bounded Path. The paper is concerned with elongating the shortest curvature bounded path between two oriented points to an expected length. The elongation of curvature bounded paths to an expected length is fundamentally important to plan missions for nonholonomic constrained vehicles in many practical applications, such as coordinating multiple nonholonomic constrained vehicles to reach a destination simultaneously or performing a mission with a strict time window. In the paper, the explicit conditions for the existence of curvature bounded paths joining two oriented points with an expected length are established by applying the properties of the reachability set of curvature bounded paths. These existence conditions are numerically verifiable, allowing readily checking the existence of curvature bounded paths between two prescribed oriented points with a desired length. In addition, once the existence conditions are met, elongation strategies are provided in the paper to get curvature bounded paths with expected lengths. Finally, some examples of minimum time path planning for multiple fixed wing aerial vehicles to cooperatively achieve a triangle shaped flight formation are presented, illustrating and verifying the developments of the paper.


Sobolev homeomorphic extensions from two to three dimensions. We study the basic question of characterizing which boundary homeomorphisms of the unit sphere can be extended to a Sobolev homeomorphism of the interior in 3D space. While the planar variants of this problem are well understood, completely new and direct ways of constructing an extension are required in 3D. We prove, among other things, that a Sobolev homeomorphism varphi colon mathbb R 2 to mathbb R 2 in W loc 1,p ( mathbb R 2 , mathbb R 2) for some p in 1, infty ) admits a homeomorphic extension h colon mathbb R 3 to mathbb R 3 in W loc 1,q ( mathbb R 3, mathbb R 3) for 1 le q frac 3 2 p . Such an extension result is nearly sharp, as the bound q frac 3 2 p cannot be improved due to the H "older embedding. The case q 3 gains an additional interest as it also provides an L 1 variant of the celebrated Beurling Ahlfors extension result.


Fourier based Video Prediction through Relational Object Motion. The ability to predict future outcomes conditioned on observed video frames is crucial for intelligent decision making in autonomous systems. Recently, deep recurrent architectures have been applied to the task of video prediction. However, this often results in blurry predictions and requires tedious training on large datasets. Here, we explore a different approach by (1) using frequency domain approaches for video prediction and (2) explicitly inferring object motion relationships in the observed scene. The resulting predictions are consistent with the observed dynamics in a scene and do not suffer from blur.


Addendum Hidden symmetries, trivial conservation laws and Casimir invariants in geophysical fluid dynamics (2018 J. Phys. Commun. 2 115018). An extension is proposed to the internal symmetry transformations associated with mass, entropy and other Clebsch related conservation in geophysical fluid dynamics. Those symmetry transformations were previously parameterized with an arbitrary function cal F of materially conserved Clebsch potentials. The extension consists in adding potential vorticity q to the list of fields on which a new arbitrary function cal G depends. If cal G q cal A (s) , where cal A (s) is an arbitrary function of specific entropy s , then the symmetry is trivial and gives rise to a trivial conservation law. Otherwise, the symmetry is non trivial and an associated non trivial conservation law exists. Moreover, the notions of trivial and non trivial Casimir invariants are defined. All non trivial symmetries that become hidden following a reduction of phase space are associated with non trivial Casimir invariants of a non canonical Hamiltonian formulation for fluids, while all trivial conservation laws are associated with trivial Casimir invariants.


The influence of SARS CoV 2 variants on national case fatality rates. Background During 2021 several new variants of the SARS CoV 2 virus appeared with both increased levels of transmissibility and virulence with respect to the original wild variant. The Delta (B.1.617.2) variation, first seen in India, dominates COVID 19 infections in several large countries including the United States and India. Most recently, the Lambda variant of interest with increased resistance to vaccines has spread through much of South America. Objective This research explores the degree to which new variants of concern 1) generate spikes and waves of fluctuations in the daily case fatality rates (CFR) across countries in several regions in the face of increasing levels of vaccination of national populations and 2) may increase the vulnerability of persons with certain comorbidities. Methods This study uses new, openly available, epidemiological statistics reported to the relevant national and international authorities for countries across the Americas, Europe, Africa, Asia and the Middle East. Daily CFRs and correlations of fatal COVID 19 infections with potential cofactors are computed for the first half of 2021 that has been dominated by the wide spread of several variants of concern as denoted by the World Health Organization. Results The analysis yields a new quantitative measure of the temporal dynamics of mortality due to SARS CoV 2 infections in the form of variations of a proxy case fatality rate compared on a country to country basis in the same region. It also finds minimal variation of correlation between the cofactors based on WHO data and on the average apparent case fatality rate.


Cofinal types on omega 2 . In this paper we start the analysis of the class mathcal D aleph 2 , the class of cofinal types of directed sets of cofinality at most aleph 2 . We compare elements of mathcal D aleph 2 using the notion of Tukey reducibility. We isolate some simple cofinal types in mathcal D aleph 2 , and then proceed to show which of these types have an immediate successor in the Tukey ordering of mathcal D aleph 2 .


Addendum to Some exotic nontrivial elements of the rational homotopy groups of mathrm Diff (S 4) (homological interpretation). In this addendum, we give a differential form interpretation of the proof of the main theorem of arXiv 1812.02448, which gives lower bounds of the dimensions of pi k(B mathrm Diff (D 4, partial)) otimes mathbb Q in terms of the dimensions of Kontsevich's graph homology, and explain why it can be extended to arbitrary even dimensions d geq 4 . We attempted to make the proof accessible to more readers. Thus we do not assume familiarity with configuration space integrals nor knowledge of finite type invariants. Part of this addendum might be joined to the original article when it will be re submitted to the journal. This is not aimed at giving a correction to the previous version.


Excitation of strongly nonlinear plasma wakefield by electron bunches. We propose a new method for analytical self consistent description of the excitation of a strongly nonlinear wakefield (a bubble) excited by an electron bunch. This method makes it possible to calculate the shape of the bubble and the distribution of the electric field in it based only on the properties of the driver, without relying on any additional parameters. The analytical results are verified by particle in cell simulations and show good correspondence. A complete analytical solution for cylindrical drivers and scaling laws for the properties of the bubble and other plasma accelerator parameters depending on the bunch charge and length are derived.


Generalization of Neural Combinatorial Solvers Through the Lens of Adversarial Robustness. End to end (geometric) deep learning has seen first successes in approximating the solution of combinatorial optimization problems. However, generating data in the realm of NP hard complete tasks brings practical and theoretical challenges, resulting in evaluation protocols that are too optimistic. Specifically, most datasets only capture a simpler subproblem and likely suffer from spurious features. We investigate these effects by studying adversarial robustness a local generalization property to reveal hard, model specific instances and spurious features. For this purpose, we derive perturbation models for SAT and TSP. Unlike in other applications, where perturbation models are designed around subjective notions of imperceptibility, our perturbation models are efficient and sound, allowing us to determine the true label of perturbed samples without a solver. Surprisingly, with such perturbations, a sufficiently expressive neural solver does not suffer from the limitations of the accuracy robustness trade off common in supervised learning. Although such robust solvers exist, we show empirically that the assessed neural solvers do not generalize well w.r.t. small perturbations of the problem instance.


Limit theorems for moment processes of beta Dyson's Brownian motions and beta Laguerre processes. In the regime where the parameter beta is proportional to the reciprocal of the system size, it is known that the empirical distribution of Gaussian beta ensembles (resp. beta Laguerre ensembles) converges to a probability measure of associated Hermite polynomials (resp. associated Laguerre polynomials). Gaussian fluctuations around the limit have been known as well. This paper aims to study a dynamical version of those results. More precisely, we study beta Dyson's Brownian motions and beta Laguerre processes and establish LLNs and CLTs for their moment processes in the same regime.


Impatient PPSZ a Faster algorithm for CSP. PPSZ is the fastest known algorithm for (d,k) CSP problems, for most values of d and k. It goes through the variables in random order and sets each variable randomly to one of the d colors, excluding those colors that can be ruled out by looking at few constraints at a time. We propose and analyze a modification of PPSZ whenever all but 2 colors can be ruled out for some variable, immediately set that variable randomly to one of the remaining colors. We show that our new "impatient PPSZ" outperforms PPSZ exponentially for all k and all d 3 on formulas with a unique satisfying assignment.