Multi population minimal time mean field games. In this paper, we consider a mean field game model inspired by crowd motion in which several interacting populations evolving in mathbb R d aim at reaching given target sets in minimal time. The movement of each agent is described by a control system depending on their position, the distribution of other agents in the same population, and the distribution of agents on other populations. Thus, interactions between agents occur through their dynamics. We consider in this paper the existence of Lagrangian equilibria to this mean field game, their asymptotic behavior, and their characterization as solutions of a mean field game system, under few regularity assumptions on agents' dynamics. In particular, the mean field game system is established without relying on semiconcavity properties of the value function.


Learning curves for Gaussian process regression with power law priors and targets. We characterize the power law asymptotics of learning curves for Gaussian process regression (GPR) under the assumption that the eigenspectrum of the prior and the eigenexpansion coefficients of the target function follow a power law. Under similar assumptions, we leverage the equivalence between GPR and kernel ridge regression (KRR) to show the generalization error of KRR. Infinitely wide neural networks can be related to GPR with respect to the neural network GP kernel and the neural tangent kernel, which in several cases is known to have a power law spectrum. Hence our methods can be applied to study the generalization error of infinitely wide neural networks. We present toy experiments demonstrating the theory.


Quadratic transformation and matrix biorthogonal polynomials an mathcal LU factorization approach. The manuscript presents the LU approach to matrix biorthogonal polynomials when all the even ordered entries in the Gram matrix are zero. This arises in case of a quadratic transformation which is briefly discussed. Further, the main diagonal of the Gram matrix is a zero diagonal and we present the theory that follows from this fact. Precisely, we discuss the Christoffel transformation and matrix representations of the kernel polynomials, usually called the ABC Theorem. Finally, we provide an illustration of our results assuming the Gram matrix has Hankel symmetry.


PWPAE An Ensemble Framework for Concept Drift Adaptation in IoT Data Streams. As the number of Internet of Things (IoT) devices and systems have surged, IoT data analytics techniques have been developed to detect malicious cyber attacks and secure IoT systems however, concept drift issues often occur in IoT data analytics, as IoT data is often dynamic data streams that change over time, causing model degradation and attack detection failure. This is because traditional data analytics models are static models that cannot adapt to data distribution changes. In this paper, we propose a Performance Weighted Probability Averaging Ensemble (PWPAE) framework for drift adaptive IoT anomaly detection through IoT data stream analytics. Experiments on two public datasets show the effectiveness of our proposed PWPAE method compared against state of the art methods.


A Quantitative Analysis of the Ignition Characteristics of Fine Iron Particles. Ignition of iron particles in an oxidizing environment marks the onset of a self sustained combustion. The objective of the current study is to quantitatively examine the ignition characteristics of fine iron particles governed by the kinetics of solid phase iron oxidation. The oxidation rates are inversely proportional to the thickness of the oxide layer and calibrated using the experimentally measured growth of iron oxide layers over time. Steady state and unsteady analysis have been performed to probe the dependence of the critical gas temperature required to trigger a thermal runaway (namely, the ignition temperature T mathrm ign ) on particle size, initial thickness of oxide layer, inert gas species, radiative heat loss, and the collective heating effect in a suspension of particles. Both analyses indicate that T mathrm ign depends on delta 0 , i.e., the ratio between the initial oxide layer thickness and particle size, regardless of the absolute size of the particle. The unsteady analysis predicts that, for delta 0 lesssim 0.003 , T mathrm ign becomes independent of delta 0 . Under standard conditions in air, T mathrm ign is approximately 1080 K for any particle size greater than 5 microns. Radiative heat loss has a minor effect on T mathrm ign . The collective effect of a suspension of iron particles in reducing T mathrm ign is demonstrated. The transition behavior between kinetic controlled and external diffusion controlled combustion regimes of an ignited iron particle is systematically examined. The influences of initial oxide layer thickness and particle temperature on the ignition delay time, tau mathrm ign , of iron particles are parametrically probed. A d 2 law scaling between tau mathrm ign and particle size is identified.


Block Coordinate Descent for smooth nonconvex constrained minimization. At each iteration of a Block Coordinate Descent method one minimizes an approximation of the objective function with respect to a generally small set of variables subject to constraints in which these variables are involved. The unconstrained case and the case in which the constraints are simple were analyzed in the recent literature. In this paper we address the problem in which block constraints are not simple and, moreover, the case in which they are not defined by global sets of equations and inequations. A general algorithm that minimizes quadratic models with quadratric regularization over blocks of variables is defined and convergence and complexity are proved. In particular, given tolerances delta 0 and varepsilon 0 for feasibility complementarity and optimality, respectively, it is shown that a measure of ( delta,0) criticality tends to zero and the the number of iterations and functional evaluations required to achieve ( delta, varepsilon) criticality is O( varepsilon 2) . Numerical experiments in which the proposed method is used to solve a continuous version of the traveling salesman problem are presented.


Efficient topology optimization using compatibility projection in micromechanical homogenization. The adjoint method allows efficient calculation of the gradient with respect to the design variables of a topology optimization problem. This method is almost exclusively used in combination with traditional Finite Element Analysis, whereas Fourier based solvers have recently shown large efficiency gains for homogenization problems. In this paper, we derive the discrete adjoint method for Fourier based solvers that employ compatibility projection. We demonstrate the method on the optimization of composite materials and auxetic metamaterials, where void regions are modelled with zero stiffness.


On the length of L Grundy sequences. An L sequence of a graph G is a sequence of distinct vertices S v 1, ... , v k such that N v i setminus cup j 1 i 1 N(v j) neq emptyset . The length of the longest L sequence is called the L Grundy domination number, denoted gamma gr L(G) . In this paper, we prove gamma gr L(G) leq n(G) delta(G) 1 , which was conjectured by Bre v s ar, Gologranc, Henning, and Kos. We also prove some early results about characteristics of n vertex graphs such gamma gr L(G) n , as well as bounds on the change in L Grundy number under graph operations.


Anti UAV A Large Multi Modal Benchmark for UAV Tracking. Unmanned Aerial Vehicle (UAV) offers lots of applications in both commerce and recreation. With this, monitoring the operation status of UAVs is crucially important. In this work, we consider the task of tracking UAVs, providing rich information such as location and trajectory. To facilitate research on this topic, we propose a dataset, Anti UAV, with more than 300 video pairs containing over 580k manually annotated bounding boxes. The releasing of such a large scale dataset could be a useful initial step in research of tracking UAVs. Furthermore, the advancement of addressing research challenges in Anti UAV can help the design of anti UAV systems, leading to better surveillance of UAVs. Besides, a novel approach named dual flow semantic consistency (DFSC) is proposed for UAV tracking. Modulated by the semantic flow across video sequences, the tracker learns more robust class level semantic information and obtains more discriminative instance level features. Experimental results demonstrate that Anti UAV is very challenging, and the proposed method can effectively improve the tracker's performance. The Anti UAV benchmark and the code of the proposed approach will be publicly available at https github.com ucas vg Anti UAV.


Convex Optimization in Sums of Banach Spaces. We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a finite sum of components, where each component belongs to its own prescribed Banach space moreover, the problem is regularized by penalizing some composite norm of the solution. We establish general conditions for existence and derive the generic parametric representation of the solution components. These representations fall into three categories depending on the underlying regularization norm (i) a linear expansion in terms of predefined "kernels" when the component space is a reproducing kernel Hilbert space (RKHS), (ii) a non linear (duality) mapping of a linear combination of measurement functionals when the component Banach space is strictly convex, and, (iii) an adaptive expansion in terms of a small number of atoms within a larger dictionary when the component Banach space is not strictly convex. Our approach generalizes and unifies a number of multi kernel (RKHS) and sparse dictionary learning techniques for compressed sensing available in the literature. It also yields the natural extension of the classical spline fitting techniques in (semi )RKHS to the abstract Banach space setting.


Cross Domain Contract Element Extraction with a Bi directional Feedback Clause Element Relation Network. Contract element extraction (CEE) is the novel task of automatically identifying and extracting legally relevant elements such as contract dates, payments, and legislation references from contracts. Automatic methods for this task view it as a sequence labeling problem and dramatically reduce human labor. However, as contract genres and element types may vary widely, a significant challenge for this sequence labeling task is how to transfer knowledge from one domain to another, i.e., cross domain CEE. Cross domain CEE differs from cross domain named entity recognition (NER) in two important ways. First, contract elements are far more fine grained than named entities, which hinders the transfer of extractors. Second, the extraction zones for cross domain CEE are much larger than for cross domain NER. As a result, the contexts of elements from different domains can be more diverse. We propose a framework, the Bi directional Feedback cLause Element relaTion network (Bi FLEET), for the cross domain CEE task that addresses the above challenges. Bi FLEET has three main components (1) a context encoder, (2) a clause element relation encoder, and (3) an inference layer. To incorporate invariant knowledge about element and clause types, a clause element graph is constructed across domains and a hierarchical graph neural network is adopted in the clause element relation encoder. To reduce the influence of context variations, a multi task framework with a bi directional feedback scheme is designed in the inference layer, conducting both clause classification and element extraction. The experimental results over both cross domain NER and CEE tasks show that Bi FLEET significantly outperforms state of the art baselines.


Delineating corneal elastic anisotropy in a porcine model using non contact optical coherence elastography and ex vivo mechanical tests. Objective To compare non contact acoustic micro tapping optical coherence elastography (AuT OCE) with destructive mechanical tests to confirm corneal elastic anisotropy. Design Ex vivo, laboratory study with non contact AuT OCE followed by mechanical rheometry and extensometry. Subjects Inflated cornea of whole globe porcine eyes. Methods A non contact transducer was used to launch mechanical waves in the cornea that were imaged with phase sensitive OCT at physiologically relevant pressures. Reconstruction of both Young's modulus (E) and out of plane shear modulus (G) in the cornea from experimental data was performed using a model of a nearly incompressible transversally isotropic (NITI) medium. Samples were then excised and parallel plate rheometry was performed to measure the shear modulus G. Corneal samples were then subjected to strip extensomety to measure the Young's modulus. Main Outcome Measures Strong corneal anisotropy was confirmed with both AuT OCE and mechanical tests, with the Young's and shear moduli differing by over an order of magnitude. These results show that AuT OCE can quantify both moduli with a non contact, non invasive, clinically translatable technique.


Targeted Attack on Deep RL based Autonomous Driving with Learned Visual Patterns. Recent studies demonstrated the vulnerability of control policies learned through deep reinforcement learning against adversarial attacks, raising concerns about the application of such models to risk sensitive tasks such as autonomous driving. Threat models for these demonstrations are limited to (1) targeted attacks through real time manipulation of the agent's observation, and (2) untargeted attacks through manipulation of the physical environment. The former assumes full access to the agent's states observations at all times, while the latter has no control over attack outcomes. This paper investigates the feasibility of targeted attacks through visually learned patterns placed on physical objects in the environment, a threat model that combines the practicality and effectiveness of the existing ones. Through analysis, we demonstrate that a pre trained policy can be hijacked within a time window, e.g., performing an unintended self parking, when an adversarial object is present. To enable the attack, we adopt an assumption that the dynamics of both the environment and the agent can be learned by the attacker. Lastly, we empirically show the effectiveness of the proposed attack on different driving scenarios, perform a location robustness test, and study the tradeoff between the attack strength and its effectiveness. Code is available at https github.com ASU APG Targeted Physical Adversarial Attacks on AD


A Dialogue based Information Extraction System for Medical Insurance Assessment. In the Chinese medical insurance industry, the assessor's role is essential and requires significant efforts to converse with the claimant. This is a highly professional job that involves many parts, such as identifying personal information, collecting related evidence, and making a final insurance report. Due to the coronavirus (COVID 19) pandemic, the previous offline insurance assessment has to be conducted online. However, for the junior assessor often lacking practical experience, it is not easy to quickly handle such a complex online procedure, yet this is important as the insurance company needs to decide how much compensation the claimant should receive based on the assessor's feedback. In order to promote assessors' work efficiency and speed up the overall procedure, in this paper, we propose a dialogue based information extraction system that integrates advanced NLP technologies for medical insurance assessment. With the assistance of our system, the average time cost of the procedure is reduced from 55 minutes to 35 minutes, and the total human resources cost is saved 30 compared with the previous offline procedure. Until now, the system has already served thousands of online claim cases.


Emotion Regularized Conditional Variational Autoencoder for Emotional Response Generation. This paper presents an emotion regularized conditional variational autoencoder (Emo CVAE) model for generating emotional conversation responses. In conventional CVAE based emotional response generation, emotion labels are simply used as additional conditions in prior, posterior and decoder networks. Considering that emotion styles are naturally entangled with semantic contents in the language space, the Emo CVAE model utilizes emotion labels to regularize the CVAE latent space by introducing an extra emotion prediction network. In the training stage, the estimated latent variables are required to predict the emotion labels and token sequences of the input responses simultaneously. Experimental results show that our Emo CVAE model can learn a more informative and structured latent space than a conventional CVAE model and output responses with better content and emotion performance than baseline CVAE and sequence to sequence (Seq2Seq) models.


On the existence of helical invariant solutions to steady Navier Stokes equations. In this paper, we investigate the nonhomogeneous boundary value problem for the steady Navier Stokes equations in a helically symmetric spatial domain. When data is assumed to be helical invariant and satisfies the compatibility condition, we prove this problem has at least one helical invariant solution.


Impact of within voxel heterogeneity in fibre geometry on spherical deconvolution. Axons in white matter have been shown to have varying geometries within a bundle using ex vivo imaging techniques, but what does this mean for diffusion MRI (dMRI) based spherical deconvolution (SD)? SD attempts to estimate the fibre orientation distribution function (fODF) by assuming a single dMRI fibre response function (FRF) for all white matter populations and deconvolving this FRF from the dMRI signal at each voxel to estimate the fODF. Variable fibre geometry within a bundle however suggests the FRF might not be constant even within a single voxel. We test what impact realistic fibre geometry has on SD by simulating the dMRI signal in a range of realistic white matter numerical phantoms, including synthetic phantoms and real axons segmented from electron microscopy. We demonstrate that variable fibre geometry leads to a variable FRF across axons and that in general no single FRF is effective to recover the underlying fibre orientation distribution function (fODF). This finding suggests that assuming a single FRF can lead to misestimation of the fODF, causing further downstream errors in techniques such as tractography.


Micro droplet nucleation through solvent exchange in a turbulent buoyant jet. Solvent exchange is a process involving mixing between a good solvent with dissolved solute and a poor solvent. The process creates local oversaturation which causes the nucleation of minute solute droplets. Such ternary systems on a macro scale have remained unexplored in the turbulent regime. We experimentally study the solvent exchange process by injecting mixtures of ethanol and trans anethole into water, forming a turbulent buoyant jet in upward direction. Locally, turbulent mixing causes oversaturation of the trans anethole following turbulent entrainment. We optically measure the concentration of the nucleated droplets using a light attenuation technique and find that the radial concentration profile is sub Gaussian. In contrast to the entrainment based models, the spatial evolution of the oversaturation reveals continuous droplet nucleation downstream and radially across the jet, which we attribute to the limited mixing capacity of the jet. Though we are far from a full quantitative understanding, this work extends the knowledge on solvent exchange into the turbulent regime, and brings in a novel type of flow, broadening the scope of multicomponent, multiphase turbulent jets with phase transition.


Multilingual training for Software Engineering. Well trained machine learning models, which leverage large amounts of open source software data, have now become an interesting approach to automating many software engineering tasks. Several SE tasks have all been subject to this approach, with performance gradually improving over the past several years with better models and training methods. More, and more diverse, clean, labeled data is better for training but constructing good quality datasets is time consuming and challenging. Ways of augmenting the volume and diversity of clean, labeled data generally have wide applicability. For some languages (e.g., Ruby) labeled data is less abundant in others (e.g., JavaScript) the available data maybe more focused on some application domains, and thus less diverse. As a way around such data bottlenecks, we present evidence suggesting that human written code in different languages (which performs the same function), is rather similar, and particularly preserving of identifier naming patterns we further present evidence suggesting that identifiers are a very important element of training data for software engineering tasks. We leverage this rather fortuitous phenomenon to find evidence that available multilingual training data (across different languages) can be used to amplify performance. We study this for 3 different tasks code summarization, code retrieval, and function naming. We note that this data augmenting approach is broadly compatible with different tasks, languages, and machine learning models.


Voxel based 3D Detection and Reconstruction of Multiple Objects from a Single Image. Inferring 3D locations and shapes of multiple objects from a single 2D image is a long standing objective of computer vision. Most of the existing works either predict one of these 3D properties or focus on solving both for a single object. One fundamental challenge lies in how to learn an effective representation of the image that is well suited for 3D detection and reconstruction. In this work, we propose to learn a regular grid of 3D voxel features from the input image which is aligned with 3D scene space via a 3D feature lifting operator. Based on the 3D voxel features, our novel CenterNet 3D detection head formulates the 3D detection as keypoint detection in the 3D space. Moreover, we devise an efficient coarse to fine reconstruction module, including coarse level voxelization and a novel local PCA SDF shape representation, which enables fine detail reconstruction and one order of magnitude faster inference than prior methods. With complementary supervision from both 3D detection and reconstruction, one enables the 3D voxel features to be geometry and context preserving, benefiting both tasks.The effectiveness of our approach is demonstrated through 3D detection and reconstruction in single object and multiple object scenarios.


Growing Neoclassical Tearing Modes Seeded via Transient Induced Multimode Interactions. Nonlinear extended MHD simulations demonstrating seeding of neoclassical tearing modes (NTMs) via MHD transient induced multimode interactions are presented. Simulations of NTMs are enabled by two recent NIMROD code developments the implementation of heuristic neoclassical stresses and the application of transient magnetic perturbations (MPs) at the boundary. NTMs are driven unstable by the inherently pressure driven kinetic bootstrap current, which arises due to collisional viscosity between passing and trapped electrons. These simulations use heuristic closures that model the neoclassical electron and ion stresses. NTM growth requires a seed island, which is generated by a transiently applied MP in simulations. The capability is demonstrated using kinetic based reconstructions with flow of a DIII D ITER Baseline Scenario discharge R.J. La Haye, et al., Proceedings IAEA FEC 2020 . The applied MP seeds a 2 1 NTM that grows in two phases a slow growth phase followed by a faster robust growth phase like that observed experimentally. Additionally, an evolving sequence of higher order core modes are excited at first. Power transfer analysis shows that nonlinear interactions between the core modes and the 2 1 helps drive the initial slow growth. Once the induced 2 1 magnetic island reaches a critical width, the NTM transitions to faster robust growth which is well described by the nonlinear modified Rutherford equation. This work highlights the role of nonlinear mode coupling in seeding NTMs.


Unicritical Laminations. Thurston introduced emph invariant (quadratic) laminations in his 1984 preprint as a vehicle for understanding the connected Julia sets and the parameter space of quadratic polynomials. Important ingredients of his analysis of the angle doubling map sigma 2 on the unit circle mathbb S 1 were the Central Strip Lemma, non existence of wandering polygons, the transitivity of the first return map on vertices of periodic polygons, and the non crossing of minors of quadratic invariant laminations. We use Thurston's methods to prove similar results for emph unicritical laminations of arbitrary degree d and to show that the set of so called emph minors of unicritical laminations themselves form a emph Unicritical Minor Lamination mathrm UML d . In the end we verify the emph Fatou conjecture for the unicritical laminations and extend the emph Lavaurs algorithm onto mathrm UML d .


A case study of intersections on blowups of the moduli of curves. We explain how logarithmic structures select natural principal components in an intersection of schemes. These manifest in Chow homology and can be understood using the geometry of strict transforms under logarithmic blowups. Our motivation comes from Gromov Witten theory. The toric contact cycles in the moduli space of curves parameterize curves that admit a map to a fixed toric variety with prescribed contact orders. We show that they are intersections of virtual strict transforms of double ramification cycles in blowups of the moduli space of curves. We supply a calculation scheme for the virtual strict transforms, and deduce that toric contact cycles lie in the tautological ring of the moduli space of curves. This is a higher dimensional analogue of a result of Faber Pandharipande. The operational Chow rings of Artin fans play a basic role, and are shown to be isomorphic to rings of piecewise polynomials on associated cone complexes. The ingredients in our analysis are Fulton's blowup formula, Aluffi's formulas for Segre classes of monomial schemes, piecewise polynomials, and degeneration methods. A model calculation in toric intersection theory is treated without logarithmic methods and may be read independently.


On a Tverberg graph. For a graph whose vertex set is a finite set of points in mathbb R d , consider the closed (open) balls with diameters induced by its edges. The graph is called a (an open) Tverberg graph if these closed (open) balls intersect. Using the idea of halving lines, we show that (i) for any finite set of points in the plane, there exists a Hamiltonian cycle that is a Tverberg graph (ii) for any n red and n blue points in the plane, there exists a perfect red blue matching that is a Tverberg graph. Also, we prove that (iii) for any even set of points in mathbb R d , there exists a perfect matching that is an open Tverberg graph (iv) for any n red and n blue points in mathbb R d , there exists a perfect red blue matching that is a Tverberg graph.


3DP3 3D Scene Perception via Probabilistic Programming. We present 3DP3, a framework for inverse graphics that uses inference in a structured generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent the 3D shape of objects, (ii) hierarchical scene graphs to decompose scenes into objects and the contacts between them, and (iii) depth image likelihoods based on real time graphics. Given an observed RGB D image, 3DP3's inference algorithm infers the underlying latent 3D scene, including the object poses and a parsimonious joint parametrization of these poses, using fast bottom up pose proposals, novel involutive MCMC updates of the scene graph structure, and, optionally, neural object detectors and pose estimators. We show that 3DP3 enables scene understanding that is aware of 3D shape, occlusion, and contact structure. Our results demonstrate that 3DP3 is more accurate at 6DoF object pose estimation from real images than deep learning baselines and shows better generalization to challenging scenes with novel viewpoints, contact, and partial observability.


Neutral atom scattering based mapping of atomically thin layers. Imaging surfaces using low energy neutral atom scattering is a relatively recent development in the field of microscopy. In this work we demonstrate that this technique is sensitive enough to distinguish films as thin as a single monolayer from the underlying substrate. Using collimated beams of He and Kr atoms as an incident probe on MoS 2 films grown on SiO 2 Si substrate, we observe systematic changes in the scattered atom flux which allows us to map the thin MoS 2 films. Measurements carried out by varying incidence energy using both He and Kr provides insights into the details of atom surface collision dynamics and its role in contrast generation.


HGAN Hybrid Generative Adversarial Network. In this paper, we present a simple approach to train Generative Adversarial Networks (GANs) in order to avoid a textit mode collapse issue. Implicit models such as GANs tend to generate better samples compared to explicit models that are trained on tractable data likelihood. However, GANs overlook the explicit data density characteristics which leads to undesirable quantitative evaluations and mode collapse. To bridge this gap, we propose a hybrid generative adversarial network (HGAN) for which we can enforce data density estimation via an autoregressive model and support both adversarial and likelihood framework in a joint training manner which diversify the estimated density in order to cover different modes. We propose to use an adversarial network to textit transfer knowledge from an autoregressive model (teacher) to the generator (student) of a GAN model. A novel deep architecture within the GAN formulation is developed to adversarially distill the autoregressive model information in addition to simple GAN training approach. We conduct extensive experiments on real world datasets (i.e., MNIST, CIFAR 10, STL 10) to demonstrate the effectiveness of the proposed HGAN under qualitative and quantitative evaluations. The experimental results show the superiority and competitiveness of our method compared to the baselines.


The liftability question for stable equivalences between representation finite self injective algebras. Let k be an algebraically closed field. It is known that any stable equivalence between standard representation finite self injective k algebras (without block of Loewy length 2) lifts to a standard derived equivalence, in particular, it is of Morita type. We show that the same holds for any stable equivalence between nonstandard representation finite self injective k algebras. We also fill a gap in the original proof in standard case. This gives a complete solution of the liftability question raised by H. Asashiba about twenty years ago.


A compact subcell WENO limiting strategy using immediate neighbors for Runge Kutta discontinuous Galerkin methods for unstructured meshes. In this paper, we generalize the compact subcell weighted essentially non oscillatory (CSWENO) limiting strategy for Runge Kutta discontinuous Galerkin method developed recently by us in 2021 for structured meshes to unstructured triangular meshes. The main idea of the limiting strategy is to divide the immediate neighbors of a given cell into the required stencil and to use a WENO reconstruction for limiting. This strategy can be applied for any type of WENO reconstruction. We have used the WENO reconstruction proposed by Zhu and Shu in 2019 and provided accuracy tests and results for two dimensional Burgers' equation and two dimensional Euler equations to illustrate the performance of this limiting strategy.


Heat kernel asymptotics for quaternionic contact manifolds. In this paper, we study the heat kernel associated to the intrinsic sublaplacian on a quaternionic contact manifold considered as a subriemannian manifold. More precisely, we explicitly compute the first two coefficients c 0 and c 1 appearing in the small time asymptotics expansion of the heat kernel on the diagonal. We show that the second coefficient c 1 depends linearly on the qc scalar curvature kappa . Finally we apply our results to compact qc Einstein manifolds and prove the spectral invariance of geometric quantities in the subriemannian setting.


An Analysis of Twitter Users From The Perspective of Their Behavior, Language, Region and Development Indices A Study of 80 Million Tweets. The need for a comprehensive study to explore various aspects of online social media has been instigated by many researchers. This paper gives an insight into the social platform, Twitter. In this present work, we have illustrated stepwise procedure for crawling the data and discuss the key issues related to extracting associated features that can be useful in Twitter related research while crawling these data from Application Programming Interfaces (APIs). Further, the data that comprises of over 86 million tweets have been analysed from various perspective including the most used languages, most frequent words, most frequent users, countries with most and least tweets and re tweets, etc. The analysis reveals that the users' data associated with Twitter has a high affinity for researches in the various domain that includes politics, social science, economics, and linguistics, etc. In addition, the relation between Twitter users of a country and its human development index has been identified. It is observed that countries with very high human development indices have a relatively higher number of tweets compared to low human development indices countries. It is envisaged that the present study shall open many doors of researches in information processing and data science.


Fast L 2 optimal mass transport via reduced basis methods for the Monge Amp grave rm e re equation. Repeatedly solving the parameterized optimal mass transport (pOMT) problem is a frequent task in applications such as image registration and adaptive grid generation. It is thus critical to develop a highly efficient reduced solver that is equally accurate as the full order model. In this paper, we propose such a machine learning like method for pOMT by adapting a new reduced basis (RB) technique specifically designed for nonlinear equations, the reduced residual reduced over collocation (R2 ROC) approach, to the parameterized Monge Amp grave rm e re equation. It builds on top of a narrow stencil finite different method (FDM), a so called truth solver, which we propose in this paper for the Monge Amp grave rm e re equation with a transport boundary. Together with the R2 ROC approach, it allows us to handle the strong and unique nonlinearity pertaining to the Monge Amp grave rm e re equation achieving online efficiency without resorting to any direct approximation of the nonlinearity. Several challenging numerical tests demonstrate the accuracy and high efficiency of our method for solving the Monge Amp grave rm e re equation with various parametric boundary conditions.


Neural Parts Learning Expressive 3D Shape Abstractions with Invertible Neural Networks. Impressive progress in 3D shape extraction led to representations that can capture object geometries with high fidelity. In parallel, primitive based methods seek to represent objects as semantically consistent part arrangements. However, due to the simplicity of existing primitive representations, these methods fail to accurately reconstruct 3D shapes using a small number of primitives parts. We address the trade off between reconstruction quality and number of parts with Neural Parts, a novel 3D primitive representation that defines primitives using an Invertible Neural Network (INN) which implements homeomorphic mappings between a sphere and the target object. The INN allows us to compute the inverse mapping of the homeomorphism, which in turn, enables the efficient computation of both the implicit surface function of a primitive and its mesh, without any additional post processing. Our model learns to parse 3D objects into semantically consistent part arrangements without any part level supervision. Evaluations on ShapeNet, D FAUST and FreiHAND demonstrate that our primitives can capture complex geometries and thus simultaneously achieve geometrically accurate as well as interpretable reconstructions using an order of magnitude fewer primitives than state of the art shape abstraction methods.


Generalized Organ Segmentation by Imitating One shot Reasoning using Anatomical Correlation. Learning by imitation is one of the most significant abilities of human beings and plays a vital role in human's computational neural system. In medical image analysis, given several exemplars (anchors), experienced radiologist has the ability to delineate unfamiliar organs by imitating the reasoning process learned from existing types of organs. Inspired by this observation, we propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. In this paper, we show that such process can be integrated into the one shot segmentation task which is a very challenging but meaningful topic. We propose pyramid reasoning modules (PRMs) to model the anatomical correlation between anchor and target volumes. In practice, the proposed module first computes a correlation matrix between target and anchor computerized tomography (CT) volumes. Then, this matrix is used to transform the feature representations of both anchor volume and its segmentation mask. Finally, OrganNet learns to fuse the representations from various inputs and predicts segmentation results for target volume. Extensive experiments show that OrganNet can effectively resist the wide variations in organ morphology and produce state of the art results in one shot segmentation task. Moreover, even when compared with fully supervised segmentation models, OrganNet is still able to produce satisfying segmentation results.


Bifurcations of heteroclinic contours in two parameter planar systems Overview and explicit examples. Smooth planar vector fields containing two hyperbolic saddles may possess contours formed by heteroclinic connections between these saddles. We present an overview of the bifurcations of these contours based on papers by J.W. Reyn and A.V. Dukov. Additionally, two new explicit polynomial systems containing such contours are derived, which are studied using the bifurcation software MatCont and are shown to exhibit the theoretically predicted phenomena, including series of heteroclinic connections.


Time integrators for dispersive equations in the long wave regime. We introduce a novel class of time integrators for dispersive equations which allow us to reproduce the dynamics of the solution from the classical varepsilon 1 up to long wave limit regime varepsilon ll 1 on the natural time scale of the PDE t mathcal O ( frac 1 varepsilon ) . Most notably our new schemes converge with rates at order tau varepsilon over long times t frac 1 varepsilon .


Positive Stochastic Collocation for the Collocated Local Volatility Model. This paper presents how to apply the stochastic collocation technique to assets that can not move below a boundary. It shows that the polynomial collocation towards a lognormal distribution does not work well. Then, the potentials issues of the related collocated local volatility model (CLV) are explored. Finally, a simple analytical expression for the Dupire local volatility derived from the option prices modelled by stochastic collocation is given.


Quantitative transfer of regularity of the incompressible Navier Stokes equations from mathbb R 3 to the case of a bounded domain. Let u 0 in C 0 5 ( B R 0 ) be divergence free and suppose that u is a strong solution of the three dimensional incompressible Navier Stokes equations on 0,T in the whole space mathbb R 3 such that u L infty ((0,T) H 5 ( mathbb R 3 )) u L infty ((0,T) W 5, infty ( mathbb R 3 )) leq M infty . We show that then there exists a unique strong solution w to the problem posed on B R with the homogeneous Dirichlet boundary conditions, with the same initial data and on the same time interval for R geq max(1 R 0, C(a) C(M) 1 a exp ( CM 4T a )) ) for any a in 0,3 2) , and we give quantitative estimates on u w and the corresponding pressure functions.


Graph and hypergraph colouring via nibble methods A survey. This paper provides a survey of methods, results, and open problems on graph and hypergraph colourings, with a particular emphasis on semi random nibble' methods. We also give a detailed sketch of some aspects of the recent proof of the Erd H o s Faber Lov ' a sz conjecture.


On certain identities involving Nahm type sums with double poles. We prove certain Nahm type sum representations for the (odd modulus) Andrews Gordon identities, the (even modulus) Andrews Bressoud identities, and Rogers' false theta functions. These identities are motivated on one hand by a recent work of C. Jennings Shaffer and one of us on double pole series, and, on the other hand, by C 'ordova, Gaiotto and Shao's work on defect Schur's indices.


The Summary Loop Learning to Write Abstractive Summaries Without Examples. This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms from the original document into the summary key terms are masked out of the original document and must be filled in by a coverage model using the current generated summary. A novel unsupervised training procedure leverages this coverage model along with a fluency model to generate and score summaries. When tested on popular news summarization datasets, the method outperforms previous unsupervised methods by more than 2 R 1 points, and approaches results of competitive supervised methods. Our model attains higher levels of abstraction with copied passages roughly two times shorter than prior work, and learns to compress and merge sentences without supervision.


Data Hand Fostering Visual Exploration of Personal Data on Smartphones Leveraging Speech and Touch Interaction. Most mobile health apps employ data visualization to help people view their health and activity data, but these apps provide limited support for visual data exploration. Furthermore, despite its huge potential benefits, mobile visualization research in the personal data context is sparse. This work aims to empower people to easily navigate and compare their personal health data on smartphones by enabling flexible time manipulation with speech. We designed and developed Data Hand, a mobile app that leverages the synergy of two complementary modalities speech and touch. Through an exploratory study with 13 long term Fitbit users, we examined how multimodal interaction helps participants explore their own health data. Participants successfully adopted multimodal interaction (i.e., speech and touch) for convenient and fluid data exploration. Based on the quantitative and qualitative findings, we discuss design implications and opportunities with multimodal interaction for better supporting visual data exploration on mobile devices.


Combining IOTA and Attribute Based Encryption for Access Control in the Internet of Things. Unauthorized resource access represents a typical security threat in the Internet of things (IoT), while distributed ledger technologies (e.g., blockchain and IOTA) hold great promise to address this threat. Although blockchain based IoT access control schemes have been the most popular ones, they suffer from several significant limitations, such as high monetary cost and low throughput of processing access requests. To overcome these limitations, this paper proposes a novel IoT access control scheme by combining the fee less IOTA technology and the Ciphertext Policy Attribute Based Encryption (CP ABE) technology. To control the access to a resource, a token, which records access permissions to this resource, is encrypted by the CP ABE technology and uploaded to the IOTA Tangle (i.e., the underlying database of IOTA). Any user can fetch the encrypted token from the Tangle, while only those who can decrypt this token are authorized to access the resource. In this way, the proposed scheme enables not only distributed, fee less and scalable access control thanks to the IOTA but also fine grained attribute based access control thanks to the CP ABE. We show the feasibility of our scheme by implementing a proof of concept prototype system and evaluate its performance in terms of access request processing throughput.


Robustness Tests of NLP Machine Learning Models Search and Semantically Replace. This paper proposes a strategy to assess the robustness of different machine learning models that involve natural language processing (NLP). The overall approach relies upon a Search and Semantically Replace strategy that consists of two steps (1) Search, which identifies important parts in the text (2) Semantically Replace, which finds replacements for the important parts, and constrains the replaced tokens with semantically similar words. We introduce different types of Search and Semantically Replace methods designed specifically for particular types of machine learning models. We also investigate the effectiveness of this strategy and provide a general framework to assess a variety of machine learning models. Finally, an empirical comparison is provided of robustness performance among three different model types, each with a different text representation.


Real degeneracy loci of matrices and phase retrieval. Let mathcal A A 1 , dots,A r be a collection of linear operators on mathbb R m . The degeneracy locus of mathcal A is defined as the set of points x in mathbb P m 1 for which rank ( A 1 x dots A r x ) leq m 1 . Motivated by results in phase retrieval we study degeneracy loci of four linear operators on mathbb R 3 and prove that the degeneracy locus consists of 6 real points obtained by intersecting four real lines if and only if the collection of matrices lies in the linear span of four fixed rank one operators. We also relate such em quadrilateral configurations to the singularity locus of the corresponding Cayley cubic symmetroid. More generally, we show that if A i , i 1, dots, m 1 are in the linear span of m 1 fixed rank one matrices, the degeneracy locus determines a em generalized Desargues configuration which corresponds to a Sylvester spectrahedron.


A map of Digital Humanities research across bibliographic data sources. Purpose. This study presents the results of an experiment we performed to measure the coverage of Digital Humanities (DH) publications in mainstream open and proprietary bibliographic data sources, by further highlighting the relations among DH and other disciplines. Methodology. We created a list of DH journals based on manual curation and bibliometric data. We used that list to identify DH publications in the bibliographic data sources under consideration. We used the ERIH PLUS list of journals to identify Social Sciences and Humanities (SSH) publications. We analysed the citation links they included to understand the relationship between DH publications and SSH and non SSH fields. Findings. Crossref emerges as the database containing the highest number of DH publications. Citations from and to DH publications show strong connections between DH and research in Computer Science, Linguistics, Psychology, and Pedagogical Educational Research. Computer Science is responsible for a large part of incoming and outgoing citations to and from DH research, which suggests a reciprocal interest between the two disciplines. Value. This is the first bibliometric study of DH research involving several bibliographic data sources, including open and proprietary databases. Research limitations. The list of DH journals we created might be only partially representative of broader DH research. In addition, some DH publications could have been cut off from the study since we did not consider books and other publications published in proceedings of DH conferences and workshops. Finally, we used a specific time coverage (2000 2018) that could have prevented the inclusion of additional DH publications.


Recursively Conditional Gaussian for Ordinal Unsupervised Domain Adaptation. The unsupervised domain adaptation (UDA) has been widely adopted to alleviate the data scalability issue, while the existing works usually focus on classifying independently discrete labels. However, in many tasks (e.g., medical diagnosis), the labels are discrete and successively distributed. The UDA for ordinal classification requires inducing non trivial ordinal distribution prior to the latent space. Target for this, the partially ordered set (poset) is defined for constraining the latent vector. Instead of the typically i.i.d. Gaussian latent prior, in this work, a recursively conditional Gaussian (RCG) set is adapted for ordered constraint modeling, which admits a tractable joint distribution prior. Furthermore, we are able to control the density of content vector that violates the poset constraints by a simple "three sigma rule". We explicitly disentangle the cross domain images into a shared ordinal prior induced ordinal content space and two separate source target ordinal unrelated spaces, and the self training is worked on the shared space exclusively for ordinal aware domain alignment. Extensive experiments on UDA medical diagnoses and facial age estimation demonstrate its effectiveness.


A note on commutative and noncommutative Gurariy spaces. In this short note, we answer two questions about Gurariy spaces asked in the literature in the affirmative. We also prove the analogue of one of the results for the noncommutative Guariy space.


Randomized Multiple Model Multiple Hypothesis Tracking. This paper considers the data association problem for multi target tracking. Multiple hypothesis tracking is a popular algorithm for solving this problem but it is NP hard and is is quite complicated for a large number of targets or for tracking maneuvering targets. To improve tracking performance and enhance robustness, we propose a randomized multiple model multiple hypothesis tracking method, which has three distinctive advantages. First, it yields a randomized data association solution which maximizes the expectation of the logarithm of the posterior probability and can be solved efficiently by linear programming. Next, the state estimation performance is improved by the random coefficient matrices Kalman filter, which mitigates the difficulty introduced by randomized data association, i.e., where the coefficient matrices of the dynamic system are random. Third, the probability that the target follows a specific dynamic model is derived by jointly optimizing the multiple possible models and data association hypotheses, and it does not require prior mode transition probabilities. Thus, it is more robust for tracking multiple maneuvering targets. Simulations demonstrate the efficiency and superior results of the proposed algorithm over interacting multiple model multiple hypothesis tracking.


Morphence Moving Target Defense Against Adversarial Examples. Robustness to adversarial examples of machine learning models remains an open topic of research. Attacks often succeed by repeatedly probing a fixed target model with adversarial examples purposely crafted to fool it. In this paper, we introduce Morphence, an approach that shifts the defense landscape by making a model a moving target against adversarial examples. By regularly moving the decision function of a model, Morphence makes it significantly challenging for repeated or correlated attacks to succeed. Morphence deploys a pool of models generated from a base model in a manner that introduces sufficient randomness when it responds to prediction queries. To ensure repeated or correlated attacks fail, the deployed pool of models automatically expires after a query budget is reached and the model pool is seamlessly replaced by a new model pool generated in advance. We evaluate Morphence on two benchmark image classification datasets (MNIST and CIFAR10) against five reference attacks (2 white box and 3 black box). In all cases, Morphence consistently outperforms the thus far effective defense, adversarial training, even in the face of strong white box attacks, while preserving accuracy on clean data.


On optimality of barrier dividend control under endogenous regime switching with application to Chapter 11 bankruptcy. Motivated by recent developments in risk management based on the U.S. bankruptcy code, we revisit the De Finetti's optimal dividend problem by incorporating the reorganization process and regulator's intervention documented in Chapter 11 bankruptcy. The resulting surplus process, bearing financial stress towards the more subtle concept of bankruptcy, corresponds to a non standard spectrally negative Levy process with endogenous regime switching. Some explicit expressions of the expected present values under a barrier strategy, new to the literature, are established in terms of scale functions. With the help of these expressions, when the tail of the Levy measure is log convex, the optimal dividend control is shown to be of the barrier type and the associated optimal barrier can be identified using scale functions of spectrally negative Levy processes. Some financial implications are also discussed in an illustrative example.


Convergence Rate Analysis for Fixed Point Iterations of Generalized Averaged Nonexpansive Operators. We estimate convergence rates for fixed point iterations of a class of nonlinear operators which are partially motivated from solving convex optimization problems. We introduce the notion of the generalized averaged nonexpansive (GAN) operator with a positive exponent, and provide a convergence rate analysis of the fixed point iteration of the GAN operator. The proposed generalized averaged nonexpansiveness is weaker than the averaged nonexpansiveness while stronger than nonexpansiveness. We show that the fixed point iteration of a GAN operator with a positive exponent converges to its fixed point and estimate the local convergence rate (the convergence rate in terms of the distance between consecutive iterates) according to the range of the exponent. We prove that the fixed point iteration of a GAN operator with a positive exponent strictly smaller than 1 can achieve an exponential global convergence rate (the convergence rate in terms of the distance between an iterate and the solution). Furthermore, we establish the global convergence rate of the fixed point iteration of a GAN operator, depending on both the exponent of generalized averaged nonexpansiveness and the exponent of the H ddot text o lder regularity, if the GAN operator is also H ddot text o lder regular. We then apply the established theory to three types of convex optimization problems that appear often in data science to design fixed point iterative algorithms for solving these optimization problems and to analyze their convergence properties.


How a Losing Team like the Canadiens can Steal a Stanley Cup A Quantitative Intransitive Hockey Analysis. We present here a simple mathematical model that provides a successful strategy, quantitatively, to ending the continued championship futility experienced by Canadian Hockey Teams. Competitive Intransitivity is used here as a simple predictive framework to capture how investing strategically, under a uniform salary cap, in just 3 independently variable aspects of the sport (such as Offence, Defence, and a Goaltender), by just 3 Hockey Teams applying differing salary priorities (such as Montreal, Boston, and New York), can lead to rich and perhaps surprisingly unexpected outcomes in play, similar to rolling intransitive dice together in a series of head to head games. A possibly fortunate conclusion of this analysis is the prediction that for any Team's chosen strategy (such as New York's), a counter strategy within the same salary cap can be adopted by a playoff opponent (such as Montreal) which will prove victorious over a long playoff series, enabling a pathway to end prolonged championship futility.


On the Tradeoff between Energy, Precision, and Accuracy in Federated Quantized Neural Networks. Deploying federated learning (FL) over wireless networks with resource constrained devices requires balancing between accuracy, energy efficiency, and precision. Prior art on FL often requires devices to train deep neural networks (DNNs) using a 32 bit precision level for data representation to improve accuracy. However, such algorithms are impractical for resource constrained devices since DNNs could require execution of millions of operations. Thus, training DNNs with a high precision level incurs a high energy cost for FL. In this paper, a quantized FL framework, that represents data with a finite level of precision in both local training and uplink transmission, is proposed. Here, the finite level of precision is captured through the use of quantized neural networks (QNNs) that quantize weights and activations in fixed precision format. In the considered FL model, each device trains its QNN and transmits a quantized training result to the base station. Energy models for the local training and the transmission with the quantization are rigorously derived. An energy minimization problem is formulated with respect to the level of precision while ensuring convergence. To solve the problem, we first analytically derive the FL convergence rate and use a line search method. Simulation results show that our FL framework can reduce energy consumption by up to 53 compared to a standard FL model. The results also shed light on the tradeoff between precision, energy, and accuracy in FL over wireless networks.


Galois structure of the holomorphic poly differentials of curves. Suppose X is a smooth projective geometrically irreducible curve over a perfect field k of positive characteristic p . Let G be a finite group acting faithfully on X over k such that G has non trivial, cyclic Sylow p subgroups. In this paper we show that for m 1 , the decomposition of mathrm H 0(X, Omega X otimes m ) into a direct sum of indecomposable kG modules is uniquely determined by the divisor class of a canonical divisor of X G together with the lower ramification groups and the fundamental characters of the closed points of X that are ramified in the cover X to X G . This extends to arbitrary m 1 the m 1 case treated by the first author with T. Chinburg and A. Kontogeorgis. We discuss some applications to congruences between modular forms in characteristic 0 , to the tangent space of the global deformation functor associated to (X,G) , and to the kG module structure of Riemann Roch spaces associated to divisors on X .


Deep Learning for Two Sided Matching. We initiate the use of a multi layer neural network to model two sided matching and to explore the design space between strategy proofness and stability. It is well known that both properties cannot be achieved simultaneously but the efficient frontier in this design space is not understood. We show empirically that it is possible to achieve a good compromise between stability and strategy proofness substantially better than that achievable through a convex combination of deferred acceptance (stable and strategy proof for only one side of the market) and randomized serial dictatorship (strategy proof but not stable).


An image incorporated immersed boundary method for diffusion equations. A novel sharp interface ghost cell based immersed boundary method has been proposed and its parameters have been optimized against an analytical model in diffusion applications. The proposed embedded constrained moving least squares (ECMLS) algorithm minimizes the error of the interpolated concentration at the image point of the ghost point by applying a moving least squares method on all internal nodes, near the ghost image point, and the associated mirrored image points of these internal nodes through the corresponding boundary conditions. Using an analytical model as a reference, the ECMLS algorithm is compared to the constrained moving least squares (CMLS) algorithm and the staircase model using various grid sizes, interpolation basis functions, weight functions, and the penalty parameter of the constraint. It is found that using ECMLS algorithm in the investigated diffusion application, the incomplete quartic basis function yields the best performance while the quadratic, cubic, and bicubic basis functions also produce results better than the staircase model. It is also found that the linear and bilinear basis functions cannot produce results better than the staircase model in diffusion applications. It is shown that the optimal radius of the region of internal nodes used for interpolation scales with the logarithm of the boundary radius of curvature. It is shown that for the diffusion application, the proposed ECMLS algorithm produces lower errors at the boundary with better numerical stability over a wider range of basis functions, weight functions, boundary radius of curvature, and the penalty parameter than the CMLS algorithm.


A Case Study on Optimization of Warehouses. In warehouses, order picking is known to be the most labor intensive and costly task in which the employees account for a large part of the warehouse performance. Hence, many approaches exist, that optimize the order picking process based on diverse economic criteria. However, most of these approaches focus on a single economic objective at once and disregard ergonomic criteria in their optimization. Further, the influence of the placement of the items to be picked is underestimated and accordingly, too little attention is paid to the interdependence of these two problems. In this work, we aim at optimizing the storage assignment and the order picking problem within mezzanine warehouse with regards to their reciprocal influence. We propose a customized version of the Non dominated Sorting Genetic Algorithm II (NSGA II) for optimizing the storage assignment problem as well as an Ant Colony Optimization (ACO) algorithm for optimizing the order picking problem. Both algorithms incorporate multiple economic and ergonomic constraints simultaneously. Furthermore, the algorithms incorporate knowledge about the interdependence between both problems, aiming to improve the overall warehouse performance. Our evaluation results show that our proposed algorithms return better storage assignments and order pick routes compared to commonly used techniques for the following quality indicators for comparing Pareto fronts Coverage, Generational Distance, Euclidian Distance, Pareto Front Size, and Inverted Generational Distance. Additionally, the evaluation regarding the interaction of both algorithms shows a better performance when combining both proposed algorithms.


Optical solitons in saturable cubic quintic nonlinear media with nonlinear dispersion. We study an intense short pulse propagation in a saturable cubic quintic nonlinear media in the presence of nonlinear dispersion within the framework of an extended variational approach. We derive an effective equation for the pulse width and demonstrate how the saturation due to nonlinearity is achieved in presence of nonlinear dispersion. We find that the nonlinear dispersion can change the pulse width and induce motion in the system. The direction of induced motion depends on the sign of nonlinear dispersion. The pulse is energetically stable at an equilibrium width. A disturbance can, however, induce oscillation in pulse width, the frequency of which is always smaller due to nonlinear dispersion. We check dynamical stability by a direct numerical simulation.


White noise driven conditional McKean Vlasov limits for systems of particles with simultaneous and random jumps. We study the convergence of N particle systems described by SDEs driven by Brownian motion and Poisson random measure, where the coefficients depend on the empirical measure of the system. Every particle jumps with a jump rate depending on its position and on the empirical measure of the system. Jumps are simultaneous, that is, at each jump time, all particles of the system are affected by this jump and receive a random jump height that is centred and scaled in N 1 2 . This particular scaling implies that the limit of the empirical measures of the system is random, describing the conditional distribution of one particle in the limit system. We call such limits it conditional McKean Vlasov limits . The conditioning in the limit measure reflects the dependencies between coexisting particles in the limit system such that we are dealing with a it conditional propagation of chaos property . As a consequence of the scaling in N 1 2 and of the fact that the limit of the empirical measures is not deterministic the limit system turns out to be solution of a non linear SDE, where not independent martingale measures and white noises appear having an intensity that depends on the conditional law of the process.


Nowhere differentiable intrinsic Lipschitz graphs. We construct intrinsic Lipschitz graphs in Carnot groups with the property that, at every point, there exist infinitely many different blow up limits, none of which is a homogeneous subgroup. This provides counterexamples to a Rademacher theorem for intrinsic Lipschitz graphs.


A Structural Observation on port Hamiltonian Systems. We study port Hamiltonian systems on a familiy of intervals and characterise all boundary conditions leading to m accretive realisations of the port Hamiltonian operator and thus to generators of contractive semigroups. The proofs are based on a structural observation that the port Hamiltonian operator can be transformed to the derivative on a familiy of reference intervals by suitable congruence relations allowing for studying the simpler case of a transport equation. Moreover, we provide well posedness results for associated control problems without assuming any additional regularity of the operators involved.


Scattering of two particles in a 1D lattice. This study concerns the two body scattering of particles in a one dimensional periodic potential. A convenient ansatz allows for the separation of center of mass and relative motion, leading to a discrete Schr "odinger equation in the relative motion that resembles a tight binding model. A lattice Green's function is used to develop the Lippmann Schwinger equation, and ultimately derive a multi band scattering K matrix which is described in detail in the two band approximation. Two distinct scattering lengths are defined according the limits of zero relative quasi momentum at the top and bottom edges of the two body collision band. Scattering resonances occur in the collision band when the energy is coincident with a bound state attached to another higher or lower band. Notably, repulsive on site interactions in an energetically closed lower band lead to collision resonances in an excited band.


Self supervised Depth Estimation Leveraging Global Perception and Geometric Smoothness Using On board Videos. Self supervised depth estimation has drawn much attention in recent years as it does not require labeled data but image sequences. Moreover, it can be conveniently used in various applications, such as autonomous driving, robotics, realistic navigation, and smart cities. However, extracting global contextual information from images and predicting a geometrically natural depth map remain challenging. In this paper, we present DLNet for pixel wise depth estimation, which simultaneously extracts global and local features with the aid of our depth Linformer block. This block consists of the Linformer and innovative soft split multi layer perceptron blocks. Moreover, a three dimensional geometry smoothness loss is proposed to predict a geometrically natural depth map by imposing the second order smoothness constraint on the predicted three dimensional point clouds, thereby realizing improved performance as a byproduct. Finally, we explore the multi scale prediction strategy and propose the maximum margin dual scale prediction strategy for further performance improvement. In experiments on the KITTI and Make3D benchmarks, the proposed DLNet achieves performance competitive to those of the state of the art methods, reducing time and space complexities by more than 62 and 56 , respectively. Extensive testing on various real world situations further demonstrates the strong practicality and generalization capability of the proposed model.


Data driven Modelling of Ship Maneuvers in Waves via Dynamic Mode Decomposition. A data driven and equation free approach is proposed and discussed to model ships maneuvers in waves, based on the dynamic mode decomposition (DMD). DMD is a dimensionality reduction reduced order modeling method, which provides a linear finite dimensional representation of a possibly nonlinear system dynamics by means of a set of modes with associated oscillation frequencies and decay growth rates. DMD also allows for short term future estimates of the system's state, which can be used for real time prediction and control. Here, the objective of the DMD is the analysis and forecast of the trajectories motions forces of ships operating in waves, offering a complementary efficient method to equation based system identification approaches. Results are presented for the course keeping of a free running naval destroyer (5415M) in irregular stern quartering waves and for the free running KRISO Container Ship (KCS) performing a turning circle in regular waves. Results are overall promising and show how DMD is able to identify the most important modes and forecast the system's state with reasonable accuracy up to two wave encounter periods.


Detecting Slag Formations with Deep Convolutional Neural Networks. We investigate the ability to detect slag formations in images from inside a Grate Kiln system furnace with two deep convolutional neural networks. The conditions inside the furnace cause occasional obstructions of the camera view. Our approach suggests dealing with this problem by introducing a convLSTM layer in the deep convolutional neural network. The results show that it is possible to achieve sufficient performance to automate the decision of timely countermeasures in the industrial operational setting. Furthermore, the addition of the convLSTM layer results in fewer outlying predictions and a lower running variance of the fraction of detected slag in the image time series.


On the convergence of the nonlocal nonlinear model to the classical elasticity equation. We consider a general class of convolution type nonlocal wave equations modeling bidirectional propagation of nonlinear waves in a continuous medium. In the limit of vanishing nonlocality we study the behavior of solutions to the Cauchy problem. We prove that, as the kernel functions of the convolution integral approach the Dirac delta function, the solutions converge strongly to the corresponding solutions of the classical elasticity equation. An energy estimate with no loss of derivative plays a critical role in proving the convergence result. As a typical example, we consider the continuous limit of the discrete lattice dynamic model (the Fermi Pasta Ulam Tsingou model) and show that, as the lattice spacing approaches zero, solutions to the discrete lattice equation converge to the corresponding solutions of the classical elasticity equation.


eDarkTrends Harnessing Social Media Trends in Substance use disorders for Opioid Listings on Cryptomarket. Opioid and substance misuse is rampant in the United States today, with the phenomenon known as the opioid crisis. The relationship between substance use and mental health has been extensively studied, with one possible relationship being substance misuse causes poor mental health. However, the lack of evidence on the relationship has resulted in opioids being largely inaccessible through legal means. This study analyzes the substance misuse posts on social media with the opioids being sold through crypto market listings. We use the Drug Abuse Ontology, state of the art deep learning, and BERT based models to generate sentiment and emotion for the social media posts to understand user perception on social media by investigating questions such as, which synthetic opioids people are optimistic, neutral, or negative about or what kind of drugs induced fear and sorrow or what kind of drugs people love or thankful about or which drug people think negatively about or which opioids cause little to no sentimental reaction. We also perform topic analysis associated with the generated sentiments and emotions to understand which topics correlate with people's responses to various drugs. Our findings can help shape policy to help isolate opioid use cases where timely intervention may be required to prevent adverse consequences, prevent overdose related deaths, and worsen the epidemic.


Collaging Class specific GANs for Semantic Image Synthesis. We propose a new approach for high resolution semantic image synthesis. It consists of one base image generator and multiple class specific generators. The base generator generates high quality images based on a segmentation map. To further improve the quality of different objects, we create a bank of Generative Adversarial Networks (GANs) by separately training class specific models. This has several benefits including dedicated weights for each class centrally aligned data for each model additional training data from other sources, potential of higher resolution and quality and easy manipulation of a specific object in the scene. Experiments show that our approach can generate high quality images in high resolution while having flexibility of object level control by using class specific generators.


Symplectomorphisms of mirrors to log Calabi Yau surfaces. Let M be a Weinstein four manifold mirror to Y D for (Y,D) a log Calabi Yau surface intuitively, this is typically the Milnor fibre of a smoothing of a cusp singularity. We introduce two families of symplectomorphisms of M Lagrangian translations, which we prove are mirror to tensors with line bundles and nodal slide recombinations, which we prove are mirror to automorphisms of (Y,D). The proof uses a detailed compatibility between the homological and SYZ view points on mirror symmetry. Together with spherical twists, these symplectomorphisms are expected to generate all autoequivalences of the wrapped Fukaya category of M which are compactly supported in a categorical sense. A range of applications is given.


Existence and multiplicity of solutions for a Dirichlet problem in Fractional Orlicz Sobolev spaces. In this paper, we first prove the existence of solutions to Dirichlet problems involving the fractional g Laplacian operator and lower order terms by appealing to sub and supersolution methods. Moreover, we also state the existence of extremal solutions. Afterwards, and under additional assumptions on the lower order structure, we establish by variational techniques the existence of multiple solutions one positive, one negative and one with non constant sign.


A Polynomial time, Truthful, Individually Rational and Budget Balanced Ridesharing Mechanism. Ridesharing has great potential to improve transportation efficiency while reducing congestion and pollution. To realize this potential, mechanisms are needed that allocate vehicles optimally and provide the right incentives to riders. However, many existing approaches consider restricted settings (e.g., only one rider per vehicle or a common origin for all riders). Moreover, naive applications of standard approaches, such as the Vickrey Clarke Groves or greedy mechanisms, cannot achieve a polynomial time, truthful, individually rational and budget balanced mechanism. To address this, we formulate a general ridesharing problem and apply mechanism design to develop a novel mechanism which satisfies all four properties and whose social cost is within 8.6 of the optimal on average.


All Graphs with a Failed Zero Forcing Number of Two. Given a graph G , the zero forcing number of G , Z(G) , is the smallest cardinality of any set S of vertices on which repeated applications of the forcing rule results in all vertices being in S . The forcing rule is if a vertex v is in S , and exactly one neighbor u of v is not in S , then u is added to S in the next iteration. Zero forcing numbers have attracted great interest over the past 15 years and have been well studied. In this paper we investigate the largest size of a set S that does not force all of the vertices in a graph to be in S . This quantity is known as the failed zero forcing number of a graphs and will be denoted by F(G) , and has received attention in recent years. We present new results involving this parameter. In particular, we completely characterize all graphs G where F(G) 2 , solving a problem posed in 2015 by Fetcie, Jacob, and Saavedra.


Relative Gorenstein dimensions over triangular matrix rings. Let A and B be rings, U a (B,A) bimodule and T begin pmatrix A 0 U B end pmatrix the triangular matrix ring. In this paper, several notions in relative Gorenstein algebra over a triangular matrix ring are investigated. We first study how to construct w tilting (tilting, semidualizing) over T using the corresponding ones over A and B . We show that when U is relative (weakly) compatible we are able to describe the structure of G C projective modules over T . As an application, we study when a morphism in T Mod has a special G CP(T) precover and when the class G CP(T) is a special precovering class. In addition, we study the relative global dimension of T . In some cases, we show that it can be computed from the relative global dimensions of A and B . We end the paper with a counterexample to a result that characterizes when a T module has a finite projective dimension.


The King is Naked on the Notion of Robustness for Natural Language Processing. There is growing evidence that the classical notion of adversarial robustness originally introduced for images has been adopted as a de facto standard by a large part of the NLP research community. We show that this notion is problematic in the context of NLP as it considers a narrow spectrum of linguistic phenomena. In this paper, we argue for semantic robustness, which is better aligned with the human concept of linguistic fidelity. We characterize semantic robustness in terms of biases that it is expected to induce in a model. We study semantic robustness of a range of vanilla and robustly trained architectures using a template based generative test bed. We complement the analysis with empirical evidence that, despite being harder to implement, semantic robustness can improve performance gives guarantees for on complex linguistic phenomena where models robust in the classical sense fail.


Privacy Preserving Near Neighbor Search via Sparse Coding with Ambiguation. In this paper, we propose a framework for privacy preserving approximate near neighbor search via stochastic sparsifying encoding. The core of the framework relies on sparse coding with ambiguation (SCA) mechanism that introduces the notion of inherent shared secrecy based on the support intersection of sparse codes. This approach is fairness aware', in the sense that any point in the neighborhood has an equiprobable chance to be chosen. Our approach can be applied to raw data, latent representation of autoencoders, and aggregated local descriptors. The proposed method is tested on both synthetic i.i.d data and real large scale image databases.


Context Aware Unsupervised Clustering for Person Search. The existing person search methods use the annotated labels of person identities to train deep networks in a supervised manner that requires a huge amount of time and effort for human labeling. In this paper, we first introduce a novel framework of person search that is able to train the network in the absence of the person identity labels, and propose efficient unsupervised clustering methods to substitute the supervision process using annotated person identity labels. Specifically, we propose a hard negative mining scheme based on the uniqueness property that only a single person has the same identity to a given query person in each image. We also propose a hard positive mining scheme by using the contextual information of co appearance that neighboring persons in one image tend to appear simultaneously in other images. The experimental results show that the proposed method achieves comparable performance to that of the state of the art supervised person search methods, and furthermore outperforms the extended unsupervised person re identification methods on the benchmark person search datasets.


SMURF SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysis. The open ended nature of visual captioning makes it a challenging area for evaluation. The majority of proposed models rely on specialized training to improve human correlation, resulting in limited adoption, generalizability, and explainabilty. We introduce "typicality", a new formulation of evaluation rooted in information theory, which is uniquely suited for problems lacking a definite ground truth. Typicality serves as our framework to develop a novel semantic comparison, SPARCS, as well as referenceless fluency evaluation metrics. Over the course of our analysis, two separate dimensions of fluency naturally emerge style, captured by metric SPURTS, and grammar, captured in the form of grammatical outlier penalties. Through extensive experiments and ablation studies on benchmark datasets, we show how these decomposed dimensions of semantics and fluency provide greater system level insight into captioner differences. Our proposed metrics along with their combination, SMURF, achieve state of the art correlation with human judgment when compared with other rule based evaluation metrics.


Wireless charging for weighted energy balance in populations of mobile peers. Wireless energy transfer is an emerging technology that is used in networks of battery powered devices in order to deliver energy and keep the network functional. Existing state of the art studies have mainly focused on applying this technology on networks of relatively strong computational and communicational capabilities (wireless sensor networks, ad hoc networks) also they assume energy transfer from special chargers to regular network nodes. Different from these works, we study how to efficiently transfer energy wirelessly in populations of battery limited devices, towards prolonging their lifetime. In contrast to the state of the art, we assume a much weaker population of distributed devices which are exchanging energy in a "peer to peer" manner with each other, without any special charger nodes. We address a quite general case of diverse energy levels and priorities in the network and study the problem of how the system can efficiently reach a weighted energy balance state distributively, under both loss less and lossy power transfer assumptions. Three protocols are designed, analyzed and evaluated, achieving different performance trade offs between energy balance quality, convergence time and energy efficiency.


An evidential classifier based on Dempster Shafer theory and deep learning. We propose a new classifier based on Dempster Shafer (DS) theory and a convolutional neural network (CNN) architecture for set valued classification. In this classifier, called the evidential deep learning classifier, convolutional and pooling layers first extract high dimensional features from input data. The features are then converted into mass functions and aggregated by Dempster's rule in a DS layer. Finally, an expected utility layer performs set valued classification based on mass functions. We propose an end to end learning strategy for jointly updating the network parameters. Additionally, an approach for selecting partial multi class acts is proposed. Experiments on image recognition, signal processing, and semantic relationship classification tasks demonstrate that the proposed combination of deep CNN, DS layer, and expected utility layer makes it possible to improve classification accuracy and to make cautious decisions by assigning confusing patterns to multi class sets.


Maximizing Cosine Similarity Between Spatial Features for Unsupervised Domain Adaptation in Semantic Segmentation. We propose a novel method that tackles the problem of unsupervised domain adaptation for semantic segmentation by maximizing the cosine similarity between the source and the target domain at the feature level. A segmentation network mainly consists of two parts, a feature extractor and a classification head. We expect that if we can make the two domains have small domain gap at the feature level, they would also have small domain discrepancy at the classification head. Our method computes a cosine similarity matrix between the source feature map and the target feature map, then we maximize the elements exceeding a threshold to guide the target features to have high similarity with the most similar source feature. Moreover, we use a class wise source feature dictionary which stores the latest features of the source domain to prevent the unmatching problem when computing the cosine similarity matrix and be able to compare a target feature with various source features from various images. Through extensive experiments, we verify that our method gains performance on two unsupervised domain adaptation tasks (GTA5 to Cityscaspes and SYNTHIA to Cityscapes).


Optimal hybrid parameter selection for stable sequential solution of inverse heat conduction problem. To deal with the ill posed nature of the inverse heat conduction problem (IHCP), the regularization parameter alpha can be incorporated into a minimization problem, which is known as Tikhonov regularization method, a popular technique to obtain stable sequential solutions. Because alpha is a penalty term, its excessive use may cause large bias errors. Ridge regression was developed as an estimator of the optimal alpha to minimize the magnitude of a gain coefficient matrix appropriately. However, the sensitivity coefficient matrix included in the gain coefficient matrix depends on the time integrator thus, certain parameters of the time integrators should be carefully considered with alpha to handle instability. Based on this motivation, we propose an effective iterative hybrid parameter selection algorithm to obtain stable inverse solutions.


Quadratic Curve Lifted Reed Solomon Codes. Lifted codes are a class of evaluation codes attracting more attention due to good locality and intermediate availability. In this work we introduce and study quadratic curve lifted Reed Solomon (QC LRS) codes, where the codeword symbols whose coordinates are on a quadratic curve form a codeword of a Reed Solomon code. We first develop a necessary and sufficient condition on the monomials which form a basis the code. Based on the condition, we give upper and lower bounds on the dimension and show that the asymptotic rate of a QC LRS code over mathbb F q with local redundancy r is 1 Theta(q r) 0.2284 . Moreover, we provide analytical results on the minimum distance of this class of codes and compare QC LRS codes with lifted Reed Solomon codes by simulations in terms of the local recovery capability against erasures. For short lengths, QC LRS codes have better performance in local recovery for erasures than LRS codes of the same dimension.


GTAE Graph Transformer based Auto Encoders for Linguistic Constrained Text Style Transfer. Non parallel text style transfer has attracted increasing research interests in recent years. Despite successes in transferring the style based on the encoder decoder framework, current approaches still lack the ability to preserve the content and even logic of original sentences, mainly due to the large unconstrained model space or too simplified assumptions on latent embedding space. Since language itself is an intelligent product of humans with certain grammars and has a limited rule based model space by its nature, relieving this problem requires reconciling the model capacity of deep neural networks with the intrinsic model constraints from human linguistic rules. To this end, we propose a method called Graph Transformer based Auto Encoder (GTAE), which models a sentence as a linguistic graph and performs feature extraction and style transfer at the graph level, to maximally retain the content and the linguistic structure of original sentences. Quantitative experiment results on three non parallel text style transfer tasks show that our model outperforms state of the art methods in content preservation, while achieving comparable performance on transfer accuracy and sentence naturalness.


Aspects of Sustainable Test Processes. Testing is a core software development activity that has huge potential to make software development more sustainable. In this paper, we discuss how environmental, social, economic, and technical sustainability map onto the activities of test planning, design, execution, and evaluation.


Construction of APN permutations via Walsh zero spaces. A Walsh zero space (WZ space) for f F 2 n rightarrow F 2 n is an n dimensional vector subspace of F 2 n times F 2 n whose all nonzero elements are Walsh zeros of f . We provide several theoretical and computer free constructions of WZ spaces for Gold APN functions f(x) x 2 i 1 on F 2 n where n is odd and gcd(i,n) 1 . We also provide several constructions of trivially intersecting pairs of such spaces. We illustrate applications of our constructions that include constructing APN permutations that are CCZ equivalent to f but not extended affine equivalent to f or its compositional inverse.


A Comparative Study of Detecting Anomalies in Time Series Data Using LSTM and TCN Models. There exist several data driven approaches that enable us model time series data including traditional regression based modeling approaches (i.e., ARIMA). Recently, deep learning techniques have been introduced and explored in the context of time series analysis and prediction. A major research question to ask is the performance of these many variations of deep learning techniques in predicting time series data. This paper compares two prominent deep learning modeling techniques. The Recurrent Neural Network (RNN) based Long Short Term Memory (LSTM) and the convolutional Neural Network (CNN) based Temporal Convolutional Networks (TCN) are compared and their performance and training time are reported. According to our experimental results, both modeling techniques perform comparably having TCN based models outperform LSTM slightly. Moreover, the CNN based TCN model builds a stable model faster than the RNN based LSTM models.


Parallelizable global quasi conformal parameterization of multiply connected surfaces via partial welding. Conformal and quasi conformal mappings have widespread applications in imaging science, computer vision and computer graphics, such as surface registration, segmentation, remeshing, and texture map compression. While various conformal and quasi conformal parameterization methods for simply connected surfaces have been proposed, efficient parameterization methods for multiply connected surfaces are less explored. In this paper, we propose a novel parallelizable algorithm for computing the global conformal and quasi conformal parameterization of multiply connected surfaces onto a 2D circular domain using variants of the partial welding algorithm and the Koebe's iteration. The main idea is to partition a multiply connected surface into several subdomains and compute the free boundary conformal or quasi conformal parameterizations of them respectively, and then apply a variant of the partial welding algorithm to reconstruct the global mapping. We apply the Koebe's iteration together with the geodesic algorithm to the boundary points and welding paths before and after the global welding to transform all the boundaries to circles conformally. After getting all the updated boundary conditions, we obtain the global parameterization of the multiply connected surface by solving the Laplace equation for each subdomain. Using this divide and conquer approach, the parameterization of surfaces with very high resolution can be efficiently computed. Experimental results are presented to demonstrate the effectiveness of our proposed algorithms.


Enantiosensitive Structure Determination by Photoelectron Scattering on Single Molecules. X ray as well as electron diffraction are powerful tools for structure determination of molecules. Electron diffraction methods yield r A ngstrom resolution even when applied to large systems or systems involving weak scatterers such as hydrogen atoms. For cases in which molecular crystals cannot be obtained or the interaction free molecular structure is to be addressed, corresponding electron scattering approaches on gas phase molecules exist. Such studies on randomly oriented molecules, however, can only provide information on interatomic distances, which is challenging to analyse in case of overlapping distance parameters and they do not reveal the handedness of chiral systems8. Here, we present a novel scheme to obtain information on the structure, handedness and even detailed geometrical features of single molecules in the gas phase. Using a loop like analysis scheme employing input from ab initio computations on the photoionization process, we are able to deduce the three dimensional molecular structure with sensitivity to the position individual atoms, as e.g. protons. To achieve this, we measure the molecular frame diffraction pattern of core shell photoelectrons in combination with only two ionic fragments from a molecular Coulomb explosion. Our approach is expected to be suitable for larger molecules, as well, since typical size limitations regarding the structure determination by pure Coulomb explosion imaging are overcome by measuring in addition the photoelectron in coincidence with the ions. As the photoelectron interference pattern captures the molecular structure at the instant of ionization, we anticipate our approach to allow for tracking changes in the molecular structure on a femtosecond time scale by applying a pump probe scheme in the future.


Strongly divisible lattices and crystalline cohomology in the imperfect residue field case. Let k be a perfect field of characteristic p geq 3 , and let K be a finite totally ramified extension of K 0 W(k) p 1 . Let L 0 be a complete discrete valuation field over K 0 whose residue field has a finite p basis, and let L L 0 otimes K 0 K . For 0 leq r leq p 2 , we classify mathbf Z p lattices of crystalline representations of mathrm Gal ( overline L L) with Hodge Tate weights in 0, r by strongly divisible lattices. Moreover, if mathcal X is a proper smooth scheme over mathcal O L which arises from a proper smooth scheme over mathcal O K , we give a cohomological description of the strongly divisible lattice associated to H i text 'et ( mathcal X overline L , mathbf Z p) for i leq p 2 , under the assumption that the crystalline cohomology of the special fiber of mathcal X is torsion free in degrees i and i 1 .


Lectin conjugated pH responsive mesoporous silica nanoparticles for targeted bone cancer treatment. A novel multifunctional nanodevice based in doxorubicin (DOX) loaded mesoporous silica nanoparticles (MSNs) as nanoplatforms for the assembly of different building blocks has been developed for bone cancer treatment. These building blocks consists of i) a polyacrylic acid (PAA) capping layer grafted to MSNs via an acid cleavable acetal linker, to minimize premature cargo release and provide the nanosystem of pHresponsive drug delivery ability and ii) a targeting ligand, the plant lectin concanavalin A (ConA), able to selectively recognize, bind and internalize owing to certain cell surface glycans, such as sialic acids (SA), overexpressed in given tumor cells. This multifunctional nanosystem exhibits a noticeable higher internalization degree into human osteosarcoma cells (HOS), overexpressing SA, compared to healthy preosteoblast cells (MC3T3 E1). Moreover, the results indicate that small DOX loading leads to almost 100 of osteosarcoma cell death in comparison with healthy bone cells, which significantly preserve their viability. Besides, this nanodevice has a cytotoxicity on tumor cells 8 fold higher than that caused by the free drug. These findings demonstrate that the synergistic combination of different building blocks into a unique nanoplatform increases antitumor effectiveness and decreases toxicity towards normal cells. This line of attack opens up new insights in targeted bone cancer therapy.


Align before Fuse Vision and Language Representation Learning with Momentum Distillation. Large scale vision and language representation learning has shown promising improvements on various vision language tasks. Most existing methods employ a transformer based multimodal encoder to jointly model visual tokens (region based image features) and word tokens. Because the visual tokens and word tokens are unaligned, it is challenging for the multimodal encoder to learn image text interactions. In this paper, we introduce a contrastive loss to ALign the image and text representations BEfore Fusing (ALBEF) them through cross modal attention, which enables more grounded vision and language representation learning. Unlike most existing methods, our method does not require bounding box annotations nor high resolution images. In order to improve learning from noisy web data, we propose momentum distillation, a self training method which learns from pseudo targets produced by a momentum model. We provide a theoretical analysis of ALBEF from a mutual information maximization perspective, showing that different training tasks can be interpreted as different ways to generate views for an image text pair. ALBEF achieves state of the art performance on multiple downstream vision language tasks. On image text retrieval, ALBEF outperforms methods that are pre trained on orders of magnitude larger datasets. On VQA and NLVR 2 , ALBEF achieves absolute improvements of 2.37 and 3.84 compared to the state of the art, while enjoying faster inference speed. Code and pre trained models are available at https github.com salesforce ALBEF .