Semi Supervised Visual Representation Learning for Fashion Compatibility. We consider the problem of complementary fashion prediction. Existing approaches focus on learning an embedding space where fashion items from different categories that are visually compatible are closer to each other. However, creating such labeled outfits is intensive and also not feasible to generate all possible outfit combinations, especially with large fashion catalogs. In this work, we propose a semi supervised learning approach where we leverage large unlabeled fashion corpus to create pseudo positive and pseudo negative outfits on the fly during training. For each labeled outfit in a training batch, we obtain a pseudo outfit by matching each item in the labeled outfit with unlabeled items. Additionally, we introduce consistency regularization to ensure that representation of the original images and their transformations are consistent to implicitly incorporate colour and other important attributes through self supervision. We conduct extensive experiments on Polyvore, Polyvore D and our newly created large scale Fashion Outfits datasets, and show that our approach with only a fraction of labeled examples performs on par with completely supervised methods.


Component by component construction of randomized rank 1 lattice rules achieving almost the optimal randomized error rate. We study a randomized quadrature algorithm to approximate the integral of periodic functions defined over the high dimensional unit cube. Recent work by Kritzer, Kuo, Nuyens and Ullrich (2019) shows that rank 1 lattice rules with a randomly chosen number of points and good generating vector achieve almost the optimal order of the randomized error in weighted Korobov spaces, and moreover, that the error is bounded independently of the dimension if the weight parameters, gamma j , satisfy the summability condition sum j 1 infty gamma j 1 alpha infty , where alpha is a smoothness parameter. The argument is based on the existence result that at least half of the possible generating vectors yield almost the optimal order of the worst case error in the same function spaces. In this paper we provide a component by component construction algorithm of such randomized rank 1 lattice rules, without any need to check whether the constructed generating vectors satisfy a desired worst case error bound. Similarly to the above mentioned work, we prove that our algorithm achieves almost the optimal order of the randomized error and that the error bound is independent of the dimension if the same condition sum j 1 infty gamma j 1 alpha infty holds. We also provide analogous results for tent transformed lattice rules for weighted half period cosine spaces and for polynomial lattice rules in weighted Walsh spaces, respectively.


Gradient Importance Learning for Incomplete Observations. Though recent works have developed methods that can generate estimates (or imputations) of the missing entries in a dataset to facilitate downstream analysis, most depend on assumptions that may not align with real world applications and could suffer from poor performance in subsequent tasks such as classification. This is particularly true if the data have large missingness rates or a small sample size. More importantly, the imputation error could be propagated into the prediction step that follows, which may constrain the capabilities of the prediction model. In this work, we introduce the gradient importance learning (GIL) method to train multilayer perceptrons (MLPs) and long short term memories (LSTMs) to directly perform inference from inputs containing missing values without imputation. Specifically, we employ reinforcement learning (RL) to adjust the gradients used to train these models via back propagation. This allows the model to exploit the underlying information behind missingness patterns. We test the approach on real world time series (i.e., MIMIC III), tabular data obtained from an eye clinic, and a standard dataset (i.e., MNIST), where our imputation free predictions outperform the traditional two step imputation based predictions using state of the art imputation methods.


L invariants for cohomological representations of PGL(2) over arbitrary number fields. Let pi be a cuspidal, cohomological automorphic representation of an inner form G of mathrm PGL 2 over a number field F of arbitrary signature. Further, let mathfrak p be a prime of F such that G is split at mathfrak p and the local component pi mathfrak p of pi at mathfrak p is the Steinberg representation. Assuming that the representation is non critical at mathfrak p we construct automorphic mathcal L invariants for the representation pi . If the number field F is totally real, we show that these automorphic mathcal L invariants agree with the Fontaine Mazur mathcal L invariant of the associated p adic Galois representation. This generalizes a recent result of Spiess respectively Rosso and the first named author from the case of parallel weight 2 to arbitrary cohomological weights.


Asymmetrical Order in Wall Bounded Turbulent Flows. Scaling of turbulent wall bounded flows is revealed in the gradient structures, for each of the Reynolds stress components. Within the dissipation structure, an asymmetrical order exists, that we can deploy to unify the scaling and transport dynamics within and across these flows. There are subtle differences in the outer boundary conditions between channel and flat plate boundary layer flows, which modify the turbulence structure far from the wall. The self similarity exhibited in the dissipation structures and corresponding transport dynamics establish capabilities and encompassing knowledge of wall bounded turbulent flows.


Adaptation through prediction multisensory active inference torque control. Adaptation to external and internal changes is major for robotic systems in uncertain environments. Here we present a novel multisensory active inference torque controller for industrial arms that shows how prediction can be used to resolve adaptation. Our controller, inspired by the predictive brain hypothesis, improves the capabilities of current active inference approaches by incorporating learning and multimodal integration of low and high dimensional sensor inputs (e.g., raw images) while simplifying the architecture. We performed a systematic evaluation of our model on a 7DoF Franka Emika Panda robot arm by comparing its behavior with previous active inference baselines and classic controllers, analyzing both qualitatively and quantitatively adaptation capabilities and control accuracy. Results showed improved control accuracy in goal directed reaching with high noise rejection due to multimodal filtering, and adaptability to dynamical inertial changes, elasticity constraints and human disturbances without the need to relearn the model nor parameter retuning.


Application of Gaussian process regression to plasma turbulent transport model validation via integrated modelling. This paper outlines an approach towards improved rigour in tokamak turbulence transport model validation within integrated modelling. Gaussian process regression (GPR) techniques were applied for profile fitting during the preparation of integrated modelling simulations allowing for rigourous sensitivity tests of prescribed initial and boundary conditions as both fit and derivative uncertainties are provided. This was demonstrated by a JETTO integrated modelling simulation of the JET ITER like wall H mode baseline discharge 92436 with the QuaLiKiz quasilinear turbulent transport model, which is the subject of extrapolation towards a deuterium tritium plasma. The simulation simultaneously evaluates the time evolution of heat, particle, and momentum fluxes over sim10 confinement times, with a simulation boundary condition at rho tor 0.85 . Routine inclusion of momentum transport prediction in multi channel flux driven transport modelling is not standard and is facilitated here by recent developments within the QuaLiKiz model. Excellent agreement was achieved between the fitted and simulated profiles for n e , T e , T i , and Omega tor within 2 sigma , but the simulation underpredicts the mid radius T i and overpredicts the core n e and T e profiles for this discharge. Despite this, it was shown that this approach is capable of deriving reasonable inputs, including derivative quantities, to tokamak models from experimental data. Furthermore, multiple figures of merit were defined to quantitatively assess the agreement of integrated modelling predictions to experimental data within the GPR profile fitting framework.


The AKSZ Construction in Derived Algebraic Geometry as an Extended Topological Field Theory. We construct a family of oriented extended topological field theories using the AKSZ construction in derived algebraic geometry, which can be viewed as an algebraic and topological version of the classical AKSZ field theories that occur in physics. These have as their targets higher categories of symplectic derived stacks, with higher morphisms given by iterated Lagrangian correspondences. We define these, as well as analogous higher categories of oriented derived stacks and iterated oriented cospans, and prove that all objects are fully dualizable. Then we set up a functorial version of the AKSZ construction, first implemented in this context by Pantev To "en Vaqui 'e Vezzosi, and show that it induces a family of symmetric monoidal functors from oriented stacks to symplectic stacks. Finally, we construct forgetful functors from the unoriented bordism ( infty,n) category to cospans of spaces, and from the oriented bordism ( infty,n) category to cospans of spaces equipped with an orientation the latter combines with the AKSZ functors by viewing spaces as constant stacks, giving the desired field theories.


A Construction of C r Conforming Finite Element Spaces in Any Dimension. This paper proposes a construction of local C r interpolation spaces and C r conforming finite element spaces with arbitrary r in any dimension. It is shown that if k ge 2 d r 1 the space mathcal P k of polynomials of degree le k can be taken as the shape function space of C r finite element spaces in d dimensions. This is the first work on constructing such C r conforming finite elements in any dimension in a unified way. It solves a long standing open problem in finite element methods.


K theory of the maximal and reduced Roe algebras of metric spaces with A by CE coarse fibrations. Let X be a discrete metric space with bounded geometry. We show that if X admits an "A by CE coarse fibration", then the canonical quotient map lambda C max (X) to C (X) from the maximal Roe algebra to the Roe algebra of X , and the canonical quotient map lambda C u, max (X) to C u(X) from the maximal uniform Roe algebra to the uniform Roe algebra of X , induce isomorphisms on K theory. A typical example of such a space arises from a sequence of group extensions 1 to N n to G n to Q n to 1 such that the sequence N n has Yu's property A, and the sequence Q n admits a coarse embedding into Hilbert space. This extends an early result of J. v S pakula and R. Willett cite JR2013 to the case of metric spaces which may not admit a coarse embedding into Hilbert space. Moreover, it implies that the maximal coarse Baum Connes conjecture holds for a large class of metric spaces which may not admit a fibred coarse embedding into Hilbert space.


Operator Autoencoders Learning Physical Operations on Encoded Molecular Graphs. Molecular dynamics simulations produce data with complex nonlinear dynamics. If the timestep behavior of such a dynamic system can be represented by a linear operator, future states can be inferred directly without expensive simulations. The use of an autoencoder in combination with a physical timestep operator allows both the relevant structural characteristics of the molecular graphs and the underlying physics of the system to be isolated during the training process. In this work, we develop a pipeline for establishing graph structured representations of time series volumetric data from molecular dynamics simulations. We then train an autoencoder to find nonlinear mappings to a latent space where future timesteps can be predicted through application of a linear operator trained in tandem with the autoencoder. Increasing the dimensionality of the autoencoder output is shown to improve the accuracy of the physical timestep operator.


A Novel Word Sense Disambiguation Approach Using WordNet Knowledge Graph. Various applications in computational linguistics and artificial intelligence rely on high performing word sense disambiguation techniques to solve challenging tasks such as information retrieval, machine translation, question answering, and document clustering. While text comprehension is intuitive for humans, machines face tremendous challenges in processing and interpreting a human's natural language. This paper presents a novel knowledge based word sense disambiguation algorithm, namely Sequential Contextual Similarity Matrix Multiplication (SCSMM). The SCSMM algorithm combines semantic similarity, heuristic knowledge, and document context to respectively exploit the merits of local context between consecutive terms, human knowledge about terms, and a document's main topic in disambiguating terms. Unlike other algorithms, the SCSMM algorithm guarantees the capture of the maximum sentence context while maintaining the terms' order within the sentence. The proposed algorithm outperformed all other algorithms when disambiguating nouns on the combined gold standard datasets, while demonstrating comparable results to current state of the art word sense disambiguation systems when dealing with each dataset separately. Furthermore, the paper discusses the impact of granularity level, ambiguity rate, sentence size, and part of speech distribution on the performance of the proposed algorithm.


Energy Efficient Ultra Dense Network with Deep Reinforcement Learning. With the explosive growth in mobile data traffic, ultra dense network (UDN) where a large number of small cells are densely deployed on top of macro cells has received a great deal of attention in recent years. While UDN offers a number of benefits, an upsurge of energy consumption in UDN due to the intensive deployment of small cells has now become a major bottleneck in achieving the primary goals viz., 100 fold increase in the throughput in 5G and 6G. In recent years, an approach to reduce the energy consumption of base stations (BSs) by selectively turning off the lightly loaded BSs, referred to as the sleep mode technique, has been suggested. However, determining the appropriate active sleep modes of BSs is a difficult task due to the huge computational overhead and inefficiency caused by the frequent BS mode conversion. An aim of this paper is to propose a deep reinforcement learning (DRL) based approach to achieve a reduction of energy consumption in UDN. Key ingredient of the proposed scheme is to use decision selection network to reduce the size of action space. Numerical results show that the proposed scheme can significantly reduce the energy consumption of UDN while ensuring the rate requirement of network.


A Survey of Microarchitectural Side channel Vulnerabilities, Attacks and Defenses in Cryptography. Side channel attacks have become a severe threat to the confidentiality of computer applications and systems. One popular type of such attacks is the microarchitectural attack, where the adversary exploits the hardware features to break the protection enforced by the operating system and steal the secrets from the program. In this paper, we systematize microarchitectural side channels with a focus on attacks and defenses in cryptographic applications. We make three contributions. (1) We survey past research literature to categorize microarchitectural side channel attacks. Since these are hardware attacks targeting software, we summarize the vulnerable implementations in software, as well as flawed designs in hardware. (2) We identify common strategies to mitigate microarchitectural attacks, from the application, OS and hardware levels. (3) We conduct a large scale evaluation on popular cryptographic applications in the real world, and analyze the severity, practicality and impact of side channel vulnerabilities. This survey is expected to inspire side channel research community to discover new attacks, and more importantly, propose new defense solutions against them.


Hemodynamic effects of stent graft introducer sheath during thoracic endovascular aortic repair. Thoracic endovascular aortic repair (TEVAR) has become the standard treatment of a variety of aortic pathologies. The objective of this study is to evaluate the hemodynamic effects of stent graft introducer sheath during TEVAR. Three idealized representative diseased aortas of aortic aneurysm, coarctation of the aorta, and aortic dissection were designed. Computational fluid dynamics studies were performed in the above idealized aortic geometries. An introducer sheath routinely used in the clinic was virtually delivered into diseased aortas. Comparative analysis was carried out to evaluate the hemodynamic effects of the introducer sheath. Results show that the blood flow to the supra aortic branches would increase above 9 due to the obstruction of the introducer sheath. The region exposed to high endothelial cell activation potential (ECAP) expands in the scenarios of coarctation of the aorta and aortic dissection, which indicates that the probability of thrombus formation may increase during TEVAR. The pressure magnitude in peak systole shows an obvious rise and a similar phenomenon is not observed in early diastole. The blood viscosity in the aortic arch and descending aorta is remarkably altered by the introducer sheath. The uneven viscosity distribution confirms the necessity of using non Newtonian models and high viscosity region with high ECAP further promotes thrombosis. Our results highlight the hemodynamic effects of stent graft introducer sheath during TEVAR, which may associate with perioperative complications.


Rigidity of free boundary MOTS. The aim of this work is to present an initial data version of Hawking's theorem on the topology of back hole spacetimes in the context of manifolds with boundary. More precisely, we generalize the results of G. J. Galloway and R. Schoen 13 and G. J. Galloway 11, 12 by proving that a compact free boundary stable marginally outer trapped surface (MOTS) Sigma in an initial data set with boundary satisfying natural dominant energy conditions (DEC) is of positive Yamabe type, i.e. Sigma admits a metric of positive scalar curvature with minimal boundary, provided Sigma is outermost. To do so, we prove that if Sigma is a compact free boundary stable MOTS which does not admit a metric of positive scalar curvature with minimal boundary in an initial data set satisfying the interior and the boundary DEC, then an outer neighborhood of Sigma can be foliated by free boundary MOTS Sigma t , assuming that Sigma is weakly outermost. Moreover, each Sigma t has vanishing outward null second fundamental form, is Ricci flat with totally geodesic boundary, and the dominant energy conditions saturate on Sigma t .


Multi Agent System for Machine Learning Under Uncertainty in Cyber Physical Manufacturing System. Recent advancements in predictive machine learning has led to its application in various use cases in manufacturing. Most research focused on maximising predictive accuracy without addressing the uncertainty associated with it. While accuracy is important, focusing primarily on it poses an overfitting danger, exposing manufacturers to risk, ultimately hindering the adoption of these techniques. In this paper, we determine the sources of uncertainty in machine learning and establish the success criteria of a machine learning system to function well under uncertainty in a cyber physical manufacturing system (CPMS) scenario. Then, we propose a multi agent system architecture which leverages probabilistic machine learning as a means of achieving such criteria. We propose possible scenarios for which our proposed architecture is useful and discuss future work. Experimentally, we implement Bayesian Neural Networks for multi tasks classification on a public dataset for the real time condition monitoring of a hydraulic system and demonstrate the usefulness of the system by evaluating the probability of a prediction being accurate given its uncertainty. We deploy these models using our proposed agent based framework and integrate web visualisation to demonstrate its real time feasibility.


A Conceptual Framework for Implicit Evaluation of Conversational Search Interfaces. Conversational search (CS) has recently become a significant focus of the information retrieval (IR) research community. Multiple studies have been conducted which explore the concept of conversational search. Understanding and advancing research in CS requires careful and detailed evaluation. Existing CS studies have been limited to evaluation based on simple user feedback on task completion. We propose a CS evaluation framework which includes multiple dimensions search experience, knowledge gain, software usability, cognitive load and user experience, based on studies of conversational systems and IR. We introduce these evaluation criteria and propose their use in a framework for the evaluation of CS systems.


A New Tool for Efficiently Generating Quality Estimation Datasets. Building of data for quality estimation (QE) training is expensive and requires significant human labor. In this study, we focus on a data centric approach while performing QE, and subsequently propose a fully automatic pseudo QE dataset generation tool that generates QE datasets by receiving only monolingual or parallel corpus as the input. Consequently, the QE performance is enhanced either by data augmentation or by encouraging multiple language pairs to exploit the applicability of QE. Further, we intend to publicly release this user friendly QE dataset generation tool as we believe this tool provides a new, inexpensive method to the community for developing QE datasets.


NeBula Quest for Robotic Autonomy in Challenging Environments TEAM CoSTAR at the DARPA Subterranean Challenge. This paper presents and discusses algorithms, hardware, and software architecture developed by the TEAM CoSTAR (Collaborative SubTerranean Autonomous Robots), competing in the DARPA Subterranean Challenge. Specifically, it presents the techniques utilized within the Tunnel (2019) and Urban (2020) competitions, where CoSTAR achieved 2nd and 1st place, respectively. We also discuss CoSTAR's demonstrations in Martian analog surface and subsurface (lava tubes) exploration. The paper introduces our autonomy solution, referred to as NeBula (Networked Belief aware Perceptual Autonomy). NeBula is an uncertainty aware framework that aims at enabling resilient and modular autonomy solutions by performing reasoning and decision making in the belief space (space of probability distributions over the robot and world states). We discuss various components of the NeBula framework, including (i) geometric and semantic environment mapping (ii) a multi modal positioning system (iii) traversability analysis and local planning (iv) global motion planning and exploration behavior (i) risk aware mission planning (vi) networking and decentralized reasoning and (vii) learning enabled adaptation. We discuss the performance of NeBula on several robot types (e.g. wheeled, legged, flying), in various environments. We discuss the specific results and lessons learned from fielding this solution in the challenging courses of the DARPA Subterranean Challenge competition.


Cohomological Hall algebras and vertex algebras. The moduli stack of representations of a quiver, or coherent sheaves on a proper curve, carries two structures on its cohomology a Hall algebra and braided vertex coalgebra. We show that they are compatible, by developing a formulation of abelian localisation which works in the derived singular setting. An application of these techniques gives an explicit formula for the cohomological Hall algebra products.


Equidistribution of Hodge loci II. Let H subset G be semisimple Lie groups, Gamma subset G a lattice and K a compact subgroup of G . For n in mathbb N , let mathcal O n be the projection to Gamma backslash G K of a finite union of closed H orbits in Gamma backslash G . In this very general context of homogeneous dynamics, we prove an equidistribution theorem for intersections of mathcal O n with an analytic subvariety S of G K of complementary dimension if mathcal O n is equidistributed in Gamma backslash G K , then the signed intersection measure of S cap mathcal O n normalized by the volume of mathcal O n converges to the restriction to S of some G invariant closed form on G K . We give general tools to determine this closed form and compute it in some examples. As our main application, we prove that, if mathbb V is a polarized variation of Hodge structure of weight 2 and Hodge numbers (q,p,q) over a base S of dimension rq , then the (non exceptional) locus where the Picard rank is at least r is equidistributed in S with respect to the volume form c q r , where c q is the q textrm th Chern form of the Hodge bundle. This generalizes a previous work of the first author which treated the case q r 1 . We also prove an equidistribution theorem for certain families of CM points in Shimura varieties, and another one for Hecke translates of a divisor in mathcal A g .


Saddle point preconditioners for weak constraint 4D Var. Data assimilation algorithms combine information from observations and prior model information to obtain the most likely state of a dynamical system. The linearised weak constraint four dimensional variational assimilation problem can be reformulated as a saddle point problem, in order to exploit highly parallel modern computer architectures. In this setting, the choice of preconditioner is crucial to ensure fast convergence and retain the inherent parallelism of the saddle point formulation. We propose new preconditioning approaches for the model term and observation error covariance term which lead to fast convergence of preconditioned Krylov subspace methods, and many of these suggested approximations are highly parallelisable. In particular our novel approach includes model information in the model term within the preconditioner, which to our knowledge has not previously been considered for data assimilation problems. We develop new theory demonstrating the effectiveness of the new preconditioners. Linear and non linear numerical experiments reveal that our new approach leads to faster convergence than existing state of the art preconditioners for a broader range of problems than indicated by the theory alone. We present a range of numerical experiments performed in serial, with further improvements expected if the highly parallelisable nature of the preconditioners is exploited.


Refinement of some partition identities of Merca and Yee. Recently, Merca and Yee proved some partition identities involving two new partition statistics. We refine these statistics and generalize the results of Merca and Yee. We also correct a small mistake in a result of Merca and Yee.


Finding NeMo Fishing in banking networks using network motifs. Banking fraud causes billion dollar losses for banks worldwide. In fraud detection, graphs help understand complex transaction patterns and discovering new fraud schemes. This work explores graph patterns in a real world transaction dataset by extracting and analyzing its network motifs. Since banking graphs are heterogeneous, we focus on heterogeneous network motifs. Additionally, we propose a novel network randomization process that generates valid banking graphs. From our exploratory analysis, we conclude that network motifs extract insightful and interpretable patterns.


Mitigating severe over parameterization in deep convolutional neural networks through forced feature abstraction and compression with an entropy based heuristic. Convolutional Neural Networks (CNNs) such as ResNet 50, DenseNet 40 and ResNeXt 56 are severely over parameterized, necessitating a consequent increase in the computational resources required for model training which scales exponentially for increments in model depth. In this paper, we propose an Entropy Based Convolutional Layer Estimation (EBCLE) heuristic which is robust and simple, yet effective in resolving the problem of over parameterization with regards to network depth of CNN model. The EBCLE heuristic employs a priori knowledge of the entropic data distribution of input datasets to determine an upper bound for convolutional network depth, beyond which identity transformations are prevalent offering insignificant contributions for enhancing model performance. Restricting depth redundancies by forcing feature compression and abstraction restricts over parameterization while decreasing training time by 24.99 78.59 without degradation in model performance. We present empirical evidence to emphasize the relative effectiveness of broader, yet shallower models trained using the EBCLE heuristic, which maintains or outperforms baseline classification accuracies of narrower yet deeper models. The EBCLE heuristic is architecturally agnostic and EBCLE based CNN models restrict depth redundancies resulting in enhanced utilization of the available computational resources. The proposed EBCLE heuristic is a compelling technique for researchers to analytically justify their HyperParameter (HP) choices for CNNs. Empirical validation of the EBCLE heuristic in training CNN models was established on five benchmarking datasets (ImageNet32, CIFAR 10 100, STL 10, MNIST) and four network architectures (DenseNet, ResNet, ResNeXt and EfficientNet B0 B2) with appropriate statistical tests employed to infer any conclusive claims presented in this paper.


Resolvent based approach for H2 optimal estimation and control an application to the cylinder flow. We consider estimation and control of the cylinder wake at low Reynolds numbers. A particular focus is on the development of efficient numerical algorithms to design optimal linear feedback controllers when there are many inputs (disturbances applied everywhere) and many outputs (perturbations measured everywhere). We propose a resolvent based iterative algorithm to perform i) optimal estimation of the flow using a limited number of sensors and ii) optimal control of the flow when the entire flow is known but only a limited number of actuators are available for control. The method uses resolvent analysis to take advantage of the low rank characteristics of the cylinder wake and solutions are obtained without any model order reduction. Optimal feedback controllers are also obtained by combining the solutions of the estimation and control problems. We show that the performance of the estimators and controllers converges to the true global optima, indicating that the important physical mechanisms for estimation and control are of low rank.


SAFIN Arbitrary Style Transfer With Self Attentive Factorized Instance Normalization. Artistic style transfer aims to transfer the style characteristics of one image onto another image while retaining its content. Existing approaches commonly leverage various normalization techniques, although these face limitations in adequately transferring diverse textures to different spatial locations. Self Attention based approaches have tackled this issue with partial success but suffer from unwanted artifacts. Motivated by these observations, this paper aims to combine the best of both worlds self attention and normalization. That yields a new plug and play module that we name Self Attentive Factorized Instance Normalization (SAFIN). SAFIN is essentially a spatially adaptive normalization module whose parameters are inferred through attention on the content and style image. We demonstrate that plugging SAFIN into the base network of another state of the art method results in enhanced stylization. We also develop a novel base network composed of Wavelet Transform for multi scale style transfer, which when combined with SAFIN, produces visually appealing results with lesser unwanted textures.


Quasi Objective Coherent Structure Diagnostics from Single Trajectories. We derive measures of local material stretching and rotation that are computable from individual trajectories without reliance on other trajectories or on an underlying velocity field. Both measures are quasi objective they approximate objective (i.e., observer independent) coherence diagnostics in frames satisfying a certain condition. This condition requires the trajectory accelerations to dominate the angular acceleration induced by the spatial mean vorticity. We illustrate in examples how quasi objective coherence diagnostics highlight elliptic and hyperbolic Lagrangian coherent structures even from very sparse trajectory data.


Real time Deep Dynamic Characters. We propose a deep videorealistic 3D human character model displaying highly realistic shape, motion, and dynamic appearance learned in a new weakly supervised way from multi view imagery. In contrast to previous work, our controllable 3D character displays dynamics, e.g., the swing of the skirt, dependent on skeletal body motion in an efficient data driven way, without requiring complex physics simulation. Our character model also features a learned dynamic texture model that accounts for photo realistic motion dependent appearance details, as well as view dependent lighting effects. During training, we do not need to resort to difficult dynamic 3D capture of the human instead we can train our model entirely from multi view video in a weakly supervised manner. To this end, we propose a parametric and differentiable character representation which allows us to model coarse and fine dynamic deformations, e.g., garment wrinkles, as explicit space time coherent mesh geometry that is augmented with high quality dynamic textures dependent on motion and view point. As input to the model, only an arbitrary 3D skeleton motion is required, making it directly compatible with the established 3D animation pipeline. We use a novel graph convolutional network architecture to enable motion dependent deformation learning of body and clothing, including dynamics, and a neural generative dynamic texture model creates corresponding dynamic texture maps. We show that by merely providing new skeletal motions, our model creates motion dependent surface deformations, physically plausible dynamic clothing deformations, as well as video realistic surface textures at a much higher level of detail than previous state of the art approaches, and even in real time.


On extension of the motivic cohomology beyond smooth schemes. We construct an algebraic cycle based model for the motivic cohomology on the category of schemes of finite type over a field, where schemes may admit arbitrary singularities and may be non reduced. We show that our theory is functorial on the category, that it detects nilpotence, and that its restriction to the subcategory of smooth schemes agrees with the pre existing motivic cohomology theory, which is the higher Chow theory of S. Bloch (Adv. Math., 1986). A few structures and applications are discussed.


EdinSaar WMT21 North Germanic Low Resource Multilingual NMT. We describe the EdinSaar submission to the shared task of Multilingual Low Resource Translation for North Germanic Languages at the Sixth Conference on Machine Translation (WMT2021). We submit multilingual translation models for translations to from Icelandic (is), Norwegian Bokmal (nb), and Swedish (sv). We employ various experimental approaches, including multilingual pre training, back translation, fine tuning, and ensembling. In most translation directions, our models outperform other submitted systems.


A stationary approach for the Kato Rosenblum theorem in von Neumann algebras. Let mathcal M be a countable decomposable properly infinite semifinite von Neumann algebra acting on a Hilbert space mathcal H . An analogue of the Kato Rosenblum theorem in mathcal M has been proved in 9 by showing the existence of generalized wave operators. It is well known that there are two typical approaches to show the existence of wave operators in the scattering theory. One is called time dependent approach and another is called stationary approach. The main purpose of this article is to introduce a stationary approach in mathcal M and then to obtain the Kato Rosenblum theorem in mathcal M by a stationary approach instead of a time dependent approach in 9 .


On endomorphisms of automatic groups. We propose two geometric versions of the bounded reduction property and find conditions for them to coincide. In particular, for the natural automatic structure on a hyperbolic group, the two notions are equivalent. We study endomorphisms with L quasiconvex image and prove that those with finite kernel satisfy a synchronous version of the bounded reduction property. Finally, we use these techniques to prove L quasiconvexity of the equalizer of two endomorphisms under certain (strict) conditions.


On LL(k) linear conjunctive grammars. Linear conjunctive grammars are a family of formal grammars with an explicit conjunction operation allowed in the rules, which is notable for its computational equivalence fo one way real time cellular automata, also known as trellis automata. This paper investigates the LL( k ) subclass of linear conjunctive grammars, defined by analogy with the classical LL( k ) grammars these are grammars that admit top down linear time parsing with k symbol lookahead. Two results are presented. First, every LL( k ) linear conjunctive grammar can be transformed to an LL(1) linear conjunctive grammar, and, accordingly, the hierarchy with respect to k collapses. Secondly, a parser for these grammars that works in linear time and uses logarithmic space is constructed, showing that the family of LL( k ) linear conjunctive languages is contained in the complexity class L .


Subspace stabilisers in hyperbolic lattices. This paper shows that immersed totally geodesic m dimensional suborbifolds of n dimensional arithmetic hyperbolic orbifolds correspond to finite subgroups of the commensurator whenever m geqslant lfloor frac n 2 rfloor . We call such totally geodesic suborbifolds finite centraliser subspaces (or fc subspaces) and use them to formulate an arithmeticity criterion for hyperbolic lattices. We show that a hyperbolic orbifold M is arithmetic if and only if it has infinitely many fc subspaces, and provide examples of non arithmetic orbifolds that contain non fc subspaces of codimension one. We analyse the relation between Vinberg's commensurability invariants of an arithmetic hyperbolic orbifold and those of its totally geodesic suborbifolds, provide an algebraic characterisation of totally geodesic immersions of hyperbolic orbifolds, and use it to construct examples of totally geodesic immersions of arithmetic hyperbolic orbifolds with different adjoint trace fields and ambient groups of different types. We also provide examples of 3 dimensional arithmetic hyperbolic orbifolds which cannot be geodesically immersed in higher dimensional arithmetic ones. Finally, we study arithmetic properties of orbifolds that descend to their totally geodesic suborbifolds, proving that all suborbifolds in a (quasi) arithmetic orbifold are (quasi) arithmetic.


Performance of Refined Isogeometric Analysis in Solving Quadratic Eigenvalue Problems. Certain applications that analyze damping effects require the solution of quadratic eigenvalue problems (QEPs). We use refined isogeometric analysis (rIGA) to solve quadratic eigenproblems. rIGA discretization, while conserving desirable properties of maximum continuity isogeometric analysis (IGA), reduces the interconnection between degrees of freedom by adding low continuity basis functions. This connectivity reduction in rIGA's algebraic system results in faster matrix LU factorizations when using multifrontal direct solvers. We compare computational costs of rIGA versus those of IGA when employing Krylov eigensolvers to solve quadratic eigenproblems arising in 2D vector valued multifield problems. For large problem sizes, the eigencomputation cost is governed by the cost of LU factorization, followed by costs of several matrix vector and vector vector multiplications, which correspond to Krylov projections. We minimize the computational cost by introducing C 0 and C 1 separators at specific element interfaces for our rIGA generalizations of the curl conforming Nedelec and divergence conforming Raviart Thomas finite elements. Let p be the polynomial degree of basis functions the LU factorization is up to O((p 1) 2) times faster when using rIGA compared to IGA in the asymptotic regime. Thus, rIGA theoretically improves the total eigencomputation cost by O((p 1) 2) for sufficiently large problem sizes. Yet, in practical cases of moderate size eigenproblems, the improvement rate deteriorates as the number of computed eigenvalues increases because of multiple matrix vector and vector vector operations. Our numerical tests show that rIGA accelerates the solution of quadratic eigensystems by O(p 1) for moderately sized problems when we seek to compute a reasonable number of eigenvalues.


Collective organisation and screening in two dimensional turbulence. Following recent evidence that the vortices in decaying two dimensional turbulence can be classified into small mobile, and large quasi stationary, this paper examines the evidence that the latter might be considered a crystal' whose formation embodies the inverse cascade of energy towards larger scales. Several diagnostics of order are applied to the ostensibly disordered large vortices. It is shown that their geometric arrangement is substantially more regular than random, that they move more slowly than could be expected from simple mean field arguments, and that their energy is significantly lower than in a random reorganisation of the same vortices. This is traced to screening of long range interactions by the preferential association of vortices of opposite sign, and it is argued that this is due to the mutual capture of corrotating vortices, in a mechanism closer to tidal disruption than to electrostatic screening. Finally, the possible relation of these stochastic crystals' to fixed points of the dynamical system representation of the turbulent flow is briefly examined.


Markov models for the tipsy cop and robber game on graphs. In this paper we analyze and model three open problems posed by Harris, Insko, Prieto Langarica, Stoisavljevic, and Sullivan in 2020 concerning the tipsy cop and robber game on graphs. The three different scenarios we model account for different biological scenarios. The first scenario is when the cop and robber have a consistent tipsiness level though the duration of the game the second is when the cop and robber sober up as a function of time the third is when the cop and robber sober up as a function of the distance between them. Using Markov chains to model each scenario we calculate the probability of a game persisting through mathbf M rounds of the game and the expected game length given different starting positions and tipsiness levels for the cop and robber.


Linear quadratic control of Volterra integral systems and extensions. We study linear quadratic optimal control problems for Voterra systems, and problems that are linear quadratic in the control but generally nonlinear in the state. In the case of linear quadratic Volterra control, we obtain sharp necessary and sufficient conditions for optimality. For problems that are linear quadratic in the control only, we obtain a novel form of necessary conditions in the form of double Volterra equation we prove the solvability of such equations.


Numerical analysis of the LDG method for large deformations of prestrained plates. A local discontinuous Galerkin (LDG) method for approximating large deformations of prestrained plates is introduced and tested on several insightful numerical examples in our previous computational work. This paper presents a numerical analysis of this LDG method, focusing on the free boundary case. The problem consists of minimizing a fourth order bending energy subject to a nonlinear and nonconvex metric constraint. The energy is discretized using LDG and a discrete gradient flow is used for computing discrete minimizers. We first show Gamma convergence of the discrete energy to the continuous one. Then we prove that the discrete gradient flow decreases the energy at each step and computes discrete minimizers with control of the metric constraint defect. We also present a numerical scheme for initialization of the gradient flow, and discuss the conditional stability of it.


String Theories involving Regular Membership Predicates From Practice to Theory and Back. Widespread use of string solvers in formal analysis of string heavy programs has led to a growing demand for more efficient and reliable techniques which can be applied in this context, especially for real world cases. Designing an algorithm for the (generally undecidable) satisfiability problem for systems of string constraints requires a thorough understanding of the structure of constraints present in the targeted cases. In this paper, we investigate benchmarks presented in the literature containing regular expression membership predicates, extract different first order logic theories, and prove their decidability, resp. undecidability. Notably, the most common theories in real world benchmarks are PSPACE complete and directly lead to the implementation of a more efficient algorithm to solving string constraints.


Voting algorithms for unique games on complete graphs. An approximation algorithm for a Constraint Satisfaction Problem is called robust if it outputs an assignment satisfying a (1 f( epsilon)) fraction of the constraints on any (1 epsilon) satisfiable instance, where the loss function f is such that f( epsilon) rightarrow 0 as epsilon rightarrow 0 . Moreover, the runtime of the algorithm should not depend in any way on epsilon . In this paper, we present such an algorithm for sc Min Unique Games(q) on complete graphs with q labels. Specifically, the loss function is f( epsilon) ( epsilon c epsilon epsilon 2) , where c epsilon is a constant depending on epsilon such that lim epsilon rightarrow 0 c epsilon 16 . The runtime of our algorithm is O(qn 3) (with no dependence on epsilon ) and can run in time O(qn 2) using a randomized implementation with a slightly larger constant c epsilon . Our algorithm is combinatorial and uses voting to find an assignment. We prove NP hardness (using a randomized reduction) for sc Min Unique Games(q) on complete graphs even in the case where the constraints form a cyclic permutation, which is also known as sc Min Linear Equations mod q on complete graphs.


Think about it! Improving defeasible reasoning by first modeling the question scenario. Defeasible reasoning is the mode of reasoning where conclusions can be overturned by taking into account new evidence. Existing cognitive science literature on defeasible reasoning suggests that a person forms a mental model of the problem scenario before answering questions. Our research goal asks whether neural models can similarly benefit from envisioning the question scenario before answering a defeasible query. Our approach is, given a question, to have a model first create a graph of relevant influences, and then leverage that graph as an additional input when answering the question. Our system, CURIOUS, achieves a new state of the art on three different defeasible reasoning datasets. This result is significant as it illustrates that performance can be improved by guiding a system to "think about" a question and explicitly model the scenario, rather than answering reflexively. Code, data, and pre trained models are located at https github.com madaan thinkaboutit.


Wafer scale, full coverage, acoustic self limiting assembly of particles on flexible substrates. Self limiting assembly of particles represents the state of the art controllability in nanomanufacturing processes where the assembly stops at a designated stage1,2, providing a desirable platform for applications requiring delicate thickness control3 5. Most successes in self limiting assembly are limited to self assembled monolayers (SAM) of small molecules on inorganic, chemically homogeneous rigid substrates (e.g., Au and SiO2) through surface interaction mechanisms6,7. Similar mechanisms, however, cannot achieve uniform assembly of particles on flexible polymer substrates8,9. The complex configurations and conformations of polymer chains create a surface with non uniform distributions of chemical groups and phases. In addition, most assembly mechanisms require good solvent wettability, where many desirable but hard to wet particles and polymer substrates are excluded. Here, we demonstrate an acoustic self limiting assembly of particles (ASAP) method to achieve wafer scale, full coverage, close packed monolayers of hydrophobic particles on hydrophobic polymer substrates in aqueous solutions. We envision many applications in functional coatings and showcase its feasibility in structural coloration.


Homogeneity in commutative graded rings. In this paper, we establish several new results on commutative G graded rings where G is a totally ordered abelian group. McCoy's theorem and Armendariz' theorem are classical results in the theory of polynomial rings. We generalize both of these celebrated theorems to the more general setting of G graded rings and simultaneously to the setting of ideals rather than to that of elements. Next, we give a complete characterization of invertible elements in G graded rings. We generalize Bergman's famous theorem (which asserts that the Jacobson radical of a mathbb Z graded ring is a graded ideal) to the setting of G graded rings and then proceed to give a natural and quite elementary proof of it. This generalization allows us to show that an abelian group is a totally ordered group if and only if the Jacobson radical of every ring graded by that group is a graded ideal, or equivalently, nonzero idempotents of every ring graded by that group are homogeneous of degree zero. Finally, some topological aspects of graded prime ideals are investigated.


Cognitive factors that affect the adoption of autonomous agriculture. Robotic and Autonomous Agricultural Technologies (RAAT) are increasingly available yet may fail to be adopted. This paper focusses specifically on cognitive factors that affect adoption including inability to generate trust, loss of farming knowledge and reduced social cognition. It is recommended that agriculture develops its own framework for the performance and safety of RAAT drawing on human factors research in aerospace engineering including human inputs (individual variance in knowledge, skills, abilities, preferences, needs and traits), trust, situational awareness and cognitive load. The kinds of cognitive impacts depend on the RAATs level of autonomy, ie whether it has automatic, partial autonomy and autonomous functionality and stage of adoption, ie adoption, initial use or post adoptive use. The more autonomous a system is, the less a human needs to know to operate it and the less the cognitive load, but it also means farmers have less situational awareness about on farm activities that in turn may affect strategic decision making about their enterprise. Some cognitive factors may be hidden when RAAT is first adopted but play a greater role during prolonged or intense post adoptive use. Systems with partial autonomy need intuitive user interfaces, engaging system information, and clear signaling to be trusted with low level tasks and to compliment and augment high order decision making on farm.


Regularity and energy of second order hyperbolic boundary value problems on non timelike hypersurfaces. We study the second order hyperbolic equations with initial conditions, a nonhomogeneous Dirichlet boundary condition and a source term. We prove the solution possesses H 1 regularity on any piecewise C 1 smooth non timelike hypersurfaces. We generalize the notion of energy to these hypersurfaces, and establish an estimate of the difference between the energies on the hypersurface and on the initial plane where the time t 0 . The energy is shown to be conserved when the source term and the boundary datum are both zero. We also obtain an L 2 estimate for the normal derivative of the solution. In the proofs we first show these results for C 2 smooth solutions by using the multiplier methods, and then we go back to the original results by approximation.


F manifold color algebras. In this paper, we introduce the notion of F manifold color algebras and study their properties which extend some results for F manifold algebras.


Multi Type TD TSR Extracting Tables from Document Images using a Multi stage Pipeline for Table Detection and Table Structure Recognition from OCR to Structured Table Representations. As global trends are shifting towards data driven industries, the demand for automated algorithms that can convert digital images of scanned documents into machine readable information is rapidly growing. Besides the opportunity of data digitization for the application of data analytic tools, there is also a massive improvement towards automation of processes, which previously would require manual inspection of the documents. Although the introduction of optical character recognition technologies mostly solved the task of converting human readable characters from images into machine readable characters, the task of extracting table semantics has been less focused on over the years. The recognition of tables consists of two main tasks, namely table detection and table structure recognition. Most prior work on this problem focuses on either task without offering an end to end solution or paying attention to real application conditions like rotated images or noise artefacts inside the document image. Recent work shows a clear trend towards deep learning approaches coupled with the use of transfer learning for the task of table structure recognition due to the lack of sufficiently large datasets. In this paper we present a multistage pipeline named Multi Type TD TSR, which offers an end to end solution for the problem of table recognition. It utilizes state of the art deep learning models for table detection and differentiates between 3 different types of tables based on the tables' borders. For the table structure recognition we use a deterministic non data driven algorithm, which works on all table types. We additionally present two algorithms. One for unbordered tables and one for bordered tables, which are the base of the used table structure recognition algorithm. We evaluate Multi Type TD TSR on the ICDAR 2019 table structure recognition dataset and achieve a new state of the art.


DIVINE Diverse Influential Training Points for Data Visualization and Model Refinement. As the complexity of machine learning (ML) models increases, resulting in a lack of prediction explainability, several methods have been developed to explain a model's behavior in terms of the training data points that most influence the model. However, these methods tend to mark outliers as highly influential points, limiting the insights that practitioners can draw from points that are not representative of the training data. In this work, we take a step towards finding influential training points that also represent the training data well. We first review methods for assigning importance scores to training points. Given importance scores, we propose a method to select a set of DIVerse INfluEntial (DIVINE) training points as a useful explanation of model behavior. As practitioners might not only be interested in finding data points influential with respect to model accuracy, but also with respect to other important metrics, we show how to evaluate training data points on the basis of group fairness. Our method can identify unfairness inducing training points, which can be removed to improve fairness outcomes. Our quantitative experiments and user studies show that visualizing DIVINE points helps practitioners understand and explain model behavior better than earlier approaches.


Extended Graph 4 Manifolds, and Einstein Metrics. We show that extended graph 4 manifolds (as defined by Frigerio Lafont Sisto in FLS15 ) do not support Einstein metrics.


The Landau Kolmogorov Problem on a Finite Interval in the Taikov Case. We solve the pointwise Landau Kolmogorov problem on the interval mathbb I 1,1 on finding left f (k) (t) right to sup under constraints f 2 leqslant delta and left f (r) right 2 leqslant 1 , where t in mathbb I and delta 0 are fixed. For r 1 and r 2 , we solve the uniform version of the Landau Kolmogorov problem on the interval mathbb I in the Taikov case by proving the Karlin type conjecture sup limits t in mathbb I left f (k) (t) right left f (k) ( 1) right under above constraints. The proof relies on the analysis of the dependence of the norm of the solution to higher order Sturm Liouville equation ( 1) ru (2r) lambda u lambda f with boundary conditions u (s) ( 1) u (s) (1) 0 , s 0,1, ldots,r 1 , on non negative parameter lambda , where f is some piece wise polynomial function. Furthermore, we find sharp inequality left f (k) right infty leqslant A f 2 B left f (r) right 2 with the smallest possible constant A 0 and the smallest possible constant B B(A) for k in r 2, r 1 .


Detecting Fake News Using Machine Learning A Systematic Literature Review. Internet is one of the important inventions and a large number of persons are its users. These persons use this for different purposes. There are different social media platforms that are accessible to these users. Any user can make a post or spread the news through the online platforms. These platforms do not verify the users or their posts. So some of the users try to spread fake news through these platforms. These news can be propaganda against an individual, society, organization or political party. A human being is unable to detect all these fake news. So there is a need for machine learning classifiers that can detect these fake news automatically. Use of machine learning classifiers for detecting fake news is described in this systematic literature review.


On convergence properties for generalized Schr " o dinger operators along tangential curves. In this paper, we consider convergence properties for generalized Schr " o dinger operators along tangential curves in mathbb R n times mathbb R with less smoothness comparing with Lipschitz condition. Firstly, we obtain sharp convergence rate for generalized Schr " o dinger operators with polynomial growth along tangential curves in mathbb R n times mathbb R , n ge 1 . Secondly, it was open until now on pointwise convergence of solutions to the Schr " o dinger equation along non C 1 curves in mathbb R n times mathbb R , n geq 2 , we obtain the corresponding results along some tangential curves when n 2 by the broad narrow argument and polynomial partitioning. Moreover, the corresponding convergence rate will follow. Thirdly, we get the convergence result along a family of restricted tangential curves in mathbb R times mathbb R . As a consequence, we obtain the sharp L p Schr " o dinger maximal estimates along tangential curves in mathbb R times mathbb R .


Simulating progressive intramural damage leading to aortic dissection using an operator regression neural network. Aortic dissection progresses via delamination of the medial layer of the wall. Notwithstanding the complexity of this process, insight has been gleaned by studying in vitro and in silico the progression of dissection driven by quasi static pressurization of the intramural space by fluid injection, which demonstrates that the differential propensity of dissection can be affected by spatial distributions of structurally significant interlamellar struts that connect adjacent elastic lamellae. In particular, diverse histological microstructures may lead to differential mechanical behavior during dissection, including the pressure volume relationship of the injected fluid and the displacement field between adjacent lamellae. In this study, we develop a data driven surrogate model for the delamination process for differential strut distributions using DeepONet, a new operator regression neural network. The surrogate model is trained to predict the pressure volume curve of the injected fluid and the damage progression field of the wall given a spatial distribution of struts, with in silico data generated with a phase field finite element model. The results show that DeepONet can provide accurate predictions for diverse strut distributions, indicating that this composite branch trunk neural network can effectively extract the underlying functional relationship between distinctive microstructures and their mechanical properties. More broadly, DeepONet can facilitate surrogate model based analyses to quantify biological variability, improve inverse design, and predict mechanical properties based on multi modality experimental data.


Active Screening for Recurrent Diseases A Reinforcement Learning Approach. Active screening is a common approach in controlling the spread of recurring infectious diseases such as tuberculosis and influenza. In this approach, health workers periodically select a subset of population for screening. However, given the limited number of health workers, only a small subset of the population can be visited in any given time period. Given the recurrent nature of the disease and rapid spreading, the goal is to minimize the number of infections over a long time horizon. Active screening can be formalized as a sequential combinatorial optimization over the network of people and their connections. The main computational challenges in this formalization arise from i) the combinatorial nature of the problem, ii) the need of sequential planning and iii) the uncertainties in the infectiousness states of the population. Previous works on active screening fail to scale to large time horizon while fully considering the future effect of current interventions. In this paper, we propose a novel reinforcement learning (RL) approach based on Deep Q Networks (DQN), with several innovative adaptations that are designed to address the above challenges. First, we use graph convolutional networks (GCNs) to represent the Q function that exploit the node correlations of the underlying contact network. Second, to avoid solving a combinatorial optimization problem in each time period, we decompose the node set selection as a sub sequence of decisions, and further design a two level RL framework that solves the problem in a hierarchical way. Finally, to speed up the slow convergence of RL which arises from reward sparseness, we incorporate ideas from curriculum learning into our hierarchical RL approach. We evaluate our RL algorithm on several real world networks.


Inductive Relation Prediction by BERT. Relation prediction in knowledge graphs is dominated by embedding based methods which mainly focus on the transductive setting. Unfortunately, they are not able to handle inductive learning where unseen entities and relations are present and cannot take advantage of prior knowledge. Furthermore, their inference process is not easily explainable. In this work, we propose an all in one solution, called BERTRL (BERT based Relational Learning), which leverages pre trained language model and fine tunes it by taking relation instances and their possible reasoning paths as training samples. BERTRL outperforms the SOTAs in 15 out of 18 cases in both inductive and transductive settings. Meanwhile, it demonstrates strong generalization capability in few shot learning and is explainable.


TICaM A Time of flight In car Cabin Monitoring Dataset. We present TICaM, a Time of flight In car Cabin Monitoring dataset for vehicle interior monitoring using a single wide angle depth camera. Our dataset addresses the deficiencies of currently available in car cabin datasets in terms of the ambit of labeled classes, recorded scenarios and provided annotations all at the same time. We record an exhaustive list of actions performed while driving and provide for them multi modal labeled images (depth, RGB and IR), with complete annotations for 2D and 3D object detection, instance and semantic segmentation as well as activity annotations for RGB frames. Additional to real recordings, we provide a synthetic dataset of in car cabin images with same multi modality of images and annotations, providing a unique and extremely beneficial combination of synthetic and real data for effectively training cabin monitoring systems and evaluating domain adaptation approaches. The dataset is available at https vizta tof.kl.dfki.de .


DegreEmbed incorporating entity embedding into logic rule learning for knowledge graph reasoning. Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, due to the nature of rapid iteration as well as incompleteness of data, KGs are usually huge and there are inevitably missing facts in KGs. Link prediction for knowledge graphs is the task aiming to complete missing facts by reasoning based on the existing knowledge. Two main streams of research are widely studied one learns low dimensional embeddings for entities and relations that can capture latent patterns, and the other gains good interpretability by mining logical rules. Unfortunately, previous studies rarely pay attention to heterogeneous KGs. In this paper, we propose DegreEmbed, a model that combines embedding based learning and logic rule mining for inferring on KGs. Specifically, we study the problem of predicting missing links in heterogeneous KGs that involve entities and relations of various types from the perspective of the degrees of nodes. Experimentally, we demonstrate that our DegreEmbed model outperforms the state of the art methods on real world datasets. Meanwhile, the rules mined by our model are of high quality and interpretability.


Nonlinear Helmholtz equations with sign changing diffusion coefficient. In this paper we study nonlinear Helmholtz equations with sign changing diffusion coefficients on bounded domains. The existence of an orthonormal basis of eigenfunctions is established making use of weak T coercivity theory. All eigenvalues are proved to be bifurcation points and the bifurcating branches are investigated both theoretically and numerically. In a one dimensional model example we obtain the existence of infinitely many bifurcating branches that are mutually disjoint, unbounded, and consist of solutions with a fixed nodal pattern.


Julia sets and geometrically finite maps over finite extensions of the p adic field. Let K be a finite extension of the field mathbb Q p of p adic numbers, and phi in K(z) be a rational map of degree at least 2 . We prove that the K Julia set of phi is the natural restriction of mathbb C p Julia set, provided that the critical orbits are well behaved. Moreover, under further assumption that phi is geometrically finite, we prove that the dynamics on the K Julia set of phi is a countable state Markov shift.


Achievable Physical Layer Secrecy in Multi Mode Fiber Channels using Artificial Noise. Reliable and secure communication is an important aspect of modern fiber optic communication. In this work we consider a multi mode fiber (MMF) channel wiretapped by an eavesdropper. We assume the transmitter knows the legitimate channel, but statistical knowledge of the eavesdropper's channel only. We propose a transmission scheme with artificial noise (AN) for such a channel. In particular, we formulate the corresponding optimization problem which aims to maximize the average secrecy rate and develop an algorithm to solve it. We apply this algorithm to actual measured MMF channels. As real fiber measurements show, for a 55 mode MMF we can achieve positive average secrecy rates with the proper use of AN. Furthermore, the gain compared to standard precoding and power allocation schemes is illustrated.


Portfolio Growth Rate and Ergodic Capacity of Fading Channels. A relationship between the growth rate of logoptimal portfolios and capacity of fading single input multiple output (SIMO) channels are established. Using this relation, stock vector stochastic processes that model the investment environments are stochastically ordered using different criteria. The presence of side information (SI) is considered, and a bound on the gains in the growth rate due to SI is derived along with data processing inequality and convexity properties. A statistical test on the usefulness of SI that does not require the computation of the optimal portfolio vector in the presence of SI is introduced and its several variants are discussed.


Functional limits for "tied down" occupation time processes of infinite ergodic transformations. We prove functional, distributional limit theorems for the occupation times of pointwise dual ergodic transformations at "tied down" times immediately after "excursions". The limiting processes are tied down Mittag Leffler processes and the transformations involved exhibit functional tied down renewal mixing properties strengthening those of AS19 .


Proving Theorems using Incremental Learning and Hindsight Experience Replay. Traditional automated theorem provers for first order logic depend on speed optimized search and many handcrafted heuristics that are designed to work best over a wide range of domains. Machine learning approaches in literature either depend on these traditional provers to bootstrap themselves or fall short on reaching comparable performance. In this paper, we propose a general incremental learning algorithm for training domain specific provers for first order logic without equality, based only on a basic given clause algorithm, but using a learned clause scoring function. Clauses are represented as graphs and presented to transformer networks with spectral features. To address the sparsity and the initial lack of training data as well as the lack of a natural curriculum, we adapt hindsight experience replay to theorem proving, so as to be able to learn even when no proof can be found. We show that provers trained this way can match and sometimes surpass state of the art traditional provers on the TPTP dataset in terms of both quantity and quality of the proofs.


ZCSD a Computational Storage Device over Zoned Namespaces (ZNS) SSDs. The Big Data trend is putting strain on modern storage systems, which have to support high performance I O accesses for the large quantities of data. With the prevalent Von Neumann computing architecture, this data is constantly moved back and forth between the computing (i.e., CPU) and storage entities (DRAM, Non Volatile Memory NVM storage). Hence, as the data volume grows, this constant data movement between the CPU and storage devices has emerged as a key performance bottleneck. To improve the situation, researchers have advocated to leverage computational storage devices (CSDs), which offer a programmable interface to run user defined data processing operations close to the storage without excessive data movement, thus offering performance improvements. However, despite its potential, building CSD aware applications remains a challenging task due to the lack of exploration and experimentation with the right API and abstraction. This is due to the limited accessibility to latest CSD NVM devices, emerging device interfaces, and closed source software internals of the devices. To remedy the situation, in this work we present an open source CSD prototype over emerging NVMe Zoned Namespaces (ZNS) SSDs and an interface that can be used to explore application designs for CSD NVM storage devices. In this paper we summarize the current state of the practice with CSD devices, make a case for designing a CSD prototype with the ZNS interface and eBPF (ZCSD), and present our initial findings. The prototype is available at https github.com Dantali0n qemu csd.


The well posedness and the regularity of global attractor for a couple stress fluid through porous layer with the local thermal non equilibrium effect. In the article, we aim to investigate the well posedness of solution and the regularity of the global attractor for the couple stress fluid in saturated porous media with the local thermal non equilibrium effect. To be more specific, we firstly show the existence and uniqueness of global weak solution to the model by making use of the standard Galerkin method. Second, relying on verifying the uniformly compact condition required, we prove the existence of the global attractor of the model in the space where the weak solution resides. Finally, we improve the regularity of global attractor by uniformly compact condition and obtain the C infty attractor for the model.


On unknotting tunnel systems of satellite chain links. We prove that the tunnel number of a satellite chain link with a number of components higher than or equal to twice the bridge number of the companion is as small as possible among links with the same number of components. We prove this result to be sharp for satellite chain links over a 2 bridge knot.


Tempered Fractional LES Modeling. The presence of nonlocal interactions and intermittent signals in the homogeneous isotropic turbulence grant multi point statistical functions a key role in formulating a new generation of large eddy simulation (LES) models of higher fidelity. We establish a tempered fractional order modeling framework for developing nonlocal LES subgrid scale models, starting from the kinetic transport. We employ a tempered L 'evy stable distribution to represent the source of turbulent effects at the kinetic level, and we rigorously show that the corresponding turbulence closure term emerges as the tempered fractional Laplacian, ( Delta lambda) alpha ( cdot) , for alpha in (0,1) , alpha neq frac 1 2 , and lambda 0 in the filtered Navier Stokes equations. Moreover, we prove the frame invariant properties of the proposed model, complying with the subgrid scale stresses. To characterize the optimum values of model parameters and infer the enhanced efficiency of the tempered fractional subgrid scale model, we develop a robust algorithm, involving two point structure functions and conventional correlation coefficients. In an a priori statistical study, we evaluate the capabilities of the developed model in fulfilling the closed essential requirements, obtained for a weaker sense of the ideal LES model (Meneveau 1994). Finally, the model undergoes the a posteriori analysis to ensure the numerical stability and pragmatic efficiency of the model.


The role of viscous regularization in dynamical problems, strain localization and mesh dependency. Strain localization is responsible for mesh dependence in numerical analyses concerning a vast variety of fields such as solid mechanics, dynamics, biomechanics and geomechanics. Therefore, numerical methods that regularize strain localization are paramount in the analysis and design of engineering products and systems. In this paper we revisit the elasto viscoplastic, strain softening, strain rate hardening model as a means to avoid strain localization on a mathematical plane in the case of a Cauchy continuum. Going beyond previous works (de Borst and Duretz (2020) Needleman (1988) Sluys and de Borst (1992) Wang et al. (1997)), we assume that both the frequency omega and the wave number k belong to the complex plane. Therefore, a different expression for the dispersion relation is derived. We prove then that under these conditions strain localization on a mathematical plane is possible. The above theoretical results are corroborated by extensive numerical analyses, where the total strain and plastic strain rate profiles exhibit mesh dependent behavior.


Paint4Poem A Dataset for Artistic Visualization of Classical Chinese Poems. In this work we propose a new task artistic visualization of classical Chinese poems, where the goal is to generatepaintings of a certain artistic style for classical Chinese poems. For this purpose, we construct a new dataset called Paint4Poem. Thefirst part of Paint4Poem consists of 301 high quality poem painting pairs collected manually from an influential modern Chinese artistFeng Zikai. As its small scale poses challenges for effectively training poem to painting generation models, we introduce the secondpart of Paint4Poem, which consists of 3,648 caption painting pairs collected manually from Feng Zikai's paintings and 89,204 poem painting pairs collected automatically from the web. We expect the former to help learning the artist painting style as it containshis most paintings, and the latter to help learning the semantic relevance between poems and paintings. Further, we analyze Paint4Poem regarding poem diversity, painting style, and the semantic relevance between poems and paintings. We create abenchmark for Paint4Poem we train two representative text to image generation models AttnGAN and MirrorGAN, and evaluate theirperformance regarding painting pictorial quality, painting stylistic relevance, and semantic relevance between poems and paintings.The results indicate that the models are able to generate paintings that have good pictorial quality and mimic Feng Zikai's style, but thereflection of poem semantics is limited. The dataset also poses many interesting research directions on this task, including transferlearning, few shot learning, text to image generation for low resource data etc. The dataset is publicly available.(https github.com paint4poem paint4poem)


Image Translation using Texture Co occurrence and Spatial Self Similarity for Texture Debiasing. Classification models trained on datasets with texture bias usually perform poorly on out of distribution samples since biased representations are embedded into the model. Recently, various debiasing methods have attempted to disentangle biased representations, but discarding texture biased features without altering other relevant information is still a challenging task. In this paper, we propose a novel texture debiasing approach to generate additional training images using the content of a source image and the texture of a target image with a different semantic label to explicitly mitigate texture biases when training a classifier. Our model ensures texture similarity between the target and generated images via a texture co occurrence loss while preserving the content details from the source image with a spatial self similarity loss. Both the generated and original training images are combined to train an improved classifier that is robust against inconsistent texture bias representations. We employ five datasets with known texture biases to demonstrate the ability of our method to mitigate texture bias. In all cases, our method outperformed existing state of the art methods.


A construction of the left curtain coupling. In a martingale optimal transport (MOT) problem mass distributed according to the law mu is transported to the law nu in such a way that the martingale property is respected. Beiglb "ock and Juillet (On a problem of optimal transport under marginal martingale constraints, Annals of Probability, 44(1) 42 106, 2016) introduced a solution to the MOT problem which they baptised the left curtain coupling. The left curtain coupling has been widely studied and shown to have many applications, including to martingale inequalities and the model independent pricing of American options. Beiglb "ock and Juillet proved existence and uniqueness, proved optimality for a family of cost functions, and proved that when mu is a continuous distribution, mass at x is mapped to one of at most two points, giving lower and upper functions. Henry Labord ere and Touzi (An explicit martingale version of Brenier s theorem, Finance and Stochastics, 20 635 668, 2016) showed that the left curtain coupling is optimal for an extended family of cost functions and gave a construction of the upper and lower functions under an assumption that mu and nu are continuous, together with further simplifying assumptions of a technical nature. In this article we construct these upper and lower functions in the general case of arbitrary centred measures in convex order, and thereby give a complete construction of the left curtain coupling. In the case where mu has atoms these upper and lower functions are to be interpreted in the sense of a lifted martingale.


Halt Properties and Complexity Evaluations for Optimal DeepLLL Algorithm Families. DeepLLL algorithm (Schnorr, 1994) is a famous variant of LLL lattice basis reduction algorithm, and PotLLL algorithm (Fontein et al., 2014) and S 2 LLL algorithm (Yasuda and Yamaguchi, 2019) are recent polynomial time variants of DeepLLL algorithm developed from cryptographic applications. However, the known polynomial bounds for computational complexity are shown only for parameter delta 1 for "optimal" parameter delta 1 which ensures the best output quality, no polynomial bounds are known, and except for LLL algorithm, it is even not formally proved that the algorithm always halts within finitely many steps. In this paper, we prove that these four algorithms always halt also with optimal parameter delta 1 , and furthermore give explicit upper bounds for the numbers of loops executed during the algorithms. Unlike the known bound (Akhavi, 2003) applicable to LLL algorithm only, our upper bounds are deduced in a unified way for all of the four algorithms.


Point Defect Localized Bound States in the Continuum in Photonic Crystals and Structured Fibers. We show that point defects in two dimensional photonic crystals can support bound states in the continuum (BICs). The mechanism of confinement is a symmetry mismatch between the defect mode and the Bloch modes of the photonic crystal. These BICs occur in the absence of bandgaps and therefore provide an alternative mechanism to confine light. Furthermore, we show that such BICs can propagate in a fiber geometry and exhibit arbitrarily small group velocity which could serve as a platform for enhancing non linear effects and light matter interactions in structured fibers.


Multi output, multi level, multi gate design using non linear programming. Using logic gates is the traditional way of designing logic circuits. However, most of the minimization algorithms concern a limited set of gates (complete sets), like sum of products, exclusive or sum of products, NAND gates, NOR gates e.t.c.. In this paper, a method is proposed for minimizing multi output Boolean functions using any kind of two input gates although it can easily be extended to multi input gates. The method is based on non linear mixed integer programming. The experimental results show that the method gives the same or better results compared to other methods available in the literature. However, other methods do not ensure that they produce the minimal solution, while the main advantages of the proposed method are that it does guarantee minimality and it can also handle Boolean functions for incompletely specified functions. The method is general enough and can easily be extended to more complicated design modules than just basic gates.


Identifying non natural language artifacts in bug reports. Bug reports are a popular target for natural language processing (NLP). However, bug reports often contain artifacts such as code snippets, log outputs and stack traces. These artifacts not only inflate the bug reports with noise, but often constitute a real problem for the NLP approach at hand and have to be removed. In this paper, we present a machine learning based approach to classify content into natural language and artifacts at line level implemented in Python. We show how data from GitHub issue trackers can be used for automated training set generation, and present a custom preprocessing approach for bug reports. Our model scores at 0.95 ROC AUC and 0.93 F1 against our manually annotated validation set, and classifies 10k lines in 0.72 seconds. We cross evaluated our model against a foreign dataset and a foreign R model for the same task. The Python implementation of our model and our datasets are made publicly available under an open source license.


Modular Proofs of Gosper's Identities. We give unified modular proofs to all of Gosper's identities on the q constant Pi q . We also confirm Gosper's observation that for any distinct positive integers n 1, cdots,n m with m geq 3 , Pi q n 1 , cdots , Pi q n m satisfy a nonzero homogeneous polynomial. Our proofs provide a method to rediscover Gosper's identities. Meanwhile, several results on Pi q found by El Bachraoui have been corrected. Furthermore, we illustrate a strategy to construct some of Gosper's identities using hauptmoduls for genus zero congruence subgroups.


Ultrahigh brightness beams from plasma photoguns. Plasma photocathodes open a path towards tunable production of well defined, compact electron beams with normalized emittance and brightness many orders of magnitude better than state of the art. Such beams could have a far reaching impact on applications such as light sources, but also open up new vistas on high energy physics and high field physics. We report on challenges and details of the proof of concept demonstration of a plasma photocathode in 90 circ geometry at SLAC FACET within the "E 210 Trojan Horse" program. Using this experience, alongside theoretical and simulation supported advances, we discuss the upcoming "E 310 Trojan Horse II" program at FACET II.


The Geometry of Memoryless Stochastic Policy Optimization in Infinite Horizon POMDPs. We consider the problem of finding the best memoryless stochastic policy for an infinite horizon partially observable Markov decision process (POMDP) with finite state and action spaces with respect to either the discounted or mean reward criterion. We show that the (discounted) state action frequencies and the expected cumulative reward are rational functions of the policy, whereby the degree is determined by the degree of partial observability. We then describe the optimization problem as a linear optimization problem in the space of feasible state action frequencies subject to polynomial constraints that we characterize explicitly. This allows us to address the combinatorial and geometric complexity of the optimization problem using recent tools from polynomial optimization. In particular, we estimate the number of critical points and use the polynomial programming description of reward maximization to solve a navigation problem in a grid world.


Local Statistics for Zeros of Artin Schreier L functions. We study the local statistics of zeros of L functions attached to Artin Scheier curves over finite fields. We consider three families of Artin Schreier L functions the ordinary, polynomial (the p rank 0 stratum) and odd polynomial families. We compute the 1 level zero density of the first and third families and the 2 level density of the second family for test functions with Fourier transform supported in a suitable interval. In each case we obtain agreement with a unitary or symplectic random matrix model.


Globally Convergent Coderivative Based Generalized Newton Methods in Nonsmooth Optimization. This paper proposes and justifies two new globally convergent Newton type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are coderivative based and employ generalized Hessians (coderivatives of subgradient mappings) associated with objective functions, which are either of class mathcal C 1,1 , or are represented in the form of convex composite optimization, where one of the terms may be extended real valued. The proposed globally convergent algorithms are of two types. The first one extends the damped Newton method and requires positive definiteness of the generalized Hessians for its well posedness and efficient performance, while the other algorithm is of the Levenberg Marquardt type being well defined when the generalized Hessians are merely positive semidefinite. The obtained convergence rates for both methods are at least linear, but becomes superlinear under the so called semismooth property of subgradient mappings. Problems of convex composite optimization are investigated with and without the strong convexity assumption on of smooth parts of objective functions by implementing the machinery of forward backward envelopes. Numerical experiments are conducted for a basic class of Lasso problems by providing performance comparisons of the new algorithms with some other first order and second order methods that are highly recognized in nonsmooth optimization.


Fusing the Old with the New Learning Relative Camera Pose with Geometry Guided Uncertainty. Learning methods for relative camera pose estimation have been developed largely in isolation from classical geometric approaches. The question of how to integrate predictions from deep neural networks (DNNs) and solutions from geometric solvers, such as the 5 point algorithm, has as yet remained under explored. In this paper, we present a novel framework that involves probabilistic fusion between the two families of predictions during network training, with a view to leveraging their complementary benefits in a learnable way. The fusion is achieved by learning the DNN uncertainty under explicit guidance by the geometric uncertainty, thereby learning to take into account the geometric solution in relation to the DNN prediction. Our network features a self attention graph neural network, which drives the learning by enforcing strong interactions between different correspondences and potentially modeling complex relationships between points. We propose motion parmeterizations suitable for learning and show that our method achieves state of the art performance on the challenging DeMoN and ScanNet datasets. While we focus on relative pose, we envision that our pipeline is broadly applicable for fusing classical geometry and deep learning.


Multimodal Graph based Transformer Framework for Biomedical Relation Extraction. The recent advancement of pre trained Transformer models has propelled the development of effective text mining models across various biomedical tasks. However, these models are primarily learned on the textual data and often lack the domain knowledge of the entities to capture the context beyond the sentence. In this study, we introduced a novel framework that enables the model to learn multi omnics biological information about entities (proteins) with the help of additional multi modal cues like molecular structure. Towards this, rather developing modality specific architectures, we devise a generalized and optimized graph based multi modal learning mechanism that utilizes the GraphBERT model to encode the textual and molecular structure information and exploit the underlying features of various modalities to enable end to end learning. We evaluated our proposed method on ProteinProtein Interaction task from the biomedical corpus, where our proposed generalized approach is observed to be benefited by the additional domain specific modality.


The distance between the weights of the neural network is meaningful. In the application of neural networks, we need to select a suitable model based on the problem complexity and the dataset scale. To analyze the network's capacity, quantifying the information learned by the network is necessary. This paper proves that the distance between the neural network weights in different training stages can be used to estimate the information accumulated by the network in the training process directly. The experiment results verify the utility of this method. An application of this method related to the label corruption is shown at the end.


Local convergence of alternating low rank optimization methods with overrelaxation. The local convergence of alternating optimization methods with overrelaxation for low rank matrix and tensor problems is established. The analysis is based on the linearization of the method which takes the form of an SOR iteration for a positive semidefinite Hessian and can be studied in the corresponding quotient geometry of equivalent low rank representations. In the matrix case, the optimal relaxation parameter for accelerating the local convergence can be determined from the convergence rate of the standard method. This result relies on a version of Young's SOR theorem for positive semidefinite 2 times 2 block systems.


An Isoperimetric inequality for the first Steklov Dirichlet Laplacian eigenvalue of convex sets with a spherical hole. In this paper we prove the existence of a maximum for the first Steklov Dirichlet Laplacian eigenvalue in the class of convex sets with a fixed spherical hole under volume constraint. More precisely, if Omega Omega 0 setminus overline B R 1 , where B R 1 is the ball centered at the origin with radius R 1 0 and Omega 0 subset mathbb R n , n geq 2 , is an open bounded and convex set such that B R 1 Subset Omega 0 , then the first Steklov Dirichlet Laplacian eigenvalue sigma 1( Omega) has a maximum when R 1 and the measure of Omega are fixed. Moreover, if Omega 0 is contained in a suitable ball, we prove that the spherical shell is the maximum.


Killing One Bird with Two Stones Model Extraction and Attribute Inference Attacks against BERT based APIs. The collection and availability of big data, combined with advances in pre trained models (e.g., BERT, XLNET, etc), have revolutionized the predictive performance of modern natural language processing tasks, ranging from text classification to text generation. This allows corporations to provide machine learning as a service (MLaaS) by encapsulating fine tuned BERT based models as APIs. However, BERT based APIs have exhibited a series of security and privacy vulnerabilities. For example, prior work has exploited the security issues of the BERT based APIs through the adversarial examples crafted by the extracted model. However, the privacy leakage problems of the BERT based APIs through the extracted model have not been well studied. On the other hand, due to the high capacity of BERT based APIs, the fine tuned model is easy to be overlearned, but what kind of information can be leaked from the extracted model remains unknown. In this work, we bridge this gap by first presenting an effective model extraction attack, where the adversary can practically steal a BERT based API (the target victim model) by only querying a limited number of queries. We further develop an effective attribute inference attack which can infer the sensitive attribute of the training data used by the BERT based APIs. Our extensive experiments on benchmark datasets under various realistic settings validate the potential vulnerabilities of BERT based APIs. Moreover, we demonstrate that two promising defense methods become ineffective against our attacks, which calls for more effective defense methods.


Polynomial Trajectory Predictions for Improved Learning Performance. The rising demand for Active Safety systems in automotive applications stresses the need for a reliable short to mid term trajectory prediction. Anticipating the unfolding path of road users, one can act to increase the overall safety. In this work, we propose to train artificial neural networks for movement understanding by predicting trajectories in their natural form, as a function of time. Predicting polynomial coefficients allows us to increased accuracy and improve generalisation.


EPNet Cascade Bi directional Fusion for Multi Modal 3D Object Detection. Recently, fusing the LiDAR point cloud and camera image to improve the performance and robustness of 3D object detection has received more and more attention, as these two modalities naturally possess strong complementarity. In this paper, we propose EPNet for multi modal 3D object detection by introducing a novel Cascade Bi directional Fusion (CB Fusion) module and a Multi Modal Consistency (MC) loss. More concretely, the proposed CB Fusion module boosts the plentiful semantic information of point features with the image features in a cascade bi directional interaction fusion manner, leading to more comprehensive and discriminative feature representations. The MC loss explicitly guarantees the consistency between predicted scores from two modalities to obtain more comprehensive and reliable confidence scores. The experiment results on the KITTI, JRDB and SUN RGBD datasets demonstrate the superiority of EPNet over the state of the art methods. Besides, we emphasize a critical but easily overlooked problem, which is to explore the performance and robustness of a 3D detector in a sparser scene. Extensive experiments present that EPNet outperforms the existing SOTA methods with remarkable margins in highly sparse point cloud cases, which might be an available direction to reduce the expensive cost of LiDAR sensors. Code will be released in the future.


Normal form coordinates for the Benjamin Ono equation having expansions in terms of pseudo differential operators. Near an arbitrary finite gap potential we construct real analytic, canonical coordinates for the Benjamin Ono equation on the torus having the following two main properties (1) up to a remainder term, which is smoothing to any given order, the coordinate transformation is a pseudo differential operator of order 0 with principal part given by a modified Fourier transform (modification by a phase factor) and (2) the pullback of the Hamiltonian of the Benjamin Ono is in normal form up to order three and the corresponding Hamiltonian vector field admits an expansion in terms of para differential operators. Such coordinates are a key ingredient for studying the stability of finite gap solutions of the Benjamin Ono equation under small, quasi linear perturbations.