L(2,1) Labeling of the iterated Mycielski of graphs and some related to matching problems. In this paper, we study the L(2, 1) Labeling of the Mycielski and the iterated Mycielski of graphs in general. For a graph G and all t geq 1 , we give sharp bounds for lambda(M t(G)) the L(2, 1) labeling number of the t th iterated Mycielski in terms of the number of iterations t , the order n , the maximum degree bigtriangleup , and lambda(G) the L(2, 1) labeling number of G . For t 1 , we present necessary and sufficient conditions between the 4 star matching number of the complement graph and lambda(M(G)) the L(2, 1) labeling number of the Mycielski of a graph, with some applications to special graphs. For all t geq 2 , we prove that for any graph G of order n , we have 2 t 1 (n 2) 2 leq lambda(M t(G)) leq 2 t (n 1) 2 . Thereafter, we characterize the graphs achieving the upper bound 2 t(n 1) 2 , then by using the Marriage Theorem and Tutte's characterization of graphs with a perfect 2 matching, we characterize all graphs without isolated vertices achieving the lower bound 2 t 1 (n 2) 2 . We determine the L(2, 1) labeling number for the Mycielski and the iterated Mycielski of some graph classes.


Gromov's Oka principle, fiber bundles and the conformal module. The conformal module of conjugacy classes of braids is an invariant that appeared earlier than the entropy of conjugacy classes of braids, and is inverse proportional to the entropy. Using the relation between the two invariants we give a short conceptional proof of an earlier result on the conformal module. Mainly, we consider situations, when the conformal module of conjugacy classes of braids serves as obstruction for the existence of homotopies (or isotopies) of smooth objects involving braids to the respective holomorphic objects, and present theorems on the restricted validity of Gromov's Oka principle in these situations.


Efficient extended search space full waveform inversion with unknown source signatures. Full waveform inversion (FWI) requires an accurate estimation of source signatures. Due to the coupling between the source signatures and the subsurface model, small errors in the former can translate into large errors in the latter. When direct methods are used to solve the forward problem, classical frequency domain FWI efficiently processes multiple sources for source signature and wavefield estimations once a single Lower Upper (LU) decomposition of the wave equation operator has been performed. However, this efficient FWI formulation is based on the exact solution of the wave equation and hence is highly sensitive to the inaccuracy of the velocity model due to the cycle skipping pathology. Recent extended space FWI variants tackle this sensitivity issue through a relaxation of the wave equation combined with data assimilation, allowing the wavefields to closely match the data from the first inversion iteration. Then, the subsurface parameters are updated by minimizing the wave equation violations. When the wavefields and the source signatures are jointly estimated with this approach, the extended wave equation operator becomes source dependent, hence making direct methods ineffective. In this paper, we propose a simple method to bypass this issue and estimate source signatures efficiently during extended FWI. The proposed method replaces each source with a blended source during each data assimilated wavefield reconstruction to make the extended wave equation operator source independent. Besides computational efficiency, the additional degrees of freedom introduced by spatially distributing the sources allows for a better signature estimation at the physical location when the velocity model is rough. Numerical tests on the Marmousi II and 2004 BP salt synthetic models confirm the efficiency and the robustness of the proposed method.


Prediction of 1 H singlet relaxation via intermolecular dipolar couplings using the molecular dynamics method. Dissolution dynamical nuclear polarization has been applied in various fields, including chemistry, biology, and medical science. To expand the scope of these applications, the nuclear singlet state, which is decoherence free against dipolar relaxation between spin pairs, has been studied experimentally, theoretically, and numerically. The singlet state composed of proton spins is used in several applications, such as enhanced polarization preservation, molecular tag to probe slow dynamic processes, and detection of ligand protein complexes. In this study, we predict the lifetimes of the nuclear spin states composed of proton spin pairs using the molecular dynamics method and quantum chemistry simulations. We consider intramolecular and intermolecular dipolar, chemical shift anisotropy, and spin rotation interactions. In particular, the relaxation rate of intermolecular dipolar interactions is calculated using the molecular dynamics method for various solvents. The calculated values and the experimental values are of the same order of magnitude. Our program would provide insight into the molecular design of several NMR applications and would be helpful in predicting the nuclear spin relaxation time of synthetic molecules in advance.


Existence in critical spaces for the magnetohydrodynamical system in 3D bounded Lipschitz domains. Existence of mild solutions for the 3D MHD system in bounded Lipschitz domains is established in critical spaces with the absolute boundary conditions.


Deep Convolution Network Based Emotion Analysis for Automatic Detection of Mild Cognitive Impairment in the Elderly. A significant number of people are suffering from cognitive impairment all over the world. Early detection of cognitive impairment is of great importance to both patients and caregivers. However, existing approaches have their shortages, such as time consumption and financial expenses involved in clinics and the neuroimaging stage. It has been found that patients with cognitive impairment show abnormal emotion patterns. In this paper, we present a novel deep convolution network based system to detect the cognitive impairment through the analysis of the evolution of facial emotions while participants are watching designed video stimuli. In our proposed system, a novel facial expression recognition algorithm is developed using layers from MobileNet and Support Vector Machine (SVM), which showed satisfactory performance in 3 datasets. To verify the proposed system in detecting cognitive impairment, 61 elderly people including patients with cognitive impairment and healthy people as a control group have been invited to participate in the experiments and a dataset was built accordingly. With this dataset, the proposed system has successfully achieved the detection accuracy of 73.3 .


Existence of minimal hypersurfaces with arbitrarily large area in full generality. We prove that in a closed Riemannian manifold with dimension between 3 and 7 , either there are minimal hypersurfaces with arbitrarily large area, or there exist uncountably many stable minimal hypersurfaces. Moreover, the latter case has a very pathological Cantor set structure which does not show up in certain manifolds. Among the applications, we prove that there exist minimal hypersurfaces with arbitrarily large area in analytic manifolds. In the proof, we use the Almgren Pitts min max theory proposed by Marques Neves, the ideas developed by Song in his proof of Yau's conjecture, and the resolution of the generic multiplicity one conjecture by Zhou.


FabricFlowNet Bimanual Cloth Manipulation with a Flow based Policy. We address the problem of goal directed cloth manipulation, a challenging task due to the deformability of cloth. Our insight is that optical flow, a technique normally used for motion estimation in video, can also provide an effective representation for corresponding cloth poses across observation and goal images. We introduce FabricFlowNet (FFN), a cloth manipulation policy that leverages flow as both an input and as an action representation to improve performance. FabricFlowNet also elegantly switches between bimanual and single arm actions based on the desired goal. We show that FabricFlowNet significantly outperforms state of the art model free and model based cloth manipulation policies that take image input. We also present real world experiments on a bimanual system, demonstrating effective sim to real transfer. Finally, we show that our method generalizes when trained on a single square cloth to other cloth shapes, such as T shirts and rectangular cloths. Video and other supplementary materials are available at https sites.google.com view fabricflownet.


A preliminary assessment of the sensitivity of uniaxially driven fusion targets to flux limited thermal conduction modeling. The role of flux limited thermal conduction on the fusion performance of the uniaxially driven targets studied by Derentowicz et al. Jour. Tech. Phys. 18, 465 (1977) and Jour. Tech. Phys. 25, 135 (1977), is explored as part of a wider effort to understand and quantify uncertainties in ICF systems sharing similarities with First Light Fusion's projectile driven concept. We examine the role of uncertainties in plasma microphysics and different choices for the numerical implementation of the conduction operator on simple metrics encapsulating the target performance. The results indicate that choices which affect the description of ionic heat flow between the heated fusion fuel and the gold anvil used to contain it are the most important. The electronic contribution is found to be robustly described by local diffusion. The sensitivities found suggest a prevalent role for quasi nonlocal ionic transport, especially in the treatment of conduction across material interfaces with strong gradients in temperature and conductivity. We note that none of the simulations produce neutron yields which substantiate those reported by Derentowicz et al. Jour. Tech. Phys. 25, 135 (1977), leaving open future studies aimed at more fully understanding this class of ICF systems.


Identification and prioritization of urban traffic bottlenecks. The increasing urbanization process we have been witnessing in the last decades is accompanied by a significant increase in traffic congestion in cities around the world. The effect of the congestion is represented in the enormous time people spent on roads leading to significant money waste and air pollution. Here, we present a new methodology for identification, cost evaluation, and thus, prioritization of congestion sources, the jam bottlenecks. It extends existing methods as it is based on network analysis of the entire road network and can be applied to different traffic models. Our results show that the macro stability, presented by scaling characteristics of the traffic bottlenecks, overshadows the existence of meso dynamics, where the bottlenecks change their location in time and space. This means that to plan and manage traffic jams in different locations and at different times, it is required to implement a framework, as developed here, that tracks traffic and evaluates the relative effect of each evolving bottleneck on the entire road network.


Soft Riemann Hilbert problems and planar orthogonal polynomials. Riemann Hilbert problems are jump problems for holomorphic functions along given interfaces. They arise in various contexts, e.g. in the asymptotic study of certain nonlinear partial differential equations and in the asymptotic analysis of orthogonal polynomials. Matrix valued Riemann Hilbert problems were considered by Deift et al. in the 1990s with a noncommutative adaptation of the steepest descent method. For orthogonal polynomials on the line or on the circle with respect to exponentially varying weights, this led to a strong asymptotic expansion in the given parameters. For orthogonal polynomials with respect to planar exponentially varying weights, the corresponding asymptotics was obtained by Hedenmalm and Wennman (2017), using a technically involved construction of an invariant foliation for the orthogonality. Planar orthogonal polynomials are characterized in terms of a matrix dbar problem (Its, Takhtajan), which we call a soft Riemann Hilbert problem. Here, we use this perspective to offer a simplified approach based not on foliations but instead on the ad hoc insertion of an algebraic ansatz for the Cauchy potential in the soft Riemann Hilbert problem. This allows the problem to decompose into a hierarchy of scalar Riemann Hilbert problems along the interface, which appears as the free boundary for an obstacle problem. Inspired by microlocal analysis, the method allows for control of the solution in such a way that for real analytic weights, the asymptotics holds in the L 2 sense with error O(e delta sqrt m ) in a fixed neighborhood of the closed exterior of the interface, for some constant delta 0 , where m to infty . Here, m is the degree of the polynomial, and in terms of pointwise asymptotics, the expansion dominates the error term in the exterior domain and across the interface a distance proportional to m frac14 .


Comparative evaluation of CNN architectures for Image Caption Generation. Aided by recent advances in Deep Learning, Image Caption Generation has seen tremendous progress over the last few years. Most methods use transfer learning to extract visual information, in the form of image features, with the help of pre trained Convolutional Neural Network models followed by transformation of the visual information using a Caption Generator module to generate the output sentences. Different methods have used different Convolutional Neural Network Architectures and, to the best of our knowledge, there is no systematic study which compares the relative efficacy of different Convolutional Neural Network architectures for extracting the visual information. In this work, we have evaluated 17 different Convolutional Neural Networks on two popular Image Caption Generation frameworks the first based on Neural Image Caption (NIC) generation model and the second based on Soft Attention framework. We observe that model complexity of Convolutional Neural Network, as measured by number of parameters, and the accuracy of the model on Object Recognition task does not necessarily co relate with its efficacy on feature extraction for Image Caption Generation task.


Extended clutching construction for the moduli of stable curves. We give a description of the formal neighborhoods of the components of the boundary divisor in the Deligne Mumford moduli stack overline mathcal M g of stable curves in terms of the extended clutching construction that we define. This construction can be viewed as a formal version of the analytic plumbing construction. The advantage of our formal construction is that we can control the effect of changing formal parameters at the marked points that are being glued. As an application, we prove that the 1st infinitesimal neighborhood of the boundary component Delta 1,g 1 is canonically isomorphic to the 1st infinitesimal neighborhood in the normal bundle, near the locus mathcal M 1,1 times mathcal M g 1,1 subset Delta 1,g 1 corresponding to pairs of smooth curves with marked points. As another application, we show how to study the period map near the boundary components Delta g 1,g 2 in terms of the coordinates coming from our extended clutching construction.


Two Souls in an Adversarial Image Towards Universal Adversarial Example Detection using Multi view Inconsistency. In the evasion attacks against deep neural networks (DNN), the attacker generates adversarial instances that are visually indistinguishable from benign samples and sends them to the target DNN to trigger misclassifications. In this paper, we propose a novel multi view adversarial image detector, namely Argos, based on a novel observation. That is, there exist two "souls" in an adversarial instance, i.e., the visually unchanged content, which corresponds to the true label, and the added invisible perturbation, which corresponds to the misclassified label. Such inconsistencies could be further amplified through an autoregressive generative approach that generates images with seed pixels selected from the original image, a selected label, and pixel distributions learned from the training data. The generated images (i.e., the "views") will deviate significantly from the original one if the label is adversarial, demonstrating inconsistencies that Argos expects to detect. To this end, Argos first amplifies the discrepancies between the visual content of an image and its misclassified label induced by the attack using a set of regeneration mechanisms and then identifies an image as adversarial if the reproduced views deviate to a preset degree. Our experimental results show that Argos significantly outperforms two representative adversarial detectors in both detection accuracy and robustness against six well known adversarial attacks. Code is available at https github.com sohaib730 Argos Adversarial Detection


Knowledge Grounded Dialogue with Reward Driven Knowledge Selection. Knowledge grounded dialogue is a task of generating a fluent and informative response based on both conversation context and a collection of external knowledge, in which knowledge selection plays an important role and attracts more and more research interest. However, most existing models either select only one knowledge or use all knowledge for responses generation. The former may lose valuable information in discarded knowledge, while the latter may bring a lot of noise. At the same time, many approaches need to train the knowledge selector with knowledge labels that indicate ground truth knowledge, but these labels are difficult to obtain and require a large number of manual annotations. Motivated by these issues, we propose Knoformer, a dialogue response generation model based on reinforcement learning, which can automatically select one or more related knowledge from the knowledge pool and does not need knowledge labels during training. Knoformer is evaluated on two knowledge guided conversation datasets, and achieves state of the art performance.


Controllability and Observability Imply Exponential Decay of Sensitivity in Dynamic Optimization. We study a property of dynamic optimization (DO) problems (as those encountered in model predictive control and moving horizon estimation) that is known as exponential decay of sensitivity (EDS). This property indicates that the sensitivity of the solution at stage i against a data perturbation at stage j decays exponentially with i j . Building upon our previous results, we show that EDS holds under uniform boundedness of the Lagrangian Hessian, a uniform second order sufficiency condition (uSOSC), and a uniform linear independence constraint qualification (uLICQ). Furthermore, we prove that uSOSC and uLICQ can be obtained under uniform controllability and observability. Hence, we have that uniform controllability and observability imply EDS. These results provide insights into how perturbations propagate along the horizon and enable the development of approximation and solution schemes. We illustrate the developments with numerical examples.


Aut invariant quasimorphisms on free products. Let G A ast B be a free product of freely indecomposable groups. We explicitly construct quasimorphisms on G which are invariant with respect to all automorphisms of G . We also prove that the space of such quasimorphisms is infinite dimensional whenever G is not the infinite dihedral group. As an application we prove that an invariant analogue of stable commutator length recently introduced by Kawasaki and Kimura is non trivial for these groups.


Descent of equivalences for blocks with Klein four defect groups. We show that the splendid Rickard complexes for blocks with Klein four defect groups constructed by Rickard and Linckelmann descend to non split fields. As a corollary, Navarro's refinement of the Alperin McKay conjecture holds for blocks with a Klein four defect group. We also prove that splendid Morita equivalences between blocks and their Brauer correspondents (if exist) descend to non split situations.


A brief history of AI how to prevent another winter (a critical review). The field of artificial intelligence (AI), regarded as one of the most enigmatic areas of science, has witnessed exponential growth in the past decade including a remarkably wide array of applications, having already impacted our everyday lives. Advances in computing power and the design of sophisticated AI algorithms have enabled computers to outperform humans in a variety of tasks, especially in the areas of computer vision and speech recognition. Yet, AI's path has never been smooth, having essentially fallen apart twice in its lifetime ('winters' of AI), both after periods of popular success ('summers' of AI). We provide a brief rundown of AI's evolution over the course of decades, highlighting its crucial moments and major turning points from inception to the present. In doing so, we attempt to learn, anticipate the future, and discuss what steps may be taken to prevent another 'winter'.


Time of flight estimation by utilizing Kalman filter tracking information Part I the concept. Recent detector concepts at future linear or circular e e colliders emphasize the benefits of time of flight measurements for particle identification of long lived charged hadrons. That method relies on a precise estimation of the time of flight as expected, for a given mass hypothesis, from the reconstructed particle momentum and its trajectory. We show that for a realistic detector set up, relativistic formulae are a good approximation down to lowest possible momenta. The optimally fitted track parameters are commonly defined near the interaction region. Extrapolation to a time of flight counter located behind the central tracking device can usually only be performed by a track model undisturbed from material effects. However, the true trajectory is distorted by multiple Coulomb scattering and the momentum is changed by energy loss. As a consequence, the estimated time of flight is biased by a large systematic error. This study presents a novel approach of time of flight estimation by splitting the trajectory into a chain of undisturbed track elements, following as close as possible the true trajectory. Each track element possesses an individual momentum p i and flight distance l i . Remarkably, our formulae emerge by formally replacing the global momentum squared p 2 by the weighted harmonic mean of the individual p i 2 , with the weights being the corresponding individual l i . The optimally fitted parameters of the individual track elements can be obtained from track reconstruction by a Kalman filter plus smoother. However, care must be taken when including mass dependent material effects. Explicit formulae for a simple scenario (homogeneous magnetic field and cylindrical surfaces) are given, together with an overview about the treatment of multiple Coulomb scattering and energy loss by a Kalman filter.


Covariant formulation of at finite speed propagating electric interaction of moving charges in Euclidean geometry. Maxwell's electrodynamics postulates the finite propagation speed of electromagnetic (EM) action and the notion of EM fields, but it only satisfies the requirement of the covariance in Minkowski metric (Lorentz invariance). Darwin's force law of moving charges, which originates from Maxwell's field theory complies the Lorentz invariance as well. Poincar 'e's principle stating that physical laws can be formulated with identical meaning on different geometries suggest, that the retarded EM interaction of moving charges might be covariant even in Euclidean geometry (Galilean invariance). Keeping the propagation speed finite, but breaking with Maxwell's field theory in this study an attempt is made to find a Galilean invariant force law. Through the altering of the Li 'enard Wiechert potential (LWP) a new retarded potential of two moving charges, the Common Retarded Electric Potential (CREP) is introduced which depends on the velocities of both interacting charges. The sought after force law is determined by means of the second order approximation of CREP. The law obtained is the Galilean invariant Weber's force law, surprisingly. Its rediscovery from the second order approximation of a retarded electric potential confirms the significance of Weber's force law and proves it to be a retarded and approximative law. The fact that Weber's force law implies even the magnetic forces tells us that magnetic phenomena are a manifestation of the retarded electric interaction exclusively. The third order approximation of the CREP opens the possibility of EM waves, and the creation of a complete, Euclidean electrodynamics.


Complexity Adaptive Maximum Likelihood Decoding of Modified boldsymbol G N Coset Codes. A complexity adaptive tree search algorithm is proposed for boldsymbol G N coset codes that implements maximum likelihood (ML) decoding by using a successive decoding schedule. The average complexity is close to that of the successive cancellation (SC) decoding for practical error rates when applied to polar codes and short Reed Muller (RM) codes, e.g., block lengths up to N 128 . By modifying the algorithm to limit the worst case complexity, one obtains a near ML decoder for longer RM codes and their subcodes. Unlike other bit flip decoders, no outer code is needed to terminate decoding. The algorithm can thus be applied to modified boldsymbol G N coset code constructions with dynamic frozen bits. One advantage over sequential decoders is that there is no need to optimize a separate parameter.


Reconstruction theorem in quasinormed spaces. We extend the Hairer reconstruction theorem for distributions due to Caravenna and Zambotti (arXiv 2005.09287) to general function spaces satisfying a translation and scaling condition. This includes Besov type spaces with exponents below 1 and Triebel Lizorkin type spaces.


Learning phylogenetic trees as hyperbolic point configurations. We propose a novel method for the inference of phylogenetic trees that utilises point configurations on hyperbolic space as its optimisation landscape. Each taxon corresponds to a point of the point configuration, while the evolutionary distance between taxa is represented by the geodesic distance between their corresponding points. The point configuration is iteratively modified to increase an objective function that additively combines pairwise log likelihood terms. After convergence, the final tree is derived from the inter point distances using a standard distance based method. The objective function, which is shown to mimic the log likelihood on tree space, is a differentiable function on a Riemannian manifold. Thus gradient based optimisation techniques can be applied, avoiding the need for combinatorial rearrangements of tree topology.


Forbidden subgraphs in generating graphs of finite groups. Let G be a 2 generated group. The generating graph Gamma(G) is the graph whose vertices are the elements of G and where two vertices g 1 and g 2 are adjacent if G langle g 1, g 2 rangle. This graph encodes the combinatorial structure of the distribution of generating pairs across G. In this paper we study some graph theoretic properties of Gamma(G) , with particular emphasis on those properties that can be formulated in terms of forbidden induced subgraphs. In particular we investigate when the generating graph Gamma(G) is a cograph (giving a complete description when G is soluble) and when it is perfect (giving a complete description when G is nilpotent and proving, among the others, that Gamma(S n) and Gamma(A n) are perfect if and only if n leq 4 ). Finally we prove that for a finite group G , the properties that Gamma(G) is split, chordal or C 4 free are equivalent.


Multipole vortex patch equilibria for active scalar equations. We study how a general configuration of finitely many point vortices, in a state of uniform rotation or translation with Newtonian interaction or generalized surface quasi geostrophic interactions, can be desingularized into a steady configuration of vortex patches. Using a technique first introduced by Hmidi and Mateu for vortex pairs, we reformulate the problem for the patch boundaries so that it no longer appears singular, at which point classical techniques such as Lyapunov Schmidt reduction can be used. Provided the point vortex equilibrium is non degenerate in a natural sense, solutions can be constructed directly using the implicit function theorem, yielding asymptotics for the shape of the patch boundaries. As an application, we prove the existence of various families of solutions with patches arranged in asymmetric pairs, regular polygons, body centered polygons, and nested regular polygons. These configurations are degenerate due to their additional symmetries, but this difficulty can be overcome by integrating the appropriate symmetries into the formulation of the problem.


Counting vertices of integral polytopes defined by facets. We present a number of complexity results concerning the problem of counting vertices of an integral polytope defined by a system of linear inequalities. The focus is on polytopes with small integer vertices, particularly 0 1 polytopes and half integral polytopes.


Contravariant pairings between standard Whittaker modules and Verma modules. We classify contravariant pairings between standard Whittaker modules and Verma modules over a complex semisimple Lie algebra. These contravariant pairings are useful in extending several classical techniques for category mathcal O to the Mili v c i ' c Soergel category mathcal N . We introduce a class of costandard modules which generalize dual Verma modules, and describe canonical maps from standard to costandard modules in terms of contravariant pairings. We show that costandard modules have unique irreducible submodules and share the same composition factors as the corresponding standard Whittaker modules. We show that costandard modules give an algebraic characterization of the global sections of costandard twisted Harish Chandra sheaves on the associated flag variety, which are defined using holonomic duality of mathcal D modules. We prove that with these costandard modules, blocks of category mathcal N have the structure of highest weight categories and we establish a BGG reciprocity theorem for mathcal N .


Robust and Scalable Routing with Multi Agent Deep Reinforcement Learning for MANETs. Highly dynamic mobile ad hoc networks (MANETs) are continuing to serve as one of the most challenging environments to develop and deploy robust, efficient, and scalable routing protocols. In this paper, we present DeepCQ routing which, in a novel manner, integrates emerging multi agent deep reinforcement learning (MADRL) techniques into existing Q learning based routing protocols and their variants, and achieves persistently higher performance across a wide range of MANET configurations while training only on a limited range of network parameters and conditions. Quantitatively, DeepCQ shows consistently higher end to end throughput with lower overhead compared to its Q learning based counterparts with the overall gain of 10 15 in its efficiency. Qualitatively and more significantly, DeepCQ maintains remarkably similar performance gains under many scenarios that it was not trained for in terms of network sizes, mobility conditions, and traffic dynamics. To the best of our knowledge, this is the first successful demonstration of MADRL for the MANET routing problem that achieves and maintains a high degree of scalability and robustness even in the environments that are outside the trained range of scenarios. This implies that the proposed hybrid design approach of DeepCQ that combines MADRL and Q learning significantly increases its practicality and explainability because the real world MANET environment will likely vary outside the trained range of MANET scenarios.


Friction modulation in limbless, three dimensional gaits and heterogeneous terrains. Motivated by a possible convergence of terrestrial limbless locomotion strategies ultimately determined by interfacial effects, we show how both 3D gait alterations and locomotory adaptations to heterogeneous terrains can be understood through the lens of local friction modulation. Via an everything is friction' modeling approach, compounded by 3D simulations, the emergence and disappearance of a range of locomotory behaviors observed in nature is systematically explained in relation to inhabited environments. Our approach also simplifies the treatment of terrain heterogeneity, whereby even solid obstacles may be seen as high friction regions, which we confirm against experiments of snakes diffracting' while traversing rows of posts 1 , similar to optical waves. We further this optic analogy by illustrating snake refraction, reflection and lens focusing. We use these insights to engineer surface friction patterns and demonstrate passive snake navigation in complex topographies. Overall, our study outlines a unified view that connects active and passive 3D mechanics with heterogeneous interfacial effects to explain a broad set of biological observations, and potentially inspire engineering design.


A note on asymptotic behavior of critical Galton Watson processes with immigration. In this somewhat didactic note we give a detailed alternative proof of the known result due to Wei and Winnicki (1989) which states that under second order moment assumptions on the offspring and immigration distributions the sequence of appropriately scaled random step functions formed from a critical Galton Watson process with immigration (starting from not necessarily zero) converges weakly towards a squared Bessel process. The proof of Wei and Winnicki (1989) is based on infinitesimal generators, while we use limit theorems for random step processes towards a diffusion process due to Isp 'any and Pap (2010). This technique was already used in Isp 'any (2008), where he proved functional limit theorems for a sequence of some appropriately normalized nearly critical Galton Watson processes with immigration starting from zero, where the offspring means tend to its critical value 1. As a special case of Theorem 2.1 in Isp 'any (2008) one can get back the result of Wei and Winnicki (1989) in the case of zero initial value. In the present note we handle non zero initial values with the technique used in Isp 'any (2008), and further, we simplify some of the arguments in the proof of Theorem 2.1 in Isp 'any (2008) as well.


Planning Spatial Networks with Monte Carlo Tree Search. We tackle the problem of goal directed graph construction given a starting graph, a budget of modifications, and a global objective function, the aim is to find a set of edges whose addition to the graph achieves the maximum improvement in the objective (e.g., communication efficiency). This problem emerges in many networks of great importance for society such as transportation and critical infrastructure networks. We identify two significant shortcomings with present methods. Firstly, they focus exclusively on network topology while ignoring spatial information however, in many real world networks, nodes are embedded in space, which yields different global objectives and governs the range and density of realizable connections. Secondly, existing RL methods scale poorly to large networks due to the high cost of training a model and the scaling factors of the action space and global objectives. In this work, we formulate this problem as a deterministic MDP. We adopt the Monte Carlo Tree Search framework for planning in this domain, prioritizing the optimality of final solutions over the speed of policy evaluation. We propose several improvements over the standard UCT algorithm for this family of problems, addressing their single agent nature, the trade off between the costs of edges and their contribution to the objective, and an action space linear in the number of nodes. We demonstrate the suitability of this approach for improving the global efficiency and attack resilience of a variety of synthetic and real world networks, including Internet backbone networks and metro systems. Our approach obtains a 24 improvement in these metrics compared to UCT on the largest networks tested and scalability superior to previous methods.


Probing the electromagnetic response of dielectric antennas by vortex electron beams. Focused beams of electrons, which act as both sources, and sensors of electric fields, can be used to characterise the electric response of complex photonic systems, by locally probing the induced optical near fields. This functionality can be complemented by embracing the recently developed vortex electron beams (VEBs), made up of electrons with orbital angular momentum, which could in addition probe induced magnetic near fields. In this work we revisit the theoretical description of this technique, dubbed vortex Electron Energy Loss Spectroscopy (v EELS). We map the fundamental, quantum mechanical picture of the scattering of the VEB electrons, to the intuitive classical models which treat the electron beams as superposition of linear electric and magnetic currents. We then apply this formalism to characterise the optical response of dielectric nanoantennas with v EELS. Our calculations reveal that VEB electrons probe electric or magnetic modes with different efficiency, which can be adjusted by changing either beam vorticity or acceleration voltage, to determine the nature of the probed excitations. We also study a chirally arranged nanostructure, which in the interaction with electron vortices produces dichroism in electron energy loss spectra. Our theoretical work establishes VEBs as versatile probes that could provide information on optical excitations otherwise inaccessible with conventional electron beams.


IoT Notary Attestable Sensor Data Capture in IoT Environments. Contemporary IoT environments, such as smart buildings, require end users to trust data capturing rules published by the systems. There are several reasons why such a trust is misplaced IoT systems may violate the rules deliberately or IoT devices may transfer user data to a malicious third party due to cyberattacks, leading to the loss of individuals' privacy or service integrity. To address such concerns, we propose IoT Notary, a framework to ensure trust in IoT systems and applications. IoT Notary provides secure log sealing on live sensor data to produce a verifiable proof of integrity,' based on which a verifier can attest that captured sensor data adheres to the published data capturing rules. IoT Notary is an integral part of TIPPERS, a smart space system that has been deployed at the University of California Irvine to provide various real time location based services on the campus. We present extensive experiments over realtime WiFi connectivity data to evaluate IoT Notary, and the results show that IoT Notary imposes nominal overheads. The secure logs only take 21 more storage, while users can verify their one day's data in less than two seconds even using a resource limited device.


Existence of Fractional Nonlocal Neutral Stochastic Differential Equation of Order 1 q 2 with Non instantaneous Impulses and State Dependent Delay. This article addresses a new class of fractional nonlocal neutral stochastic differential system of order 1 q 2 including non instantaneous impulses(NIIs) and state dependent delay(SDD) with the Poisson jumps and the Wiener process in Hilbert spaces. We examine the existence of a mild solution without assuming the compactness of the resolvent operators. The Monch fixed point theorem is used along with the Hausdorff measure of noncompactness. An example is constructed to verify the theoretical developments.


On the convergence and applications of the inertial like method for null point problems. In this paper, we propose two novel inertial like algorithms for solving the split common null point problem (SCNPP) with respect to set valued maximal operators. The features of the presented algorithm are using new inertial structure (i.e, the design of the new inertial like method does neither involve computation of the norm of the difference between x n and x n 1 in advance, nor need to consider the special value of the inertial parameter theta n to make the condition sum n 1 infty alpha n x n x n 1 2 infty valid) and the selection of the step sizes does not need prior knowledge of operator norms. Numerical experiments are presented to illustrate the performance of the algorithms.


GaTector A Unified Framework for Gaze Object Prediction. Gaze object prediction is a newly proposed task that aims to discover the objects being stared at by humans. It is of great application significance but still lacks a unified solution framework. An intuitive solution is to incorporate an object detection branch into an existing gaze prediction method. However, previous gaze prediction methods usually use two different networks to extract features from scene image and head image, which would lead to heavy network architecture and prevent each branch from joint optimization. In this paper, we build a novel framework named GaTector to tackle the gaze object prediction problem in a unified way. Particularly, a specific general specific (SGS) feature extractor is firstly proposed to utilize a shared backbone to extract general features for both scene and head images. To better consider the specificity of inputs and tasks, SGS introduces two input specific blocks before the shared backbone and three task specific blocks after the shared backbone. Specifically, a novel Defocus layer is designed to generate object specific features for the object detection task without losing information or requiring extra computations. Moreover, the energy aggregation loss is introduced to guide the gaze heatmap to concentrate on the stared box. In the end, we propose a novel wUoC metric that can reveal the difference between boxes even when they share no overlapping area. Extensive experiments on the GOO dataset verify the superiority of our method in all three tracks, i.e. object detection, gaze estimation, and gaze object prediction.


A Latency Aware Real Time Video Surveillance Demo Network Slicing for Improving Public Safety. We report the automated deployment of 5G services across a latency aware, semidisaggregated, and virtualized metro network. We summarize the key findings in a detailed analysis of end to end latency, service setup time, and soft failure detection time.


Rail Vehicle Localization and Mapping with LiDAR Vision Inertial GNSS Fusion. In this paper, we present a global navigation satellite system (GNSS) aided LiDAR visual inertial scheme, RailLoMer V, for accurate and robust rail vehicle localization and mapping. RailLoMer V is formulated atop a factor graph and consists of two subsystems an odometer assisted LiDAR inertial system (OLIS) and an odometer integrated Visual inertial system (OVIS). Both the subsystem exploits the typical geometry structure on the railroads. The plane constraints from extracted rail tracks are used to complement the rotation and vertical errors in OLIS. Besides, the line features and vanishing points are leveraged to constrain rotation drifts in OVIS. The proposed framework is extensively evaluated on datasets over 800 km, gathered for more than a year on both general speed and high speed railways, day and night. Taking advantage of the tightly coupled integration of all measurements from individual sensors, our framework is accurate to long during tasks and robust enough to grievously degenerated scenarios (railway tunnels). In addition, the real time performance can be achieved with an onboard computer.


Neural network featured timing systems for radiation detectors performance evaluation based on bound analysis. Waveform sampling systems are used pervasively in the design of front end electronics for radiation detection. The introduction of new feature extraction algorithms (eg. neural networks) to waveform sampling has the great potential to substantially improve the performance and enrich the capability. To analyze the limits of such algorithms and thus illuminate the direction of resolution optimization, in this paper we systematically simulate the detection procedure of contemporary radiation detectors with an emphasis on pulse timing. Neural networks and variants of constant fraction discrimination are studied in a wide range of analog channel frequency and noise level. Furthermore, we propose an estimation of multivariate Cram 'er Rao lower bound within the model using intrinsic extrinsic parametrization and prior information. Two case studies (single photon detection and shashlik type calorimeter) verify the reliability of the proposed method and show it works as a useful guideline when assessing the abilities of various feature extraction algorithms.


On the functional graph of f(X) c(X q 1 aX 2) over quadratic extensions of finite fields. Let mathbb F q be the finite field with q elements and char( mathbb F q) odd. In this article we will describe completely the dynamics of the map f(X) c(X q 1 aX 2) , for a pm1 and c in mathbb F q , over the finite field mathbb F q 2 , and give some partial results for a in mathbb F q setminus pm1 .


The Case for Translation Invariant Self Attention in Transformer Based Language Models. Mechanisms for encoding positional information are central for transformer based language models. In this paper, we analyze the position embeddings of existing language models, finding strong evidence of translation invariance, both for the embeddings themselves and for their effect on self attention. The degree of translation invariance increases during training and correlates positively with model performance. Our findings lead us to propose translation invariant self attention (TISA), which accounts for the relative position between tokens in an interpretable fashion without needing conventional position embeddings. Our proposal has several theoretical advantages over existing position representation approaches. Experiments show that it improves on regular ALBERT on GLUE tasks, while only adding orders of magnitude less positional parameters.


Continua in the Gromov Hausdorff space. We first prove that for all compact metrizable spaces, there exists a topological embedding of the compact metrizable space into each of the sets of compact metric spaces which are connected, path connected, geodesic, or CAT(0), in the Gromov Hausdorff space with finite prescribed values. As its application, we show that the sets prescribed above are path connected and their non empty open subsets have infinite topological dimension. By the same method, we also prove that the set of all proper CAT(0) spaces is path connected and its non empty open subsets have infinite topological dimension with respect to the pointed Gromov Hausdorff distance.


How (Non )Optimal is the Lexicon?. The mapping of lexical meanings to wordforms is a major feature of natural languages. While usage pressures might assign short words to frequent meanings (Zipf's law of abbreviation), the need for a productive and open ended vocabulary, local constraints on sequences of symbols, and various other factors all shape the lexicons of the world's languages. Despite their importance in shaping lexical structure, the relative contributions of these factors have not been fully quantified. Taking a coding theoretic view of the lexicon and making use of a novel generative statistical model, we define upper bounds for the compressibility of the lexicon under various constraints. Examining corpora from 7 typologically diverse languages, we use those upper bounds to quantify the lexicon's optimality and to explore the relative costs of major constraints on natural codes. We find that (compositional) morphology and graphotactics can sufficiently account for most of the complexity of natural codes as measured by code length.


Arcs Intersecting at Most Once on the 4 Punctured Sphere. We classify maximal systems of arcs which intersect at most once on the 4 punctured sphere.


Robust Secretary and Prophet Algorithms for Packing Integer Programs. We study the problem of solving Packing Integer Programs (PIPs) in the online setting, where columns in 0,1 d of the constraint matrix are revealed sequentially, and the goal is to pick a subset of the columns that sum to at most B in each coordinate while maximizing the objective. Excellent results are known in the secretary setting, where the columns are adversarially chosen, but presented in a uniformly random order. However, these existing algorithms are susceptible to adversarial attacks they try to "learn" characteristics of a good solution, but tend to over fit to the model, and hence a small number of adversarial corruptions can cause the algorithm to fail. In this paper, we give the first robust algorithms for Packing Integer Programs, specifically in the recently proposed Byzantine Secretary framework. Our techniques are based on a two level use of online learning, to robustly learn an approximation to the optimal value, and then to use this robust estimate to pick a good solution. These techniques are general and we use them to design robust algorithms for PIPs in the prophet model as well, specifically in the Prophet with Augmentations framework. We also improve known results in the Byzantine Secretary framework we make the non constructive results algorithmic and improve the existing bounds for single item and matroid constraints.


Online Optimal State Feedback Control of Linear Systems over Wireless MIMO Fading Channels. We consider the optimal control of linear systems over wireless MIMO fading channels, where the MIMO wireless fading and random access of the remote controller may cause intermittent controllability or uncontrollability of the closed loop control system. We formulate the optimal control design over random access MIMO fading channels as an infinite horizon average cost Markov decision process (MDP), and we propose a novel state reduction technique such that the optimality condition is transformed into a time invariant reduced state Bellman optimality equation. We provide the closed form characterizations on the existence and uniqueness of the optimal control solution via analyzing the reduced state Bellman optimality equation. Specifically, in the case that the closed loop system is almost surely controllable, we show that the optimal control solution always exists and is unique. In the case that MIMO fading channels and the random access of the remote controller destroy the closed loop controllability, we propose a novel controllable and uncontrollable positive semidefinite (PSD) cone decomposition induced by the singular value decomposition (SVD) of the MIMO fading channel contaminated control input matrix. Based on the decomposed fine grained reduced state Bellman optimality equation, we further propose a closed form sufficient condition for both the existence and the uniqueness of the optimal control solution. The closed form sufficient condition reveals the fact that the optimal control action may still exist even if the closed loop system suffers from intermittent controllability or almost sure uncontrollability.


Dual Level Collaborative Transformer for Image Captioning. Descriptive region features extracted by object detection networks have played an important role in the recent advancements of image captioning. However, they are still criticized for the lack of contextual information and fine grained details, which in contrast are the merits of traditional grid features. In this paper, we introduce a novel Dual Level Collaborative Transformer (DLCT) network to realize the complementary advantages of the two features. Concretely, in DLCT, these two features are first processed by a novelDual way Self Attenion (DWSA) to mine their intrinsic properties, where a Comprehensive Relation Attention component is also introduced to embed the geometric information. In addition, we propose a Locality Constrained Cross Attention module to address the semantic noises caused by the direct fusion of these two features, where a geometric alignment graph is constructed to accurately align and reinforce region and grid features. To validate our model, we conduct extensive experiments on the highly competitive MS COCO dataset, and achieve new state of the art performance on both local and online test sets, i.e., 133.8 CIDEr D on Karpathy split and 135.4 CIDEr on the official split. Code is available at https github.com luo3300612 image captioning DLCT.


Human AI interaction An emerging interdisciplinary domain for enabling human centered AI. The new characteristics of AI technology have brought new challenges to the research and development of AI systems. AI technology has benefited humans, but if improperly developed, it will harm humans. At present, there is no systematic interdisciplinary approach to effectively deal with these new challenges. This paper analyzes the new challenges faced by AI systems and further elaborates the "Human Centered AI" (HCAI) approach we proposed in 2019. In order to enable the implementation of the HCAI approach, we systematically propose an emerging interdisciplinary domain of "Human AI Interaction" (HAII), and define the objective, methodology, and scope. Based on literature review and analyses, this paper summarizes the main areas of the HAII research and application as well as puts forward the future research agenda for HAII. Finally, the paper provides strategic recommendations for future implementation of the HCAII approach and HAII work.


CML COVID A Large Scale COVID 19 Twitter Dataset with Latent Topics, Sentiment and Location Information. As a platform, Twitter has been a significant public space for discussion related to the COVID 19 pandemic. Public social media platforms such as Twitter represent important sites of engagement regarding the pandemic and these data can be used by research teams for social, health, and other research. Understanding public opinion about COVID 19 and how information diffuses in social media is important for governments and research institutions. Twitter is a ubiquitous public platform and, as such, has tremendous utility for understanding public perceptions, behavior, and attitudes related to COVID 19. In this research, we present CML COVID, a COVID 19 Twitter data set of 19,298,967 million tweets from 5,977,653 unique individuals and summarize some of the attributes of these data. These tweets were collected between March 2020 and July 2020 using the query terms coronavirus, covid and mask related to COVID 19. We use topic modeling, sentiment analysis, and descriptive statistics to describe the tweets related to COVID 19 we collected and the geographical location of tweets, where available. We provide information on how to access our tweet dataset (archived using twarc).


The Effectiveness of Intermediate Task Training for Code Switched Natural Language Understanding. While recent benchmarks have spurred a lot of new work on improving the generalization of pretrained multilingual language models on multilingual tasks, techniques to improve code switched natural language understanding tasks have been far less explored. In this work, we propose the use of bilingual intermediate pretraining as a reliable technique to derive large and consistent performance gains on three different NLP tasks using code switched text. We achieve substantial absolute improvements of 7.87 , 20.15 , and 10.99 , on the mean accuracies and F1 scores over previous state of the art systems for Hindi English Natural Language Inference (NLI), Question Answering (QA) tasks, and Spanish English Sentiment Analysis (SA) respectively. We show consistent performance gains on four different code switched language pairs (Hindi English, Spanish English, Tamil English and Malayalam English) for SA. We also present a code switched masked language modelling (MLM) pretraining technique that consistently benefits SA compared to standard MLM pretraining using real code switched text.


Summation method in optimal control problem with delay. We describe a summation procedure for the construction of the optimal solution in null controllability problem for differential equation with distributed delay


A Functional Operator for Model Uncertainty Quantification in the RKHS. Accurate uncertainty quantification of model predictions is a crucial problem in machine learning. Existing Bayesian methods, relying on iterative procedures or Monte Carlo sampling, are computationally expensive to implement and often fail to capture the true posterior of a model, especially in high dimensional problems. This paper proposes a framework for single shot predictive uncertainty quantification of a neural network that replaces the conventional Bayesian notion of weight probability density function (PDF) with a functional defined on the model weights in a reproducing kernel Hilbert space (RKHS). The resulting RKHS based analysis yields a potential field based interpretation of the model weight PDF and allows the definition of a functional operator, inspired by perturbation theory, that performs a moment decomposition of the model weight PDF to quantify uncertainty of the model predictions. The extracted moments from this approach automatically decompose the weight PDF around the local neighborhood of the specified model output and determine, with great sensitivity, the local heterogeneity and anisotropy of the weight PDF around a given model prediction output. Consequently, these functional moments provide much more precise and sharper estimates of model predictive uncertainty than the central stochastic moments characterized by Bayesian and ensemble methods. Experimental results demonstrate this by evaluating the error detection capability of the model uncertainty quantification methods on test data that has undergone a covariate shift away from the training PDF learned by the model. We find our proposed measure for uncertainty quantification to be significantly more precise and better calibrated than baseline methods on various benchmark datasets, while also being much faster to compute.


Bounding s for vertex primitive s arc transitive digraphs of alternating and symmetric groups. Determining the upper bound on s for vertex primitive s arc transitive digraphs has received considerable attention dating back to a question of Praeger in 1990. It was shown by Giudici and the third author that the smallest upper bound on s is the same for those admitting almost simple groups. In this short paper, based on the recent work of Pan, Wu and Yin, we prove that s leqslant 2 for alternating and symmetric groups.


Long Short term Memory RNN. This paper is based on a machine learning project at the Norwegian University of Science and Technology, fall 2020. The project was initiated with a literature review on the latest developments within time series forecasting methods in the scientific community over the past five years. The paper summarizes the essential aspects of this research. Furthermore, in this paper, we introduce an LSTM cell's architecture, and explain how different components go together to alter the cell's memory and predict the output. Also, the paper provides the necessary formulas and foundations to calculate a forward iteration through an LSTM. Then, the paper refers to some practical applications and research that emphasize the strength and weaknesses of LSTMs, shown within the time series domain and the natural language processing (NLP) domain. Finally, alternative statistical methods for time series predictions are highlighted, where the paper outline ARIMA and exponential smoothing. Nevertheless, as LSTMs can be viewed as a complex architecture, the paper assumes that the reader has some knowledge of essential machine learning aspects, such as the multi layer perceptron, activation functions, overfitting, backpropagation, bias, over and underfitting, and more.


Isomorphisms of Galois groups of number fields with restricted ramification. Let K be a number field and S a set of primes of K . We write K S K for the maximal extension of K unramified outside S and G K,S for its Galois group. In this paper, we answer the following question under some assumptions "For i 1,2 , let K i be a number field, S i a (sufficiently large) set of primes of K i and sigma G K 1,S 1 to G K 2,S 2 an isomorphism. Is sigma induced by a unique isomorphism between K 1,S 1 K 1 and K 2,S 2 K 2 ?" Here the main assumption is about the Dirichlet density of S i .


The strong field QED experiment LUXE at the European XFEL and its detector challenges. The LUXE experiment aims at studying high field QED in electron laser and photon laser interactions, with the 16.5 GeV electron beam of the European XFEL and a laser beam with power of up to 350 TW. The experiment will measure the spectra of electrons and photons in non linear Compton scattering where production rates in excess of 10 9 are expected per 1 Hz bunch crossing. At the same time positrons from pair creation in either the two step trident process or the Breit Wheeler process will be measured, where the expected rates range from 10 3 to 10 3 per bunch crossing, depending on the laser power and focus. These measurements have to be performed in the presence of low energy high radiation background. To meet these challenges, for high rate electron and photon fluxes, the experiment will use Cherenkov radiation detectors, scintillator screens, sapphire sensors as well as lead glass monitors for backscattering off the beam dump. A four layer silicon pixel tracker and a compact electromagnetic tungsten calorimeter with GaAs sensors will be used to measure the positron spectra. The layout of the experiment and the expected performance under the harsh radiation conditions will be presented.


Fairness and Data Protection Impact Assessments. In this paper, we critically examine the effectiveness of the requirement to conduct a Data Protection Impact Assessment (DPIA) in Article 35 of the General Data Protection Regulation (GDPR) in light of fairness metrics. Through this analysis, we explore the role of the fairness principle as introduced in Article 5(1)(a) and its multifaceted interpretation in the obligation to conduct a DPIA. Our paper argues that although there is a significant theoretical role for the considerations of fairness in the DPIA process, an analysis of the various guidance documents issued by data protection authorities on the obligation to conduct a DPIA reveals that they rarely mention the fairness principle in practice.


Design of double and multi bend achromat lattices with large dynamic aperture and approximate invariants. A numerical method to design nonlinear double and multi bend achromat (DBA and MBA) lattices with approximate invariants of motion is investigated. The search for such nonlinear lattices is motivated by Fermilab's Integrable Optics Test Accelerator (IOTA), whose design is based on an integrable Hamiltonian system with two invariants of motion. While it may not be possible to design an achromatic lattice for a dedicated synchrotron light source storage ring with one or more exact invariants of motion, it is possible to tune the sextupoles and octupoles in existing DBA and MBA lattices to produce approximate invariants. In our procedure, the lattice is tuned while minimizing the turn by turn fluctuations of the Courant Snyder actions J x and J y at several distinct amplitudes, while simultaneously minimizing diffusion of the on energy betatron tunes. The resulting lattices share some important features with integrable ones, such as a large dynamic aperture, trajectories confined to invariant tori, robustness to resonances and errors, and a large amplitude dependent tune spread. Compared to the nominal NSLS II lattice, the single and multi bunch instability thresholds are increased and the bunch by bunch feedback gain can be reduced.


The polynomial closure is not topological. We characterize the polynomial closure of a pseudo convergent sequence in a valuation domain V of arbitrary rank, and then we use this result to show that the polynomial closure is never topological when V has rank at least 2 .


Improved Rank Modulation Codes for DNA Storage with Shotgun Sequencing. We study permutations over the set of ell grams, that are feasible in the sense that there is a sequence whose ell gram frequency has the same ranking as the permutation. Codes, which are sets of feasible permutations, protect information stored in DNA molecules using the rank modulation scheme, and read using the shotgun sequencing technique. We construct systematic codes with an efficient encoding algorithm, and show that they are optimal in size. The length of the DNA sequences that correspond to the codewords is shown to be polynomial in the code parameters. Non systematic with larger size are also constructed.


Frozen in Time A Joint Video and Image Encoder for End to End Retrieval. Our objective in this work is video text retrieval in particular a joint embedding that enables efficient text to video retrieval. The challenges in this area include the design of the visual architecture and the nature of the training data, in that the available large scale video text training datasets, such as HowTo100M, are noisy and hence competitive performance is achieved only at scale through large amounts of compute. We address both these challenges in this paper. We propose an end to end trainable model that is designed to take advantage of both large scale image and video captioning datasets. Our model is an adaptation and extension of the recent ViT and Timesformer architectures, and consists of attention in both space and time. The model is flexible and can be trained on both image and video text datasets, either independently or in conjunction. It is trained with a curriculum learning schedule that begins by treating images as 'frozen' snapshots of video, and then gradually learns to attend to increasing temporal context when trained on video datasets. We also provide a new video text pretraining dataset WebVid 2M, comprised of over two million videos with weak captions scraped from the internet. Despite training on datasets that are an order of magnitude smaller, we show that this approach yields state of the art results on standard downstream video retrieval benchmarks including MSR VTT, MSVD, DiDeMo and LSMDC.


Privacy preserving Logistic Regression with Secret Sharing. Logistic regression (LR) is a widely used classification method for modeling binary outcomes in many medical data classification tasks. Research that collects and combines datasets from various data custodians and jurisdictions can excessively benefit from the increased statistical power to support their analyzing goals. However, combining data from these various sources creates significant privacy concerns that need to be addressed. In this paper, we proposed secret sharing based privacy preserving logistic regression protocols using the Newton Raphson method. Our proposed approaches are based on secure Multi Party Computation (MPC) with different security settings to analyze data owned by several data holders. We conducted experiments on both synthetic data and real world datasets and compared the efficiency and accuracy of them with those of an ordinary logistic regression model. Experimental results demonstrate that the proposed protocols are highly efficient and accurate. This study introduces iterative algorithms to simplify the federated training a logistic regression model in a privacy preserving manner. Our implementation results show that our improved method can handle large datasets used in securely training a logistic regression from multiple sources.


Class aware Sounding Objects Localization via Audiovisual Correspondence. Audiovisual scenes are pervasive in our daily life. It is commonplace for humans to discriminatively localize different sounding objects but quite challenging for machines to achieve class aware sounding objects localization without category annotations, i.e., localizing the sounding object and recognizing its category. To address this problem, we propose a two stage step by step learning framework to localize and recognize sounding objects in complex audiovisual scenarios using only the correspondence between audio and vision. First, we propose to determine the sounding area via coarse grained audiovisual correspondence in the single source cases. Then visual features in the sounding area are leveraged as candidate object representations to establish a category representation object dictionary for expressive visual character extraction. We generate class aware object localization maps in cocktail party scenarios and use audiovisual correspondence to suppress silent areas by referring to this dictionary. Finally, we employ category level audiovisual consistency as the supervision to achieve fine grained audio and sounding object distribution alignment. Experiments on both realistic and synthesized videos show that our model is superior in localizing and recognizing objects as well as filtering out silent ones. We also transfer the learned audiovisual network into the unsupervised object detection task, obtaining reasonable performance.


Network Inference and Influence Maximization from Samples. Influence maximization is the task of selecting a small number of seed nodes in a social network to maximize the influence spread from these seeds. It has been widely investigated in the past two decades. In the canonical setting, the social network and its diffusion parameters are given as input. In this paper, we consider the more realistic sampling setting where the network is unknown and we only have a set of passively observed cascades that record the sets of activated nodes at each diffusion step. We study the task of influence maximization from these cascade samples (IMS) and present constant approximation algorithms for it under mild conditions on the seed set distribution. To achieve the optimization goal, we also provide a novel solution to the network inference problem, that is, learning diffusion parameters and the network structure from the cascade data. Compared with prior solutions, our network inference algorithms require weaker assumptions and do not rely on maximum likelihood estimation and convex programming. Our IMS algorithms enhance the learning and then optimization approach by allowing a constant approximation ratio even when the diffusion parameters are hard to learn, and we do not need any assumption related to the network structure or diffusion parameters.


There is More than Meets the Eye Self Supervised Multi Object Detection and Tracking with Sound by Distilling Multimodal Knowledge. Attributes of sound inherent to objects can provide valuable cues to learn rich representations for object detection and tracking. Furthermore, the co occurrence of audiovisual events in videos can be exploited to localize objects over the image field by solely monitoring the sound in the environment. Thus far, this has only been feasible in scenarios where the camera is static and for single object detection. Moreover, the robustness of these methods has been limited as they primarily rely on RGB images which are highly susceptible to illumination and weather changes. In this work, we present the novel self supervised MM DistillNet framework consisting of multiple teachers that leverage diverse modalities including RGB, depth and thermal images, to simultaneously exploit complementary cues and distill knowledge into a single audio student network. We propose the new MTA loss function that facilitates the distillation of information from multimodal teachers in a self supervised manner. Additionally, we propose a novel self supervised pretext task for the audio student that enables us to not rely on labor intensive manual annotations. We introduce a large scale multimodal dataset with over 113,000 time synchronized frames of RGB, depth, thermal, and audio modalities. Extensive experiments demonstrate that our approach outperforms state of the art methods while being able to detect multiple objects using only sound during inference and even while moving.


Bottom Up Derivatives of Tree Expressions. In this paper, we extend the notion of (word) derivatives and partial derivatives due to (respectively) Brzozowski and Antimirov to tree derivatives using already known inductive formulae of quotients. We define a new family of extended regular tree expressions (using negation or intersection operators), and we show how to compute a Brzozowski like inductive tree automaton the fixed point of this construction, when it exists, is the derivative tree automaton. Such a deterministic tree automaton can be used to solve the membership test efficiently the whole structure is not necessarily computed, and the derivative computations can be performed in parallel. We also show how to solve the membership test using our (Bottom Up) partial derivatives, without computing an automaton.


On toric Hermitian ALF gravitational instantons. We give a classification of toric, Hermitian, Ricci flat, ALF Riemannian metrics in dimension 4, including metrics with conical singularities. The only smooth examples are on one hand the hyperKaehler ALF metrics, on the other hand, the Kerr, Taub NUT and Chen Teo metrics. There are examples with conical singularities with infinitely many distinct topologies. We provide explicit formulas.


A mean field extension of the LIBOR market model. We introduce a mean field extension of the LIBOR market model (LMM) which preserves the basic features of the original model. Among others, these features are the martingale property, a directly implementable calibration and an economically reasonable parametrization of the classical LMM. At the same time, the mean field LIBOR market model (MF LMM) is designed to reduce the probability of exploding scenarios, arising in particular in the market consistent valuation of long term guarantees. To this end, we prove existence and uniqueness of the corresponding MF LMM and investigate its practical aspects, including a Black '76 type formula. Moreover, we present an extensive numerical analysis of the MF LMM. The corresponding Monte Carlo method is based on a suitable interacting particle system which approximates the underlying mean field equation.


Highly tunable broadband coherent wavelength conversion with a fiber based optomechanical system. The modern information networks are built on hybrid systems working at disparate optical wavelengths. Coherent interconnects for converting photons between different wavelengths are highly desired. Although coherent interconnects have conventionally been realized with nonlinear optical effects, those systems require demanding experimental conditions such as phase matching and or cavity enhancement, which not only bring difficulties in experimental implementation but also set a narrow operating bandwidth (typically in MHz to GHz range as determined by the cavity linewidth). Here, we propose and experimentally demonstrate coherent information transfer between two orthogonally propagating light beams of disparate wavelengths in a fiber based optomechanical system, which does not require any sort of phase matching or cavity enhancement of the pump beam. The coherent process is demonstrated by phenomena of optomechanically induced transparency and absorption. Our scheme not only significantly simplifies the experimental implementation of coherent wavelength conversion, but also extends the operating bandwidth to that of an optical fiber (tens of THz), which will enable a broad range of coherent optics based applications such as optical sensing, spectroscopy, and communication.


Enjoy Your Editing Controllable GANs for Image Editing via Latent Space Navigation. Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial Net (GAN) to learn a latent space and suitable latent space transformations. However, current approaches often suffer from attribute edits that are entangled, global image identity changes, and diminished photo realism. To address these concerns, we learn multiple attribute transformations simultaneously, integrate attribute regression into the training of transformation functions, and apply a content loss and an adversarial loss that encourages the maintenance of image identity and photo realism. We propose quantitative evaluation strategies for measuring controllable editing performance, unlike prior work, which primarily focuses on qualitative evaluation. Our model permits better control for both single and multiple attribute editing while preserving image identity and realism during transformation. We provide empirical results for both natural and synthetic images, highlighting that our model achieves state of the art performance for targeted image manipulation.


Unsupervised Person Re Identification with Multi Label Learning Guided Self Paced Clustering. Although unsupervised person re identification (Re ID) has drawn increasing research attention recently, it remains challenging to learn discriminative features without annotations across disjoint camera views. In this paper, we address the unsupervised person Re ID with a conceptually novel yet simple framework, termed as Multi label Learning guided self paced Clustering (MLC). MLC mainly learns discriminative features with three crucial modules, namely a multi scale network, a multi label learning module, and a self paced clustering module. Specifically, the multi scale network generates multi granularity person features in both global and local views. The multi label learning module leverages a memory feature bank and assigns each image with a multi label vector based on the similarities between the image and feature bank. After multi label training for several epochs, the self paced clustering joins in training and assigns a pseudo label for each image. The benefits of our MLC come from three aspects i) the multi scale person features for better similarity measurement, ii) the multi label assignment based on the whole dataset ensures that every image can be trained, and iii) the self paced clustering removes some noisy samples for better feature learning. Extensive experiments on three popular large scale Re ID benchmarks demonstrate that our MLC outperforms previous state of the art methods and significantly improves the performance of unsupervised person Re ID.


Re distributing Biased Pseudo Labels for Semi supervised Semantic Segmentation A Baseline Investigation. While self training has advanced semi supervised semantic segmentation, it severely suffers from the long tailed class distribution on real world semantic segmentation datasets that make the pseudo labeled data bias toward majority classes. In this paper, we present a simple and yet effective Distribution Alignment and Random Sampling (DARS) method to produce unbiased pseudo labels that match the true class distribution estimated from the labeled data. Besides, we also contribute a progressive data augmentation and labeling strategy to facilitate model training with pseudo labeled data. Experiments on both Cityscapes and PASCAL VOC 2012 datasets demonstrate the effectiveness of our approach. Albeit simple, our method performs favorably in comparison with state of the art approaches. Code will be available at https github.com CVMI Lab DARS.


The Diversity of Minimal Cofinal Extensions. Fix a countable nonstandard model mathcal M of Peano Arithmetic. Even with some rather severe restrictions placed on the types of minimal cofinal extensions mathcal N succ mathcal M that are allowed, we still find that there are 2 aleph 0 possible theories of ( mathcal N,M) for such mathcal N 's.


Hausdorff Operators on Some Spaces of Holomorphic Functions on the Unit Disc. We introduce Hausdorff operators over the unit disc and give conditions for boundedness of such operator in Bloch, Bergman, and Hardy spaces on the disc. Identity approximation by Hausdorff operators is also considered.


Nodal geometry and topology of low energy eigenfunctions. We investigate various aspects of the nodal geometry and topology of Laplace eigenfunctions on compact Riemannian manifolds and bounded Euclidean domains, with particular emphasis on the low frequency regime. This includes geometry and topology of nodal sets, particularly in and around the area of the Payne property, opening angle estimates, (fundamental) spectral gaps etc., and behaviour of all of the above under small scale perturbations. We aim to highlight interesting aspects of spectral theory and nodal phenomena tied to ground state low energy eigenfunctions, as opposed to asymptotic results.


New Directions in Cloud Programming. Nearly twenty years after the launch of AWS, it remains difficult for most developers to harness the enormous potential of the cloud. In this paper we lay out an agenda for a new generation of cloud programming research aimed at bringing research ideas to programmers in an evolutionary fashion. Key to our approach is a separation of distributed programs into a PACT of four facets Program semantics, Availablity, Consistency and Targets of optimization. We propose to migrate developers gradually to PACT programming by lifting familiar code into our more declarative level of abstraction. We then propose a multi stage compiler that emits human readable code at each stage that can be hand tuned by developers seeking more control. Our agenda raises numerous research challenges across multiple areas including language design, query optimization, transactions, distributed consistency, compilers and program synthesis.


Drop Clause Enhancing Performance, Interpretability and Robustness of the Tsetlin Machine. In this article, we introduce a novel variant of the Tsetlin machine (TM) that randomly drops clauses, the key learning elements of a TM. In effect, TM with drop clause ignores a random selection of the clauses in each epoch, selected according to a predefined probability. In this way, additional stochasticity is introduced in the learning phase of TM. To explore the effects drop clause has on accuracy, training time, interpretability and robustness, we conduct extensive experiments on nine benchmark datasets in natural language processing (NLP) (IMDb, R8, R52, MR and TREC) and image classification (MNIST, Fashion MNIST, CIFAR 10 and CIFAR 100). Our proposed model outperforms baseline machine learning algorithms by a wide margin and achieves competitive performance in comparison with recent deep learning model such as BERT and AlexNET DFA. In brief, we observe up to 10 increase in accuracy and 2x to 4x faster learning compared with standard TM. We further employ the Convolutional TM to document interpretable results on the CIFAR datasets, visualizing how the heatmaps produced by the TM become more interpretable with drop clause. We also evaluate how drop clause affects learning robustness by introducing corruptions and alterations in the image language test data. Our results show that drop clause makes TM more robust towards such changes.


Touch based Curiosity for Sparse Reward Tasks. Robots in many real world settings have access to force torque sensors in their gripper and tactile sensing is often necessary in tasks that involve contact rich motion. In this work, we leverage surprise from mismatches in touch feedback to guide exploration in hard sparse reward reinforcement learning tasks. Our approach, Touch based Curiosity (ToC), learns what visible objects interactions are supposed to "feel" like. We encourage exploration by rewarding interactions where the expectation and the experience don't match. In our proposed method, an initial task independent exploration phase is followed by an on task learning phase, in which the original interactions are relabeled with on task rewards. We test our approach on a range of touch intensive robot arm tasks (e.g. pushing objects, opening doors), which we also release as part of this work. Across multiple experiments in a simulated setting, we demonstrate that our method is able to learn these difficult tasks through sparse reward and curiosity alone. We compare our cross modal approach to single modality (touch or vision only) approaches as well as other curiosity based methods and find that our method performs better and is more sample efficient.


Robustness Certification for Point Cloud Models. The use of deep 3D point cloud models in safety critical applications, such as autonomous driving, dictates the need to certify the robustness of these models to real world transformations. This is technically challenging, as it requires a scalable verifier tailored to point cloud models that handles a wide range of semantic 3D transformations. In this work, we address this challenge and introduce 3DCertify, the first verifier able to certify the robustness of point cloud models. 3DCertify is based on two key insights (i) a generic relaxation based on first order Taylor approximations, applicable to any differentiable transformation, and (ii) a precise relaxation for global feature pooling, which is more complex than pointwise activations (e.g., ReLU or sigmoid) but commonly employed in point cloud models. We demonstrate the effectiveness of 3DCertify by performing an extensive evaluation on a wide range of 3D transformations (e.g., rotation, twisting) for both classification and part segmentation tasks. For example, we can certify robustness against rotations by pm 60 deg for 95.7 of point clouds, and our max pool relaxation increases certification by up to 15.6 .


QROSS QUBO Relaxation Parameter Optimisation via Learning Solver Surrogates. An increasingly popular method for solving a constrained combinatorial optimisation problem is to first convert it into a quadratic unconstrained binary optimisation (QUBO) problem, and solve it using a standard QUBO solver. However, this relaxation introduces hyper parameters that balance the objective and penalty terms for the constraints, and their chosen values significantly impact performance. Hence, tuning these parameters is an important problem. Existing generic hyper parameter tuning methods require multiple expensive calls to a QUBO solver, making them impractical for performance critical applications when repeated solutions of similar combinatorial optimisation problems are required. In this paper, we propose the QROSS method, in which we build surrogate models of QUBO solvers via learning from solver data on a collection of instances of a problem. In this way, we are able capture the common structure of the instances and their interactions with the solver, and produce good choices of penalty parameters with fewer number of calls to the QUBO solver. We take the Traveling Salesman Problem (TSP) as a case study, where we demonstrate that our method can find better solutions with fewer calls to QUBO solver compared with conventional hyper parameter tuning techniques. Moreover, with simple adaptation methods, QROSS is shown to generalise well to out of distribution datasets and different types of QUBO solvers.


The Demailly system for a direct sum of ample line bundles on Riemann surfaces. We prove that a system of equations introduced by Demailly (to attack a conjecture of Griffiths) has a smooth solution for a direct sum of ample line bundles on a Riemann surface. We also reduce the problem for general vector bundles to an a priori estimate using Leray Schauder degree theory.


Forgiveness is an Adaptation in Iterated Prisoner's Dilemma with Memory. The Prisoner's Dilemma is used to represent many real life phenomena whether from the civilized world of humans or from the wild life of the other living. Researchers working on iterated prisoner's dilemma (IPD) with limited memory inspected the outcome of different forgetting strategies in homogeneous environment, within which all agents adopt the same forgetting strategy at a time. In this work, with the intention to represent real life more realistically, we improve existing forgetting strategies, offer new ones, and conduct experiments in heterogeneous environment that contains mixed agents and compare the results with previous research as well as homogeneous environment. Our findings show that the outcome depends on the type of the environment, and is just the opposite for homogeneous and heterogeneous ones, opposing the existing literature in IPD. Consequently, forgetting and forgiving defectors is the supreme memory management strategy in a competitive, heterogeneous environment. Therefore, forgiveness is an adaptation.


Yin Yang Puzzles are NP complete. We prove NP completeness of Yin Yang Shiromaru Kuromaru pencil and paper puzzles. Viewed as a graph partitioning problem, we prove NP completeness of partitioning a rectangular grid graph into two induced trees (normal Yin Yang), or into two induced connected subgraphs (Yin Yang without 2 times 2 rule), subject to some vertices being pre assigned to a specific tree subgraph.


3D Human Pose Estimation with Spatial and Temporal Transformers. Transformer architectures have become the model of choice in natural language processing and are now being introduced into computer vision tasks such as image classification, object detection, and semantic segmentation. However, in the field of human pose estimation, convolutional architectures still remain dominant. In this work, we present PoseFormer, a purely transformer based approach for 3D human pose estimation in videos without convolutional architectures involved. Inspired by recent developments in vision transformers, we design a spatial temporal transformer structure to comprehensively model the human joint relations within each frame as well as the temporal correlations across frames, then output an accurate 3D human pose of the center frame. We quantitatively and qualitatively evaluate our method on two popular and standard benchmark datasets Human3.6M and MPI INF 3DHP. Extensive experiments show that PoseFormer achieves state of the art performance on both datasets. Code is available at url https github.com zczcwh PoseFormer


Maximum and Leaky Maximum Propagation. In this work, we present an alternative to conventional residual connections, which is inspired by maxout nets. This means that instead of the addition in residual connections, our approach only propagates the maximum value or, in the leaky formulation, propagates a percentage of both. In our evaluation, we show on different public data sets that the presented approaches are comparable to the residual connections and have other interesting properties, such as better generalization with a constant batch normalization, faster learning, and also the possibility to generalize without additional activation functions. In addition, the proposed approaches work very well if ensembles together with residual networks are formed. https atreus.informatik.uni tuebingen.de seafile d 8e2ab8c3fdd444e1a135 ?p 2FMaximumPropagation mode list


On the value function for nonautonomous optimal control problems with infinite horizon. In this paper we consider nonautonomous optimal control problems of infinite horizon type, whose control actions are given by L 1 functions. We verify that the value function is locally Lipschitz. The equivalence between dynamic programming inequalities and Hamilton Jacobi Bellman (HJB) inequalities for proximal sub (super) gradients is proven. Using this result we show that the value function is a Dini solution of the HJB equation. We obtain a verification result for the class of Dini sub solutions of the HJB equation and also prove a minimax property of the value function with respect to the sets of Dini semi solutions of the HJB equation. We introduce the concept of viscosity solutions of the HJB equation in infinite horizon and prove the equivalence between this and the concept of Dini solutions. In the appendix we provide an existence theorem.


Phase transitions in rare earth ferrimagnets with surface anisotropy near the magnetization compensation point. We report of a theoretical model for calculating the H T phase diagrams of a rare earth ferrimagnet, taking into account anisotropies originated by both magnetization sublattices' and by the surface. The possibility of an exchange spring formation due to surface anisotropy is considered. This situation is realized in heterostructures containing a ferrimagnet and a heavy metal. We derive the stability lose lines of the collinear phase from the free energy of the two sublattice ferrimagnet. We numerical calculate the magnetic phase diagrams for the cases when the magnetic field applied along and perpendecular to the easy axis. We demonstrate that tricritical point down at the low field range due to surface anisotropy effect. Moreover, the line of the first order phase transition between angular and collinear phases reduces due to surface anisotropy. In the case when magnetic field is applied perpendicular to the easy axis we show the possibility of the first order phase transition between two collinear phases in contrast to the phase diagram without surface anisotropy.


Generating the liftable mapping class groups of regular cyclic covers. Let text Mod (S g) be the mapping class group of the closed orientable surface of genus g geq 1 , and let text LMod p (X) be the liftable mapping class group associated with a finite sheeted branched cover p S to X , where X is a hyperbolic surface. For k geq 2 , let p k S k(g 1) 1 to S g be the standard k sheeted regular cyclic cover. In this paper, we derive an explicit finite generating sets for text LMod p k (S g) for g geq 3 and k geq 2 , and text LMod p 2 (S 2) . For g geq 2 , as an application of our main result, we also derive a generating set for text LMod p 2 (S g) cap C text Mod (S g) ( iota) , where C text Mod (S g) ( iota) is the centralizer of the hyperelliptic involution iota in text Mod (S g) . Let mathcal L be the infinite ladder surface, and let q g mathcal L to S g be the standard infinite sheeted cover induced by langle h g 1 rangle where h is the standard handle shift on mathcal L . As another application, we derive a finite generating set for text LMod q g (S g) . Finally, we establish that for k geq 2 and g geq 2 , text LMod p k (S g) is self normalizing in text Mod (S g) .


The complexity of high dimensional cuts. Cut problems form one of the most fundamental classes of problems in algorithmic graph theory. For instance, the minimum cut, the minimum s t cut, the minimum multiway cut, and the minimum k way cut are some of the commonly encountered cut problems. Many of these problems have been extensively studied over several decades. In this paper, we initiate the algorithmic study of some cut problems in high dimensions. The first problem we study, namely, Topological Hitting Set (THS), is defined as follows Given a nontrivial r cycle zeta in a simplicial complex mathsf K , find a set mathcal S of r dimensional simplices of minimum cardinality so that mathcal S meets every cycle homologous to zeta . Our main result is that this problem admits a polynomial time solution on triangulations of closed surfaces. Interestingly, the optimal solution is given in terms of the cocycles of the surface. For general complexes, we show that THS is W 1 hard with respect to the solution size k . On the positive side, we show that THS admits an FPT algorithm with respect to k d , where d is the maximum degree of the Hasse graph of the complex mathsf K . We also define a problem called Boundary Nontrivialization (BNT) Given a bounding r cycle zeta in a simplicial complex mathsf K , find a set mathcal S of (r 1) dimensional simplices of minimum cardinality so that the removal of mathcal S from mathsf K makes zeta non bounding. We show that BNT is W 1 hard with respect to the solution size as the parameter, and has an O( log n) approximation FPT algorithm for (r 1) dimensional complexes with the (r 1) th Betti number beta r 1 as the parameter. Finally, we provide randomized (approximation) FPT algorithms for the global variants of THS and BNT.


DeMFI Deep Joint Deblurring and Multi Frame Interpolation with Flow Guided Attentive Correlation and Recursive Boosting. In this paper, we propose a novel joint deblurring and multi frame interpolation (DeMFI) framework, called DeMFI Net, which accurately converts blurry videos of lower frame rate to sharp videos at higher frame rate based on flow guided attentive correlation based feature bolstering (FAC FB) module and recursive boosting (RB), in terms of multi frame interpolation (MFI). The DeMFI Net jointly performs deblurring and MFI where its baseline version performs feature flow based warping with FAC FB module to obtain a sharp interpolated frame as well to deblur two center input frames. Moreover, its extended version further improves the joint task performance based on pixel flow based warping with GRU based RB. Our FAC FB module effectively gathers the distributed blurry pixel information over blurry input frames in feature domain to improve the overall joint performances, which is computationally efficient since its attentive correlation is only focused pointwise. As a result, our DeMFI Net achieves state of the art (SOTA) performances for diverse datasets with significant margins compared to the recent SOTA methods, for both deblurring and MFI. All source codes including pretrained DeMFI Net are publicly available at https github.com JihyongOh DeMFI.


Planar Brownian motion winds evenly along its trajectory. Let D N be the set of points around which a planar Brownian motion winds at least N times. We prove that the random measure on the plane with density 2 pi N 1 D N with respect to the Lebesgue measure converges almost surely weakly, as N tends to infinity, towards the occupation measure of the Brownian motion.